-- Logs begin at Tue 2022-10-04 17:04:52 UTC, end at Tue 2022-10-04 20:15:22 UTC. -- Oct 04 17:53:09.229743 n-d-833090-21 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:53:09.239037 n-d-833090-21 devstack@n-api.service[107145]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:53:09 2022] *** Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: nodename: n-d-833090-21 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: machine: x86_64 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: clock source: unix Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: pcre jit disabled Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: detected number of CPU cores: 4 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: current working directory: / Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: your processes number limit is 47680 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: your memory page size is 4096 bytes Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: detected max file descriptor number: 2048 Oct 04 17:53:09.240965 n-d-833090-21 devstack@n-api.service[107145]: lock engine: pthread robust mutexes Oct 04 17:53:09.241965 n-d-833090-21 devstack@n-api.service[107145]: thunder lock: enabled Oct 04 17:53:09.241965 n-d-833090-21 devstack@n-api.service[107145]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:53:09.241965 n-d-833090-21 devstack@n-api.service[107145]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:53:09.281888 n-d-833090-21 devstack@n-api.service[107145]: Python main interpreter initialized at 0x55e2557659c0 Oct 04 17:53:09.281888 n-d-833090-21 devstack@n-api.service[107145]: python threads support enabled Oct 04 17:53:09.281888 n-d-833090-21 devstack@n-api.service[107145]: your server socket listen backlog is limited to 100 connections Oct 04 17:53:09.281888 n-d-833090-21 devstack@n-api.service[107145]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:53:09.282261 n-d-833090-21 devstack@n-api.service[107145]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:53:09.282261 n-d-833090-21 devstack@n-api.service[107145]: *** Operational MODE: preforking *** Oct 04 17:53:09.282504 n-d-833090-21 devstack@n-api.service[107145]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:53:09.282504 n-d-833090-21 devstack@n-api.service[107145]: spawned uWSGI master process (pid: 107145) Oct 04 17:53:09.282713 n-d-833090-21 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:53:09.285567 n-d-833090-21 devstack@n-api.service[107145]: spawned uWSGI worker 1 (pid: 107146, cores: 1) Oct 04 17:53:09.285567 n-d-833090-21 devstack@n-api.service[107145]: spawned uWSGI worker 2 (pid: 107147, cores: 1) Oct 04 17:53:09.285567 n-d-833090-21 devstack@n-api.service[107145]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:53:09.967886 n-d-833090-21 devstack@n-api.service[107146]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:53:09.974001 n-d-833090-21 devstack@n-api.service[107147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:53:11.067192 n-d-833090-21 devstack@n-api.service[107146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:53:11.067192 n-d-833090-21 devstack@n-api.service[107146]: from cryptography.utils import int_from_bytes Oct 04 17:53:11.067808 n-d-833090-21 devstack@n-api.service[107146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:53:11.067808 n-d-833090-21 devstack@n-api.service[107146]: from cryptography.utils import int_from_bytes Oct 04 17:53:11.077019 n-d-833090-21 devstack@n-api.service[107147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:53:11.077019 n-d-833090-21 devstack@n-api.service[107147]: from cryptography.utils import int_from_bytes Oct 04 17:53:11.077611 n-d-833090-21 devstack@n-api.service[107147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:53:11.077611 n-d-833090-21 devstack@n-api.service[107147]: from cryptography.utils import int_from_bytes Oct 04 17:53:13.594333 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:53:13.594994 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:53:13.595094 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:53:13.595478 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:53:13.595580 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:53:13.595938 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:53:13.596029 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:53:13.596115 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.596351 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:53:13.596447 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.596710 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:53:13.596900 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.596993 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:53:13.597360 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.597655 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.597804 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.597892 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.598121 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.598446 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.598767 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599025 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599113 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599343 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599440 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599682 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599794 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.599998 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600086 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-21 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600314 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600450 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600621 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600707 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.600930 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601014 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601193 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601290 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601509 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601599 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601833 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-21 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.601916 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.602161 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.602252 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.602467 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.602653 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.602772 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.603855 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.603999 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604116 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604208 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604208 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604399 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604399 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604607 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604607 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604798 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604897 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.604976 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605052 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605181 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605262 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605384 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605539 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605686 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605859 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.605988 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606252 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-21 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606376 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606568 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606660 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606872 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.606962 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.607181 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.607274 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.607501 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.607643 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.607909 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-21 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608009 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608206 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608303 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608512 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608686 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608822 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.608918 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609124 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609218 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609449 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609543 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609774 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.609919 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610171 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610402 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610529 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610701 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.610797 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611004 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611091 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611309 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611404 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611649 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611738 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.611964 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612061 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612263 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612358 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612537 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612622 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612844 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.612928 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613152 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613245 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613452 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613539 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613752 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613852 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.613996 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614244 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614328 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614562 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614659 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614876 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.614965 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615181 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615268 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615433 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615555 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615708 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.615804 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616019 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616106 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616330 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616419 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616632 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616730 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.616933 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617019 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617233 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617320 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617535 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617623 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617862 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.617948 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618163 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618251 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618461 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618547 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618764 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.618851 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619078 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619164 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619388 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619484 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619716 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.619790 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620016 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620098 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620332 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620438 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620659 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620757 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.620956 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621043 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621269 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621402 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621570 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621664 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621874 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.621960 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622178 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622270 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622485 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622578 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622799 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.622885 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623100 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623194 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623347 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623440 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623671 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623774 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.623977 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624077 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624290 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624386 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624592 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624678 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624836 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.624922 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625132 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625219 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625435 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625520 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625746 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.625832 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626044 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626128 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626344 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626485 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626643 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626733 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.626939 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627049 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627234 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627318 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627551 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627655 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627854 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.627980 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628156 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628299 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628456 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628611 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628732 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.628828 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629027 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629114 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629324 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629423 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629620 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629706 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.629918 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630038 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630223 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630435 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630522 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630628 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630810 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.630907 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631105 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631201 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631407 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631589 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631727 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.631825 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632026 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632125 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632324 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632424 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632628 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632774 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.632923 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.633025 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.633732 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.633831 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634052 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634174 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634353 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634467 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634657 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634788 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.634954 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635043 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635250 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635343 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635573 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635662 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635873 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.635960 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636177 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636277 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636472 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636564 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636769 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.636856 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637064 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637151 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637355 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637441 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637648 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637733 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.637944 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638056 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638240 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638327 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638535 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638624 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638828 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.638926 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.639138 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.639225 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.639452 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.639616 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.639773 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.639865 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.640072 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.640158 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.640371 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.640515 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.640708 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:53:13.640800 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641060 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641147 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641375 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641470 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641684 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641778 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.641997 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642083 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642320 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642408 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642630 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642732 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.642937 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643024 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643246 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643334 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643586 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643732 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.643904 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.644025 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.644232 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.644347 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.644531 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.644842 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.645153 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.645468 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.645680 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.645794 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646003 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646090 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646325 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646412 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646640 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646781 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.646956 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647103 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647283 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647416 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647626 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647770 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.647944 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648077 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648251 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648397 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648586 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648703 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.648962 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.649567 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.649791 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.649939 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650099 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650231 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650414 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650541 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650718 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.650825 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651117 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651325 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651421 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651684 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651787 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.651996 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652079 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652306 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652404 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652613 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652708 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.652919 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653011 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653233 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653325 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653540 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653634 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653847 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.653947 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.654419 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.654538 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.654724 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.654818 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655029 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655121 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655361 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655453 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655694 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.655788 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656015 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656108 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656326 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656420 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656632 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656725 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.656938 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657031 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657242 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657342 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657550 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657643 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657849 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.657955 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658146 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658245 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658444 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658536 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658740 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.658832 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659038 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659137 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659335 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659433 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659675 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659780 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.659978 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660079 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660286 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660385 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660599 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660694 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.660910 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661012 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661226 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661431 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661586 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661739 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.661915 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662080 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662233 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662379 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662525 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662668 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662827 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.662980 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663124 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663213 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663294 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663373 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663604 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663697 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663910 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.663999 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664213 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664308 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664540 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664626 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664850 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.664958 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665158 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665262 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665462 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665552 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665767 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.665860 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666072 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666164 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666377 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666463 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666698 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666799 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.666989 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667151 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667297 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667384 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667652 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667739 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.667954 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668040 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668271 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668376 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668590 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668805 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668918 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.668999 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669191 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669276 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669501 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669594 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669840 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.669938 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670106 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670201 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670407 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670533 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670709 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.670795 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671011 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671116 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671302 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671521 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671610 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.671690 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676295 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676388 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676507 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676590 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676658 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676730 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676796 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676861 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676925 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.676997 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677075 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677142 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677215 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677312 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677393 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677468 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677541 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677608 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677702 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677780 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677860 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.677934 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678007 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678073 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678139 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678209 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678287 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678354 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678419 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678483 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678579 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678647 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678720 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678787 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678851 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.678915 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679032 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679117 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679204 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679283 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679359 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679438 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679532 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679609 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679698 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679777 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679853 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.679937 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680013 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680102 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680181 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680264 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680343 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680419 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680495 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680579 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680668 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680752 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680891 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.680979 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681058 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681143 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681304 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681391 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681621 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681713 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.681929 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682238 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682324 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682543 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682627 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682848 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.682934 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683153 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683238 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683457 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683579 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683786 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.683872 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684090 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684175 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684439 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684529 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684704 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.684788 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685017 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685140 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685326 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685416 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685625 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685755 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.685919 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686003 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686227 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686320 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686548 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686633 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686862 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.686946 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687166 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687259 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687493 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687581 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687811 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.687895 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688117 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688217 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688430 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688525 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688723 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.688815 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689021 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689234 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689320 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689398 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689610 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689696 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.689918 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690082 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690220 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690313 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690519 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690603 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690817 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.690901 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691123 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691214 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691422 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691525 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691749 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.691836 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692044 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692128 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692367 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692500 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692658 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692750 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.692959 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693043 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693276 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693373 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693578 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693663 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693876 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.693966 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694174 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694267 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694486 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694577 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694788 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.694889 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.695090 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.695250 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.695387 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.695524 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.695708 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.696319 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.696557 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.696657 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.696862 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.696947 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697162 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697247 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697471 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697565 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697784 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.697867 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698084 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698168 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698390 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698475 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698694 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698778 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.698996 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699312 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699399 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699643 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699728 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.699948 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700034 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700253 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700338 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700554 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700644 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700857 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.700942 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701160 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701245 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701463 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701582 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701766 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.701859 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702068 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702161 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702367 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702451 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702661 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702758 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.702965 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.703051 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.703275 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.703566 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.703872 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.703975 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704197 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704282 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704512 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704602 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704830 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.704923 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705153 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705246 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705482 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705576 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705808 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.705901 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706117 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706211 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706421 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706506 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706722 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.706806 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707021 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707117 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707319 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707409 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707645 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707731 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.707953 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708055 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708252 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708343 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708549 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708632 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708850 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.708936 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709149 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709242 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709446 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709545 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709741 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.709826 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710037 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710124 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710336 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710428 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710633 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710718 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.710929 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711061 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711229 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711322 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711604 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711751 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.711921 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712034 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712216 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712314 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712516 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712609 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712814 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.712906 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713113 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713205 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713439 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713523 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713735 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.713826 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714067 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714207 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714392 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714478 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714699 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.714782 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715004 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715089 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715309 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715393 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715644 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715743 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.715949 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716044 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716238 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716323 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716534 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716619 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716834 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.716919 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717134 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717224 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717432 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717554 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717742 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.717837 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718040 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718136 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718340 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718424 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718637 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718722 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.718931 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.719015 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.719228 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.719392 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.719538 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.719619 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.722958 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723074 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723165 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723259 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723359 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723443 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723565 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723649 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723729 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723818 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723899 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.723978 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724057 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724136 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724215 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724305 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724387 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724473 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724552 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724638 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724726 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724806 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724884 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724962 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.724962 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725115 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725207 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725287 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725366 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725444 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725523 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725601 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725693 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725775 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725860 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.725940 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726018 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726102 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726194 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726274 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726353 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726431 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726517 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726627 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726696 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726775 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726853 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.726931 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.727010 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.727625 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.727696 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.727769 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.727948 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728031 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728273 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728366 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728586 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728672 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728902 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.728988 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729197 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729301 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729496 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729593 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729797 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.729898 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730094 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730192 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730412 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730513 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730699 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730786 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.730996 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731317 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731432 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731640 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731727 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.731941 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732039 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732238 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732325 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732534 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732619 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732871 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.732959 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733169 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733256 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733518 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733612 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733815 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.733900 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734124 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734217 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734438 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734543 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734748 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.734836 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735062 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735155 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735364 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735459 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735685 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735770 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.735993 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736091 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736297 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736396 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736597 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736682 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736894 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.736988 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737191 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737286 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737506 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737593 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737810 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.737896 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738116 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738203 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738431 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738518 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738749 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.738835 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739049 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739135 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739354 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739440 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739679 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739769 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.739985 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740074 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740296 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740382 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740605 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740693 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.740917 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741012 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741220 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741315 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741528 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741628 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741833 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.741920 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.742139 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.742229 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.742443 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.742537 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.743287 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.743388 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.743621 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.743711 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.743927 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744228 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744315 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744541 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744627 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744844 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.744931 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745143 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745238 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745445 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745534 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745742 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.745829 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746120 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746272 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746388 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746482 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746773 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.746912 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747177 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747388 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747496 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747712 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.747800 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748019 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748107 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748325 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748491 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748636 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748730 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.748941 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749037 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749237 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749355 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749657 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749801 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.749958 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750046 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750265 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750360 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750570 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750657 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750870 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.750955 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751169 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751281 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751508 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751601 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751804 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.751983 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758149 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758408 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758496 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758575 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758667 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758749 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758838 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758918 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.758998 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759077 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759165 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759245 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759337 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759419 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759524 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759605 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759674 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759760 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759842 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759911 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.759989 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760066 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760164 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760251 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760332 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760409 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760496 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760577 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760663 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760743 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760822 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760909 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.760989 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761066 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761144 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761229 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761310 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761397 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761466 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761544 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761619 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761692 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761759 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761897 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.761987 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762074 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762155 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762230 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762297 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762375 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762456 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762534 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762619 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762699 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762786 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762867 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.762946 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763030 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763117 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763197 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763283 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763363 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763447 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763566 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763649 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763728 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763819 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763899 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.763978 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764057 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764135 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764213 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764302 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764383 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764462 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764540 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764618 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764709 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764790 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764868 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.764946 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765103 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765193 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765273 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765352 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765429 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765515 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765595 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765685 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.765766 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766014 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766103 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766329 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766425 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766653 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766751 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.766966 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767053 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767268 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767379 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767604 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767694 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767909 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.767996 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768209 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768304 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768531 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768654 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768808 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.768933 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769145 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769249 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769442 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769538 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769758 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.769878 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770081 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770188 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770402 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770490 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770708 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.770797 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771037 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771126 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771356 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771457 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771697 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.771793 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772001 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772090 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772316 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772432 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772633 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772729 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.772931 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773019 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773230 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773318 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773531 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773618 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.773831 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.774455 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.774659 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.774751 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.774961 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775058 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775268 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775355 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775594 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775685 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775896 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.775996 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776191 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776286 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776509 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776604 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776808 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.776904 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777125 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777260 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777425 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777519 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777724 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.777820 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778179 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778324 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778446 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778661 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778754 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.778983 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.779329 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.779556 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.779661 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.779865 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.779965 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780181 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780286 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780488 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780576 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780798 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.780894 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781108 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781194 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781415 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781502 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781724 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.781821 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782034 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782129 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782343 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782455 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782648 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782744 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.782953 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.783040 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.783259 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.783355 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.783590 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.783682 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784131 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784218 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784458 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784569 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784763 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.784850 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785074 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785183 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785376 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785472 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785738 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785842 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.785994 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786090 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786297 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786386 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786602 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786689 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786907 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.786993 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787209 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787320 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787554 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787652 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787872 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.787973 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788193 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788331 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788519 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788616 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788836 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.788938 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.789143 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.789243 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.789451 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.789539 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.790312 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.790424 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.790657 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.790747 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.790967 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791057 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791271 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791365 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791602 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791731 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.791915 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792003 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792222 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792320 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792529 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792632 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792835 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.792945 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793140 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793233 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793446 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793544 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793748 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.793845 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794049 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794137 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794354 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794448 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794663 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794757 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.794978 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795065 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795308 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795395 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795648 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795740 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.795959 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.796075 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.796266 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.796365 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.796577 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.796672 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797088 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797175 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797396 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797492 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797724 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.797814 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798045 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798131 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798363 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798449 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798678 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798765 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.798989 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799075 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799311 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799407 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799636 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799726 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.799937 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800031 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800242 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800364 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800548 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800655 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800843 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.800931 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801159 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801256 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801463 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801552 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801762 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.801876 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.802076 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.802173 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.802379 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.802467 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.802902 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803056 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803241 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803341 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803583 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803710 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803902 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.803998 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804221 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804312 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804535 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804622 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804833 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.804918 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805169 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805258 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805474 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805560 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805774 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.805861 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806085 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806174 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806388 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806476 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806686 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806782 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.806986 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807079 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807288 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807374 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807617 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807737 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.807914 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808001 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808216 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808310 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808514 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808610 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808836 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.808923 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809135 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809220 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809435 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809536 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809733 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.809821 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810039 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810136 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810338 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810439 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810640 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810784 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.810936 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811024 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811235 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811332 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811559 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811650 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811857 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.811953 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812159 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812248 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812455 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812550 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812764 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.812877 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813111 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813263 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813404 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813540 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813684 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.813828 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814005 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814151 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814290 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814437 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814608 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814759 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.814896 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815032 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815170 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815313 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815508 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815632 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815819 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.815915 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816127 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816224 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816469 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816578 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816777 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.816870 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.817314 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.817413 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.817657 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.817807 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.817977 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818121 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818305 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818467 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818634 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818768 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.818945 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819085 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819224 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819362 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819567 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819702 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819835 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.819981 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820138 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820275 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820442 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820577 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820807 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.820945 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821102 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821242 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821379 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821524 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821660 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821802 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.821949 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822093 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822231 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822367 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822504 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822648 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822792 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.822958 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823098 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823187 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823401 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823534 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823730 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.823819 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824034 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824159 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824345 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824456 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824681 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824777 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.824995 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825082 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825307 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825403 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825618 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825706 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.825932 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826029 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826245 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826356 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826547 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826635 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826850 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.826936 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827155 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827249 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827493 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827596 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827808 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.827897 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.828116 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.828215 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.828417 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.828513 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829100 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829195 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829412 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829500 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829730 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.829825 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830049 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830145 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830358 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830446 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830679 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.830783 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831000 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831101 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831306 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831399 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831647 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831762 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.831957 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832130 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832281 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832371 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832617 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832704 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.832939 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833083 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833259 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833348 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833563 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833657 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833862 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.833956 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834163 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834250 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834471 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834557 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834784 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.834871 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835089 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835177 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835387 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835515 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835711 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.835802 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.836015 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.836110 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.836314 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.836928 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837151 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837241 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837454 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837579 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837752 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.837845 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838057 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838157 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838357 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838452 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838652 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838750 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.838974 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839075 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839252 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839339 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839571 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839681 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839874 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.839964 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840178 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840266 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840475 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840570 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840775 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.840862 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841077 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841198 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841377 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841479 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841672 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841766 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.841998 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842131 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842326 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842423 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842638 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842768 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.842954 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843055 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843262 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843371 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843602 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843707 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843912 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.843999 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844224 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844318 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844592 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844686 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844851 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.844937 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845156 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845248 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845483 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845570 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845791 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.845902 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846099 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846185 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846401 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846487 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846706 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.846870 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847010 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847105 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847315 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847401 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847659 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847762 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.847987 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848151 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848292 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848431 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848582 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848746 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.848892 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849031 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849190 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849336 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849484 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849621 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849792 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.849953 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850127 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850292 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850437 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850571 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850729 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.850864 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851035 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851199 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851342 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851487 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851669 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851806 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.851997 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.852751 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.852848 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853068 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853173 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853380 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853469 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853698 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.853813 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854014 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854102 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854335 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854422 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854640 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854729 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.854952 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855039 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855271 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855370 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855619 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855723 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.855930 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856040 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856270 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856368 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856594 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856682 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856903 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.856997 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.857211 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.857308 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.857510 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.857597 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.857751 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:53:13.857838 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:53:13.858048 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:53:14.009615 n-d-833090-21 devstack@n-api.service[107147]: INFO dbcounter [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Registered counter for database nova_api Oct 04 17:53:14.009860 n-d-833090-21 devstack@n-api.service[107146]: INFO dbcounter [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Registered counter for database nova_api Oct 04 17:53:14.032200 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_db.sqlalchemy.engines [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.035099 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_db.sqlalchemy.engines [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.039179 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writer thread running {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.042203 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writer thread running {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.095596 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.context [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=107147) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:53:14.097699 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.context [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=107146) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:53:14.099397 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.099888 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.101427 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.101523 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.102042 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.102752 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.103192 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.104116 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.104830 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.105154 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.105280 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.107161 n-d-833090-21 devstack@n-api.service[107147]: INFO dbcounter [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Registered counter for database nova_cell0 Oct 04 17:53:14.107264 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_concurrency.lockutils [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.109193 n-d-833090-21 devstack@n-api.service[107146]: INFO dbcounter [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Registered counter for database nova_cell0 Oct 04 17:53:14.111289 n-d-833090-21 devstack@n-api.service[107147]: INFO dbcounter [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Registered counter for database nova_cell1 Oct 04 17:53:14.113175 n-d-833090-21 devstack@n-api.service[107146]: INFO dbcounter [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Registered counter for database nova_cell1 Oct 04 17:53:14.118781 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_db.sqlalchemy.engines [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.122088 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_db.sqlalchemy.engines [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.123049 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_db.sqlalchemy.engines [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.124063 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_db.sqlalchemy.engines [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.129688 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writer thread running {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.129809 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writer thread running {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.130028 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writer thread running {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.132430 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writer thread running {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.278836 n-d-833090-21 devstack@n-api.service[107147]: INFO dbcounter [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Registered counter for database nova_cell0 Oct 04 17:53:14.282726 n-d-833090-21 devstack@n-api.service[107146]: INFO dbcounter [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Registered counter for database nova_cell0 Oct 04 17:53:14.288208 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_db.sqlalchemy.engines [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.289854 n-d-833090-21 devstack@n-api.service[107146]: DEBUG oslo_db.sqlalchemy.engines [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:53:14.292972 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writer thread running {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.294572 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writer thread running {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:53:14.757582 n-d-833090-21 devstack@n-api.service[107147]: WARNING keystonemiddleware.auth_token [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:53:14.765204 n-d-833090-21 devstack@n-api.service[107147]: WARNING keystonemiddleware.auth_token [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:53:14.788042 n-d-833090-21 devstack@n-api.service[107146]: WARNING keystonemiddleware.auth_token [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:53:14.795981 n-d-833090-21 devstack@n-api.service[107146]: WARNING keystonemiddleware.auth_token [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:53:15.111641 n-d-833090-21 devstack@n-api.service[107147]: WARNING keystonemiddleware.auth_token [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:53:15.117719 n-d-833090-21 devstack@n-api.service[107147]: WARNING keystonemiddleware.auth_token [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:53:15.123035 n-d-833090-21 devstack@n-api.service[107147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2557659c0 pid: 107147 (default app) Oct 04 17:53:15.125147 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.126346 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Oct 04 17:53:15.126765 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:15.136194 n-d-833090-21 devstack@n-api.service[107146]: WARNING keystonemiddleware.auth_token [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:53:15.142200 n-d-833090-21 devstack@n-api.service[107146]: WARNING keystonemiddleware.auth_token [None req-179aeb12-aff6-4984-8138-0cd4c34e20d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:53:15.147418 n-d-833090-21 devstack@n-api.service[107146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2557659c0 pid: 107146 (default app) Oct 04 17:54:40.787964 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:40.788996 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 04 17:54:40.794381 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:40.805506 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_api:SELECT=3 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:40.807138 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_cell1:SELECT=3 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:40.808053 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_cell0:SELECT=3 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:40.809114 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:41.729424 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-1a165c12-799b-486d-9a49-948fdb912f8a admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.765111 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-1a165c12-799b-486d-9a49-948fdb912f8a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.968356 Oct 04 17:54:41.767511 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 17:54:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:44.532854 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:44.535545 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-47780fe3-6f8f-4b01-b1e9-ce995fd4bf39 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001782 Oct 04 17:54:44.535545 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:45.022400 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-28757011-147d-4f44-8fcd-592053c38709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:45.131274 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-28757011-147d-4f44-8fcd-592053c38709 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.586875 Oct 04 17:54:45.132502 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:54:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:45.149338 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_api:SELECT=3 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:45.150160 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_cell0:SELECT=3 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:45.151631 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_cell1:SELECT=3 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:45.152435 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:45.361606 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-6a9d0c49-ab6a-4361-8c3b-68b0d590d6a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:45.501887 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-6a9d0c49-ab6a-4361-8c3b-68b0d590d6a3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.358623 Oct 04 17:54:45.502613 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 4 17:54:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:48.320456 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-28757011-147d-4f44-8fcd-592053c38709 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.322295 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-28757011-147d-4f44-8fcd-592053c38709 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002789 Oct 04 17:54:48.323214 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:49.129535 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-370700f8-8d70-4f06-a344-93cc9bdcc27e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:49.349553 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-370700f8-8d70-4f06-a344-93cc9bdcc27e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.019051 Oct 04 17:54:49.351359 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:54:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:54:49.379721 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-421c8dd9-0241-420e-b8c6-81bf3d4dccce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:49.541970 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-421c8dd9-0241-420e-b8c6-81bf3d4dccce admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.172140 Oct 04 17:54:49.542568 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 4 17:54:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:52.668940 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-370700f8-8d70-4f06-a344-93cc9bdcc27e admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.670129 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-370700f8-8d70-4f06-a344-93cc9bdcc27e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Oct 04 17:54:52.670685 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:53.118814 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-58be0ba6-ebd7-416b-b806-2688586dcc19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:53.206645 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-58be0ba6-ebd7-416b-b806-2688586dcc19 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529768 Oct 04 17:54:53.207438 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:54:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:53.220490 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-b3cc9b5e-6ca6-472c-a90a-032f23f9a136 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:53.309381 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-b3cc9b5e-6ca6-472c-a90a-032f23f9a136 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092644 Oct 04 17:54:53.310434 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 4 17:54:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:56.017410 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-58be0ba6-ebd7-416b-b806-2688586dcc19 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:56.018481 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-58be0ba6-ebd7-416b-b806-2688586dcc19 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 04 17:54:56.018907 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:56.520044 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-47206639-a64f-450f-8afe-83cf85b01fd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "vcpus": 2, "disk": 10, "ram": 2048, "swap": 0}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:56.608625 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-47206639-a64f-450f-8afe-83cf85b01fd0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.582692 Oct 04 17:54:56.609386 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:54:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:54:56.622237 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-158fd0a3-b7e8-4344-ac57-dd7001e9d231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:56.720788 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-158fd0a3-b7e8-4344-ac57-dd7001e9d231 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102402 Oct 04 17:54:56.721823 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 4 17:54:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:59.465431 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-47206639-a64f-450f-8afe-83cf85b01fd0 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.467026 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-47206639-a64f-450f-8afe-83cf85b01fd0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Oct 04 17:54:59.483547 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:59.955891 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:00.071411 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597185 Oct 04 17:55:00.072288 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:54:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:00.085337 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-d8b62341-3758-4bc9-8f7f-57d773293583 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:00.184871 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-d8b62341-3758-4bc9-8f7f-57d773293583 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103485 Oct 04 17:55:00.185416 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 4 17:55:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:02.939229 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.940345 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Oct 04 17:55:02.940772 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:03.427999 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-1afff0c7-88ad-4665-bd3b-7210e60db91c admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.453085 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-1afff0c7-88ad-4665-bd3b-7210e60db91c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.505473 Oct 04 17:55:03.453668 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:06.356754 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.357827 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-c7b688a1-72d8-4940-ade2-ec6736edbcbe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 04 17:55:06.358501 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:55:06.845004 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-6d25f1ca-08ac-4f4e-aa4d-75776183d017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "vcpus": 1, "id": "1", "name": "m1.tiny"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:06.964054 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-6d25f1ca-08ac-4f4e-aa4d-75776183d017 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.598054 Oct 04 17:55:06.964463 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:55:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:55:06.976988 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-3f09f253-087b-446a-a9b9-13496de845d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:07.117650 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-3f09f253-087b-446a-a9b9-13496de845d5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144433 Oct 04 17:55:07.118501 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 4 17:55:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:09.958629 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-6d25f1ca-08ac-4f4e-aa4d-75776183d017 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:09.959734 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-6d25f1ca-08ac-4f4e-aa4d-75776183d017 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 04 17:55:09.960130 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:10.382715 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-bfcd6bb0-8a37-4895-b758-759733fa98ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:10.480089 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-bfcd6bb0-8a37-4895-b758-759733fa98ae admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513766 Oct 04 17:55:10.480578 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:55:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:10.492878 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-42674e7b-37fb-4fe4-a022-63fc112e8ea4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:10.579880 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-42674e7b-37fb-4fe4-a022-63fc112e8ea4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090920 Oct 04 17:55:10.580611 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 4 17:55:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:13.223649 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-bfcd6bb0-8a37-4895-b758-759733fa98ae admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.224595 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-bfcd6bb0-8a37-4895-b758-759733fa98ae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 04 17:55:13.224992 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:13.638285 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-6a6cc60e-224c-44bf-a221-7c8619d39738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "disk": 40, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:14.283063 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-6a6cc60e-224c-44bf-a221-7c8619d39738 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.051335 Oct 04 17:55:14.283772 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:55:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:14.296415 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-7623361e-ef30-4263-b53f-e4b831406871 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:14.301915 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:14.417451 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-7623361e-ef30-4263-b53f-e4b831406871 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124756 Oct 04 17:55:14.418210 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 4 17:55:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:17.036415 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-6a6cc60e-224c-44bf-a221-7c8619d39738 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:17.037434 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-6a6cc60e-224c-44bf-a221-7c8619d39738 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 04 17:55:17.038489 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:17.492271 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-b433d16b-a418-418c-9e25-bac5c576b98a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "vcpus": 4}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:17.562406 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-b433d16b-a418-418c-9e25-bac5c576b98a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.517675 Oct 04 17:55:17.563185 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:55:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:17.576060 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-aa452f5a-1d1d-415c-b498-761d573cc546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:17.634256 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-aa452f5a-1d1d-415c-b498-761d573cc546 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061749 Oct 04 17:55:17.634890 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 4 17:55:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:20.297997 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-b433d16b-a418-418c-9e25-bac5c576b98a admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.299041 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-b433d16b-a418-418c-9e25-bac5c576b98a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 04 17:55:20.300008 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:20.744108 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "ram": 16384}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:20.754306 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:20.842201 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.535629 Oct 04 17:55:20.843430 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 4 17:55:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:20.855221 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-a304c21f-2b7e-4816-814c-3b3512ebcab5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:20.988924 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-a304c21f-2b7e-4816-814c-3b3512ebcab5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137397 Oct 04 17:55:20.989522 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 4 17:55:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:41.054800 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.066006 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002380 Oct 04 17:55:41.066006 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:41.067825 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:41.492471 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-a4f25a78-5086-4cea-8bf4-d5e38a7344ad admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.513183 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-a4f25a78-5086-4cea-8bf4-d5e38a7344ad admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.450087 Oct 04 17:55:41.513747 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:42.839731 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.840726 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-fa7b00db-6f23-4a13-a97f-40e68bdbfea5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 04 17:55:42.841112 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:43.393831 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-14566913-fe56-46e5-ac6c-dc15a8fe5991 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.399834 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.wsgi [None req-14566913-fe56-46e5-ac6c-dc15a8fe5991 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-14566913-fe56-46e5-ac6c-dc15a8fe5991 admin admin] Request method failure captured: Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Accept: application/json Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Accept-Encoding: gzip, deflate Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Connection: keep-alive Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Content-Length: 0 Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Host: 10.222.0.40 Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: Openstack-System-Scope: None Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: User-Agent: python-novaclient Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Auth-Token: gAAAAABjPHOe2YWJcAgVNljY7KYOTjkMjrLuBPwr0cox1hrzBr6uBV1lFtC4YUx3TuPSYek3h7cCj0LaHQHkDtGxEVO_EEIxr8mNvkYZUR6-UYomaoO5fT-_INMHIvbnPLyMozTjDaLLhvsQ4DavpIyq4Z-yrAopT8YmpD6112JHADvP2EcMZFE Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Id: None Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Name: None Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Identity-Status: Confirmed Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Is-Admin-Project: True Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Id: default Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Name: Default Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Name: admin Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Role: reader,admin,member Oct 04 17:55:43.403076 n-d-833090-21 devstack@n-api.service[107146]: X-Roles: reader,admin,member Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant: admin Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Name: admin Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-User: admin Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Id: default Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Name: Default Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: X-User-Name: admin Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: method: > Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: exception: Flavor 42 could not be found. Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: action_args: {'id': '42'} Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:43.404993 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:43.405914 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.407091 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-14566913-fe56-46e5-ac6c-dc15a8fe5991 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:43.408252 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-14566913-fe56-46e5-ac6c-dc15a8fe5991 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.411307 Oct 04 17:55:43.408252 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:55:43.415865 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-c3102d02-2d93-4fd7-a4fe-f7fafd082916 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.438291 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-c3102d02-2d93-4fd7-a4fe-f7fafd082916 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026925 Oct 04 17:55:43.438857 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:43.462558 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-ac3b5544-fe20-4989-afa6-0c295bf9c445 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.484580 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-ac3b5544-fe20-4989-afa6-0c295bf9c445 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027160 Oct 04 17:55:43.485151 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:43.496347 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-4a4015ea-31b5-4e48-b7b3-1c8142bf2711 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.502253 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.wsgi [None req-4a4015ea-31b5-4e48-b7b3-1c8142bf2711 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-4a4015ea-31b5-4e48-b7b3-1c8142bf2711 admin admin] Request method failure captured: Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Accept: application/json Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Accept-Encoding: gzip, deflate Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Connection: keep-alive Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Content-Length: 0 Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Host: 10.222.0.40 Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: Openstack-System-Scope: None Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: User-Agent: python-novaclient Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Auth-Token: gAAAAABjPHOe2YWJcAgVNljY7KYOTjkMjrLuBPwr0cox1hrzBr6uBV1lFtC4YUx3TuPSYek3h7cCj0LaHQHkDtGxEVO_EEIxr8mNvkYZUR6-UYomaoO5fT-_INMHIvbnPLyMozTjDaLLhvsQ4DavpIyq4Z-yrAopT8YmpD6112JHADvP2EcMZFE Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Id: None Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Name: None Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Identity-Status: Confirmed Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Is-Admin-Project: True Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Id: default Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Name: Default Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Name: admin Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Role: reader,admin,member Oct 04 17:55:43.505589 n-d-833090-21 devstack@n-api.service[107147]: X-Roles: reader,admin,member Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant: admin Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Name: admin Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-User: admin Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Id: default Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Name: Default Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: X-User-Name: admin Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: method: > Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: exception: Flavor 42 could not be found. Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: action_args: {'id': '42'} Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:43.512137 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:43.512959 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:43.513981 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-4a4015ea-31b5-4e48-b7b3-1c8142bf2711 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:43.514963 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-4a4015ea-31b5-4e48-b7b3-1c8142bf2711 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015356 Oct 04 17:55:43.514963 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:55:44.759387 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-ac3b5544-fe20-4989-afa6-0c295bf9c445 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:44.760571 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-ac3b5544-fe20-4989-afa6-0c295bf9c445 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 04 17:55:44.760950 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:45.305206 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-473c776a-19d9-45e1-b2ed-280986091b65 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.310315 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.wsgi [None req-473c776a-19d9-45e1-b2ed-280986091b65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-473c776a-19d9-45e1-b2ed-280986091b65 admin admin] Request method failure captured: Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Accept: application/json Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Accept-Encoding: gzip, deflate Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Connection: keep-alive Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Content-Length: 0 Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Host: 10.222.0.40 Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: Openstack-System-Scope: None Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: User-Agent: python-novaclient Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Auth-Token: gAAAAABjPHOg95ucVQE6YNqJ0qYAdkdersCKOlhYDsaH9QXtz0GJyQXsR2OwXK32eCPvRlwb5G1xB7b2DCl7UDPQZImiRwkm1Dn9-jDVnJRT7HgrCAL4rDjV7XhYKdDqExjRXwPXLPLIGLlhWRUg0Dhn2P-cVb7ozamYJgSoNuZ8A0c5gyTyQog Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Id: None Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Name: None Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Identity-Status: Confirmed Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Is-Admin-Project: True Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Id: default Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Name: Default Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Name: admin Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Role: reader,admin,member Oct 04 17:55:45.311930 n-d-833090-21 devstack@n-api.service[107147]: X-Roles: reader,admin,member Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant: admin Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Name: admin Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-User: admin Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Id: default Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Name: Default Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: X-User-Name: admin Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: method: > Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: exception: Flavor 84 could not be found. Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: action_args: {'id': '84'} Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:45.313255 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:45.314043 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.315258 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-473c776a-19d9-45e1-b2ed-280986091b65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:45.316353 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-473c776a-19d9-45e1-b2ed-280986091b65 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409819 Oct 04 17:55:45.316353 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:55:45.323914 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-d1b93bc4-bade-4120-9ef8-d126675ed707 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.338780 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-d1b93bc4-bade-4120-9ef8-d126675ed707 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018443 Oct 04 17:55:45.339362 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:45.349038 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-810dba30-81de-4eb2-962f-ff76bc3bf8fe admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.364397 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-810dba30-81de-4eb2-962f-ff76bc3bf8fe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018924 Oct 04 17:55:45.365050 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:45.374973 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10f80a6a-55f8-4ea2-b7b8-0e0314230885 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.380123 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.wsgi [None req-10f80a6a-55f8-4ea2-b7b8-0e0314230885 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10f80a6a-55f8-4ea2-b7b8-0e0314230885 admin admin] Request method failure captured: Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Accept: application/json Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Accept-Encoding: gzip, deflate Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Connection: keep-alive Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Content-Length: 0 Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Host: 10.222.0.40 Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: Openstack-System-Scope: None Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: User-Agent: python-novaclient Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Auth-Token: gAAAAABjPHOg95ucVQE6YNqJ0qYAdkdersCKOlhYDsaH9QXtz0GJyQXsR2OwXK32eCPvRlwb5G1xB7b2DCl7UDPQZImiRwkm1Dn9-jDVnJRT7HgrCAL4rDjV7XhYKdDqExjRXwPXLPLIGLlhWRUg0Dhn2P-cVb7ozamYJgSoNuZ8A0c5gyTyQog Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Id: None Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Name: None Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Identity-Status: Confirmed Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Is-Admin-Project: True Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Id: default Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Name: Default Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Name: admin Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Role: reader,admin,member Oct 04 17:55:45.382342 n-d-833090-21 devstack@n-api.service[107146]: X-Roles: reader,admin,member Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant: admin Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Name: admin Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-User: admin Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Id: default Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Name: Default Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: X-User-Name: admin Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: method: > Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: exception: Flavor 84 could not be found. Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: action_args: {'id': '84'} Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:45.383811 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:45.384594 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:45.385681 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10f80a6a-55f8-4ea2-b7b8-0e0314230885 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:45.386724 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-10f80a6a-55f8-4ea2-b7b8-0e0314230885 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012396 Oct 04 17:55:45.386724 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:55:46.626318 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-810dba30-81de-4eb2-962f-ff76bc3bf8fe admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.627326 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-810dba30-81de-4eb2-962f-ff76bc3bf8fe admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 04 17:55:46.627761 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:47.201574 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10eae1f2-d360-416c-9176-f86636021277 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.210276 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.wsgi [None req-10eae1f2-d360-416c-9176-f86636021277 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10eae1f2-d360-416c-9176-f86636021277 admin admin] Request method failure captured: Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Accept: application/json Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Accept-Encoding: gzip, deflate Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Connection: keep-alive Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Content-Length: 0 Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Host: 10.222.0.40 Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: Openstack-System-Scope: None Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: User-Agent: python-novaclient Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Auth-Token: gAAAAABjPHOi3yGXTsC62QevPdzjhMCBlVVsqyufG1DcNSJYm-4XGk0oenYG6_bzNn7EJL_zxpPEtm0e89KA4cuf5_sx-dutPPWxtNhCdn6J0Ujz2Qeo398Bvp0X3_76C75n0tpU5Wb7v6zqgTGi_RSrTAiAaBzUWS3hKJfiHtz0p5W674Wz7_Y Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Id: None Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Domain-Name: None Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Identity-Status: Confirmed Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Is-Admin-Project: True Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Id: default Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Domain-Name: Default Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Project-Name: admin Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Role: reader,admin,member Oct 04 17:55:47.211986 n-d-833090-21 devstack@n-api.service[107146]: X-Roles: reader,admin,member Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant: admin Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-Tenant-Name: admin Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-User: admin Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Id: default Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-User-Domain-Name: Default Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: X-User-Name: admin Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: method: > Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: exception: Flavor 451 could not be found. Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: action_args: {'id': '451'} Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:47.213561 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:47.214384 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.215553 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-10eae1f2-d360-416c-9176-f86636021277 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:47.216604 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-10eae1f2-d360-416c-9176-f86636021277 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.447981 Oct 04 17:55:47.216604 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:55:47.225898 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-b3391bbb-5016-45e0-8d58-9f93b3e2b088 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.241762 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-b3391bbb-5016-45e0-8d58-9f93b3e2b088 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019445 Oct 04 17:55:47.242328 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:47.252284 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.267715 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018887 Oct 04 17:55:47.268299 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 4 17:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:47.278803 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-3a0c71dc-a58f-407d-9277-849b3d74d390 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.284071 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.wsgi [None req-3a0c71dc-a58f-407d-9277-849b3d74d390 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-3a0c71dc-a58f-407d-9277-849b3d74d390 admin admin] Request method failure captured: Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Accept: application/json Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Accept-Encoding: gzip, deflate Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Connection: keep-alive Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Content-Length: 0 Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Host: 10.222.0.40 Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Openstack-Api-Version: compute 2.92 Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: Openstack-System-Scope: None Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: User-Agent: python-novaclient Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Auth-Token: gAAAAABjPHOi3yGXTsC62QevPdzjhMCBlVVsqyufG1DcNSJYm-4XGk0oenYG6_bzNn7EJL_zxpPEtm0e89KA4cuf5_sx-dutPPWxtNhCdn6J0Ujz2Qeo398Bvp0X3_76C75n0tpU5Wb7v6zqgTGi_RSrTAiAaBzUWS3hKJfiHtz0p5W674Wz7_Y Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Id: None Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Domain-Name: None Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Identity-Status: Confirmed Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Is-Admin-Project: True Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Id: default Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Domain-Name: Default Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Project-Name: admin Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Role: reader,admin,member Oct 04 17:55:47.285628 n-d-833090-21 devstack@n-api.service[107147]: X-Roles: reader,admin,member Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7ea8aac6d2c04f8198092de6d0540b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7ea8aac6d2c04f8198092de6d0540b5f"}]}] Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant: admin Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Id: 7ea8aac6d2c04f8198092de6d0540b5f Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-Tenant-Name: admin Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-User: admin Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Id: default Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-User-Domain-Name: Default Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-User-Id: 8196ac146d894ca891183bac903aec72 Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: X-User-Name: admin Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: method: > Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: exception: Flavor 451 could not be found. Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: action_args: {'id': '451'} Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:47.287106 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:47.288480 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: ERROR nova.api.openstack.wsgi Oct 04 17:55:47.289847 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-3a0c71dc-a58f-407d-9277-849b3d74d390 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:47.291097 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-3a0c71dc-a58f-407d-9277-849b3d74d390 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012354 Oct 04 17:55:47.291097 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 17:55:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:55:48.547749 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:48.548770 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 17:55:48.549171 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:49.119117 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-b3276387-38e4-4005-9ae1-1c8c98fee19a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:49.196666 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-b3276387-38e4-4005-9ae1-1c8c98fee19a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.507353 Oct 04 17:55:49.197227 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 4 17:55:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:50.557342 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.558335 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 04 17:55:50.558727 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:51.100204 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-0e26aba2-6b65-4a9b-8c01-a2abfa2d6c07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:51.174725 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-0e26aba2-6b65-4a9b-8c01-a2abfa2d6c07 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.477164 Oct 04 17:55:51.175213 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 4 17:55:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:52.392395 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.393453 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 04 17:55:52.393841 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:52.931026 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-01d6e903-c5cf-44a4-838b-a6e73c8b5155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:53.019521 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-01d6e903-c5cf-44a4-838b-a6e73c8b5155 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.489072 Oct 04 17:55:53.020286 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 4 17:55:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:54.273146 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:54.274148 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Oct 04 17:55:54.274538 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:54.816254 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-f3691364-237d-4684-b6ae-eb7d326a65ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:54.929512 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-f3691364-237d-4684-b6ae-eb7d326a65ce admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.517381 Oct 04 17:55:54.930090 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 4 17:55:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:56.206042 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.207052 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 04 17:55:56.211909 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:56.733793 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-da56e233-0698-481e-bab5-810b6035e4ed admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.754523 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-da56e233-0698-481e-bab5-810b6035e4ed admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410585 Oct 04 17:55:56.754996 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:56:54.524412 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.525406 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-aa266a0f-6e6d-4977-a896-65133b8f23cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 04 17:56:54.525802 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:54.536797 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:54.919150 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-e4b50e63-899e-457c-9584-456c5aaf019f admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.939401 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-e4b50e63-899e-457c-9584-456c5aaf019f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407260 Oct 04 17:56:54.939975 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:54.962362 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_api:SELECT=14 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:54.966114 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-7982bf42-c101-49db-ae5f-92ef73869364 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.973387 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-7982bf42-c101-49db-ae5f-92ef73869364 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012446 Oct 04 17:56:54.975600 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:54.985558 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-244ba492-b3d0-4dd0-96f6-15937ce6f068 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.992846 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-244ba492-b3d0-4dd0-96f6-15937ce6f068 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010881 Oct 04 17:56:54.993363 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.004719 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.012807 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011653 Oct 04 17:56:55.013348 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Tue Oct 4 17:56:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.025870 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-d22d1c10-0ec6-44f9-82f7-93ccce8d1826 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.034535 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-d22d1c10-0ec6-44f9-82f7-93ccce8d1826 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013000 Oct 04 17:56:55.035082 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Tue Oct 4 17:56:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:26.488290 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:26.489305 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 04 18:02:26.489706 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 18:02:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:26.630890 n-d-833090-21 devstack@n-api.service[107147]: DEBUG dbcounter [-] [107147] Writing DB stats nova_api:SELECT=6 {{(pid=107147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:26.777256 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:26.782237 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.782721 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.783155 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.783901 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.784357 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.784781 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.824448 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-582ab7ca-42a9-419b-842b-20fc15e2088c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.195257 Oct 04 18:02:26.825218 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 18:02:26 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:27.905069 n-d-833090-21 devstack@n-api.service[107146]: DEBUG nova.api.openstack.wsgi [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] Calling method '>' {{(pid=107146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.906073 n-d-833090-21 devstack@n-api.service[107146]: INFO nova.api.openstack.requestlog [None req-0c5f5106-3616-4581-80a6-0a48c7f50349 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 04 18:02:27.906613 n-d-833090-21 devstack@n-api.service[107146]: [pid: 107146|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 4 18:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:28.100128 n-d-833090-21 devstack@n-api.service[107147]: DEBUG nova.api.openstack.wsgi [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Calling method '>' {{(pid=107147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:28.103844 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.104486 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.104924 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:28.105656 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:28.106106 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:28.106531 n-d-833090-21 devstack@n-api.service[107147]: DEBUG oslo_concurrency.lockutils [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:28.130110 n-d-833090-21 devstack@n-api.service[107147]: INFO nova.api.openstack.requestlog [None req-12ff5b2c-dc03-4c47-985c-37f6329099a5 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.084597 Oct 04 18:02:28.130891 n-d-833090-21 devstack@n-api.service[107147]: [pid: 107147|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 18:02:28 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:15.176373 n-d-833090-21 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 18:03:15.177214 n-d-833090-21 devstack@n-api.service[107145]: Tue Oct 4 18:03:15 2022 - graceful shutdown triggered... Oct 04 18:03:15.177730 n-d-833090-21 devstack@n-api.service[107147]: Gracefully killing worker 2 (pid: 107147)... Oct 04 18:03:15.178153 n-d-833090-21 devstack@n-api.service[107146]: Gracefully killing worker 1 (pid: 107146)... Oct 04 18:03:15.304451 n-d-833090-21 devstack@n-api.service[107146]: DEBUG dbcounter [-] [107146] Writing DB stats nova_api:SELECT=4 {{(pid=107146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:16.177030 n-d-833090-21 devstack@n-api.service[107145]: worker 1 buried after 1 seconds Oct 04 18:03:16.177030 n-d-833090-21 devstack@n-api.service[107145]: worker 2 buried after 1 seconds Oct 04 18:03:16.177030 n-d-833090-21 devstack@n-api.service[107145]: goodbye to uWSGI. Oct 04 18:03:16.178566 n-d-833090-21 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 18:03:16.179672 n-d-833090-21 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 18:03:16.182456 n-d-833090-21 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 18:03:16.193832 n-d-833090-21 devstack@n-api.service[123875]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 18:03:16.209771 n-d-833090-21 devstack@n-api.service[123875]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 18:03:16 2022] *** Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: nodename: n-d-833090-21 Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: machine: x86_64 Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: clock source: unix Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: pcre jit disabled Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: detected number of CPU cores: 4 Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: current working directory: / Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: detected binary path: /usr/bin/uwsgi-core Oct 04 18:03:16.210007 n-d-833090-21 devstack@n-api.service[123875]: your processes number limit is 47680 Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: your memory page size is 4096 bytes Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: detected max file descriptor number: 2048 Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: lock engine: pthread robust mutexes Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: thunder lock: enabled Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 18:03:16.210709 n-d-833090-21 devstack@n-api.service[123875]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 18:03:16.250453 n-d-833090-21 devstack@n-api.service[123875]: Python main interpreter initialized at 0x55d7738269c0 Oct 04 18:03:16.250724 n-d-833090-21 devstack@n-api.service[123875]: python threads support enabled Oct 04 18:03:16.250857 n-d-833090-21 devstack@n-api.service[123875]: your server socket listen backlog is limited to 100 connections Oct 04 18:03:16.250960 n-d-833090-21 devstack@n-api.service[123875]: your mercy for graceful operations on workers is 90 seconds Oct 04 18:03:16.251375 n-d-833090-21 devstack@n-api.service[123875]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 18:03:16.251601 n-d-833090-21 devstack@n-api.service[123875]: *** Operational MODE: preforking *** Oct 04 18:03:16.252037 n-d-833090-21 devstack@n-api.service[123875]: *** uWSGI is running in multiple interpreter mode *** Oct 04 18:03:16.252037 n-d-833090-21 devstack@n-api.service[123875]: spawned uWSGI master process (pid: 123875) Oct 04 18:03:16.254824 n-d-833090-21 devstack@n-api.service[123875]: spawned uWSGI worker 1 (pid: 123886, cores: 1) Oct 04 18:03:16.254824 n-d-833090-21 devstack@n-api.service[123875]: spawned uWSGI worker 2 (pid: 123887, cores: 1) Oct 04 18:03:16.254824 n-d-833090-21 devstack@n-api.service[123875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 18:03:16.252248 n-d-833090-21 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 18:03:16.911409 n-d-833090-21 devstack@n-api.service[123887]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:03:17.015918 n-d-833090-21 devstack@n-api.service[123886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 18:03:18.074954 n-d-833090-21 devstack@n-api.service[123887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:03:18.074954 n-d-833090-21 devstack@n-api.service[123887]: from cryptography.utils import int_from_bytes Oct 04 18:03:18.075687 n-d-833090-21 devstack@n-api.service[123887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:03:18.075687 n-d-833090-21 devstack@n-api.service[123887]: from cryptography.utils import int_from_bytes Oct 04 18:03:18.244243 n-d-833090-21 devstack@n-api.service[123886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:03:18.244243 n-d-833090-21 devstack@n-api.service[123886]: from cryptography.utils import int_from_bytes Oct 04 18:03:18.244884 n-d-833090-21 devstack@n-api.service[123886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 18:03:18.244884 n-d-833090-21 devstack@n-api.service[123886]: from cryptography.utils import int_from_bytes Oct 04 18:03:20.530235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:03:20.530917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:03:20.531010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:03:20.531372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:03:20.531907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:03:20.532595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.533030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.533510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.533985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.534533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.535008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.535517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.536018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.536473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.537188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.538020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.538633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-21 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.538987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.539290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.539791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.540367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.540936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.541454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.541944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.542621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.543363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.544269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.545093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.545704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.546519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.547440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.548016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.548307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.548928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.549131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.549700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-21 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.550182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.550864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.551460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.558983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.559987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.560185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.560676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.561167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.561634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.562142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.562421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.562933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.563228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.563750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.564228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.564538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.565015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.565331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.565797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.566273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.566599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.567005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.567251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.567798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.568127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.568523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.569045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.569374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.570239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.570712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.571167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.571653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.572128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.572636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.572946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.573364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.573671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.574132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.574615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.575282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.575282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.576225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.576586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.577111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.577644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.577975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.578452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.578963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.579298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.579658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.580179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.580517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.580844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.581274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.581614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.582142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.582671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.583168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.583507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.584016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.584516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.584836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.585363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.585833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.586374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.586688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.587174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.587515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.588050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.588555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.589507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.589846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.590371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.590845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.591214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.591717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.592251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.592715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.593184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.593696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.593977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.594451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.594956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.595441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.595790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.596273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.596607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.597101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.597682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.598231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.598741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.599283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.599730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.600238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.600562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.601084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.601430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.601745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.602220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.602739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.603319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.603863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.609925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.610720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.611226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.611639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.611980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.612295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.612794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.613377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.613869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.618811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.619397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.619927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.620438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.620980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.621497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.622009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.622507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.623010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.623553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.624044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.624582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.625100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.625621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.626122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.626674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.627186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.628337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.628882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.629665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.630259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.630803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.631444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.638824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.639537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.639537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.639843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.640413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.640951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.641743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.642299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.642656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.643545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.643901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.644251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.644587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.644907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.645391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.645897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.646222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.646544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.646866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.647182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.647530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.647901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.648225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.648554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.648880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.649263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.649580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.649891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.650211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.650570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.650889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.651258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.651620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.651950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.652283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.652606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.652933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.653257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.653579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.653900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.654219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.654793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.655127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.655481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.660568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.661101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.662274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.662779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.663302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.663806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.664300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.664636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.664968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.665448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.665914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.666128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.666666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.666987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.667666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.667999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.668334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.668672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.669259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.669409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.669623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.670083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.670431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.670739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.671071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.671366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.671779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.672077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.672394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.672708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.673030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.673373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.673692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.674022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.674355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.674684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.674970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.675303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.675647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.676129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.676446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.676762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.677116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.677475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.677791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.678123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.678454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.678773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.679678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.684793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.685277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 18:03:20.685703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.685800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 18:03:20.685891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.685977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 18:03:20.686054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.686158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 18:03:20.686158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 18:03:20.686321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.686399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.686467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.686698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.686816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.687075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.687187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.687356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.687447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.687714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.687813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.688034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.688131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.688347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.688443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.688668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.688774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.688984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.689162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.689334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.689476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.689650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.689788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.689995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-21 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.690310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.690459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.690624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.690726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.690941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.691098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.691276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.691366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.691633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.691729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.692008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.692296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.692401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.692666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.692854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.692980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.693155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.693253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.693525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.693636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.693791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.693882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.694152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.694310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.694577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.695200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.695417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.695619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.695754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.697753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.697847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.697932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.698032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.698109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.698189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.698275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.698403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-21 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.698505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.698597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.698711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.698814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.698913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.699019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.699115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.699200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.699283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.699397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.699533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.699632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.699749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.699835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.699927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.700048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.700145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.700230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.700321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.700483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.700607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.700766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.700935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.701091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.701254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.701460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.701597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.701772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.701872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.702070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.702208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.702386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.702484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.702699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.702837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.703018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.703164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.703387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.703619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.703853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.704012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.704150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.704281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.704426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.704548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.704648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.704879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.705023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.705182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.705336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.705487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.705634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.705790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.705936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.706068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.706165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.706314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.706461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.706604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.706744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.706847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.707084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.707281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.707563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.707723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.707877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.708019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.708178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.708322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.708469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.708603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.708737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.708885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.708982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.709105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.709214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.709303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.709510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.709668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.709834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.709990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.710159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.710298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.710459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.710724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.710987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.711107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.711318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.711436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.711781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.720846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.721000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.721124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.721235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.721354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.721481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.721593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.721701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.721817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.721934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.722055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.722185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.722318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.722504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.722669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.722831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.723043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.723144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.723320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.723415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.723553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.723630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.723760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.724101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.724202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.724333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.724459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.724551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.724688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.724786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.724871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.725041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.725254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.725393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.725491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.725575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.726195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.726293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.726423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.726533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.726722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.726846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.726938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.727029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.727114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.727324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.727577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.727710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.727840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.727984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.728114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.728201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.728293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.728446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.728539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.728632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.728772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.728874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.729111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.729304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.729471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.729647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.729834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.729924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.730916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.730997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.731097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.731189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.731272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.731362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.731452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.731568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.732627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.732807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.732965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.733144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.733289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.733382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.733475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.733606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.733711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.733803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.733925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.734052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.734278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.734411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.734502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.734587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.734667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.734773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.734860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.734860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.735073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.735162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.735257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.735332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.735581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.735685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.735761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.735851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.735942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.736163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.736379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.736469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 18:03:20.736629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.736965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.737980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.738948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.739949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.740941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.741025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.741106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.741201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.741285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.742918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.743006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.743089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.743170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.743294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.743400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.748878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.749947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.750914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.751941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.752969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.753078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.753169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.753241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:20.753319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.049676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.049780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.049853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.049948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.050498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.051925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.052949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.053996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.054975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.055936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.056952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.057934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.058906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.059937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.060877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.061918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.062901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.063976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.064964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.065982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.066999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.067928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.068924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.069976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.070882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.071968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.072921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.073897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.074947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.075968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.076868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.077906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.078965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.079989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.080850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.081916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.082758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.083567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.083728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.083866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.084802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.085891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.086974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.087972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.088031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.088148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.088318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.088618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.088707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.089012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.089253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.089469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.089617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.089818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.090023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.090249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.090378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.090525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.090785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.091006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.091456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.091684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.092145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.092272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.092482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.092679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.092882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.093174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.093300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.093619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.093747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.093999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.094200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.094360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.094768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.094985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.095158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.095370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.095544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.095783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.095981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.096159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.096298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.096559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.096696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.096893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.097076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.097352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.097493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.097717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.098218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.098430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.098430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.098694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.098830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.099947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.100127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.100347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.100533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.101235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.101468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.101700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.101845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.102960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.103154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.103330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.103515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.103658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.103819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.104079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.104234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.104475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.104620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.104908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.105058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.105352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.105495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.105729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.105872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.106934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.107275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.107451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.107662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.107810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.108833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.109913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.110845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.111859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.112092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.112486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.112684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.112842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.113973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.114982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.115258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.115409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.115621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.115772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.115941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.116077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.116255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.116450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.117994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.118259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.118414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.118590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.118729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.118905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.119067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.119211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.119440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.119736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.119876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.120886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.121027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.121387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.121539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.121726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.121913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.122196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.122339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.122604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.122760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.122894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.123875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.124113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.124261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.124501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.124652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.124890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.125040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.125293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.125441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.125662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.125819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.126858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.127070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.127233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.127410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.127624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.127797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.128995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.129273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.129484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.129661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.129802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.130981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:03:21.131151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.131602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.131967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.132330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.132715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.133050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.138261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.139308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.140204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.140204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.140204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.140486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.140799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.141133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.141443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.141768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.142074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.142388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.142701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.143012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.143306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.143632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.143954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.144258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.144578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.144894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.145219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.145541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.145847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.146169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.146588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.146902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.147207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.148139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.148409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.148719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.149044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.149380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.149706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.150018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.150355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.150685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.151006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.151320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.151672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.151998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.152333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.152639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.152957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.153253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.153588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.153860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.154168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.154473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.154776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.155079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.155400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.155730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.156053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.156363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.156670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.156980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.157285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.157669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.158315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.158630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.158942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.159263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.159606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.159925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.160241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.160556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.160872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.161589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.161589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.161882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.162096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.162408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.162813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.164345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.164660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.165085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.165359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.165717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.166017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.166236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.166551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.166866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.167181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.167570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.167837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.168213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.168482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.168860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.169148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.169576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.169813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.170285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.170663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.171120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.171432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.171772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.172095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.172407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.172724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.173037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.173353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.173667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.174063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.174291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.174637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.174957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.175282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.175640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.175970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.176288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.176616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.176911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.177455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.177768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.178101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.178423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.178746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.179098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.179403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.179752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.180057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.180396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.180714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.181025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.181330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.181652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.181963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.182266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.182587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.182896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.183432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.183800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.184217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.184433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.184758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.185072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.185383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.185704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.186300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.186616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.186925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.187236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.187563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.188197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.188373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.189285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.189659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.189889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.190226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.190556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.190867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.191172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.191486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.191835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.192144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.192448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.194894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.195238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.195572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.197790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.198205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.198205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.199090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.199090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.199255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.199759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.200097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.200419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.200767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.201117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.201426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.201734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.202039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.202366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.202677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.202988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.203298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.203637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.203946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.204265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.204579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.204891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.205204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.205608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.205817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.206128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.206438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.206746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.207063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.207402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.207747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.208065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.208382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.208695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.209015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.209390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.209700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.210008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.210824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.211158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.211557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.211799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.212613 n-d-833090-21 devstack@n-api.service[123887]: INFO dbcounter [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Registered counter for database nova_api Oct 04 18:03:21.212780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.212921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.213120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.213439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.213779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.214071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.214394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.214708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.215031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.215349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.215694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.216033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.216360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.216683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.216989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.217293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.217595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.217904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.218220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.218529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.218833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.219245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.219585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.219892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.220199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.220502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.220948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.221103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.221400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.221703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.222005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.222306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.222627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.222908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.223215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.223674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.224013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.224289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.224611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.224906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.225254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.225574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.226498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.226826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.227142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.227497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.227997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.228477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.228698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.229104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.229493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.229817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.230146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.230537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.230793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.231121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.231432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.231768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.232099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.232426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.237518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.238362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.239178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.239178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.239178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.239585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.241547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.241547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.241547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.242083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.242226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.242226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.242226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.243085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.243500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.243848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 18:03:21.244097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 18:03:21.250492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writer thread running {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.325061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.context [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123887) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:03:21.330582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.331418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.333442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.334383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.334891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.338143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.340901 n-d-833090-21 devstack@n-api.service[123887]: INFO dbcounter [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Registered counter for database nova_cell0 Oct 04 18:03:21.346890 n-d-833090-21 devstack@n-api.service[123887]: INFO dbcounter [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Registered counter for database nova_cell1 Oct 04 18:03:21.357295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.359276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.369833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writer thread running {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.370435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writer thread running {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.411508 n-d-833090-21 devstack@n-api.service[123886]: INFO dbcounter [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Registered counter for database nova_api Oct 04 18:03:21.434494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.442819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writer thread running {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.506020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.context [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123886) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 18:03:21.510801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.511489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.513246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.514111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.514696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.517136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.519356 n-d-833090-21 devstack@n-api.service[123886]: INFO dbcounter [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Registered counter for database nova_cell0 Oct 04 18:03:21.524194 n-d-833090-21 devstack@n-api.service[123886]: INFO dbcounter [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Registered counter for database nova_cell1 Oct 04 18:03:21.532633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.534708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.541947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writer thread running {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.543502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writer thread running {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.568751 n-d-833090-21 devstack@n-api.service[123887]: INFO dbcounter [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Registered counter for database nova_cell0 Oct 04 18:03:21.577542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.587550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writer thread running {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.706744 n-d-833090-21 devstack@n-api.service[123886]: INFO dbcounter [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Registered counter for database nova_cell0 Oct 04 18:03:21.716127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_db.sqlalchemy.engines [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 18:03:21.721583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writer thread running {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 18:03:21.918874 n-d-833090-21 devstack@n-api.service[123887]: WARNING keystonemiddleware.auth_token [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:03:21.927788 n-d-833090-21 devstack@n-api.service[123887]: WARNING keystonemiddleware.auth_token [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:03:22.080033 n-d-833090-21 devstack@n-api.service[123886]: WARNING keystonemiddleware.auth_token [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:03:22.088784 n-d-833090-21 devstack@n-api.service[123886]: WARNING keystonemiddleware.auth_token [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:03:22.277759 n-d-833090-21 devstack@n-api.service[123887]: WARNING keystonemiddleware.auth_token [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:03:22.284569 n-d-833090-21 devstack@n-api.service[123887]: WARNING keystonemiddleware.auth_token [None req-12cb932c-6cc6-4831-82db-ec33eb3892e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:03:22.290462 n-d-833090-21 devstack@n-api.service[123887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d7738269c0 pid: 123887 (default app) Oct 04 18:03:22.482089 n-d-833090-21 devstack@n-api.service[123886]: WARNING keystonemiddleware.auth_token [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 18:03:22.488623 n-d-833090-21 devstack@n-api.service[123886]: WARNING keystonemiddleware.auth_token [None req-c6e764e5-44b3-4fcc-aaa0-2f12678c5677 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 18:03:22.494745 n-d-833090-21 devstack@n-api.service[123886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d7738269c0 pid: 123886 (default app) Oct 04 18:04:04.088852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:04.090211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:04.091671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:04.092762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.888537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.890761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.891281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.892230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:06.246288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.250545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.250545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.251157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.252475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.253460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.254192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.305728 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-724b08a7-a1b5-447a-899c-70adb222863a tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 2.235543 Oct 04 18:04:06.306324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1/1] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:06.776409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-344c974b-5aa7-4910-8049-ba4776bcd947 tempest-AZAdminNegativeTestJSON-934009323 tempest-AZAdminNegativeTestJSON-934009323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.778429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-344c974b-5aa7-4910-8049-ba4776bcd947 tempest-AZAdminNegativeTestJSON-934009323 tempest-AZAdminNegativeTestJSON-934009323-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2765324e8594488b88c60490e90afa75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e95c99d58a149939b0ec23eec8b4168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-344c974b-5aa7-4910-8049-ba4776bcd947 tempest-AZAdminNegativeTestJSON-934009323 tempest-AZAdminNegativeTestJSON-934009323-project] Request method failure captured: Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWSQq6gC_iSJqMN48xnrXxkC98pvuKsLZcxhsez3bDjPxHbcqas-IH3y8UyDIngFX5A2FsAiKH50ZjvXhzH8C3dFs10zwICLo599HRkLVLXVsNgNgob7z3mFLWmt8e_TEsIeAFARL0yrIdg2K_YQu5o59LDzFRraNy7CDRSDA1ZBcI Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 3e95c99d58a149939b0ec23eec8b4168 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AZAdminNegativeTestJSON-934009323 Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:06.783946 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3e95c99d58a149939b0ec23eec8b4168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3e95c99d58a149939b0ec23eec8b4168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3e95c99d58a149939b0ec23eec8b4168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3e95c99d58a149939b0ec23eec8b4168"}]}] Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AZAdminNegativeTestJSON-934009323 Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 3e95c99d58a149939b0ec23eec8b4168 Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-934009323 Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AZAdminNegativeTestJSON-934009323-project Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2765324e8594488b88c60490e90afa75 Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AZAdminNegativeTestJSON-934009323-project Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:04:06.786055 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:06.787400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.791894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-344c974b-5aa7-4910-8049-ba4776bcd947 tempest-AZAdminNegativeTestJSON-934009323 tempest-AZAdminNegativeTestJSON-934009323-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:06.796484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-344c974b-5aa7-4910-8049-ba4776bcd947 tempest-AZAdminNegativeTestJSON-934009323 tempest-AZAdminNegativeTestJSON-934009323-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.478970 Oct 04 18:04:06.796484 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 482 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:07.297379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Calling method '.version_select at 0x7f900b80b3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.313848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123887) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:04:07.315172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.315923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.316474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.349101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.349806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.350477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.357717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee296182-113e-44b0-b7a4-6c7f2444945e tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1667790401", "ram": 512, "vcpus": 1, "disk": 10, "id": 665656022, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.376162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.376812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.377352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.384838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-23b1be5f-8927-451e-8589-87b75f0fc82c tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.592643 Oct 04 18:04:07.385588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1208 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:07.390771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.392279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.392899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.393504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.394379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.395091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.395762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.426833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7cccb8a3-8dc4-4133-859b-87cafb695043 tempest-AZAdminV2TestJSON-1930166966 tempest-AZAdminV2TestJSON-1930166966-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.040012 Oct 04 18:04:07.427548 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.709071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.713111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.713581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.714009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.714717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.715167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.715625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.738993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce63474f-312a-4ffb-abb7-ea1a460c206a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.310333 Oct 04 18:04:07.739617 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.823805 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee296182-113e-44b0-b7a4-6c7f2444945e tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.947099 Oct 04 18:04:07.824791 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1/6] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:05 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.829929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10d88c38-6aab-44c9-94f1-bc363ad275d6 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1842837337"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.834066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-10d88c38-6aab-44c9-94f1-bc363ad275d6 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Generated uuid 6243ddd4-f5da-40e4-a50c-662846d1befe for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:08.048317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10d88c38-6aab-44c9-94f1-bc363ad275d6 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.221784 Oct 04 18:04:08.053147 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2/7] 10.222.0.40 () {62 vars in 1205 bytes} [Tue Oct 4 18:04:07 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:08.113553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '.version_select at 0x7f900ae11940>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.116304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.117718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.118647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.147450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.147450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.147450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.159343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.160196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.160933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.170151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a571b215-0be2-4e62-b92b-e2646f4ad2b1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.429449 Oct 04 18:04:08.170749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 6/8] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:08.175941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0d3732e-cd63-48dd-b8ff-c34cf8e60789 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1880605702"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.479710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0d3732e-cd63-48dd-b8ff-c34cf8e60789 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.306482 Oct 04 18:04:08.485125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 7/9] 10.222.0.40 () {62 vars in 1210 bytes} [Tue Oct 4 18:04:08 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:08.498239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-717ddb24-3281-421d-9a85-e686b9a8b675 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.509075 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-717ddb24-3281-421d-9a85-e686b9a8b675 tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.014950 Oct 04 18:04:08.518818 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 8/10] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:04:08.527401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ceae0389-c6a7-4193-a452-b304f20e16be tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.546664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceae0389-c6a7-4193-a452-b304f20e16be tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.547153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceae0389-c6a7-4193-a452-b304f20e16be tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.547678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceae0389-c6a7-4193-a452-b304f20e16be tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.680713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ebff382-6fba-4076-8814-834a9a2a4a3d tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.717903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8ebff382-6fba-4076-8814-834a9a2a4a3d tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] HTTP exception thrown: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ebff382-6fba-4076-8814-834a9a2a4a3d tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Request method failure captured: Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSjV01WYyUofN14kQ15NRsLO3PNvRjGa5f_9GR9HUciFMxxr0n1OTUDyd_lhXGc3y6y4n1XM6T5iK6P9OezqslB6aiZyUNITi0SI9bP3w1ShaWcgRvWvHyKaV2GqM90eDV0IcDp3BKffq2xml19bB4CchDYa457xxsMvRY9Ow83SU Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:08.721345 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1306836d15fc4402be47326bb0b4521f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1306836d15fc4402be47326bb0b4521f"}]}] Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 4872fb8eee3a4a5491b08d83bcf37f8b Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:08.722900 n-d-833090-21 devstack@n-api.service[123886]: exception: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:cpu_thread_policy'} Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:08.723681 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ebff382-6fba-4076-8814-834a9a2a4a3d tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Returning 404 to user: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ebff382-6fba-4076-8814-834a9a2a4a3d tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] 10.222.0.40 "GET /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.667845 Oct 04 18:04:08.725049 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3/11] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 669 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:08.733754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-133bc4f4-b692-4d52-b693-609999d69830 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.737421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-133bc4f4-b692-4d52-b693-609999d69830 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '4872fb8eee3a4a5491b08d83bcf37f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1306836d15fc4402be47326bb0b4521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-133bc4f4-b692-4d52-b693-609999d69830 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Request method failure captured: Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/flavors/665656022/os-extra_specs HTTP/1.1 Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 66 Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSjV01WYyUofN14kQ15NRsLO3PNvRjGa5f_9GR9HUciFMxxr0n1OTUDyd_lhXGc3y6y4n1XM6T5iK6P9OezqslB6aiZyUNITi0SI9bP3w1ShaWcgRvWvHyKaV2GqM90eDV0IcDp3BKffq2xml19bB4CchDYa457xxsMvRY9Ow83SU Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:08.740616 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1306836d15fc4402be47326bb0b4521f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1306836d15fc4402be47326bb0b4521f"}]}] Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 4872fb8eee3a4a5491b08d83bcf37f8b Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 18:04:08.742475 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:08.743112 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 18:04:08.744785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.746176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-133bc4f4-b692-4d52-b693-609999d69830 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:08.746176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-133bc4f4-b692-4d52-b693-609999d69830 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] 10.222.0.40 "POST /compute/v2.1/flavors/665656022/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013351 Oct 04 18:04:08.747144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4/12] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/flavors/665656022/os-extra_specs => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:08.759884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bdf1a301-214b-40d7-b9fa-d04f21b30b2d tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.921311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bdf1a301-214b-40d7-b9fa-d04f21b30b2d tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/665656022/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.172442 Oct 04 18:04:08.921907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 5/13] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/flavors/665656022/os-extra_specs => generated 66 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:08.933002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03df606b-3445-41a4-b19b-73611743e8f2 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.935902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03df606b-3445-41a4-b19b-73611743e8f2 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '4872fb8eee3a4a5491b08d83bcf37f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1306836d15fc4402be47326bb0b4521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03df606b-3445-41a4-b19b-73611743e8f2 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Request method failure captured: Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSjV01WYyUofN14kQ15NRsLO3PNvRjGa5f_9GR9HUciFMxxr0n1OTUDyd_lhXGc3y6y4n1XM6T5iK6P9OezqslB6aiZyUNITi0SI9bP3w1ShaWcgRvWvHyKaV2GqM90eDV0IcDp3BKffq2xml19bB4CchDYa457xxsMvRY9Ow83SU Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:08.938854 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1306836d15fc4402be47326bb0b4521f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1306836d15fc4402be47326bb0b4521f"}]}] Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 4872fb8eee3a4a5491b08d83bcf37f8b Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:08.943637 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:numa_nodes'} Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:08.944185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:08.945721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03df606b-3445-41a4-b19b-73611743e8f2 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:08.946542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03df606b-3445-41a4-b19b-73611743e8f2 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] 10.222.0.40 "DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013409 Oct 04 18:04:08.946542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 6/14] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:04:08 2022] DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:08.952071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16fb9061-1789-4c40-b591-177b398e03e4 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:08.988388 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16fb9061-1789-4c40-b591-177b398e03e4 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/665656022/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039951 Oct 04 18:04:08.989280 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 7/15] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/flavors/665656022/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:04:09.005224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0164b75a-e45c-4b37-9803-83151fb97233 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.009204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0164b75a-e45c-4b37-9803-83151fb97233 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '4872fb8eee3a4a5491b08d83bcf37f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1306836d15fc4402be47326bb0b4521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0164b75a-e45c-4b37-9803-83151fb97233 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Request method failure captured: Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 22 Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSjV01WYyUofN14kQ15NRsLO3PNvRjGa5f_9GR9HUciFMxxr0n1OTUDyd_lhXGc3y6y4n1XM6T5iK6P9OezqslB6aiZyUNITi0SI9bP3w1ShaWcgRvWvHyKaV2GqM90eDV0IcDp3BKffq2xml19bB4CchDYa457xxsMvRY9Ow83SU Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:09.010789 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1306836d15fc4402be47326bb0b4521f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1306836d15fc4402be47326bb0b4521f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1306836d15fc4402be47326bb0b4521f"}]}] Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1306836d15fc4402be47326bb0b4521f Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 4872fb8eee3a4a5491b08d83bcf37f8b Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: {"hw:numa_nodes": "1"} Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:09.012259 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:09.013746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 18:04:09.015806 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.018031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0164b75a-e45c-4b37-9803-83151fb97233 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:09.018031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0164b75a-e45c-4b37-9803-83151fb97233 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855 tempest-FlavorsExtraSpecsNegativeTestJSON-298207855-project] 10.222.0.40 "PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013257 Oct 04 18:04:09.018031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 8/16] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:04:08 2022] PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:09.026398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85ad3f5e-b513-4373-981d-9dc78b5e8836 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.045539 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-85ad3f5e-b513-4373-981d-9dc78b5e8836 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] HTTP exception thrown: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85ad3f5e-b513-4373-981d-9dc78b5e8836 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Request method failure captured: Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWVbCS_aNNE_ruKi81w88oZE09mXvTejxLOqVQx7FmozTfHkXOJH-St1ZrgYFS8Mpkg0YIo_roobjPHLPk4dPbVaGFaETAI6ctyKlOx719DJS3MFuzCb8TpSKGqxIDcTPI7vWoR5bzsAlaIKiv6KvwzOzvdhKnU5XS9f_ZPyfIlxsE Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:09.048662 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a91d35e7061d40d1bead3b71268e3b12"}]}] Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d9d6008787174e01a0ddf69a46981da5 Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:09.050946 n-d-833090-21 devstack@n-api.service[123886]: exception: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:cpu_thread_policy'} Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.052259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85ad3f5e-b513-4373-981d-9dc78b5e8836 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Returning 404 to user: Flavor 665656022 has no extra specs with key hw:cpu_thread_policy. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85ad3f5e-b513-4373-981d-9dc78b5e8836 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.030908 Oct 04 18:04:09.054685 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:04:09 2022] DELETE /compute/v2.1/flavors/665656022/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:09.068827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-526ae0f7-faf9-438e-a3a1-09349ca85955 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.076967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-526ae0f7-faf9-438e-a3a1-09349ca85955 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-526ae0f7-faf9-438e-a3a1-09349ca85955 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Request method failure captured: Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 27 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWVbCS_aNNE_ruKi81w88oZE09mXvTejxLOqVQx7FmozTfHkXOJH-St1ZrgYFS8Mpkg0YIo_roobjPHLPk4dPbVaGFaETAI6ctyKlOx719DJS3MFuzCb8TpSKGqxIDcTPI7vWoR5bzsAlaIKiv6KvwzOzvdhKnU5XS9f_ZPyfIlxsE Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:09.079904 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a91d35e7061d40d1bead3b71268e3b12"}]}] Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d9d6008787174e01a0ddf69a46981da5 Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: {"hw:cpu_policy": "shared"} Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:09.082361 n-d-833090-21 devstack@n-api.service[123886]: exception: Request body and URI mismatch Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.083705 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-526ae0f7-faf9-438e-a3a1-09349ca85955 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-526ae0f7-faf9-438e-a3a1-09349ca85955 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.023045 Oct 04 18:04:09.087527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 10/18] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:04:09 2022] PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:04:09.097595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbac4017-a57d-4405-a211-17666e9c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbac4017-a57d-4405-a211-17666e9c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Request method failure captured: Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 49 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWVbCS_aNNE_ruKi81w88oZE09mXvTejxLOqVQx7FmozTfHkXOJH-St1ZrgYFS8Mpkg0YIo_roobjPHLPk4dPbVaGFaETAI6ctyKlOx719DJS3MFuzCb8TpSKGqxIDcTPI7vWoR5bzsAlaIKiv6KvwzOzvdhKnU5XS9f_ZPyfIlxsE Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:09.103744 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a91d35e7061d40d1bead3b71268e3b12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a91d35e7061d40d1bead3b71268e3b12"}]}] Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a91d35e7061d40d1bead3b71268e3b12 Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d9d6008787174e01a0ddf69a46981da5 Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 18:04:09.104899 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'flavor_id': '665656022', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 18:04:09.105510 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.106682 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 18:04:09.107814 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.116502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbac4017-a57d-4405-a211-17666e9c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:09.116502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fbac4017-a57d-4405-a211-17666e9c36c9 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017538 Oct 04 18:04:09.116502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 11/19] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:04:09 2022] PUT /compute/v2.1/flavors/665656022/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:04:09.128182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5cf12e55-0bc1-4f07-bd47-9ca04487db63 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.235581 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5cf12e55-0bc1-4f07-bd47-9ca04487db63 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/665656022" status: 202 len: 0 microversion: 2.1 time: 0.116173 Oct 04 18:04:09.236389 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 12/20] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:04:09 2022] DELETE /compute/v2.1/flavors/665656022 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:09.247620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8d5e3bc-dae4-4316-9763-a0822ce3932a tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.291373 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8d5e3bc-dae4-4316-9763-a0822ce3932a tempest-FlavorsExtraSpecsNegativeTestJSON-600128416 tempest-FlavorsExtraSpecsNegativeTestJSON-600128416-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047426 Oct 04 18:04:09.292012 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 13/21] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:09.673175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a05aadbe-9d09-4f55-90bf-f484e6c62f9d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-853017521", "id": 1792858805, "os-flavor-access:is_public": "False"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:09.795667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a05aadbe-9d09-4f55-90bf-f484e6c62f9d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.501938 Oct 04 18:04:09.797426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 14/22] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:09 2022] POST /compute/v2.1/flavors => generated 438 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:09.813930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e25e66ee-4e45-4a95-b08d-d8bb412c4924 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.082810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ceae0389-c6a7-4193-a452-b304f20e16be tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.561465 Oct 04 18:04:10.084358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 9/23] 10.222.0.40 () {62 vars in 1232 bytes} [Tue Oct 4 18:04:08 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:10.098500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19ab0f1c-58dc-4b94-bdb8-b52f9f9ed45a tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.112520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ab0f1c-58dc-4b94-bdb8-b52f9f9ed45a tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.113451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ab0f1c-58dc-4b94-bdb8-b52f9f9ed45a tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.114191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ab0f1c-58dc-4b94-bdb8-b52f9f9ed45a tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.464447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19ab0f1c-58dc-4b94-bdb8-b52f9f9ed45a tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.370454 Oct 04 18:04:10.465076 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 10/24] 10.222.0.40 () {62 vars in 1232 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:10.477749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f035a8d0-4006-4a95-b8a0-f562ef2c60ff tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.832804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f035a8d0-4006-4a95-b8a0-f562ef2c60ff tempest-AggregatesAdminTestV241-1198685731 tempest-AggregatesAdminTestV241-1198685731-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.358860 Oct 04 18:04:10.833395 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 11/25] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 18:04:10 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:10.850285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1398272d-13c3-428a-99a3-b1340e275ef1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1104726685", "name": "tempest-test_aggregate-95064702"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.888701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-1398272d-13c3-428a-99a3-b1340e275ef1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid d3274aee-3c17-4e5c-93a4-211d81a2fab8 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:10.981536 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1398272d-13c3-428a-99a3-b1340e275ef1 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.134733 Oct 04 18:04:10.991685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 12/26] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:11.000244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe1f3638-c1d4-45de-a7f2-421e2a70b103 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:11.012604 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe1f3638-c1d4-45de-a7f2-421e2a70b103 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.016736 Oct 04 18:04:11.013515 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 13/27] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:04:10 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:11.031821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4df61b0-9204-418d-8959-72e4230e84a9 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:11.043743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4df61b0-9204-418d-8959-72e4230e84a9 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.044520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4df61b0-9204-418d-8959-72e4230e84a9 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.044962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4df61b0-9204-418d-8959-72e4230e84a9 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.393409 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4df61b0-9204-418d-8959-72e4230e84a9 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.369952 Oct 04 18:04:11.394772 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 14/28] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:11.434958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e25e66ee-4e45-4a95-b08d-d8bb412c4924 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1792858805/action" status: 200 len: 97 microversion: 2.1 time: 1.623767 Oct 04 18:04:11.434958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 15/29] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:04:09 2022] POST /compute/v2.1/flavors/1792858805/action => generated 97 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:04:11.450661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24337d99-5c0a-418f-a996-2267837ec581 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:12.411418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1916201711", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "availability_zone": "tempest-test_az-1104726685"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:12.477078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.478327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.480438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.482155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.483584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.484681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.543032 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-24337d99-5c0a-418f-a996-2267837ec581 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24337d99-5c0a-418f-a996-2267837ec581 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Request method failure captured: Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/flavors/1792858805/action HTTP/1.1 Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 67 Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWcFiJ9CbujLn3BAmeln6dqIYj0CJoW_ubMLrAOqbMB3Fx_v_uyF2Nks_eszSOO9F9uKRebjWtrlNY1VQWEHO1_2lsmJse6-HOhk8YlZF2yqo69vZGZhJ4T1QsnRmvWlrP5pw8ScZYy3LED221Z9_HdSYpjV4cIvQ65Oks0Vv0Pfg Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:12.571890 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}] Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 636f9a9de0f44320b62e6fec674ac819 Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} Oct 04 18:04:12.574102 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: exception: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1792858805', 'body': {'addTenantAccess': {'tenant': '4a8a7733a2e546c283e4857a31acf364'}}} Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:04:12.575377 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-4a8a7733a2e546c283e4857a31acf364' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:04:12.581511 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:04:12.583431 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:04:12.586428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-4a8a7733a2e546c283e4857a31acf364' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 4, 12, 459260), 'updated_at': None, 'flavor_id': 16, 'project_id': '4a8a7733a2e546c283e4857a31acf364'}] Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:12.588512 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:12.590326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:12.592565 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24337d99-5c0a-418f-a996-2267837ec581 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 4a8a7733a2e546c283e4857a31acf364 combination. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24337d99-5c0a-418f-a996-2267837ec581 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1792858805/action" status: 409 len: 152 microversion: 2.1 time: 1.131835 Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 15/30] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:04:11 2022] POST /compute/v2.1/flavors/1792858805/action => generated 152 bytes in 1136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:12.599460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7847104f-0d34-4884-a6a4-246529954b68 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:12.973411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7847104f-0d34-4884-a6a4-246529954b68 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1792858805/action" status: 200 len: 21 microversion: 2.1 time: 0.391151 Oct 04 18:04:12.974338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 16/31] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:04:12 2022] POST /compute/v2.1/flavors/1792858805/action => generated 21 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:04:12.985002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49187597-1daa-4912-859f-ae6bcc7d795a tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.137927 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49187597-1daa-4912-859f-ae6bcc7d795a tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1792858805" status: 202 len: 0 microversion: 2.1 time: 0.157129 Oct 04 18:04:13.138510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 17/32] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:04:12 2022] DELETE /compute/v2.1/flavors/1792858805 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:13.149390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dec835a-e897-45b6-a1fe-c5daa6daf8f3 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.189638 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8dec835a-e897-45b6-a1fe-c5daa6daf8f3 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045010 Oct 04 18:04:13.190877 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.231607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18389108-6baa-40a1-a971-802e4a7cb3e7 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-792631663", "id": 512285436, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:13.311238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18389108-6baa-40a1-a971-802e4a7cb3e7 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.086388 Oct 04 18:04:13.312370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 19/34] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:13 2022] POST /compute/v2.1/flavors => generated 434 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:13.335324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79604452-8de5-4312-93a1-6b3090742054 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.350747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-79604452-8de5-4312-93a1-6b3090742054 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79604452-8de5-4312-93a1-6b3090742054 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Request method failure captured: Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/flavors/512285436/os-flavor-access HTTP/1.1 Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWcFiJ9CbujLn3BAmeln6dqIYj0CJoW_ubMLrAOqbMB3Fx_v_uyF2Nks_eszSOO9F9uKRebjWtrlNY1VQWEHO1_2lsmJse6-HOhk8YlZF2yqo69vZGZhJ4T1QsnRmvWlrP5pw8ScZYy3LED221Z9_HdSYpjV4cIvQ65Oks0Vv0Pfg Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:13.352119 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}] Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 636f9a9de0f44320b62e6fec674ac819 Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: exception: Access list not available for public flavors. Oct 04 18:04:13.353637 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'flavor_id': '512285436'} Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 18:04:13.355180 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.357854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79604452-8de5-4312-93a1-6b3090742054 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:13.357854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79604452-8de5-4312-93a1-6b3090742054 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/512285436/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025560 Oct 04 18:04:13.357854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 20/35] 10.222.0.40 () {58 vars in 1206 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/flavors/512285436/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:04:13.368902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b70a2e7-4919-4d5c-a886-4480a9808cbe tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.386932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:13.443346 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b70a2e7-4919-4d5c-a886-4480a9808cbe tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/512285436" status: 202 len: 0 microversion: 2.1 time: 0.078437 Oct 04 18:04:13.445604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 21/36] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:04:13 2022] DELETE /compute/v2.1/flavors/512285436 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:13.457164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-666cdb1c-5882-4381-a4d4-66487bcb38d9 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.503915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-666cdb1c-5882-4381-a4d4-66487bcb38d9 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043081 Oct 04 18:04:13.504992 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 22/37] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.528089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a380ea4e-f95b-4e67-b611-d56e00d6842d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1001305725", "id": 1326862686, "os-flavor-access:is_public": "False"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:13.590609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:13.819941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:13.820406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:13.820893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:13.821524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:13.821949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:13.835400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.836417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.836856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.837588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.838049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.838479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.873725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Getting quotas for project db9060741da54161b592c88621832842. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:13.881279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Getting quotas for user bbc5f201fd874669a9240bbc8d58f1cd and project db9060741da54161b592c88621832842. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:13.894392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:13.897555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:13.911397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a380ea4e-f95b-4e67-b611-d56e00d6842d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.387583 Oct 04 18:04:13.912881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 23/38] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:14.078684 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e02483c-c2c0-448f-bfc2-6e9933f4b105 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149590 Oct 04 18:04:14.083251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 16/39] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:14.107781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b00cb828-cd47-429e-8f1e-8249ef0ab8ad tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.110787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b00cb828-cd47-429e-8f1e-8249ef0ab8ad tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.260697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b00cb828-cd47-429e-8f1e-8249ef0ab8ad tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.291182 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b00cb828-cd47-429e-8f1e-8249ef0ab8ad tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1243 microversion: 2.1 time: 0.201153 Oct 04 18:04:14.307285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 17/40] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.564167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56325b55-05c2-453e-bfa0-bd29ad146c97 tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:14.568690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56325b55-05c2-453e-bfa0-bd29ad146c97 tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '903f1468e04845978b271e7f2c28eaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a7733a2e546c283e4857a31acf364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56325b55-05c2-453e-bfa0-bd29ad146c97 tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Request method failure captured: Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/flavors/1326862686/action HTTP/1.1 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 67 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWSe9g32TvriasMW-bhZzvUmPKPV7YVjEA6dl8ruI1ZVM6IpbDmBEjh34-N-RCpkV7o7DCIej2LmzYQBipgf2TVr5zRsW3LdK1p2JcTmQtqEWXO28omXGIfbA5tdqcsUS2LxYohxfLVg82BhgLHvZwzBRMyDCPvUyNr3-4rcYKy2Lo Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 4a8a7733a2e546c283e4857a31acf364 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:14.570708 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a8a7733a2e546c283e4857a31acf364"}]}] Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 4a8a7733a2e546c283e4857a31acf364 Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsAccessNegativeTestJSON-1774859731-project Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 903f1468e04845978b271e7f2c28eaf7 Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731-project Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} Oct 04 18:04:14.572109 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1326862686', 'body': {'addTenantAccess': {'tenant': '4a8a7733a2e546c283e4857a31acf364'}}} Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:14.573267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 18:04:14.574836 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:14.581514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56325b55-05c2-453e-bfa0-bd29ad146c97 tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:14.581514 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-56325b55-05c2-453e-bfa0-bd29ad146c97 tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] 10.222.0.40 "POST /compute/v2.1/flavors/1326862686/action" status: 403 len: 130 microversion: 2.1 time: 0.650127 Oct 04 18:04:14.581514 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 24/41] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:04:13 2022] POST /compute/v2.1/flavors/1326862686/action => generated 130 bytes in 651 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:14.582483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddfbfe2e-c9fd-4508-a6ca-233845850cb0 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.692716 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddfbfe2e-c9fd-4508-a6ca-233845850cb0 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1326862686" status: 202 len: 0 microversion: 2.1 time: 0.114264 Oct 04 18:04:14.693592 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 18/42] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:04:14 2022] DELETE /compute/v2.1/flavors/1326862686 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:14.701565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8504d110-d00f-45bc-a8fc-fe5b6426b614 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.732716 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8504d110-d00f-45bc-a8fc-fe5b6426b614 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034625 Oct 04 18:04:14.733326 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 25/43] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.755500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93a3b381-370e-4f00-ae10-8f375bb38275 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-958566559", "id": 304748905, "os-flavor-access:is_public": "False"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:14.961710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93a3b381-370e-4f00-ae10-8f375bb38275 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.209944 Oct 04 18:04:14.962347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 19/44] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:14.988127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57ee49f7-e1c3-49da-ab17-60faf4af8e5d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:15.317736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8c8c2a2-e11c-4c5c-b9b7-b260fb13b2f6 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:15.318340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f8c8c2a2-e11c-4c5c-b9b7-b260fb13b2f6 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:15.457274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f8c8c2a2-e11c-4c5c-b9b7-b260fb13b2f6 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.470926 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f8c8c2a2-e11c-4c5c-b9b7-b260fb13b2f6 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1243 microversion: 2.1 time: 0.154762 Oct 04 18:04:15.484160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 20/45] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:15 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1243 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:15.780193 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57ee49f7-e1c3-49da-ab17-60faf4af8e5d tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/304748905/action" status: 200 len: 96 microversion: 2.1 time: 0.808620 Oct 04 18:04:15.781609 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 26/46] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 4 18:04:14 2022] POST /compute/v2.1/flavors/304748905/action => generated 96 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:15.793609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3a279a1-6807-4d32-a138-2809f3cd169a tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:15.797944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3a279a1-6807-4d32-a138-2809f3cd169a tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '903f1468e04845978b271e7f2c28eaf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a7733a2e546c283e4857a31acf364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3a279a1-6807-4d32-a138-2809f3cd169a tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Request method failure captured: Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/flavors/304748905/action HTTP/1.1 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 70 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSe9g32TvriasMW-bhZzvUmPKPV7YVjEA6dl8ruI1ZVM6IpbDmBEjh34-N-RCpkV7o7DCIej2LmzYQBipgf2TVr5zRsW3LdK1p2JcTmQtqEWXO28omXGIfbA5tdqcsUS2LxYohxfLVg82BhgLHvZwzBRMyDCPvUyNr3-4rcYKy2Lo Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 4a8a7733a2e546c283e4857a31acf364 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:15.800637 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a8a7733a2e546c283e4857a31acf364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a8a7733a2e546c283e4857a31acf364"}]}] Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 4a8a7733a2e546c283e4857a31acf364 Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731 Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FlavorsAccessNegativeTestJSON-1774859731-project Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 903f1468e04845978b271e7f2c28eaf7 Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1774859731-project Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: {"removeTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} Oct 04 18:04:15.801757 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '304748905', 'body': {'removeTenantAccess': {'tenant': '4a8a7733a2e546c283e4857a31acf364'}}} Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can( Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:15.802460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 18:04:15.803599 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:15.812372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3a279a1-6807-4d32-a138-2809f3cd169a tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:15.815789 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3a279a1-6807-4d32-a138-2809f3cd169a tempest-FlavorsAccessNegativeTestJSON-1774859731 tempest-FlavorsAccessNegativeTestJSON-1774859731-project] 10.222.0.40 "POST /compute/v2.1/flavors/304748905/action" status: 403 len: 133 microversion: 2.1 time: 0.027373 Oct 04 18:04:15.820562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 21/47] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 4 18:04:15 2022] POST /compute/v2.1/flavors/304748905/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:15.825667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f767876f-6780-4aa6-9ab9-1188b4f756ab tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4a8a7733a2e546c283e4857a31acf364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:16.505925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a818da4d-3b89-4f6e-8d54-55f43c07ae72 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.506599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a818da4d-3b89-4f6e-8d54-55f43c07ae72 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.646946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a818da4d-3b89-4f6e-8d54-55f43c07ae72 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.655156 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a818da4d-3b89-4f6e-8d54-55f43c07ae72 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1243 microversion: 2.1 time: 0.154381 Oct 04 18:04:16.657652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 22/48] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1243 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.159155 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f767876f-6780-4aa6-9ab9-1188b4f756ab tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/304748905/action" status: 200 len: 21 microversion: 2.1 time: 1.336922 Oct 04 18:04:17.160704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 27/49] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 4 18:04:15 2022] POST /compute/v2.1/flavors/304748905/action => generated 21 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:17.170776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f005f15d-7cdc-42ea-be50-566b8b51c2dd tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.178760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:17.275950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f005f15d-7cdc-42ea-be50-566b8b51c2dd tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/304748905" status: 202 len: 0 microversion: 2.1 time: 0.108998 Oct 04 18:04:17.278128 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 23/50] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:04:17 2022] DELETE /compute/v2.1/flavors/304748905 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:17.286763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45aa3fd7-d989-40f0-baf8-ecb4b42ab140 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.310608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45aa3fd7-d989-40f0-baf8-ecb4b42ab140 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027846 Oct 04 18:04:17.311437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 28/51] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.333764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a72156f-4fd7-41b6-8b3d-79069e78e47f tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2015976746", "id": 1432285791, "os-flavor-access:is_public": "False"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:17.477561 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a72156f-4fd7-41b6-8b3d-79069e78e47f tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.149384 Oct 04 18:04:17.483585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 24/52] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:17 2022] POST /compute/v2.1/flavors => generated 439 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:17.492754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6154ca33-b19a-43e9-ac0a-3be8fc1ee3cb tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eef5266629d44f16ae238f6380da1a60"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:17.692320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.693273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.715617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.721448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:17.723829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.724678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.726005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.728902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.730946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.921238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.948472 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f8f92f7-f50a-4c70-a301-42960509b449 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1243 microversion: 2.1 time: 0.269205 Oct 04 18:04:17.949546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 25/53] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1243 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.318126 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6154ca33-b19a-43e9-ac0a-3be8fc1ee3cb tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] HTTP exception thrown: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6154ca33-b19a-43e9-ac0a-3be8fc1ee3cb tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Request method failure captured: Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/flavors/1432285791/action HTTP/1.1 Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 70 Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWcFiJ9CbujLn3BAmeln6dqIYj0CJoW_ubMLrAOqbMB3Fx_v_uyF2Nks_eszSOO9F9uKRebjWtrlNY1VQWEHO1_2lsmJse6-HOhk8YlZF2yqo69vZGZhJ4T1QsnRmvWlrP5pw8ScZYy3LED221Z9_HdSYpjV4cIvQ65Oks0Vv0Pfg Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:18.323452 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a74d4c6b6c9e436b908ad8d3e3b9095d"}]}] Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a74d4c6b6c9e436b908ad8d3e3b9095d Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156128408 Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 636f9a9de0f44320b62e6fec674ac819 Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: {"removeTenantAccess": {"tenant": "eef5266629d44f16ae238f6380da1a60"}} Oct 04 18:04:18.324607 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: exception: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1432285791', 'body': {'removeTenantAccess': {'tenant': 'eef5266629d44f16ae238f6380da1a60'}}} Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 18:04:18.325200 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:18.326097 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. Oct 04 18:04:18.327064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:18.336128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6154ca33-b19a-43e9-ac0a-3be8fc1ee3cb tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Returning 404 to user: Flavor access not found for 20 / eef5266629d44f16ae238f6380da1a60 combination. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:18.338308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6154ca33-b19a-43e9-ac0a-3be8fc1ee3cb tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1432285791/action" status: 404 len: 124 microversion: 2.1 time: 0.850930 Oct 04 18:04:18.343830 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 29/54] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:04:17 2022] POST /compute/v2.1/flavors/1432285791/action => generated 124 bytes in 856 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:18.349750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d8c9b7b-8809-4ee4-9ba7-4ed0efe8ae23 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.436093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d8c9b7b-8809-4ee4-9ba7-4ed0efe8ae23 tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1432285791" status: 202 len: 0 microversion: 2.1 time: 0.089643 Oct 04 18:04:18.437030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 26/55] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:04:18 2022] DELETE /compute/v2.1/flavors/1432285791 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:18.444884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aeb28451-334f-4561-9111-428efcbe413f tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.502075 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aeb28451-334f-4561-9111-428efcbe413f tempest-FlavorsAccessNegativeTestJSON-156128408 tempest-FlavorsAccessNegativeTestJSON-156128408-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060908 Oct 04 18:04:18.521051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 30/56] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.906923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7ab8cde-8b2b-4c99-b8e0-610b386debc0 tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1563846642", "id": 1881317836, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:18.977654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.978723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.995299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.996093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.996855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.997870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.998419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.999091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.018382 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7ab8cde-8b2b-4c99-b8e0-610b386debc0 tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.395589 Oct 04 18:04:19.029616 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 27/57] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:04:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:19.829622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a766fd4-6193-4cd2-ab71-e823a9ced453 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.860604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a766fd4-6193-4cd2-ab71-e823a9ced453 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] 10.222.0.40 "GET /compute/v2.1/flavors/1881317836" status: 200 len: 468 microversion: 2.61 time: 0.828145 Oct 04 18:04:19.868854 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 28/58] 10.222.0.40 () {60 vars in 1199 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/flavors/1881317836 => generated 468 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:19.883660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-417e3cd8-6fe3-4cc8-aed6-deae593ecb8d tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] Action: 'update', calling method: .version_select at 0x7f900b341310>, body: {"flavor": {"description": "new"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:20.082175 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-417e3cd8-6fe3-4cc8-aed6-deae593ecb8d tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1881317836" status: 200 len: 469 microversion: 2.61 time: 0.202355 Oct 04 18:04:20.082751 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 29/59] 10.222.0.40 () {62 vars in 1219 bytes} [Tue Oct 4 18:04:19 2022] PUT /compute/v2.1/flavors/1881317836 => generated 469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:20.097565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14287a99-5789-42ad-9abc-080e5e55afb4 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.130401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14287a99-5789-42ad-9abc-080e5e55afb4 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.036974 Oct 04 18:04:20.131219 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 30/60] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:20.167080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb55fea8-00b3-4f23-9707-7555c87ff1e2 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.213708 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb55fea8-00b3-4f23-9707-7555c87ff1e2 tempest-FlavorsV261TestJSON-1632780357 tempest-FlavorsV261TestJSON-1632780357-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.056325 Oct 04 18:04:20.222986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 31/61] 10.222.0.40 () {60 vars in 1166 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:20.231181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ea4c321-8e9c-42df-961d-501884cb10e9 tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.333039 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ea4c321-8e9c-42df-961d-501884cb10e9 tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1881317836" status: 202 len: 0 microversion: 2.61 time: 0.104753 Oct 04 18:04:20.334063 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 4 18:04:20 2022] DELETE /compute/v2.1/flavors/1881317836 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:04:20.348902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e38501b-9688-4505-af43-58b9c5a6185c tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.375933 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e38501b-9688-4505-af43-58b9c5a6185c tempest-FlavorsV261TestJSON-703823800 tempest-FlavorsV261TestJSON-703823800-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.030506 Oct 04 18:04:20.377046 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 33/63] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:21.341538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.361851 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14011409-f286-4526-bc17-c16846d3d763 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1333 microversion: 2.1 time: 2.390810 Oct 04 18:04:21.362845 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 31/64] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1333 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:22.393686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.393686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:22.402416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.403317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.403947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.406473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.408965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.409590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.591494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.642166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-358327ba-21ce-4020-9bc9-0bf3651c6404 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.220050 Oct 04 18:04:22.642166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 32/65] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:22.926972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Calling method '.version_select at 0x7f900a3589d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.941839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.945679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.950204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.951973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.952604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.959833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.092633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f971289-7b21-4626-85d1-4931709c4011 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.179178 Oct 04 18:04:23.095950 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:23.652556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.655008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.676777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.677521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.678114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.680358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.680836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.681551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.967152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ce01d4b-52b8-45a5-b34a-ec7f3921b561 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Calling method '.version_select at 0x7f900a1d5820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.979862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9ce01d4b-52b8-45a5-b34a-ec7f3921b561 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ce01d4b-52b8-45a5-b34a-ec7f3921b561 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:23.982041 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:04:23.983439 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:23.992052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 18:04:23.993386 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:23.994695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ce01d4b-52b8-45a5-b34a-ec7f3921b561 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:23.994695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9ce01d4b-52b8-45a5-b34a-ec7f3921b561 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.880607 Oct 04 18:04:23.994695 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 888 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:23.996384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ce1a930-8483-428f-ab09-a3c7608bb362 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Calling method '.version_select at 0x7f900a131670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.002697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ce1a930-8483-428f-ab09-a3c7608bb362 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ce1a930-8483-428f-ab09-a3c7608bb362 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/n-d-833090-21/reboot HTTP/1.1 Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:24.004576 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21'} Oct 04 18:04:24.005792 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.006630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 18:04:24.008283 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.015140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ce1a930-8483-428f-ab09-a3c7608bb362 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.016569 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ce1a930-8483-428f-ab09-a3c7608bb362 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-833090-21/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023862 Oct 04 18:04:24.017294 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 34/68] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/os-hosts/n-d-833090-21/reboot => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.039350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09482075-d0e3-473d-925b-cd52bcc09e11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Calling method '.version_select at 0x7f900a1311f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.075529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-09482075-d0e3-473d-925b-cd52bcc09e11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09482075-d0e3-473d-925b-cd52bcc09e11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.091987 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:04:24.097503 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:24.098396 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:04:24.099564 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09482075-d0e3-473d-925b-cd52bcc09e11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-09482075-d0e3-473d-925b-cd52bcc09e11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.066476 Oct 04 18:04:24.101147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 35/69] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:24.103508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c926699a-0eaf-49b3-aee4-c594424ad1f4 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Calling method '.version_select at 0x7f900a0d18b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.129917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c926699a-0eaf-49b3-aee4-c594424ad1f4 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c926699a-0eaf-49b3-aee4-c594424ad1f4 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/n-d-833090-21 HTTP/1.1 Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:24.136730 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21'} Oct 04 18:04:24.141736 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.142841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 18:04:24.144106 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.145069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c926699a-0eaf-49b3-aee4-c594424ad1f4 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.148433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c926699a-0eaf-49b3-aee4-c594424ad1f4 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-833090-21" status: 403 len: 109 microversion: 2.1 time: 0.040844 Oct 04 18:04:24.154260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 36/70] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/n-d-833090-21 => generated 109 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.168991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9dc18f47-d8ed-44b4-9dab-f395f5ef6f11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Calling method '.version_select at 0x7f900a059430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.197503 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9dc18f47-d8ed-44b4-9dab-f395f5ef6f11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9dc18f47-d8ed-44b4-9dab-f395f5ef6f11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.200523 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:04:24.201618 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.202297 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.203293 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.210423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9dc18f47-d8ed-44b4-9dab-f395f5ef6f11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.221345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9dc18f47-d8ed-44b4-9dab-f395f5ef6f11 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.065700 Oct 04 18:04:24.222075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 37/71] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:24.240729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d8d371e-5c71-4198-8072-63b400505660 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Calling method '.version_select at 0x7f900a0d19d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.250665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d8d371e-5c71-4198-8072-63b400505660 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d8d371e-5c71-4198-8072-63b400505660 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/n-d-833090-21/shutdown HTTP/1.1 Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:24.260123 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21'} Oct 04 18:04:24.261335 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.262023 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 18:04:24.262994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.269231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d8d371e-5c71-4198-8072-63b400505660 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.270384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d8d371e-5c71-4198-8072-63b400505660 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-833090-21/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.041278 Oct 04 18:04:24.273873 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 38/72] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/n-d-833090-21/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.283534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-779d189d-c0ef-4992-962a-566ac5273b68 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Calling method '.version_select at 0x7f900a1315e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.310246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-779d189d-c0ef-4992-962a-566ac5273b68 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-779d189d-c0ef-4992-962a-566ac5273b68 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.312187 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:04:24.313546 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:24.314248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:04:24.315170 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-779d189d-c0ef-4992-962a-566ac5273b68 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-779d189d-c0ef-4992-962a-566ac5273b68 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037877 Oct 04 18:04:24.322994 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 39/73] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:24.333118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07854dd8-9b04-4fb0-b765-f530373297a0 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Calling method '.version_select at 0x7f900a0d19d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.341723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07854dd8-9b04-4fb0-b765-f530373297a0 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07854dd8-9b04-4fb0-b765-f530373297a0 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/n-d-833090-21/startup HTTP/1.1 Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:24.343865 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21'} Oct 04 18:04:24.344971 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.345628 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 18:04:24.347064 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.356443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07854dd8-9b04-4fb0-b765-f530373297a0 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.357833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07854dd8-9b04-4fb0-b765-f530373297a0 tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-833090-21/startup" status: 403 len: 110 microversion: 2.1 time: 0.029088 Oct 04 18:04:24.362661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 40/74] 10.222.0.40 () {58 vars in 1194 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/n-d-833090-21/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.368659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f74ef684-4ae7-4bf4-b463-2bc90149c809 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Calling method '.version_select at 0x7f900a0590d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.399797 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f74ef684-4ae7-4bf4-b463-2bc90149c809 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f74ef684-4ae7-4bf4-b463-2bc90149c809 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.401764 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'nonexistent_hostname'} Oct 04 18:04:24.404127 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:24.411295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 18:04:24.412581 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f74ef684-4ae7-4bf4-b463-2bc90149c809 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.413795 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f74ef684-4ae7-4bf4-b463-2bc90149c809 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041507 Oct 04 18:04:24.415575 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 41/75] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:24.432344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba10a8ec-ce74-48b9-aa49-ae79397154c8 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Action: 'update', calling method: .version_select at 0x7f900a0d1d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba10a8ec-ce74-48b9-aa49-ae79397154c8 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-hosts/n-d-833090-21 HTTP/1.1 Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 51 Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.450476 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.452129 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.452986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.456442 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.458947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba10a8ec-ce74-48b9-aa49-ae79397154c8 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.461959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba10a8ec-ce74-48b9-aa49-ae79397154c8 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-833090-21" status: 400 len: 199 microversion: 2.1 time: 0.038396 Oct 04 18:04:24.468549 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 42/76] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 18:04:24 2022] PUT /compute/v2.1/os-hosts/n-d-833090-21 => generated 199 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:24.500574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8699ce8c-95ff-4be5-9446-00046065a417 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Action: 'update', calling method: .version_select at 0x7f900a059c10>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8699ce8c-95ff-4be5-9446-00046065a417 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-hosts/n-d-833090-21 HTTP/1.1 Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 51 Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.511363 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.512826 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.513800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.516555 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.517910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8699ce8c-95ff-4be5-9446-00046065a417 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.518379 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8699ce8c-95ff-4be5-9446-00046065a417 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-833090-21" status: 400 len: 189 microversion: 2.1 time: 0.046487 Oct 04 18:04:24.523773 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 43/77] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 18:04:24 2022] PUT /compute/v2.1/os-hosts/n-d-833090-21 => generated 189 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:24.534404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49608012-83ef-481f-b018-7451b955c38a tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Action: 'update', calling method: .version_select at 0x7f900a131a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.540803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49608012-83ef-481f-b018-7451b955c38a tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a096df8e2fb54e3fb3ed57c0275b4c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd7f9d6e7c6497eb0f9d587126c11bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49608012-83ef-481f-b018-7451b955c38a tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Request method failure captured: Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-hosts/n-d-833090-21 HTTP/1.1 Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 50 Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWhhbN7r_j6qWV3OXCazxO87XuPebuGhSw0QifZMCqzHTyLYRCchJFmHraHsbp5pY7VuBP-fMj3jr0E-uaQC_trnAa0-COXCMDq2YbYWhv5eYPT-cxYmq2eza1j5n7YgzxFCzRA1cL9X05o5Arl-v5MmIcJOQEjRC6GMVoFQWD5UCY Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:24.548242 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ddd7f9d6e7c6497eb0f9d587126c11bc"}]}] Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ddd7f9d6e7c6497eb0f9d587126c11bc Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-880151030 Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a096df8e2fb54e3fb3ed57c0275b4c94 Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-880151030-project Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:04:24.556902 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.558030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 18:04:24.559395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.560832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49608012-83ef-481f-b018-7451b955c38a tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.561218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49608012-83ef-481f-b018-7451b955c38a tempest-HostsAdminNegativeTestJSON-880151030 tempest-HostsAdminNegativeTestJSON-880151030-project] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-833090-21" status: 403 len: 111 microversion: 2.1 time: 0.031543 Oct 04 18:04:24.561936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 44/78] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 18:04:24 2022] PUT /compute/v2.1/os-hosts/n-d-833090-21 => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:24.578603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6fa16d0-449f-433b-a4a9-7b3f343e0e0d tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Action: 'update', calling method: .version_select at 0x7f900a07ec10>, body: {"status": null, "maintenance_mode": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6fa16d0-449f-433b-a4a9-7b3f343e0e0d tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-hosts/n-d-833090-21 HTTP/1.1 Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 42 Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.597760 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: {"status": null, "maintenance_mode": null} Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:04:24.598995 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-d-833090-21', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance: Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi None Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.599942 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.601751 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.602684 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:04:24.602684 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:04:24.602684 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 18:04:24.602684 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.604442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6fa16d0-449f-433b-a4a9-7b3f343e0e0d tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.610616 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6fa16d0-449f-433b-a4a9-7b3f343e0e0d tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-833090-21" status: 400 len: 127 microversion: 2.1 time: 0.038462 Oct 04 18:04:24.615563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 45/79] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 4 18:04:24 2022] PUT /compute/v2.1/os-hosts/n-d-833090-21 => generated 127 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:24.633100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Action: 'update', calling method: .version_select at 0x7f900a07ef70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:24.645362 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.hosts [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Enabling host nonexistent_hostname. Oct 04 18:04:24.673478 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Request method failure captured: Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 50 Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWl5TB_GCtwc_XzdGDxsM2-SkzcuG0VzCXsqbdRM1qcuED9mWcjbxHqASpbPDgteNCauZTFo8JpFXHrZFre9CyeLUEybniL-JU5w1E1kTZw-IUCiaXUgTzaLsL5WuwKfriigAUS4fdVfRGYXH_aFfK5Q-Il2Dt-UZV9mOLqP5xNKgI Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:24.683257 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb8b8ddd57ad4c50a6a5effdba38ed2b"}]}] Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb8b8ddd57ad4c50a6a5effdba38ed2b Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-611316534 Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c38d8624bd1042c0a447e6781f13d2ff Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HostsAdminNegativeTestJSON-611316534-project-admin Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.684398 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:24.685121 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:24.691616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:24.692729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:24.693525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f017a4e1-6ac2-4ce5-ba5e-3a3e8ec8b875 tempest-HostsAdminNegativeTestJSON-611316534 tempest-HostsAdminNegativeTestJSON-611316534-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066750 Oct 04 18:04:24.693525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 46/80] 10.222.0.40 () {60 vars in 1211 bytes} [Tue Oct 4 18:04:24 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:24.879994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.900543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ccd46544-e338-47be-be2e-fbee5c93721e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 1.249622 Oct 04 18:04:24.903492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 35/81] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:26.350706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0703db7d-2bcc-4e7e-87e0-c5b237b1a8f0 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Action: 'create', calling method: .version_select at 0x7f900a131d30>, body: {"keypair": {"name": "tempest-keypair-1110712955", "type": "ssh", "user_id": "ce91ba73efc34e75bb89987df92ba357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwgAnZLe94QjGFL4O7Mrm197F1DaIWbcxP2lDxOpwtGZySJaIgtiFP6a1P3awnjMq5oN8Ueaf4F4NotD24zn6swwTr4k9zof3n+UINkP1rIA4KrDrg3W1Xvemw9ECTA3w=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:26.425578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0703db7d-2bcc-4e7e-87e0-c5b237b1a8f0 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:26.442798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0703db7d-2bcc-4e7e-87e0-c5b237b1a8f0 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for user cf06204aab764cafbbac5336cdf9839e and project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:26.578770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0703db7d-2bcc-4e7e-87e0-c5b237b1a8f0 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 1.442943 Oct 04 18:04:26.580859 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 47/82] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:04:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1446 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:04:26.592235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.593514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.610327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.611381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.612103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.613582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.614985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.616281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.651197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:26.837110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f900a358820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.853007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.853007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.853007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.853007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.853700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.853700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.919359 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9256757-4b52-47d3-821c-ccab74f27f7c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.003213 Oct 04 18:04:26.932016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 36/83] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:26.941546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51198ea0-ec30-46ae-9322-6b54c21d2844 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Action: 'create', calling method: .version_select at 0x7f900a3d99d0>, body: {"keypair": {"name": "tempest-keypair-1381220864", "type": "ssh", "user_id": "ce91ba73efc34e75bb89987df92ba357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmCK8//C93I3GeKINPE9sMH1iti53hUiPKRk7GwnROBhhbcg4f4frKJTNgFLKcyGELagYhZCuH3vpqPl9aFbiJ6Hhvl78q0h+dcjJlOKAPz+Bj3XU4rd0FHVGL88V7VIw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:26.978267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-51198ea0-ec30-46ae-9322-6b54c21d2844 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:26.985091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-51198ea0-ec30-46ae-9322-6b54c21d2844 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for user cf06204aab764cafbbac5336cdf9839e and project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:27.166138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51198ea0-ec30-46ae-9322-6b54c21d2844 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.231802 Oct 04 18:04:27.171561 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 37/84] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:04:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:04:27.178218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f900a36b310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.198385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.219219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.219710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.223569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.228570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.229263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.231731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.242349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa831e1b-75eb-4ca6-82b0-eed09d400a8c tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.657982 Oct 04 18:04:27.246752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 48/85] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.291365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-792565c8-de1c-4c6c-ae00-3c0c32a35be9 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.122522 Oct 04 18:04:27.295947 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 38/86] 10.222.0.40 () {58 vars in 1139 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:27.323128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ab7b505-33f8-496b-b73e-ca83ef5a5087 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Calling method '.version_select at 0x7f900a2f3670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.362348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ab7b505-33f8-496b-b73e-ca83ef5a5087 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1110712955?user_id=ce91ba73efc34e75bb89987df92ba357" status: 200 len: 512 microversion: 2.10 time: 0.061031 Oct 04 18:04:27.362348 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 39/87] 10.222.0.40 () {60 vars in 1340 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1110712955?user_id=ce91ba73efc34e75bb89987df92ba357 => generated 512 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:27.366963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f900a2f3700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.372836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.374162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.375127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.376724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.377577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.378386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.411421 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36886ecf-d70d-47e1-a258-93fce20b2a3c tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.050725 Oct 04 18:04:27.413484 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 40/88] 10.222.0.40 () {58 vars in 1145 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:27.429974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a9b27f6-0c0e-4534-92e1-32e3ec28839a tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Action: 'create', calling method: .version_select at 0x7f900a3d9ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1409377971", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2D8U+8o6XZ4G6GLk+DL1SMYKkuq+HC2hz3LoWoCqd5paz//LLh7Pc0GgAfCmNysMoE5Chh38hQ4jC0EZfAssEDr1znGFrRxQLFJYxkLQbPAz7mq9SjL0AFKeSRk0JMzA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:27.456537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1a9b27f6-0c0e-4534-92e1-32e3ec28839a tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:27.487788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1a9b27f6-0c0e-4534-92e1-32e3ec28839a tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Getting quotas for user cf06204aab764cafbbac5336cdf9839e and project 1faf5a8220c84a37b2ac4735530d02c3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:27.622542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a9b27f6-0c0e-4534-92e1-32e3ec28839a tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.206574 Oct 04 18:04:27.623202 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 41/89] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:04:27 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:04:27.638009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3398741-ee1f-4fc4-a320-47a097dab01c tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Calling method '.version_select at 0x7f900a2f3b80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.688866 n-d-833090-21 devstack@n-api.service[123886]: WARNING oslo_db.sqlalchemy.utils [None req-b3398741-ee1f-4fc4-a320-47a097dab01c tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:04:27.727907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3398741-ee1f-4fc4-a320-47a097dab01c tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs?user_id=ce91ba73efc34e75bb89987df92ba357" status: 200 len: 726 microversion: 2.10 time: 0.087809 Oct 04 18:04:27.732535 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 42/90] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/os-keypairs?user_id=ce91ba73efc34e75bb89987df92ba357 => generated 726 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:27.757114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-254c8d58-7ba4-43ca-804f-17ae543c0ab4 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Calling method '.version_select at 0x7f900a316d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.871838 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-254c8d58-7ba4-43ca-804f-17ae543c0ab4 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1409377971" status: 204 len: 0 microversion: 2.10 time: 0.130684 Oct 04 18:04:27.872972 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 43/91] 10.222.0.40 () {60 vars in 1325 bytes} [Tue Oct 4 18:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1409377971 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:04:27.885143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07123135-19d1-4bbc-8051-f917fdd92b70 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Calling method '.version_select at 0x7f900a3cbe50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.912458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c7a77f-8a68-4ade-bf93-b64df26b54ee", "tag": "962536ee-06c4-4ab8-8661-c543daa62894"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:27.955137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.959872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.960422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.986928 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Creating event network-changed:962536ee-06c4-4ab8-8661-c543daa62894 for instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee on n-h1-833090-21 Oct 04 18:04:27.987936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:27.988651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c213070c-02e2-4041-9c91-e7ad139ee467 req-20c10525-bc03-4b97-8f6a-00db408405f7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:27.990187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.997411 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07123135-19d1-4bbc-8051-f917fdd92b70 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381220864?user_id=ce91ba73efc34e75bb89987df92ba357" status: 204 len: 0 microversion: 2.10 time: 0.119674 Oct 04 18:04:27.999677 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 44/92] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381220864?user_id=ce91ba73efc34e75bb89987df92ba357 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:28.000679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.001406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.002460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.003200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.003847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.012667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-051851ae-1956-4a88-a0c9-a8952403a7f6 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] Calling method '.version_select at 0x7f900a316430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.044398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:28.045026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.rpcapi [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:04:28.047455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] Releasing lock "compute-rpcapi-router" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:28.074787 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73b88053-00aa-4a4f-be10-e0112322bce0 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.826046 Oct 04 18:04:28.076034 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 49/93] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:28.106731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-051851ae-1956-4a88-a0c9-a8952403a7f6 tempest-KeyPairsV210TestJSON-1546181018 tempest-KeyPairsV210TestJSON-1546181018-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110712955?user_id=ce91ba73efc34e75bb89987df92ba357" status: 204 len: 0 microversion: 2.10 time: 0.100785 Oct 04 18:04:28.111296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 45/94] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110712955?user_id=ce91ba73efc34e75bb89987df92ba357 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:28.274207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.275038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.302108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.302606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.303115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.314693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.315528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.324245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.931992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.945277 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-335d6170-cc36-402d-91c0-016bb66de80f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.674479 Oct 04 18:04:28.945914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 50/95] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:29.974505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:29.975123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:29.999390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.003217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.004297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.014426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.016710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.017564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.763804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.774555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.802206 Oct 04 18:04:30.774555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 46/96] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:29 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.820718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.824760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.844495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.845240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.845813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.846549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.847012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.847491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.493800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.519430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36de3dd4-2353-4cd3-ba91-1af751e53197 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.708018 Oct 04 18:04:32.530225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 51/97] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.119173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.121858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a052ae3f-5fd9-4991-a818-8433fd3c8208 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003700 Oct 04 18:04:33.122406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 47/98] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:04:33.536815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.537510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.553564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.556947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.557807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.559844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.561597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.562851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.953134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.981575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e112ed55-29db-4b48-acd2-da55ef68dd79 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.448883 Oct 04 18:04:34.004143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 52/99] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:35.032385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.033257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.043492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.044046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.044525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.045295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.045795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.046254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.218823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.218823 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12195e45-dc82-4ab0-8b5b-c06d4556732a tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.182890 Oct 04 18:04:35.218823 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 48/100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.245526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.247409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.261229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.263088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.264932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.270232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.270232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.271677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.285195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=71 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:36.492045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:36.613459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.625098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0885a5c1-1e1d-46b7-9e68-f5787de05072 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.383555 Oct 04 18:04:36.641830 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 53/101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:37.394071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:37.499210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:37.857289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd7f3dfe-d384-4ecf-a152-54546f955e8b tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-475272497", "id": 2125860645, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:37.961917 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd7f3dfe-d384-4ecf-a152-54546f955e8b tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.573370 Oct 04 18:04:37.963315 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 49/102] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:04:37 2022] POST /compute/v2.1/flavors => generated 470 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:37.971007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.972105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.981138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.981985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.982649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.983685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.984902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.985555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.992424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=37 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:38.046589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3541b1c1-c89f-4b51-8c6d-aea4a4ec8f11 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.051605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:38.070944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3541b1c1-c89f-4b51-8c6d-aea4a4ec8f11 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.561157 Oct 04 18:04:38.086553 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 54/103] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:38.092051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4bbb9ee-0962-4e3c-860b-13dbe2eaffd4 tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.250001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.259969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e94258e-940a-40a4-9fce-13448b84ce41 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.294990 Oct 04 18:04:38.265710 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 50/104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.432554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4bbb9ee-0962-4e3c-860b-13dbe2eaffd4 tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/2125860645/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.343035 Oct 04 18:04:38.433207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 55/105] 10.222.0.40 () {62 vars in 1265 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/flavors/2125860645/os-extra_specs => generated 62 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.450300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1ce21e4-bd99-45bf-a91d-a52f8bba6ff6 tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.586358 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1ce21e4-bd99-45bf-a91d-a52f8bba6ff6 tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2125860645" status: 202 len: 0 microversion: 2.86 time: 0.145257 Oct 04 18:04:38.590952 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 56/106] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 4 18:04:38 2022] DELETE /compute/v2.1/flavors/2125860645 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:04:38.597623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce1d8e32-1cbd-44fc-966b-cfcd60210d8a tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.620771 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce1d8e32-1cbd-44fc-966b-cfcd60210d8a tempest-FlavorMetadataValidation-1499783800 tempest-FlavorMetadataValidation-1499783800-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.026967 Oct 04 18:04:38.621374 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 57/107] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:38.658305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d0f5ab8-0867-42df-8543-bfbb6f13ae71 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-38497638", "id": 432728042, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.735212 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d0f5ab8-0867-42df-8543-bfbb6f13ae71 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.459425 Oct 04 18:04:38.735917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 51/108] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/flavors => generated 420 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:38.748247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0920611e-1084-44ee-852e-95c334c3f1ca tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.758153 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0920611e-1084-44ee-852e-95c334c3f1ca tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011481 Oct 04 18:04:38.758153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 58/109] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:38.767304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a86428c-605a-49ae-8cf3-668a67f96946 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1369862219", "id": 1690840264, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.850206 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a86428c-605a-49ae-8cf3-668a67f96946 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.087363 Oct 04 18:04:38.850995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 52/110] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:38.863001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b30336be-9445-4f5c-aa23-58e66c27d851 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.874576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b30336be-9445-4f5c-aa23-58e66c27d851 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015459 Oct 04 18:04:38.875166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 59/111] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:04:38.900415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62e70abc-7244-4ad1-9428-6b8f1a7776ed tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Action: 'create', calling method: .version_select at 0x7f900a2983a0>, body: {"keypair": {"name": "tempest-keypair-1829553481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVZ84w/HSLfofJhG9WcvRT2/GeFeQM77jVBakIm9eqlsFIUFMt8aJjoVsB97N3s2EPFvP8H1QTqYPDebBbSNiHPdev1xUJaf3r55aWp3nFV4eV9R2k0SrGOkpcDgfcIYg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:38.925065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-62e70abc-7244-4ad1-9428-6b8f1a7776ed tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for project fedc406ff3744145837933a196352fff. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:38.931342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-62e70abc-7244-4ad1-9428-6b8f1a7776ed tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for user 447d091b94834e6188a45ba773e4477d and project fedc406ff3744145837933a196352fff. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:39.005183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62e70abc-7244-4ad1-9428-6b8f1a7776ed tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109580 Oct 04 18:04:39.005976 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 53/112] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:39.287122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.287830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.297894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.297894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.298372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.299379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.300048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.300681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.515669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.528517 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85ec14cd-041e-4692-86e5-b15e49b66258 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.245948 Oct 04 18:04:39.529118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 54/113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:39.580223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Calling method '.version_select at 0x7f900a032160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.583449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.584212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.584992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.616506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.617857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.622764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.652798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.653600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.654227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.669372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab6a1972-f2c8-4e2a-a686-a84d85c2776c tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.615849 Oct 04 18:04:39.672481 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 60/114] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:39.692193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Calling method '.version_select at 0x7f900a3cb820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.704480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123886) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 18:04:39.706310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.707251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.710230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.753069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.753659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.754549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.860587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.861296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.862008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.873219 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93426113-d934-46a1-8c7d-25804374d127 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-833090-21/servers" status: 200 len: 197 microversion: 2.1 time: 0.193860 Oct 04 18:04:39.874554 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 55/115] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-21/servers => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:39.887537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Calling method '.version_select at 0x7f900a082ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.889365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.894905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.894905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.906523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:39.911950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.912441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.912877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.926000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.926532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.926965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.935160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-256044f2-c390-4962-a5f8-c3aa33365969 tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.052023 Oct 04 18:04:39.936164 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 61/116] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:39.949904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Calling method '.version_select at 0x7f900a316280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.951998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.952712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.953398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.969650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.971089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.972148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.982228 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e3bf566-b813-431b-a97d-12b300fd1f0f tempest-HypervisorAdminUnderV252Test-1990833867 tempest-HypervisorAdminUnderV252Test-1990833867-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-833090-21/search" status: 200 len: 105 microversion: 2.1 time: 0.038546 Oct 04 18:04:39.983881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 56/117] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-21/search => generated 105 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:40.552750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.553479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.560605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.561214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.561754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.562611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.563146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.563727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.764946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.810502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e51fde2-def6-47cf-a09a-8053dc3f4c9e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.262323 Oct 04 18:04:40.817708 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 57/118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:40.850133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8cd97a4-dcb5-42af-94da-e330b59e1625 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] Calling method '.version_select at 0x7f900a0543a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.888982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8cd97a4-dcb5-42af-94da-e330b59e1625 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.744675 Oct 04 18:04:40.889785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 62/119] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:40.902066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e675cd9-d6f7-4996-baa9-e8a8f4211c41 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] Action: 'update', calling method: .version_select at 0x7f900a3169d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:41.841317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.841947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.849212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.849719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.850140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.850879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.857160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.864923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.049569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.061420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84ad995d-c119-45d6-a198-b340d63e2283 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.224297 Oct 04 18:04:42.068741 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 63/120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:42.315102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=72,nova_api:INSERT=15,nova_api:UPDATE=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:42.452378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e675cd9-d6f7-4996-baa9-e8a8f4211c41 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.553681 Oct 04 18:04:42.465544 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 58/121] 10.222.0.40 () {60 vars in 1206 bytes} [Tue Oct 4 18:04:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:42.469383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1dfc42c-49a5-4e9d-a75d-e4a67635929b tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] Calling method '.version_select at 0x7f900a131dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.496051 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1dfc42c-49a5-4e9d-a75d-e4a67635929b tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029192 Oct 04 18:04:42.504918 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 64/122] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:42.511087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5534ff36-ff07-4c66-858d-598b1876fda1 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] Action: 'update', calling method: .version_select at 0x7f900a2f3550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.612461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c7a77f-8a68-4ade-bf93-b64df26b54ee", "name": "network-vif-plugged", "status": "completed", "tag": "962536ee-06c4-4ab8-8661-c543daa62894"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:42.626171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.626646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.627073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.647754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] Creating event network-vif-plugged:962536ee-06c4-4ab8-8661-c543daa62894 for instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee on n-h1-833090-21 Oct 04 18:04:42.647754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ffd89c40-5086-48c5-847a-b703789f689a req-fcc1ea2b-ea22-4281-9839-0fd504fca44f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109336 Oct 04 18:04:42.647754 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 65/123] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:42.848848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-395857636", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "1690840264", "adminPass": "***", "networks": [{"uuid": "4db24dda-d1df-423d-b4e8-7ba3a23d704a"}], "security_groups": [{"name": "tempest-securitygroup--978806416"}], "key_name": "tempest-keypair-1829553481", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:43.004295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] validate_networks() for [('4db24dda-d1df-423d-b4e8-7ba3a23d704a', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:43.674880 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5534ff36-ff07-4c66-858d-598b1876fda1 tempest-QuotaClassesAdminTestJSON-1996978926 tempest-QuotaClassesAdminTestJSON-1996978926-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.168103 Oct 04 18:04:43.683696 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 59/124] 10.222.0.40 () {60 vars in 1206 bytes} [Tue Oct 4 18:04:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:43.683696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.683696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.687021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.689445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.689445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.689445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.689445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.689740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.835590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.844365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b41e3e27-1289-4129-bd1b-1df60134bd3e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.167606 Oct 04 18:04:43.860347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 60/125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.964480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:43.965024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:43.965620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:43.966181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:43.966692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:43.977580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.978052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.978475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.979181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.979661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.980073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.005326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for project fedc406ff3744145837933a196352fff. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:44.010701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for user 447d091b94834e6188a45ba773e4477d and project fedc406ff3744145837933a196352fff. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:44.025364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:44.028239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:44.131435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-003e19ce-d608-44cf-a4ac-f9d664c37b76 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.288577 Oct 04 18:04:44.132086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 66/126] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:04:44.150554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ee1cfcb-ab93-4bc7-a8f9-823ab5a2feea tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.150554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2ee1cfcb-ab93-4bc7-a8f9-823ab5a2feea tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.234240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ee1cfcb-ab93-4bc7-a8f9-823ab5a2feea tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.252080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ee1cfcb-ab93-4bc7-a8f9-823ab5a2feea tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1264 microversion: 2.1 time: 0.111974 Oct 04 18:04:44.269406 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 67/127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:44.413513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Calling method '.version_select at 0x7f900a241790>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.416897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.417363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.418131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.442696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.443341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.443979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.456527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.457515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.458850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.471655 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c6493012-644d-435f-990d-247b0a294eaf tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.622023 Oct 04 18:04:44.472442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 61/128] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:44.776461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aab2f901-8f12-4ca7-a70e-82b4132c078a tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Calling method '.version_select at 0x7f900a054700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.778887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aab2f901-8f12-4ca7-a70e-82b4132c078a tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'c7bc4e94e4b54ecf89a0e5579bfc0f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2135fc472af84f5498c2ae32f395c220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aab2f901-8f12-4ca7-a70e-82b4132c078a tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Request method failure captured: Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/n-h1-833090-21/search HTTP/1.1 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW57OjfrKo0ELUnYp9RHfH9tYULoqspctI2W7vNUpSFAKmpjiieLB8ReuE9zxwkzTQTrqI5-PIQmZVUh962vOX99MnDD16bSqI_zNa7t41OivCdvh4DAMd7WQJ0qpnytE7Tt1-oRcEClA4V2DZeJoa9UJDIAHQSRdl3LNwyZaMRMpg Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2135fc472af84f5498c2ae32f395c220 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:44.782779 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2135fc472af84f5498c2ae32f395c220"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2135fc472af84f5498c2ae32f395c220"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2135fc472af84f5498c2ae32f395c220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2135fc472af84f5498c2ae32f395c220"}]}] Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2135fc472af84f5498c2ae32f395c220 Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c7bc4e94e4b54ecf89a0e5579bfc0f32 Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:04:44.785225 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'n-h1-833090-21'} Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:44.786171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 18:04:44.787637 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.790819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aab2f901-8f12-4ca7-a70e-82b4132c078a tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:44.791743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aab2f901-8f12-4ca7-a70e-82b4132c078a tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h1-833090-21/search" status: 403 len: 117 microversion: 2.1 time: 0.311220 Oct 04 18:04:44.792687 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 68/129] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-21/search => generated 117 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:44.803751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Calling method '.version_select at 0x7f900a2413a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.805945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.806888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.807900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.817339 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Request method failure captured: Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHW7-crRdLRRBQ4upapI5UzFQHnae69lmkVyky6IWBQ5uTDOlYTnfniBygRquPgPg_AhMWv0YlmUaX2zb29DSdbMlQQlwTkZfYrJGMxiPZYml_aXWf8Val9AZMv9mN4YJLz_8fqvXu3U1ysVDNCUjB3aXg-MA1IQJBucsYS5_IKBt-Y Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a290d8c307dc44dfa95a92b92bbb12b6 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:44.820771 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a290d8c307dc44dfa95a92b92bbb12b6"}]}] Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a290d8c307dc44dfa95a92b92bbb12b6 Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 1029172f958d46b9b09bf1fc60786e54 Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:04:44.823367 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:44.824156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:44.825408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:44.827269 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba4b6ed2-48a4-4b3b-9b09-7857b31b621d tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.028455 Oct 04 18:04:44.828248 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 62/130] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:44.855712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Calling method '.version_select at 0x7f9009fba160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.868576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.869479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.870223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.870340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.871020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.882435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.882968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.883426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.884605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.886247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.887197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.917668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.918470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.919231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.942723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.943916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.944542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.957794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd9b83a2-ddea-45d4-a44d-ac8c012a8cb4 tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.120480 Oct 04 18:04:44.963645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 69/131] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:44.979378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5daaf54c-bcb3-4bc5-bdfe-070a520bd422 tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Calling method '.version_select at 0x7f900a0468b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.988146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5daaf54c-bcb3-4bc5-bdfe-070a520bd422 tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'c7bc4e94e4b54ecf89a0e5579bfc0f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2135fc472af84f5498c2ae32f395c220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5daaf54c-bcb3-4bc5-bdfe-070a520bd422 tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Request method failure captured: Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW57OjfrKo0ELUnYp9RHfH9tYULoqspctI2W7vNUpSFAKmpjiieLB8ReuE9zxwkzTQTrqI5-PIQmZVUh962vOX99MnDD16bSqI_zNa7t41OivCdvh4DAMd7WQJ0qpnytE7Tt1-oRcEClA4V2DZeJoa9UJDIAHQSRdl3LNwyZaMRMpg Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2135fc472af84f5498c2ae32f395c220 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:44.993317 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2135fc472af84f5498c2ae32f395c220"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2135fc472af84f5498c2ae32f395c220"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2135fc472af84f5498c2ae32f395c220"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2135fc472af84f5498c2ae32f395c220"}]}] Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2135fc472af84f5498c2ae32f395c220 Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932 Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c7bc4e94e4b54ecf89a0e5579bfc0f32 Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:04:45.002313 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1'} Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:45.003961 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 18:04:45.008068 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.013563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5daaf54c-bcb3-4bc5-bdfe-070a520bd422 tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:45.013563 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5daaf54c-bcb3-4bc5-bdfe-070a520bd422 tempest-HypervisorAdminNegativeUnderV252Test-1023994932 tempest-HypervisorAdminNegativeUnderV252Test-1023994932-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025484 Oct 04 18:04:45.013563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 70/132] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:45.019665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Calling method '.version_select at 0x7f9009f054c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.042033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.043139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.044109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.063522 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] HTTP exception thrown: No hypervisor matching '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6' could be found. Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Request method failure captured: Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6/servers HTTP/1.1 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW7-crRdLRRBQ4upapI5UzFQHnae69lmkVyky6IWBQ5uTDOlYTnfniBygRquPgPg_AhMWv0YlmUaX2zb29DSdbMlQQlwTkZfYrJGMxiPZYml_aXWf8Val9AZMv9mN4YJLz_8fqvXu3U1ysVDNCUjB3aXg-MA1IQJBucsYS5_IKBt-Y Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a290d8c307dc44dfa95a92b92bbb12b6 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:45.066602 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a290d8c307dc44dfa95a92b92bbb12b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a290d8c307dc44dfa95a92b92bbb12b6"}]}] Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a290d8c307dc44dfa95a92b92bbb12b6 Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903 Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 1029172f958d46b9b09bf1fc60786e54 Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: exception: No hypervisor matching '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6' could be found. Oct 04 18:04:45.067997 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6'} Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6' could be found. Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.068818 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6' could be found. Oct 04 18:04:45.069976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:45.071337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] Returning 404 to user: No hypervisor matching '7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6' could be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:45.072353 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52c2921e-29b3-4ce7-af02-53dd3c064fed tempest-HypervisorAdminNegativeUnderV252Test-249473903 tempest-HypervisorAdminNegativeUnderV252Test-249473903-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6/servers" status: 404 len: 123 microversion: 2.1 time: 0.060091 Oct 04 18:04:45.073450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 71/133] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/os-hypervisors/7ac6d52a-649c-4dd0-8aa4-2f71d0be0ed6/servers => generated 123 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:45.154555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.163274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae2434f8-7a20-4442-93f2-9afeab1be510 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1339 microversion: 2.1 time: 0.297880 Oct 04 18:04:45.163963 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 63/134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1339 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:45.280461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4019f384-957a-417c-96d5-e1e92e927cd2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.281820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4019f384-957a-417c-96d5-e1e92e927cd2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.344976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4019f384-957a-417c-96d5-e1e92e927cd2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.354040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4019f384-957a-417c-96d5-e1e92e927cd2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1264 microversion: 2.1 time: 0.078770 Oct 04 18:04:45.370665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 72/135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1264 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.187050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.187798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.195834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.196119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.196766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.197136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.197598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.198200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.381448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.381892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.389800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.390552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.391174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.392645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.394566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.395176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.402232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.415151 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ef76b4c-36b0-4140-ac1c-90e2939655d0 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1488 microversion: 2.1 time: 0.232349 Oct 04 18:04:46.416252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 64/136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.446475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.447099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.459324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.459885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.460521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.462079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.464801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.465402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.585048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.592785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-128accc9-f536-46af-8260-39cce1eeed6f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1268 microversion: 2.1 time: 0.218380 Oct 04 18:04:46.593370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 73/137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:47.099364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50843a74-63e5-4c98-98f2-87455c514435 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Calling method '.version_select at 0x7f9009f0eaf0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.099364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50843a74-63e5-4c98-98f2-87455c514435 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '3034494631d94036bba0b576b399cf01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5d3c418184d7ca740d69f7651303b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50843a74-63e5-4c98-98f2-87455c514435 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Request method failure captured: Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW9afyLr-y4BbLdzKtxTh6jHvy7-FLUTv-obKlsWz9F0wKOHg3mMVOfxJQolbGFfrOZ6ns9UbbmSDdQ1n_1HC3RCR5FvlzepYauzQHRQ4OwgRxFYMo2I5KM01N3CPY20UxZOqi3o0l-M_zcSGPOns0dye_pc3QZa_ZIsyRCrk05OrM Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:47.100871 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67e5d3c418184d7ca740d69f7651303b"}]}] Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 3034494631d94036bba0b576b399cf01 Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:04:47.102268 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:47.103065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 18:04:47.104117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.105086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50843a74-63e5-4c98-98f2-87455c514435 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.105086 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50843a74-63e5-4c98-98f2-87455c514435 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.335849 Oct 04 18:04:47.105086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 74/138] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.112823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a12d9838-9744-40c5-a805-9dfece12af43 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Calling method '.version_select at 0x7f9009f0e3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.114720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a12d9838-9744-40c5-a805-9dfece12af43 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '3034494631d94036bba0b576b399cf01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5d3c418184d7ca740d69f7651303b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a12d9838-9744-40c5-a805-9dfece12af43 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Request method failure captured: Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW9afyLr-y4BbLdzKtxTh6jHvy7-FLUTv-obKlsWz9F0wKOHg3mMVOfxJQolbGFfrOZ6ns9UbbmSDdQ1n_1HC3RCR5FvlzepYauzQHRQ4OwgRxFYMo2I5KM01N3CPY20UxZOqi3o0l-M_zcSGPOns0dye_pc3QZa_ZIsyRCrk05OrM Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:47.116449 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67e5d3c418184d7ca740d69f7651303b"}]}] Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 3034494631d94036bba0b576b399cf01 Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:04:47.118203 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:47.119136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 18:04:47.120257 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.121231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a12d9838-9744-40c5-a805-9dfece12af43 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.121231 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a12d9838-9744-40c5-a805-9dfece12af43 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009917 Oct 04 18:04:47.121231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 75/139] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.128687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4114e3ef-ec5e-4f4a-8ee6-5c0a5cb2eb07 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Calling method '.version_select at 0x7f9009f0ed30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.130834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4114e3ef-ec5e-4f4a-8ee6-5c0a5cb2eb07 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '3034494631d94036bba0b576b399cf01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5d3c418184d7ca740d69f7651303b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4114e3ef-ec5e-4f4a-8ee6-5c0a5cb2eb07 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Request method failure captured: Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW9afyLr-y4BbLdzKtxTh6jHvy7-FLUTv-obKlsWz9F0wKOHg3mMVOfxJQolbGFfrOZ6ns9UbbmSDdQ1n_1HC3RCR5FvlzepYauzQHRQ4OwgRxFYMo2I5KM01N3CPY20UxZOqi3o0l-M_zcSGPOns0dye_pc3QZa_ZIsyRCrk05OrM Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:47.132598 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67e5d3c418184d7ca740d69f7651303b"}]}] Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 3034494631d94036bba0b576b399cf01 Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:04:47.133961 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:47.134857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 18:04:47.140274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.141280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4114e3ef-ec5e-4f4a-8ee6-5c0a5cb2eb07 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.141280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4114e3ef-ec5e-4f4a-8ee6-5c0a5cb2eb07 tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010136 Oct 04 18:04:47.141280 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 76/140] 10.222.0.40 () {58 vars in 1179 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:47.233542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7f19bab-c4a0-4df1-94d1-d578a56f5479 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1641 microversion: 2.1 time: 0.786763 Oct 04 18:04:47.234169 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 65/141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1641 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.261306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.262166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.268885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.269380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.269972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.270817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.271276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.271743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.315323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:47.414699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Calling method '.version_select at 0x7f9009f0eee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.416802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.417468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.417907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.434203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.434693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.435308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.449101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.449587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.450019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.458175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78da922c-7127-4dc4-9562-9c57c1cae72a tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.313956 Oct 04 18:04:47.458768 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 77/142] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:47.471239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-584638ba-52a9-41b4-9879-bc3c6b1ccaae tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Calling method '.version_select at 0x7f9009f0ee50>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.473386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-584638ba-52a9-41b4-9879-bc3c6b1ccaae tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '3034494631d94036bba0b576b399cf01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5d3c418184d7ca740d69f7651303b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-584638ba-52a9-41b4-9879-bc3c6b1ccaae tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Request method failure captured: Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW9afyLr-y4BbLdzKtxTh6jHvy7-FLUTv-obKlsWz9F0wKOHg3mMVOfxJQolbGFfrOZ6ns9UbbmSDdQ1n_1HC3RCR5FvlzepYauzQHRQ4OwgRxFYMo2I5KM01N3CPY20UxZOqi3o0l-M_zcSGPOns0dye_pc3QZa_ZIsyRCrk05OrM Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:47.474965 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67e5d3c418184d7ca740d69f7651303b"}]}] Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 3034494631d94036bba0b576b399cf01 Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1'} Oct 04 18:04:47.476232 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:47.477036 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 18:04:47.478021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.478893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-584638ba-52a9-41b4-9879-bc3c6b1ccaae tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.478893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-584638ba-52a9-41b4-9879-bc3c6b1ccaae tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010350 Oct 04 18:04:47.478893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 78/143] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.486344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e8456c9-d187-4e48-8a8b-cfcbbda10caa tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Calling method '.version_select at 0x7f9009f05dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.488470 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-3e8456c9-d187-4e48-8a8b-cfcbbda10caa tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] HTTP exception thrown: Hypervisor with ID 'b936ab11-5a20-4a22-b07a-5e730c2456e0' could not be found. Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e8456c9-d187-4e48-8a8b-cfcbbda10caa tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Request method failure captured: Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/b936ab11-5a20-4a22-b07a-5e730c2456e0/uptime HTTP/1.1 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW-aWv3TEBbCGuZ_rZ_2cTha-KQcEP8d6yJlQ4Y0LbqUn_m1lR0wEACX8W4IqEdC9SiKesc7_ruWCy6pWMxiWv2eLyeXfXAVvRWcSiHqnnR0KvCfvS-4DtOmyVrhw0_aB32GCkRLfUyU74o9ka46yIfe3OKJPkrdpVwvvi1uz5OTGw Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1962f522417d4ff4835741fe2437c409 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:47.493742 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1962f522417d4ff4835741fe2437c409"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1962f522417d4ff4835741fe2437c409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1962f522417d4ff4835741fe2437c409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1962f522417d4ff4835741fe2437c409"}]}] Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1962f522417d4ff4835741fe2437c409 Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 00503252d0284db494c346867572b792 Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: exception: Hypervisor with ID 'b936ab11-5a20-4a22-b07a-5e730c2456e0' could not be found. Oct 04 18:04:47.495072 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b936ab11-5a20-4a22-b07a-5e730c2456e0'} Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b936ab11-5a20-4a22-b07a-5e730c2456e0' Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:04:47.496248 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b936ab11-5a20-4a22-b07a-5e730c2456e0' could not be found. Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.497682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b936ab11-5a20-4a22-b07a-5e730c2456e0' could not be found. Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e8456c9-d187-4e48-8a8b-cfcbbda10caa tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Returning 404 to user: Hypervisor with ID 'b936ab11-5a20-4a22-b07a-5e730c2456e0' could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3e8456c9-d187-4e48-8a8b-cfcbbda10caa tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/b936ab11-5a20-4a22-b07a-5e730c2456e0/uptime" status: 404 len: 123 microversion: 2.1 time: 0.012763 Oct 04 18:04:47.499002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 79/144] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors/b936ab11-5a20-4a22-b07a-5e730c2456e0/uptime => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.505644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Calling method '.version_select at 0x7f9009ea7160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.508306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.508588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.509027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.522754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.523232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.523712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.535149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.535720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.536203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.542622 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5eb92f10-623d-414a-87ab-18634e0debf2 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.041270 Oct 04 18:04:47.543211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 80/145] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:47.558700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-010322e2-348c-4307-a0fe-3f494d3096ea tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Calling method '.version_select at 0x7f9009f0eaf0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.561669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-010322e2-348c-4307-a0fe-3f494d3096ea tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '3034494631d94036bba0b576b399cf01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e5d3c418184d7ca740d69f7651303b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-010322e2-348c-4307-a0fe-3f494d3096ea tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Request method failure captured: Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW9afyLr-y4BbLdzKtxTh6jHvy7-FLUTv-obKlsWz9F0wKOHg3mMVOfxJQolbGFfrOZ6ns9UbbmSDdQ1n_1HC3RCR5FvlzepYauzQHRQ4OwgRxFYMo2I5KM01N3CPY20UxZOqi3o0l-M_zcSGPOns0dye_pc3QZa_ZIsyRCrk05OrM Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:04:47.565516 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/67e5d3c418184d7ca740d69f7651303b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/67e5d3c418184d7ca740d69f7651303b"}]}] Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 67e5d3c418184d7ca740d69f7651303b Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-248431376 Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 3034494631d94036bba0b576b399cf01 Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-248431376-project Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1'} Oct 04 18:04:47.566844 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:47.567543 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 18:04:47.569168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.571708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-010322e2-348c-4307-a0fe-3f494d3096ea tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.571708 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-010322e2-348c-4307-a0fe-3f494d3096ea tempest-HypervisorAdminNegativeTestJSON-248431376 tempest-HypervisorAdminNegativeTestJSON-248431376-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.012546 Oct 04 18:04:47.571708 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 81/146] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.576888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b89c770-31c8-448e-8021-dd56180b68b8 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Calling method '.version_select at 0x7f9009ea78b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.578456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9b89c770-31c8-448e-8021-dd56180b68b8 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] HTTP exception thrown: Hypervisor with ID '475c8fa6-9812-4834-88be-f49c5807d367' could not be found. Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b89c770-31c8-448e-8021-dd56180b68b8 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Request method failure captured: Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-hypervisors/475c8fa6-9812-4834-88be-f49c5807d367 HTTP/1.1 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHW-aWv3TEBbCGuZ_rZ_2cTha-KQcEP8d6yJlQ4Y0LbqUn_m1lR0wEACX8W4IqEdC9SiKesc7_ruWCy6pWMxiWv2eLyeXfXAVvRWcSiHqnnR0KvCfvS-4DtOmyVrhw0_aB32GCkRLfUyU74o9ka46yIfe3OKJPkrdpVwvvi1uz5OTGw Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1962f522417d4ff4835741fe2437c409 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:47.580120 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1962f522417d4ff4835741fe2437c409"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1962f522417d4ff4835741fe2437c409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1962f522417d4ff4835741fe2437c409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1962f522417d4ff4835741fe2437c409"}]}] Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1962f522417d4ff4835741fe2437c409 Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451496601 Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 00503252d0284db494c346867572b792 Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: exception: Hypervisor with ID '475c8fa6-9812-4834-88be-f49c5807d367' could not be found. Oct 04 18:04:47.581379 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '475c8fa6-9812-4834-88be-f49c5807d367'} Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '475c8fa6-9812-4834-88be-f49c5807d367' Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 18:04:47.582018 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:04:47.583233 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '475c8fa6-9812-4834-88be-f49c5807d367' could not be found. Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '475c8fa6-9812-4834-88be-f49c5807d367' could not be found. Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b89c770-31c8-448e-8021-dd56180b68b8 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] Returning 404 to user: Hypervisor with ID '475c8fa6-9812-4834-88be-f49c5807d367' could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b89c770-31c8-448e-8021-dd56180b68b8 tempest-HypervisorAdminNegativeTestJSON-451496601 tempest-HypervisorAdminNegativeTestJSON-451496601-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/475c8fa6-9812-4834-88be-f49c5807d367" status: 404 len: 123 microversion: 2.1 time: 0.009409 Oct 04 18:04:47.584926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 82/147] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/os-hypervisors/475c8fa6-9812-4834-88be-f49c5807d367 => generated 123 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:47.624935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.625631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.635177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.635735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.636175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.636892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.637353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.637840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.687908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "compute-rpcapi-router" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:04:47.688466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2f43a7-ccd1-463f-8422-4125d98df91e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquired lock "compute-rpcapi-router" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:04:47.690633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.691329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.691857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.692697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.693384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.694224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.713926 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.rpcapi [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 18:04:47.713926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] Releasing lock "compute-rpcapi-router" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:04:47.714098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.720559 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a3cda91-9254-4581-b56d-d6efb52b0fe0 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1324 microversion: 2.1 time: 0.100897 Oct 04 18:04:47.727043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 83/148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1324 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:47.872738 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9cb932d-b2b1-4521-bdad-a1691040c8e9 None None] 10.222.0.40 "DELETE /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 204 len: 0 microversion: 2.1 time: 0.614836 Oct 04 18:04:47.873462 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 66/149] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:47 2022] DELETE /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:04:47.881845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.882469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.898983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.899495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.899922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.900665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.901140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.901560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.183253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.193327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a90312b5-044e-4316-adba-230ee209f9c2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1494 microversion: 2.1 time: 0.315468 Oct 04 18:04:48.194409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 84/150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1494 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.748543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.749697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.762051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.763046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.765085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.766072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.766749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.767374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.863123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.875118 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9b049ca-d8af-460b-b9b0-a71aa2b116cb tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1322 microversion: 2.1 time: 0.132822 Oct 04 18:04:48.876661 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 67/151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1322 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.219626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.221664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.231976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.232514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.233137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.234252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.274787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.276599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.490692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Calling method '.version_select at 0x7f900a3d99d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.494608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.503610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.504015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:49.504644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.516280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e5bb9be-b13e-4bc4-93df-d5a5d829677f tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1494 microversion: 2.1 time: 0.303545 Oct 04 18:04:49.516809 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 85/152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1494 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:49.550950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.554477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.555214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.578649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.579440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.580478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.589208 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a52ae05-a4ef-4c9c-b53c-2f0fb5a6f59b tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.319279 Oct 04 18:04:49.590412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 68/153] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:04:49.604806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Calling method '.version_select at 0x7f9009ea7160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.607740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.608222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.608847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.639628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.640118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.640553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.653964 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6a0e2ed-94ed-4c8b-93ff-49bda388236d tempest-HypervisorAdminV228Test-802238543 tempest-HypervisorAdminV228Test-802238543-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.052835 Oct 04 18:04:49.654740 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 86/154] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:49.903974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.905200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.911763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.912436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.913023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.913912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.914345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.914774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.148108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.156994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e9a79bc-88f2-4c05-915a-f528b0a57660 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.257046 Oct 04 18:04:50.157582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 69/155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.382637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c7a77f-8a68-4ade-bf93-b64df26b54ee", "name": "network-vif-deleted", "tag": "962536ee-06c4-4ab8-8661-c543daa62894"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:50.401071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.404346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.404959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.419052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] Creating event network-vif-deleted:962536ee-06c4-4ab8-8661-c543daa62894 for instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee on n-h1-833090-21 Oct 04 18:04:50.429430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b2257381-b80e-4110-bdf4-108aa233b707 req-b92ab49c-2435-482f-a7b7-01ea4cba8a54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050585 Oct 04 18:04:50.430115 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 87/156] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:50.547563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.547563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.551898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.552501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.554487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.555441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.556038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.562176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.574465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:50.638430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc5f201fd874669a9240bbc8d58f1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9060741da54161b592c88621832842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.647037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48a0f2c6-4304-40ef-864b-5c6c997cb97e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 200 len: 1324 microversion: 2.1 time: 0.110058 Oct 04 18:04:50.647850 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 70/157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 1324 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.183202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.183998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.191376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.192170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.192641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.193335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.193978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.194711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.547261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.560326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b2eaecee-d7aa-482a-9966-5376279cb88e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.381710 Oct 04 18:04:51.560925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 88/158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.674155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.675453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.682441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.682961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.683401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.684129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.684585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.685015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.702046 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] HTTP exception thrown: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Request method failure captured: Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee HTTP/1.1 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWT1Ef9gQTr_lBbtcabQUWoPz_pX9DQA6uq1KNCJRPDnEjNf1G1jJ-S7plNrN31AKPw88rnTTWODaxQgFzkILnQqZRLsQDeXrEcRrIAM2wje8Dzv8GL_9SpzlC4T_Chlkk0OWzIy9ZGCm2N7McVgwKe2qvlMGIkPTMVVk3Fe9cq9V4 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db9060741da54161b592c88621832842 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:51.715583 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db9060741da54161b592c88621832842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db9060741da54161b592c88621832842"}]}] Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db9060741da54161b592c88621832842 Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bbc5f201fd874669a9240bbc8d58f1cd Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:04:51.717107 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a1c7a77f-8a68-4ade-bf93-b64df26b54ee'} Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:51.717889 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:04:51.719511 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:51.724935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Returning 404 to user: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:51.724935 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d56bd13c-69b6-433e-856c-8a73dfbec3a2 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 404 len: 111 microversion: 2.1 time: 0.050021 Oct 04 18:04:51.724935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 71/159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:51.728081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a97b6f38-017e-4999-96dd-9976428d3382 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:51.739285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a97b6f38-017e-4999-96dd-9976428d3382 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.740063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a97b6f38-017e-4999-96dd-9976428d3382 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.740637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a97b6f38-017e-4999-96dd-9976428d3382 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.983294 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a97b6f38-017e-4999-96dd-9976428d3382 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.259680 Oct 04 18:04:51.984109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 89/160] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:51.996162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1efd8eda-6f2d-403f-b144-3467bfe71aa6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.075983 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1efd8eda-6f2d-403f-b144-3467bfe71aa6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.083401 Oct 04 18:04:52.076831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 72/161] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:52.091789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a57f7d4-4045-4ec2-b68c-3501a871f266 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-17972756"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.118775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-4a57f7d4-4045-4ec2-b68c-3501a871f266 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 9eee08ee-77d8-4eb3-837d-13529aad3012 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:52.199634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a57f7d4-4045-4ec2-b68c-3501a871f266 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.111321 Oct 04 18:04:52.202157 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 90/162] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:52.211643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1402f5ed-a61c-40e5-8169-a1600dfec7e5 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.226293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1402f5ed-a61c-40e5-8169-a1600dfec7e5 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.226996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1402f5ed-a61c-40e5-8169-a1600dfec7e5 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.227575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1402f5ed-a61c-40e5-8169-a1600dfec7e5 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.585489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.586876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.593512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.594264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.596577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.596577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.618802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.619394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.818217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.834307 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e09b2abb-4422-4c78-9c25-143d472a7466 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.252784 Oct 04 18:04:52.835549 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 91/163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:53.417260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1402f5ed-a61c-40e5-8169-a1600dfec7e5 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 1.209332 Oct 04 18:04:53.417865 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 73/164] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:53.432338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9492371d-83f6-4342-a395-dd6071d881bc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.452150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9492371d-83f6-4342-a395-dd6071d881bc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.014740 Oct 04 18:04:53.452150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 92/165] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:53.458888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-638b98e0-d66a-426f-84ba-dccbe61f5d8e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:53.481176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-638b98e0-d66a-426f-84ba-dccbe61f5d8e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.481176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-638b98e0-d66a-426f-84ba-dccbe61f5d8e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.481176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-638b98e0-d66a-426f-84ba-dccbe61f5d8e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.672571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:53.860211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-638b98e0-d66a-426f-84ba-dccbe61f5d8e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.406780 Oct 04 18:04:53.861936 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 74/166] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:53 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:53.862557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.863848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.870256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.870666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.871139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.871826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.872355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.872695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.873460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c3c497e-21d8-431c-ad39-b15c961eeea3 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.982661 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c3c497e-21d8-431c-ad39-b15c961eeea3 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.113020 Oct 04 18:04:53.990530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 75/167] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:53 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:53.996738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6885a7b7-6a0f-45e7-bac9-b8971ac54a52 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1669097201"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:53.997842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:54.001409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-6885a7b7-6a0f-45e7-bac9-b8971ac54a52 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 565746ec-66d1-4b35-861a-cf5a7be7c692 for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:54.020091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.030205 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afca9b08-e7bd-4e10-a8f1-d24ef1df5d8e tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.176198 Oct 04 18:04:54.041501 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 93/168] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.116540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6885a7b7-6a0f-45e7-bac9-b8971ac54a52 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.121447 Oct 04 18:04:54.117981 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 76/169] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:54.129442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50c9b19b-77f4-4608-95ca-66932dc075d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.143182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c9b19b-77f4-4608-95ca-66932dc075d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.143962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c9b19b-77f4-4608-95ca-66932dc075d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.144619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c9b19b-77f4-4608-95ca-66932dc075d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.148649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:54.468001 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50c9b19b-77f4-4608-95ca-66932dc075d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.342596 Oct 04 18:04:54.473120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 94/170] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:54.480534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2285eed5-1459-4085-956f-afec12331648 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.488748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2285eed5-1459-4085-956f-afec12331648 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.012073 Oct 04 18:04:54.489240 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 95/171] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:54.501675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-113a0d4e-6399-494c-91e8-07fedcb8ecfc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.512585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113a0d4e-6399-494c-91e8-07fedcb8ecfc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:54.513064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113a0d4e-6399-494c-91e8-07fedcb8ecfc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:54.513496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113a0d4e-6399-494c-91e8-07fedcb8ecfc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.816626 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-113a0d4e-6399-494c-91e8-07fedcb8ecfc tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.319422 Oct 04 18:04:54.824100 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 96/172] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:54.824435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Action: 'update', calling method: .version_select at 0x7f900a0fc820>, body: {"quota_set": {"ram": "5120"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.829694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7c8354c-07ec-4a2f-abca-b1ed365d0d6b tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.835686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:54.930263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7c8354c-07ec-4a2f-abca-b1ed365d0d6b tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.104228 Oct 04 18:04:54.932609 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 97/173] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:54 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:54.948537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d9938f0-7f8a-42d5-b893-47979f79c4f7 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1301910072"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:54.951586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-5d9938f0-7f8a-42d5-b893-47979f79c4f7 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 515f6462-5aa7-40a3-aa84-d5358facfc87 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:55.078297 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d9938f0-7f8a-42d5-b893-47979f79c4f7 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.135324 Oct 04 18:04:55.079507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 98/174] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:55.084478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.085272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.093124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.093797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.094234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.094983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.095433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.095884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.173627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.174118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.174631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.175301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.175812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.176221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.231232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=13,nova_api:DELETE=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:55.288122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:55.297234 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df1880aa-5529-47cb-ae9c-933cbf8fa483 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.216444 Oct 04 18:04:55.298506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 99/175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.303883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3bb9ad3-3fd8-4d4c-8f95-7dcd1e078091 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:55.317158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3bb9ad3-3fd8-4d4c-8f95-7dcd1e078091 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.318042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3bb9ad3-3fd8-4d4c-8f95-7dcd1e078091 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.318839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3bb9ad3-3fd8-4d4c-8f95-7dcd1e078091 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.350032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:55.361114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25908ead-9d6b-4de8-b5a0-bf83cc082918 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e" status: 200 len: 148 microversion: 2.57 time: 0.971032 Oct 04 18:04:55.361844 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 77/176] 10.222.0.40 () {62 vars in 1303 bytes} [Tue Oct 4 18:04:54 2022] PUT /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e => generated 148 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:04:55.372506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Calling method '.version_select at 0x7f900a0db1f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.754160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3bb9ad3-3fd8-4d4c-8f95-7dcd1e078091 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.454294 Oct 04 18:04:55.755066 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 100/177] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:55.766547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1f27968-f023-493c-99e9-0d9c10c01160 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:55.777588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f27968-f023-493c-99e9-0d9c10c01160 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.778076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f27968-f023-493c-99e9-0d9c10c01160 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.778507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f27968-f023-493c-99e9-0d9c10c01160 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.010603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.011876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.012105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.012856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.013278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.016652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.049991 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-301c3a96-92eb-4067-84b7-4fd5c450985d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e/detail" status: 200 len: 463 microversion: 2.57 time: 0.681141 Oct 04 18:04:56.050604 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 78/178] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e/detail => generated 463 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:04:56.067390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1f27968-f023-493c-99e9-0d9c10c01160 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.304713 Oct 04 18:04:56.070510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 101/179] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:56.080597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a84bfa0d-9d6c-43d9-bc3e-8b58db2cbc95 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.202328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a84bfa0d-9d6c-43d9-bc3e-8b58db2cbc95 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.125701 Oct 04 18:04:56.206309 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 79/180] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:56.217469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e70d9b66-3d62-4ffd-bfde-8daaba81daa3 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2123960446"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.226270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8c50ea6-94c1-4faa-a3e9-8084a2e56a07 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1075828053"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.230414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-e8c50ea6-94c1-4faa-a3e9-8084a2e56a07 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 91a08440-d714-4f52-9630-68d27693d99d for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:56.231216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-e70d9b66-3d62-4ffd-bfde-8daaba81daa3 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 924a4b87-7735-460c-8464-7567ca128169 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:56.365247 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8c50ea6-94c1-4faa-a3e9-8084a2e56a07 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142609 Oct 04 18:04:56.366367 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 80/181] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:56.369628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e70d9b66-3d62-4ffd-bfde-8daaba81daa3 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.159189 Oct 04 18:04:56.376158 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 102/182] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:56.382648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e44b241-d8fc-4554-aab4-5ba7b8944914 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.385328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.388765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.396115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e44b241-d8fc-4554-aab4-5ba7b8944914 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.396993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e44b241-d8fc-4554-aab4-5ba7b8944914 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.397482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e44b241-d8fc-4554-aab4-5ba7b8944914 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.406177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.409048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.410327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.412540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.413854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.416744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.656530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.666300 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae793feb-ca95-4c96-8360-bd90bbabc82d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.298043 Oct 04 18:04:56.667046 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 81/183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.672021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee5e3027-6f79-4661-881e-1e7d2d011568 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.735838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e44b241-d8fc-4554-aab4-5ba7b8944914 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 243 microversion: 2.1 time: 0.357400 Oct 04 18:04:56.736427 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 103/184] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/os-aggregates/7/action => generated 243 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:56.834764 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee5e3027-6f79-4661-881e-1e7d2d011568 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.165181 Oct 04 18:04:56.835586 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 82/185] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:56.843420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Action: 'update', calling method: .version_select at 0x7f900a0fce50>, body: {"quota_set": {"ram": "2048"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.038084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-edecf0e5-1da2-47a2-af73-5f8212cecef7 tempest-InstanceUsageAuditLogTestJSON-484393706 tempest-InstanceUsageAuditLogTestJSON-484393706-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.062458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-edecf0e5-1da2-47a2-af73-5f8212cecef7 tempest-InstanceUsageAuditLogTestJSON-484393706 tempest-InstanceUsageAuditLogTestJSON-484393706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:04:56" status: 200 len: 318 microversion: 2.1 time: 0.324968 Oct 04 18:04:57.063046 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 104/186] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A04%3A56 => generated 318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:57.068265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.079766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.080434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.081088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.145630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-833090-21. Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 40 Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:57.151197 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: {"add_host": {"host": "n-h1-833090-21"}} Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:57.154546 n-d-833090-21 devstack@n-api.service[123887]: exception: Aggregate 7 already has host n-h1-833090-21. Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-833090-21'}}} Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:04:57.155291 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-833090-21-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:04:57.156389 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:04:57.158092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:04:57.160862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-833090-21-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 4, 57, 98633), 'updated_at': None, 'host': 'n-h1-833090-21', 'aggregate_id': 7}] Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.163118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-833090-21. Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.165590 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-833090-21. Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:57.169303 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-833090-21. Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-833090-21. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0ec96a4-75a8-43b7-aebf-182dd707ffdc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.088566 Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 105/187] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10606847-7bde-4055-9a83-7fbd3d32d26a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.171422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-10606847-7bde-4055-9a83-7fbd3d32d26a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10606847-7bde-4055-9a83-7fbd3d32d26a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Request method failure captured: Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWD0E0v7KIKPDSR9O2DXDYnVG2MnnTRc4u-Uo3g1z8xaGX-2fnDbp-VJCSqd_IpKc0nW1FG82nLKuKvGs1Aw1dAEd0f_B_OcStHauyLho45PRWMHtKv__k0ynQetDu4YGyR1tMEMCQY14ejw-qCpeuQnsFeScAWUJZfMTmiR-o6bg Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:57.172385 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5bf5c85dc694266b151d872bd9a17dc"}]}] Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec69676c29264f89a679d88ece49316c Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: exception: Aggregate 6 could not be found. Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6'} Oct 04 18:04:57.175679 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.180058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:04:57.182185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.186423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10606847-7bde-4055-9a83-7fbd3d32d26a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:57.186423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10606847-7bde-4055-9a83-7fbd3d32d26a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.016845 Oct 04 18:04:57.186423 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 106/188] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:57.186423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d543f2d7-b9f3-4ae7-aced-1cdc7b291605 tempest-InstanceUsageAuditLogTestJSON-484393706 tempest-InstanceUsageAuditLogTestJSON-484393706-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.198091 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d543f2d7-b9f3-4ae7-aced-1cdc7b291605 tempest-InstanceUsageAuditLogTestJSON-484393706 tempest-InstanceUsageAuditLogTestJSON-484393706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023027 Oct 04 18:04:57.199236 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 107/189] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:57.203697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ce33231-f48b-451e-8c45-53285d8f6e70 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.215745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ce33231-f48b-451e-8c45-53285d8f6e70 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.216346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ce33231-f48b-451e-8c45-53285d8f6e70 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.216837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ce33231-f48b-451e-8c45-53285d8f6e70 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.249841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.250379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.252406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.253871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.255160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.257737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.305022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.307133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.308553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.309332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.310641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.312703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.489469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4295d86-6009-4bda-a400-bc95fbfab207 tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e?user_id=6817321943a3400fbc83b6dbc510bfb3" status: 200 len: 148 microversion: 2.57 time: 0.651883 Oct 04 18:04:57.496507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 83/190] 10.222.0.40 () {62 vars in 1384 bytes} [Tue Oct 4 18:04:56 2022] PUT /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e?user_id=6817321943a3400fbc83b6dbc510bfb3 => generated 148 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:57.500560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1495b07-4dcd-4b66-9b4d-ccc6c8e384d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.524082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c1495b07-4dcd-4b66-9b4d-ccc6c8e384d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1495b07-4dcd-4b66-9b4d-ccc6c8e384d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Request method failure captured: Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWWD0E0v7KIKPDSR9O2DXDYnVG2MnnTRc4u-Uo3g1z8xaGX-2fnDbp-VJCSqd_IpKc0nW1FG82nLKuKvGs1Aw1dAEd0f_B_OcStHauyLho45PRWMHtKv__k0ynQetDu4YGyR1tMEMCQY14ejw-qCpeuQnsFeScAWUJZfMTmiR-o6bg Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:57.528617 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5bf5c85dc694266b151d872bd9a17dc"}]}] Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ec69676c29264f89a679d88ece49316c Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: exception: Aggregate 6 could not be found. Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6'} Oct 04 18:04:57.529855 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:57.530532 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:57.531801 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1495b07-4dcd-4b66-9b4d-ccc6c8e384d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1495b07-4dcd-4b66-9b4d-ccc6c8e384d6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.033732 Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 84/191] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:57.535664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7be6060b-b405-40a5-8f3b-4d03b09a957d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] Calling method '.version_select at 0x7f9009ff6430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.575078 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ce33231-f48b-451e-8c45-53285d8f6e70 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.374549 Oct 04 18:04:57.583083 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 108/192] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:57.588235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d635ab-ac98-463b-b96f-5a2b465da08a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-298430441", "name": "tempest-test_aggregate-1759504364"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.611346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-f7d635ab-ac98-463b-b96f-5a2b465da08a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid c044f688-c9f1-4b75-aa9e-8ec367562fb8 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:57.707752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d635ab-ac98-463b-b96f-5a2b465da08a tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.123061 Oct 04 18:04:57.716469 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 109/193] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 4 18:04:57 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:57.722267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2586c5c-b7d3-499d-925d-2eee5a41da92 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.834783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2586c5c-b7d3-499d-925d-2eee5a41da92 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.116764 Oct 04 18:04:57.835681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 110/194] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:57.850433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.851116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.861239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.861728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.862166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.862879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.863335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.863786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.137702 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7be6060b-b405-40a5-8f3b-4d03b09a957d tempest-QuotasAdminTestV257-1042093404 tempest-QuotasAdminTestV257-1042093404-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e?user_id=6817321943a3400fbc83b6dbc510bfb3" status: 200 len: 190 microversion: 2.57 time: 0.602774 Oct 04 18:04:58.138348 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 85/195] 10.222.0.40 () {60 vars in 1364 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/os-quota-sets/6dfbc48d73ac43cda0d0df00bf47923e?user_id=6817321943a3400fbc83b6dbc510bfb3 => generated 190 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:58.146601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-465cff1f-0adf-4927-afc6-4878bf452f66 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.260818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-465cff1f-0adf-4927-afc6-4878bf452f66 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.121335 Oct 04 18:04:58.266155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 86/196] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:58 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:58.275927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f9009ff6670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.284309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.284810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.285251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.287729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.289591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.290196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.347617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0eb5534b-c2de-436e-970f-342d80e019ff tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.078185 Oct 04 18:04:58.350479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 87/197] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.359678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28ec7e85-7ecb-497d-8b52-b1c5d758e6c0 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-744807082"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.368790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-28ec7e85-7ecb-497d-8b52-b1c5d758e6c0 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 6ee21f35-7afe-4e90-8b1c-388d73ebcdaa for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:58.406984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:58.416927 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8155ec72-51ef-4482-b40a-af6c10450ecc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.580098 Oct 04 18:04:58.417827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 111/198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:58.480075 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28ec7e85-7ecb-497d-8b52-b1c5d758e6c0 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.128227 Oct 04 18:04:58.481654 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 88/199] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.491373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53cbf4c8-38e6-4058-befd-9d0cf9397fc6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.500911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-53cbf4c8-38e6-4058-befd-9d0cf9397fc6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53cbf4c8-38e6-4058-befd-9d0cf9397fc6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Request method failure captured: Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWWD0E0v7KIKPDSR9O2DXDYnVG2MnnTRc4u-Uo3g1z8xaGX-2fnDbp-VJCSqd_IpKc0nW1FG82nLKuKvGs1Aw1dAEd0f_B_OcStHauyLho45PRWMHtKv__k0ynQetDu4YGyR1tMEMCQY14ejw-qCpeuQnsFeScAWUJZfMTmiR-o6bg Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:04:58.503239 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5bf5c85dc694266b151d872bd9a17dc"}]}] Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ec69676c29264f89a679d88ece49316c Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: exception: Aggregate 8 could not be found. Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '8'} Oct 04 18:04:58.504631 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.505337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 04 18:04:58.506316 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.508703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53cbf4c8-38e6-4058-befd-9d0cf9397fc6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:58.508703 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53cbf4c8-38e6-4058-befd-9d0cf9397fc6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.022734 Oct 04 18:04:58.508703 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 89/200] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:58.512421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f9009ff6f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.516308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.517002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.517860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.518757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.519390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.520384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.546057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9d1ebd4-cf91-4f58-8c6f-6033f11eed56 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.038602 Oct 04 18:04:58.546660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 90/201] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.706308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69", "tag": "7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.725547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.725547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.725547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.732009 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] Creating event network-changed:7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc for instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 on n-h2-833090-21 Oct 04 18:04:58.738392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b938a9bb-6c93-4929-9940-413002cd2375 req-859239b0-f8a2-450e-bfc7-7d9b23473568 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317781 Oct 04 18:04:58.739539 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 112/202] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.745920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0a40a76-0f15-42d6-82f5-66dca4a756f8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.759198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f0a40a76-0f15-42d6-82f5-66dca4a756f8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0a40a76-0f15-42d6-82f5-66dca4a756f8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Request method failure captured: Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWD0E0v7KIKPDSR9O2DXDYnVG2MnnTRc4u-Uo3g1z8xaGX-2fnDbp-VJCSqd_IpKc0nW1FG82nLKuKvGs1Aw1dAEd0f_B_OcStHauyLho45PRWMHtKv__k0ynQetDu4YGyR1tMEMCQY14ejw-qCpeuQnsFeScAWUJZfMTmiR-o6bg Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:58.761468 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5bf5c85dc694266b151d872bd9a17dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5bf5c85dc694266b151d872bd9a17dc"}]}] Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f5bf5c85dc694266b151d872bd9a17dc Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1175885067 Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec69676c29264f89a679d88ece49316c Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminTestJSON-1175885067-project-admin Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: exception: Aggregate 8 could not be found. Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '8'} Oct 04 18:04:58.762657 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:58.763342 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.764357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.765463 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.765463 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:58.765463 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:58.765463 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 04 18:04:58.765463 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.769923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0a40a76-0f15-42d6-82f5-66dca4a756f8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:58.772124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0a40a76-0f15-42d6-82f5-66dca4a756f8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.031353 Oct 04 18:04:58.773799 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 113/203] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:58 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:04:58.783450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f9009f0e5e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.793232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.800302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.803228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.804292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.806379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.807013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.869578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a217ceae-7d14-4ad1-aa98-d098a27aa6a7 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.090167 Oct 04 18:04:58.874985 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 114/204] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:58.886224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45e1ac16-85f8-4c02-b56f-f75b4650c4a0 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1038271345"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.896527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-45e1ac16-85f8-4c02-b56f-f75b4650c4a0 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 0f741336-1560-4d33-b925-3e7c1cec47bb for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:58.916934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76f3a934-f8f2-4c59-805d-75a8a4241916 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76f3a934-f8f2-4c59-805d-75a8a4241916 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76f3a934-f8f2-4c59-805d-75a8a4241916 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 40 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:04:58.923823 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: {"add_host": {"host": "n-h1-833090-21"}} Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:04:58.925360 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-833090-21'}}} Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:58.926056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 18:04:58.927133 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:04:58.930114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76f3a934-f8f2-4c59-805d-75a8a4241916 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:58.930114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76f3a934-f8f2-4c59-805d-75a8a4241916 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.374272 Oct 04 18:04:58.930532 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 91/205] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:58.942121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f9009f795e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:58.950356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.950854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.951358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.965358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.965869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.966293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.975893 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53172915-2644-4722-9f7f-216fa0de9c95 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h1-833090-21" status: 200 len: 335 microversion: 2.1 time: 0.044250 Oct 04 18:04:58.981313 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 92/206] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:04:58 2022] GET /compute/v2.1/os-hosts/n-h1-833090-21 => generated 335 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.019572 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45e1ac16-85f8-4c02-b56f-f75b4650c4a0 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.142472 Oct 04 18:04:59.027273 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 115/207] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.033612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f538395-81e0-4d74-93ae-ba00ddb59f72 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.132979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f538395-81e0-4d74-93ae-ba00ddb59f72 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.104160 Oct 04 18:04:59.134230 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 116/208] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:59 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:59.142271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Calling method '.version_select at 0x7f9009f0e1f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.151265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.152247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.152905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.168780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.169275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.169713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.183666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-185423135", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.203239 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-528ec86a-8319-4d34-90d8-6862de21daa4 tempest-HostsAdminTestJSON-1560428211 tempest-HostsAdminTestJSON-1560428211-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h2-833090-21" status: 200 len: 471 microversion: 2.1 time: 0.067780 Oct 04 18:04:59.204452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 117/209] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/os-hosts/n-h2-833090-21 => generated 471 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.221214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee9d7605-4bb0-40c0-b050-306be93f721c tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.224942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee9d7605-4bb0-40c0-b050-306be93f721c tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.019224 Oct 04 18:04:59.225574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 118/210] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.231798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ceb8f623-28bf-4506-a536-6f89fd9c2c7d tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-791720246"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.241180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-ceb8f623-28bf-4506-a536-6f89fd9c2c7d tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid e7f8ca2e-2df8-4cb9-9619-45ee62876bd7 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:04:59.269445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:59.340722 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ceb8f623-28bf-4506-a536-6f89fd9c2c7d tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.113873 Oct 04 18:04:59.341403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 119/211] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.348815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f0578c2-baf0-4ea3-bb9d-b3b904b4f9b8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.364443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=9 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:59.446699 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f0578c2-baf0-4ea3-bb9d-b3b904b4f9b8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.104206 Oct 04 18:04:59.447395 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 120/212] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.492204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-489197055"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.521651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.522358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.523365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.531881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.533111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.533625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.541691 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-489197055 could not be found. Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 57 Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:04:59.543807 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: {"add_host": {"host": "tempest-nonexist_host-489197055"}} Oct 04 18:04:59.545105 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: exception: Compute host tempest-nonexist_host-489197055 could not be found. Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-489197055'}}} Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-489197055' is not mapped to any cell Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:59.545816 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 18:04:59.546925 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-489197055 could not be found. Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-489197055 could not be found. Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:59.555357 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-489197055 could not be found. Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-489197055 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9ee2fd5-42ad-4c09-9f0f-4e7d969d61c6 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.088305 Oct 04 18:04:59.558856 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 121/213] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:59.560155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.560155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.565587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.566108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.566540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.567395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.567895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.568317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.680477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:59.680944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:59.681358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:59.681764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:59.682199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:59.695405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.695940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.696374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.697214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.697651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.698262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.717429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Getting quotas for project 57244ffb1da648d6a3a532292184d294. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:59.722618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Getting quotas for user 775c03ae1cc940d68a1c8c29ad6a82ae and project 57244ffb1da648d6a3a532292184d294. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:59.734331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.737630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:59.739976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:59.742325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61149105-28fe-436c-9c0f-61b8899023c2 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.195426 Oct 04 18:04:59.743582 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 122/214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.751642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c695001-0cfd-4ef9-9cdd-773a2bea04f6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.760145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c695001-0cfd-4ef9-9cdd-773a2bea04f6 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.015882 Oct 04 18:04:59.760702 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 123/215] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:59.767720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c49c0a0-0eec-4056-a581-422d8d92e0a8 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.776791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:59.858962 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2831a2f6-1dff-471b-9237-9d22da654e1c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881307 Oct 04 18:04:59.860330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 93/216] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:59.868368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c49c0a0-0eec-4056-a581-422d8d92e0a8 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.106525 Oct 04 18:04:59.869498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 124/217] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:04:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:04:59.872831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddef629f-306a-4f9b-9fc1-fefb32718b9e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.875179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79dbe98c-8182-40eb-9715-964d832dbe0a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.876360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79dbe98c-8182-40eb-9715-964d832dbe0a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.960035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79dbe98c-8182-40eb-9715-964d832dbe0a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.969898 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79dbe98c-8182-40eb-9715-964d832dbe0a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1222 microversion: 2.1 time: 0.099017 Oct 04 18:04:59.983638 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 125/218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.994042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-002c6acc-12bf-4378-b417-b666dc822122 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-002c6acc-12bf-4378-b417-b666dc822122 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 283 Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:00.001085 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.002385 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:00.002931 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.003591 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.004503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.005305 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:00.005305 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:00.005305 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:00.005305 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.005305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-002c6acc-12bf-4378-b417-b666dc822122 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.007173 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-002c6acc-12bf-4378-b417-b666dc822122 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016740 Oct 04 18:05:00.007173 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 126/219] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:00.032496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ea92534-9249-4306-a702-2f9815027dcc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ea92534-9249-4306-a702-2f9815027dcc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 27 Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:00.037842 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: {"aggregate": {"name": ""}} Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:00.039261 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '' Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.040497 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:05:00.042908 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.044270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ea92534-9249-4306-a702-2f9815027dcc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.044270 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ea92534-9249-4306-a702-2f9815027dcc tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022076 Oct 04 18:05:00.044270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 127/220] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:00.044462 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddef629f-306a-4f9b-9fc1-fefb32718b9e tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.178672 Oct 04 18:05:00.045374 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 94/221] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:04:59 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:00.051369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c348f37-9766-49d3-af0b-d44e5d4a1af4 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1164208616", "availability_zone": "tempest-test_az-2145644898"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.052756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-174d4662-b044-4d81-b601-d157a17f74b6 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1622256447"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.056994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-174d4662-b044-4d81-b601-d157a17f74b6 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-174d4662-b044-4d81-b601-d157a17f74b6 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 60 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:00.059291 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: {"aggregate": {"name": "tempest-test_aggregate-1622256447"}} Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:00.060836 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1622256447'}}} Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:00.061694 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:00.063644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 18:05:00.069712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.069712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-174d4662-b044-4d81-b601-d157a17f74b6 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.069712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-174d4662-b044-4d81-b601-d157a17f74b6 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014311 Oct 04 18:05:00.069712 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 128/222] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:00.077948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-9c348f37-9766-49d3-af0b-d44e5d4a1af4 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid 0b13ae9a-8594-4181-8bac-8990df3de550 for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:00.080806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60a9b373-3a88-47bd-84c8-46806c8e63ad tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-677055544"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.098443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-60a9b373-3a88-47bd-84c8-46806c8e63ad tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 84ca0958-1658-4a1f-99f0-2f02d30c5081 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:00.169547 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c348f37-9766-49d3-af0b-d44e5d4a1af4 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.122598 Oct 04 18:05:00.195688 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 95/223] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.206617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bdba92b5-7e57-43fb-9749-3cb9e76de329 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1164208616_new", "availability_zone": "tempest-test_az-2145644898_new"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.226738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60a9b373-3a88-47bd-84c8-46806c8e63ad tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.151442 Oct 04 18:05:00.227697 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 129/224] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.244950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-677055544"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.250308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid f12697cf-da75-4ae7-b242-50adc110b7bb for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:00.267234 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-677055544 already exists. Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 59 Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:00.269668 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: {"aggregate": {"name": "tempest-test_aggregate-677055544"}} Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:00.270840 n-d-833090-21 devstack@n-api.service[123887]: exception: Aggregate tempest-test_aggregate-677055544 already exists. Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-677055544'}}} Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 18:05:00.271930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-677055544 already exists. Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:00.272965 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-677055544 already exists. Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-677055544 already exists. Oct 04 18:05:00.273998 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.275954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-677055544 already exists. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.277648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adf58d73-ff18-4ff8-a355-0cf3d3a6c41e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.038668 Oct 04 18:05:00.278792 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 130/225] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:00.292146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40b186a7-8317-4e4e-b520-82415cdae384 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.394660 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40b186a7-8317-4e4e-b520-82415cdae384 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.109823 Oct 04 18:05:00.405398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 131/226] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:00.414021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-835049a7-9d3e-441d-adad-1c6547b667c3 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-434193270"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.419788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-835049a7-9d3e-441d-adad-1c6547b667c3 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 9d4285ba-6744-459b-82c4-0c289ac2ce2a for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:00.501947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdba92b5-7e57-43fb-9749-3cb9e76de329 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.502470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdba92b5-7e57-43fb-9749-3cb9e76de329 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.506028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdba92b5-7e57-43fb-9749-3cb9e76de329 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.550411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-835049a7-9d3e-441d-adad-1c6547b667c3 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142205 Oct 04 18:05:00.558792 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 132/227] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.567411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65f01335-925e-4c64-a1d2-f39f91a5149a tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.583380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65f01335-925e-4c64-a1d2-f39f91a5149a tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65f01335-925e-4c64-a1d2-f39f91a5149a tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:00.593154 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:05:00.594757 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '14'} Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:00.596165 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.597547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65f01335-925e-4c64-a1d2-f39f91a5149a tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.599743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65f01335-925e-4c64-a1d2-f39f91a5149a tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.034930 Oct 04 18:05:00.599743 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 133/228] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:00.621160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a92d174c-908f-4ce9-8cd1-7bdeac5a872b tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.700981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bdba92b5-7e57-43fb-9749-3cb9e76de329 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.503823 Oct 04 18:05:00.706429 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 96/229] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:05:00 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.716414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff18926f-bd8c-4d81-a54f-1b2a6aabcbad tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.749232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff18926f-bd8c-4d81-a54f-1b2a6aabcbad tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.038461 Oct 04 18:05:00.749694 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a92d174c-908f-4ce9-8cd1-7bdeac5a872b tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.140863 Oct 04 18:05:00.752281 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 97/230] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.755747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 134/231] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:00.768156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72180760-2d26-4b6c-b776-41c5063ff1b8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.777043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4fe5eda-d610-4ada-b035-ea278c813f90 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.801973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-b4fe5eda-d610-4ada-b035-ea278c813f90 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4fe5eda-d610-4ada-b035-ea278c813f90 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:05:00.804122 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: exception: Aggregate -1 could not be found. Oct 04 18:05:00.805588 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '-1'} Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:05:00.806465 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.807451 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:05:00.809582 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:00.811399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4fe5eda-d610-4ada-b035-ea278c813f90 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:00.812536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4fe5eda-d610-4ada-b035-ea278c813f90 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.055704 Oct 04 18:05:00.818787 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 98/232] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:00.825941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.827107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.835598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.836298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.836970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.837951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.838560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.839767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.929574 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72180760-2d26-4b6c-b776-41c5063ff1b8 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.168027 Oct 04 18:05:00.930202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 135/233] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:05:00.945727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d7e906-e942-468c-86ca-40c4e21736a5 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-276576581"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:00.950259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-f7d7e906-e942-468c-86ca-40c4e21736a5 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 172405cd-a1ae-43a0-87cd-7561b894e3e9 for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:01.042153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.060584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d7e906-e942-468c-86ca-40c4e21736a5 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.129332 Oct 04 18:05:01.061506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 136/234] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.073508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71e782da-aacc-4b98-8ec9-b65bffc06d4f tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-76347798"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:01.077704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.aggregate [None req-71e782da-aacc-4b98-8ec9-b65bffc06d4f tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Generated uuid b1740f71-6191-4389-8a6e-71af44ac310d for aggregate {{(pid=123887) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:01.114718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d4dec75-855d-470c-960e-6ceb116206db tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.292653 Oct 04 18:05:01.119527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 99/235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:01.129996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9be0562-14c0-46fc-8126-b9261aff952d tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.131120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9be0562-14c0-46fc-8126-b9261aff952d tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.167342 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-71e782da-aacc-4b98-8ec9-b65bffc06d4f tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.104499 Oct 04 18:05:01.169127 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 137/236] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.189615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3008f2ff-3ec5-4ccd-9b1b-8610465a520e tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.193942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3008f2ff-3ec5-4ccd-9b1b-8610465a520e tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3008f2ff-3ec5-4ccd-9b1b-8610465a520e tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:01.202792 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:05:01.204900 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '15'} Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:01.205689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 18:05:01.206957 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.223077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3008f2ff-3ec5-4ccd-9b1b-8610465a520e tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.225831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b9be0562-14c0-46fc-8126-b9261aff952d tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.226695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3008f2ff-3ec5-4ccd-9b1b-8610465a520e tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.054258 Oct 04 18:05:01.227254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 138/237] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:01.237317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9be0562-14c0-46fc-8126-b9261aff952d tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1222 microversion: 2.1 time: 0.113636 Oct 04 18:05:01.238475 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 100/238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:01.246812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-acf3e133-a614-4405-a5fd-2b6e67964f24 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.258017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00c42a2f-1fda-4129-9d83-31b2318a0bab tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.289998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00c42a2f-1fda-4129-9d83-31b2318a0bab tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 443 microversion: 2.1 time: 0.060305 Oct 04 18:05:01.294297 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 139/239] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/os-aggregates => generated 443 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.306621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a2de483-232b-425c-85da-6f8fdbb33308 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.377270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-acf3e133-a614-4405-a5fd-2b6e67964f24 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.132570 Oct 04 18:05:01.377885 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 101/240] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:01.389185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58fc60cc-221b-49a8-bf28-effaa0deb3b9 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.408353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-58fc60cc-221b-49a8-bf28-effaa0deb3b9 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58fc60cc-221b-49a8-bf28-effaa0deb3b9 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:05:01.410132 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: exception: Aggregate -1 could not be found. Oct 04 18:05:01.411355 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '-1'} Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.412052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 18:05:01.413132 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.414079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58fc60cc-221b-49a8-bf28-effaa0deb3b9 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.414079 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58fc60cc-221b-49a8-bf28-effaa0deb3b9 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027770 Oct 04 18:05:01.414291 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a2de483-232b-425c-85da-6f8fdbb33308 tempest-AggregatesAdminTestJSON-1175885067 tempest-AggregatesAdminTestJSON-1175885067-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.111425 Oct 04 18:05:01.414291 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 140/241] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 18:05:01.425418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.425967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 102/242] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:05:01.429378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.432333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ea4247f-1e38-4983-b0b0-27a2dbe88f59 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.435429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ea4247f-1e38-4983-b0b0-27a2dbe88f59 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ea4247f-1e38-4983-b0b0-27a2dbe88f59 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:05:01.437222 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:05:01.448823 n-d-833090-21 devstack@n-api.service[123886]: action_args: {} Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:01.449607 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.450858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ea4247f-1e38-4983-b0b0-27a2dbe88f59 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.451979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ea4247f-1e38-4983-b0b0-27a2dbe88f59 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011832 Oct 04 18:05:01.451979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 103/243] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:01.452214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.452960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.453770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.454192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-521a0f4e-9e93-4823-adba-8be8b8c8f86e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1372229836"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:01.454941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.455690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.456648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.458330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-521a0f4e-9e93-4823-adba-8be8b8c8f86e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 35bfd11a-63e5-491e-9194-e602a94fd176 for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:01.476452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] HTTP exception thrown: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Request method failure captured: Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee HTTP/1.1 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWT1Ef9gQTr_lBbtcabQUWoPz_pX9DQA6uq1KNCJRPDnEjNf1G1jJ-S7plNrN31AKPw88rnTTWODaxQgFzkILnQqZRLsQDeXrEcRrIAM2wje8Dzv8GL_9SpzlC4T_Chlkk0OWzIy9ZGCm2N7McVgwKe2qvlMGIkPTMVVk3Fe9cq9V4 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: db9060741da54161b592c88621832842 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:01.479450 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db9060741da54161b592c88621832842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db9060741da54161b592c88621832842"}]}] Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: db9060741da54161b592c88621832842 Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: bbc5f201fd874669a9240bbc8d58f1cd Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.480731 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a1c7a77f-8a68-4ade-bf93-b64df26b54ee'} Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.481409 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.482458 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.485429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Returning 404 to user: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.485429 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7fa9fe2d-d6fb-45fc-8598-ec494b20b507 tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 404 len: 111 microversion: 2.1 time: 0.062465 Oct 04 18:05:01.490262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 141/244] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:01 2022] DELETE /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:05:01.491335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.492104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] [instance: a1c7a77f-8a68-4ade-bf93-b64df26b54ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.499086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.499804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.500493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.501279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.501808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.502346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.518474 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] HTTP exception thrown: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Request method failure captured: Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee HTTP/1.1 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWT1Ef9gQTr_lBbtcabQUWoPz_pX9DQA6uq1KNCJRPDnEjNf1G1jJ-S7plNrN31AKPw88rnTTWODaxQgFzkILnQqZRLsQDeXrEcRrIAM2wje8Dzv8GL_9SpzlC4T_Chlkk0OWzIy9ZGCm2N7McVgwKe2qvlMGIkPTMVVk3Fe9cq9V4 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: db9060741da54161b592c88621832842 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:01.520187 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db9060741da54161b592c88621832842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db9060741da54161b592c88621832842"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db9060741da54161b592c88621832842"}]}] Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: db9060741da54161b592c88621832842 Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-619403170 Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: bbc5f201fd874669a9240bbc8d58f1cd Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminTestJSON-619403170-project Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.521511 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a1c7a77f-8a68-4ade-bf93-b64df26b54ee'} Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:01.522161 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. Oct 04 18:05:01.526979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:01.528979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] Returning 404 to user: Instance a1c7a77f-8a68-4ade-bf93-b64df26b54ee could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:01.528979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88acd485-98af-4652-8087-a3ad0052488e tempest-AggregatesAdminTestJSON-619403170 tempest-AggregatesAdminTestJSON-619403170-project] 10.222.0.40 "GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee" status: 404 len: 111 microversion: 2.1 time: 0.034812 Oct 04 18:05:01.550120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 142/245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/a1c7a77f-8a68-4ade-bf93-b64df26b54ee => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:01.564345 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-521a0f4e-9e93-4823-adba-8be8b8c8f86e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.115364 Oct 04 18:05:01.565340 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 104/246] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:01.578077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b2d5cc2-e153-4ad2-800d-c8dc73b88e21 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:01.602608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b2d5cc2-e153-4ad2-800d-c8dc73b88e21 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.604627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b2d5cc2-e153-4ad2-800d-c8dc73b88e21 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.605759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b2d5cc2-e153-4ad2-800d-c8dc73b88e21 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.041281 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b2d5cc2-e153-4ad2-800d-c8dc73b88e21 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.467468 Oct 04 18:05:02.042274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 143/247] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:05:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:02.074302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af569c32-2efe-4ab3-b349-3881e6676598 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:02.097828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af569c32-2efe-4ab3-b349-3881e6676598 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6d8e82280b6b41c29dd55fb0a6e3b83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5747fd20bf141b3b968455576d39239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af569c32-2efe-4ab3-b349-3881e6676598 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Request method failure captured: Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 43 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWSY9p_Ubzz56-iLMMzd9cxGf3eHrJIbBAovJ28Cyj0F1WU5gkraER_BfX8nWaGha0Ecjxq7GWIiz6pNKsi27iPGyR7g90Ay-WPRADUYhtMtOtkIJrdZhhjlOy2-ayE9QNG8j10kEAKcbvqBN3KIT4-wMxcJfGBwgjnRl-UsSXwVPM Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:05:02.107084 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5747fd20bf141b3b968455576d39239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5747fd20bf141b3b968455576d39239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5747fd20bf141b3b968455576d39239"}]}] Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b5747fd20bf141b3b968455576d39239 Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545 Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6d8e82280b6b41c29dd55fb0a6e3b83d Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1302287545-project Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: {"remove_host": {"host": "n-h1-833090-21"}} Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:02.108619 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-833090-21'}}} Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:02.109635 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 18:05:02.111196 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:02.117394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af569c32-2efe-4ab3-b349-3881e6676598 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:02.117394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af569c32-2efe-4ab3-b349-3881e6676598 tempest-AggregatesAdminNegativeTestJSON-1302287545 tempest-AggregatesAdminNegativeTestJSON-1302287545-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.065734 Oct 04 18:05:02.124726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 105/248] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:05:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:02.136710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c37f7ac9-2c92-470c-b4db-adf512aa062e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:02.160667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c37f7ac9-2c92-470c-b4db-adf512aa062e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.167241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c37f7ac9-2c92-470c-b4db-adf512aa062e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.167241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c37f7ac9-2c92-470c-b4db-adf512aa062e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.167597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.167597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.205031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.205424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.208094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.212163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.212850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.213513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.596164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c37f7ac9-2c92-470c-b4db-adf512aa062e tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.464312 Oct 04 18:05:02.608723 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 144/249] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:05:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:02.624949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.626827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.629109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.637934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.638742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.647730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.647730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.647730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.647730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.653391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e3f76eb-810b-4aa1-bddf-52cdfe30abfc tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.513434 Oct 04 18:05:02.657261 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 106/250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.662249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6380173f-e175-4593-97ac-32baf404b07a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.748907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.788639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6380173f-e175-4593-97ac-32baf404b07a tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.129837 Oct 04 18:05:02.796360 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 107/251] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:02 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:02.796802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-774baa6e-a7a1-4588-94a8-fe4d5236d989 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1274 microversion: 2.1 time: 0.181564 Oct 04 18:05:02.801561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 145/252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.815580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28c96a83-6e2c-4031-96d7-758b92e28005 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1401845141"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:02.820983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-28c96a83-6e2c-4031-96d7-758b92e28005 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Generated uuid 9123443f-9405-4d7e-b520-ef74fb1b189a for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:05:02.943596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28c96a83-6e2c-4031-96d7-758b92e28005 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.143296 Oct 04 18:05:02.946050 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 108/253] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:05:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:02.959154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:02.982334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.985400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.985875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.000622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.001117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.007803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.032360 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.compute.aggregates [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:05:03.032924 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Request method failure captured: Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 42 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWWOdCcW1uVcvab-E5aeh1WfRD3nXXDVN2YmqmbL-Bh5gP17NKCcuhBnGytJOi7BJDzSaCNbBs-lkNudSJUZzvokVW3XUYRFxGbEtFhizEZ2VrsNhfXsi2J1WUDLQP3-vIK1wsQ1CUSx-edrmsChRHXmx3oyzVVBEgh0KI7yc9Mw2I Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:03.037270 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6482269ea20a413684857f068052265b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6482269ea20a413684857f068052265b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6482269ea20a413684857f068052265b"}]}] Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6482269ea20a413684857f068052265b Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592 Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9acc671d1d9d488793427cf3757b7c93 Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: {"remove_host": {"host": "nonexist_host"}} Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:03.038515 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 18:05:03.039214 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 18:05:03.040306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.041390 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:03.042583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73936223-7c2f-4f91-be85-784f55707740 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.084979 Oct 04 18:05:03.045601 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 146/254] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:05:02 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:05:03.055539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31cce5d6-3da5-40b3-b59e-587cfbaa5300 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.205704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31cce5d6-3da5-40b3-b59e-587cfbaa5300 tempest-AggregatesAdminNegativeTestJSON-1935116592 tempest-AggregatesAdminNegativeTestJSON-1935116592-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.158889 Oct 04 18:05:03.206690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 109/255] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:05:03 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:05:03.682788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.684662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.700923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.715747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.715747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.716772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.727159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.727840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.835607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.836866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.845500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.846332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.847001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.848036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.848703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.849380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.972562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.996711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b64f5b1-a568-497c-984d-0831f8f38c6e tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1292 microversion: 2.1 time: 0.167983 Oct 04 18:05:03.999555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 110/256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1292 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:04.104108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.118265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8011c64-666a-4c22-ad46-081c9d6ce8e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.441059 Oct 04 18:05:04.118995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 147/257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:05.026158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.034417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.034417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.034417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.036247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.043512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.044678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.045148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.149640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:05.151198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:05.173041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.175325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.177616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.179382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.180888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.181828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.264310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.285638 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c79a18a5-756a-4bce-853f-b6255d4c6186 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1280 microversion: 2.1 time: 0.261633 Oct 04 18:05:05.305794 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 111/258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:05.575070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.615495 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43a31452-9bd0-4596-a96e-228f3439bdc6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.471937 Oct 04 18:05:05.617642 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 148/259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:05.790423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69", "name": "network-vif-plugged", "status": "completed", "tag": "7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:05.790423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.790423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.790423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.851304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] Creating event network-vif-plugged:7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc for instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 on n-h2-833090-21 Oct 04 18:05:05.888437 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cea900da-5ea2-47d9-9fc2-9d68538b4330 req-246cb5c2-4b28-496c-b0bc-8b42fe3db015 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130651 Oct 04 18:05:05.897342 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 112/260] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:06.321107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.321107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.328328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.330789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.331257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.334189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.334795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.335240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.575279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.584298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d618c44-c000-4862-bbc8-a80f41f9ccc7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.273328 Oct 04 18:05:06.600059 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 149/261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:06.644985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.646546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.655173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.656384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.661622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.661622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.661622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.662004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.921942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.931370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f9ae538-0e4c-4e60-9679-dc82b5cc71e7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.291077 Oct 04 18:05:06.932325 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 113/262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.433130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52dd8d6-81e7-4f73-9de0-86f502ecb955", "tag": "d97f045d-9a70-4c56-8098-9d80480824c7"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:07.451996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.453207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.454211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.472593 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] Creating event network-changed:d97f045d-9a70-4c56-8098-9d80480824c7 for instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 on n-h1-833090-21 Oct 04 18:05:07.479886 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-dfd46e28-6415-459b-9e5b-54ef88afdcd9 req-bf0c6d68-c5f8-4ff9-a7f2-dc8775920f3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050941 Oct 04 18:05:07.480853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 150/263] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:07.610162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.618850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.618850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.618850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.618850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.619874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.620356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.620786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.875320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.883178 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6cf95234-b9eb-46e9-aaff-e43f0e19bec5 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.278496 Oct 04 18:05:07.896454 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 114/264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.956980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.957765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.974931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.976294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.976744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.978322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.979083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.979623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.225303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.228403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:08.252261 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6457967a-bcc9-4425-b0e5-aa79c5cda1c7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1389 microversion: 2.1 time: 0.285407 Oct 04 18:05:08.252261 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 151/265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:08.915514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.916205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.926769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.928037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.929204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.930708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.931355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.931962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.099251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:09.107308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5b6400b-8209-4f05-91ea-2b81c6921115 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.201785 Oct 04 18:05:09.108042 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 115/266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.262901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.263453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.270302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.271121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.271813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.272819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.273486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.274158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.777907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:09.796677 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d50a9c8c-4866-4ee1-88c7-b8ee92b51b6d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1589 microversion: 2.1 time: 0.537081 Oct 04 18:05:09.797707 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 152/267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1589 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.819540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=17 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:09.824579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.825083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.835882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.836366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.839255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.842446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.843688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.844431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.133296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.133937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.137500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:10.148876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.151128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.152047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.156011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.157913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.159331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.235219 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5bc449e3-5082-4d27-a0ac-fc4ca4f83236 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.416336 Oct 04 18:05:10.236354 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 116/268] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69/os-interface => generated 285 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:10.717777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:10.726932 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28716066-e838-4212-9cca-cf73a7ff3ef7 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.599911 Oct 04 18:05:10.734301 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 153/269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:10.847051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-311155435", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:10.941867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:11.235220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=34 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:11.436876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:11.438614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:11.439235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:11.439810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:11.442455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:11.457696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.459430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.460051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.460956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.462255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.463018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.484133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Getting quotas for project 41462bdf6c6a4c0c9959a8289689ec92. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:11.489942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Getting quotas for user f1faf17db3a745e288d227ce3c8c4294 and project 41462bdf6c6a4c0c9959a8289689ec92. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:11.502618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:11.504940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:11.638227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e144c44-7645-4e56-a3f0-d1eac567da53 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119321 Oct 04 18:05:11.638456 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 117/270] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:05:11.655985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95e32cb7-c900-489d-937f-6e5f27f5318a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.657744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95e32cb7-c900-489d-937f-6e5f27f5318a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.674428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:11.761315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.762633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.774078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.775162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.776040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.785949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.785949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.785949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.807229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-95e32cb7-c900-489d-937f-6e5f27f5318a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.825510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95e32cb7-c900-489d-937f-6e5f27f5318a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1218 microversion: 2.1 time: 0.178546 Oct 04 18:05:11.829903 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 154/271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.079124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.095372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ffd63aa-b599-43e4-aad2-2bd5630dbe46 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.340682 Oct 04 18:05:12.101326 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 118/272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.351557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.352190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.368558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.369103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.369728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.370622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.371116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.371611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.431720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:12.791845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.797820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd71f599-ce94-450b-824a-5d42b1c6e4dd tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1968682790", "id": 777851308, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.803242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-581c1714-e43e-4c11-979b-1eb107a09a9b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 200 len: 1589 microversion: 2.1 time: 0.455337 Oct 04 18:05:12.804330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 119/273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 1589 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.811372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69", "tag": "7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.823064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.824159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.824626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.838057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] Creating event network-changed:7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc for instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 on n-h2-833090-21 Oct 04 18:05:12.851895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3d351932-c34e-45c9-8c86-934c3f5700f4 req-e61f4722-7df1-4336-9f85-74e5990f8a88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041337 Oct 04 18:05:12.853587 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 120/274] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:12.862433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfd9460c-e413-4e6c-8429-3c508a3e0f12 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.863639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfd9460c-e413-4e6c-8429-3c508a3e0f12 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.870603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:12.902596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd71f599-ce94-450b-824a-5d42b1c6e4dd tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.654757 Oct 04 18:05:12.904150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 155/275] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:12 2022] POST /compute/v2.1/flavors => generated 427 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:12.921719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-480dca76-280a-4af3-b003-a8b8d717b175 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.993809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:13.049490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dfd9460c-e413-4e6c-8429-3c508a3e0f12 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:13.070974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfd9460c-e413-4e6c-8429-3c508a3e0f12 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1218 microversion: 2.1 time: 0.215015 Oct 04 18:05:13.077870 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 121/276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:13.106014 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-480dca76-280a-4af3-b003-a8b8d717b175 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/777851308" status: 202 len: 0 microversion: 2.1 time: 0.192638 Oct 04 18:05:13.108879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 156/277] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:12 2022] DELETE /compute/v2.1/flavors/777851308 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:13.117776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed9e7db7-b137-490a-8b76-04f6f330972c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.160074 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed9e7db7-b137-490a-8b76-04f6f330972c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.048107 Oct 04 18:05:13.161292 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 157/278] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:13.178428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.189237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.189237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.189237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.189237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.189698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.189698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.189698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.319611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1310595493", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:13.395160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:13.957962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:13.959402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:13.960069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:13.960627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:13.961220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:13.985757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.986449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.986890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.987885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.988476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.989003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.020815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Getting quotas for project 1ea7b1e2c62244debad4da496575243f. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:14.043955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Getting quotas for user bb87ce6533524ec3aa86764646b52a32 and project 1ea7b1e2c62244debad4da496575243f. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:14.068227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:14.070850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:14.238625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce74786e-f4e0-4f15-96f8-205201d8fd37 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162331 Oct 04 18:05:14.246101 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 122/279] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:14.252085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb5b58b2-0f40-43f9-9c88-aaa8f8ada6d8 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-189547088", "id": 138503027, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.260106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.271555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da8e17de-3d2c-4cce-9129-0bb46abd7e48 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 1.108657 Oct 04 18:05:14.281076 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 158/280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.290030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.290642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.309453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.310043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.310523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.312141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.315860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.316471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.365428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb5b58b2-0f40-43f9-9c88-aaa8f8ada6d8 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.117793 Oct 04 18:05:14.380010 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 123/281] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:14.385328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c26d6408-e203-479a-a2b8-2ab1703cc50b tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.386264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c26d6408-e203-479a-a2b8-2ab1703cc50b tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.518966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c26d6408-e203-479a-a2b8-2ab1703cc50b tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.532798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c26d6408-e203-479a-a2b8-2ab1703cc50b tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1220 microversion: 2.1 time: 0.151185 Oct 04 18:05:14.537174 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 124/282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.545199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22d040cb-b396-4ffc-aa1f-f9ef5a746a3e tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.612260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22d040cb-b396-4ffc-aa1f-f9ef5a746a3e tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.073654 Oct 04 18:05:14.625895 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 125/283] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.635831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26d5d097-0afe-41dc-8caf-dfc584acce68 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.699034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.709537 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9a9c82e-177c-456b-b028-8839b9b8f784 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1214 microversion: 2.1 time: 0.427207 Oct 04 18:05:14.710827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 159/284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1214 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.778764 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26d5d097-0afe-41dc-8caf-dfc584acce68 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/138503027" status: 202 len: 0 microversion: 2.1 time: 0.146496 Oct 04 18:05:14.788853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47d3f55a-95b8-439d-b3de-7a8bb01f185b tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.792745 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 126/285] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:14 2022] DELETE /compute/v2.1/flavors/138503027 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:14.821856 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47d3f55a-95b8-439d-b3de-7a8bb01f185b tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.037134 Oct 04 18:05:14.823186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 160/286] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.853259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41a31273-7c31-4e8d-96b4-dbd92d0b039c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1337823694", "id": 190071679, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:14.974582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41a31273-7c31-4e8d-96b4-dbd92d0b039c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.126206 Oct 04 18:05:14.999801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a24b6698-6ea2-48ef-b6da-e87b9b052e0c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.014677 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 127/287] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:14 2022] POST /compute/v2.1/flavors => generated 426 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.162896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52dd8d6-81e7-4f73-9de0-86f502ecb955", "name": "network-vif-plugged", "status": "completed", "tag": "d97f045d-9a70-4c56-8098-9d80480824c7"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.172732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a24b6698-6ea2-48ef-b6da-e87b9b052e0c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/190071679" status: 202 len: 0 microversion: 2.1 time: 0.185084 Oct 04 18:05:15.173341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 161/288] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:14 2022] DELETE /compute/v2.1/flavors/190071679 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:15.187133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e58f9298-865e-4ccc-8722-1d41d547cf7c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.238329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.239009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.239745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.245506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e58f9298-865e-4ccc-8722-1d41d547cf7c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.065567 Oct 04 18:05:15.248893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 162/289] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.272638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a9da7d8-f6ab-4734-8ca5-59d9745c14ae tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1728818905", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.273316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] Creating event network-vif-plugged:d97f045d-9a70-4c56-8098-9d80480824c7 for instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 on n-h1-833090-21 Oct 04 18:05:15.282953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e3e514c9-e632-4b43-abea-aca7518af268 req-27d29af2-851b-4488-8119-8a919b1c4c1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128474 Oct 04 18:05:15.286251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 128/290] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:15.300819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.302988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.387008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a9da7d8-f6ab-4734-8ca5-59d9745c14ae tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.118375 Oct 04 18:05:15.393284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.394273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.397379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 163/291] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:15.398242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.403633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36246a25-2334-4f85-8c26-3386640c2425 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.405747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.408590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.409428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.482748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36246a25-2334-4f85-8c26-3386640c2425 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/f6347ea0-e6c5-45e6-bf5f-7a2062e2387a" status: 202 len: 0 microversion: 2.1 time: 0.083009 Oct 04 18:05:15.487748 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 164/292] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:15 2022] DELETE /compute/v2.1/flavors/f6347ea0-e6c5-45e6-bf5f-7a2062e2387a => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:15.495799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f57a25d-bb8d-47ce-a6ec-794993f2a62f tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.540941 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f57a25d-bb8d-47ce-a6ec-794993f2a62f tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.050757 Oct 04 18:05:15.542136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 165/293] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.563098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb7a108a-fd68-402f-adda-0689819452a9 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.565738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cb7a108a-fd68-402f-adda-0689819452a9 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.759954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cb7a108a-fd68-402f-adda-0689819452a9 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.776807 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb7a108a-fd68-402f-adda-0689819452a9 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1220 microversion: 2.1 time: 0.220486 Oct 04 18:05:15.795640 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 166/294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1220 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.813983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-48fb3fc5-a21b-4ebf-86ed-cca0665ebbd3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2063343317", "id": "5c325c27-638c-4a8d-87bb-722a8c1dec43", "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.972127 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-48fb3fc5-a21b-4ebf-86ed-cca0665ebbd3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.166734 Oct 04 18:05:15.972874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 167/295] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:16.004530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.005506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.026120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.028487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.033374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.033374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.033374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.036905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.196143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.206348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.216413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10b379f1-2d88-4db0-81e5-203aad65a115 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1276 microversion: 2.1 time: 0.238690 Oct 04 18:05:16.218223 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 168/296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.221178 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a299eeae-a651-4296-8fcf-72a7b4e57b43 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.926000 Oct 04 18:05:16.222044 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 129/297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.252780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f891c68-59f6-40fc-a481-55f7fea18bc0 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.358472 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f891c68-59f6-40fc-a481-55f7fea18bc0 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/5c325c27-638c-4a8d-87bb-722a8c1dec43" status: 202 len: 0 microversion: 2.1 time: 0.137517 Oct 04 18:05:16.359889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 169/298] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:16 2022] DELETE /compute/v2.1/flavors/5c325c27-638c-4a8d-87bb-722a8c1dec43 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:16.369112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b07b32ce-5c7f-495e-a797-f8c5fe2ea778 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.416379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b07b32ce-5c7f-495e-a797-f8c5fe2ea778 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.051714 Oct 04 18:05:16.418350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 130/299] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.449257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da6aefb5-d4f7-49de-9bfe-b59a209e79c5 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-653736116", "id": 2009579523, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:16.599306 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da6aefb5-d4f7-49de-9bfe-b59a209e79c5 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.158159 Oct 04 18:05:16.600262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 170/300] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:16.619311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c57bd010-2f1d-40ea-a4be-19869703db82 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.637637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c57bd010-2f1d-40ea-a4be-19869703db82 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/2009579523" status: 200 len: 413 microversion: 2.1 time: 0.029084 Oct 04 18:05:16.638235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 131/301] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/flavors/2009579523 => generated 413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:16.805176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.806145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.815234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.816113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.817548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.818468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.819074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.819926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.828138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-effec78f-33ec-473d-8d9d-e8cba4754eee tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.897804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-effec78f-33ec-473d-8d9d-e8cba4754eee tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.248531 Oct 04 18:05:16.902437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 171/302] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.922657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-efef63a7-589c-4876-83df-c17d1010bb36 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.945655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.962900 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cdf6f24a-8d1f-4ba7-8420-97996f1170a8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1216 microversion: 2.1 time: 0.164775 Oct 04 18:05:16.965218 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 132/303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.037828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-efef63a7-589c-4876-83df-c17d1010bb36 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2009579523" status: 202 len: 0 microversion: 2.1 time: 0.119269 Oct 04 18:05:17.041140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 172/304] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:16 2022] DELETE /compute/v2.1/flavors/2009579523 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:17.047441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca95bbe8-f313-4831-af9d-ee8bbe0ae630 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.090093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca95bbe8-f313-4831-af9d-ee8bbe0ae630 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.046293 Oct 04 18:05:17.103069 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 133/305] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.124229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cc5d9d7-afc5-4c6b-bf26-775af56d880d tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1687876152", "id": 241435605, "os-flavor-access:is_public": "False"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:17.246642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.249328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.269025 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cc5d9d7-afc5-4c6b-bf26-775af56d880d tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.149197 Oct 04 18:05:17.270910 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 173/306] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:17 2022] POST /compute/v2.1/flavors => generated 427 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:17.282063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.284087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.287451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.287737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.289298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.290353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.291065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.292399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.327061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.330618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.331454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.332248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.336207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.336672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.889158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.900644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ede1079-7c81-48f2-8d12-00306080f79a tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1322 microversion: 2.1 time: 0.627938 Oct 04 18:05:17.914038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.923381 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 174/307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.932776 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e6597f6-676d-4d8d-bf70-8f4e30da1ac7 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1276 microversion: 2.1 time: 0.694289 Oct 04 18:05:17.934199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8098034-1aff-4516-8471-6df128714bcc tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "241435605"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:17.941434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 134/308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1276 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.976683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e8098034-1aff-4516-8471-6df128714bcc tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] HTTP exception thrown: Flavor 241435605 could not be found. Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8098034-1aff-4516-8471-6df128714bcc tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Request method failure captured: Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 106 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXW_7EcPkZluf1UKWSBjG3pPF3s50jKEq_uSpw_sXCOxatFBDkcon5YCP5nnwS85sOpVnD_XEIHvrvxnagth0QO2QzVLQmV0RNU0cv0ItvvY0eo2rGix1eAGLnD5-a6xqMDwMsc2EezNRgyfG5BaInlWRKs5YiZ7aJhp6eeIy83Bhs Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 73ce68fabb11423da611dd49ff028c46 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsAdminTestJSON-1944208930 Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:17.988393 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_73ce68fabb11423da611dd49ff028c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73ce68fabb11423da611dd49ff028c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/73ce68fabb11423da611dd49ff028c46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/73ce68fabb11423da611dd49ff028c46"}]}] Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsAdminTestJSON-1944208930 Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 73ce68fabb11423da611dd49ff028c46 Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1944208930 Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsAdminTestJSON-1944208930-project Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 42f0ff5f7af34fc08988fd46fd6eac43 Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsAdminTestJSON-1944208930-project Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "test", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "241435605"}} Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:17.990075 n-d-833090-21 devstack@n-api.service[123887]: exception: Flavor 241435605 could not be found. Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '241435605'}}} Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 241435605 could not be found. Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.994258 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 241435605 could not be found. Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:17.995793 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 241435605 could not be found. Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8098034-1aff-4516-8471-6df128714bcc tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Returning 400 to user: Flavor 241435605 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8098034-1aff-4516-8471-6df128714bcc tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.065525 Oct 04 18:05:17.997191 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 175/309] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:17 2022] POST /compute/v2.1/servers => generated 80 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:05:18.002024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.003751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.003925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b11bb0d-a9ee-4689-bff4-9ade27d27190 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.018431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.020627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.021349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.022754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.024376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.025020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.124734 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b11bb0d-a9ee-4689-bff4-9ade27d27190 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/241435605" status: 202 len: 0 microversion: 2.1 time: 0.126254 Oct 04 18:05:18.125292 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 176/310] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:17 2022] DELETE /compute/v2.1/flavors/241435605 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:18.134047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c4e8886-04f5-40e1-b1c1-e180d5395033 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.174741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c4e8886-04f5-40e1-b1c1-e180d5395033 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.044835 Oct 04 18:05:18.175386 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 177/311] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:18.196572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8ee7aad-148f-4b78-8228-895ed6a3efc3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1518516681", "id": 726977450, "os-flavor-access:is_public": "False"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:18.286466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:18.310726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8ee7aad-148f-4b78-8228-895ed6a3efc3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.117291 Oct 04 18:05:18.319660 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 178/312] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:18 2022] POST /compute/v2.1/flavors => generated 412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:18.321324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f98b3f67-4bed-4bdb-a1b2-5e12149313a3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1280 microversion: 2.1 time: 0.329216 Oct 04 18:05:18.339629 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 135/313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.351352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a784c16-d77e-4a2f-85cf-b6a7f82d65fa tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1297709100", "id": 1870817707, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:18.433266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a784c16-d77e-4a2f-85cf-b6a7f82d65fa tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.100342 Oct 04 18:05:18.434585 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 179/314] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:18.449860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4908b37c-3f9c-4918-b579-b58af80bb95f tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.476415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4908b37c-3f9c-4918-b579-b58af80bb95f tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.032184 Oct 04 18:05:18.485442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 136/315] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:18.493399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ba2967c-99b0-4709-984a-b2b4e3e66ae3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.539689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ba2967c-99b0-4709-984a-b2b4e3e66ae3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.051862 Oct 04 18:05:18.542489 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 180/316] 10.222.0.40 () {58 vars in 1177 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:18.558321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-969070e7-c4e7-4884-8139-216b55dcbec3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.590625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-969070e7-c4e7-4884-8139-216b55dcbec3 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.036224 Oct 04 18:05:18.597283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 137/317] 10.222.0.40 () {58 vars in 1171 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:18.607688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3eabbeb9-b66b-4f79-b958-cd683fde6054 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.616241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:18.626435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3eabbeb9-b66b-4f79-b958-cd683fde6054 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.024578 Oct 04 18:05:18.636626 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 181/318] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:18.654441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d82154d-15dd-4f2a-856b-c8a6511fbdda tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.693787 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d82154d-15dd-4f2a-856b-c8a6511fbdda tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6220 microversion: 2.1 time: 0.048079 Oct 04 18:05:18.695213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 138/319] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6220 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.718020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79b37f34-3da7-461e-b0e7-7e37adbfa151 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.776644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79b37f34-3da7-461e-b0e7-7e37adbfa151 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6220 microversion: 2.1 time: 0.066257 Oct 04 18:05:18.780825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 182/320] 10.222.0.40 () {58 vars in 1175 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.798982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c296ff91-36d6-464c-abab-41e8b0e84625 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.850274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c296ff91-36d6-464c-abab-41e8b0e84625 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6220 microversion: 2.1 time: 0.055678 Oct 04 18:05:18.860411 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 139/321] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6220 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.873132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0eb4d865-3a68-44ce-af64-7b2c9630c99a tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.925969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0eb4d865-3a68-44ce-af64-7b2c9630c99a tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6220 microversion: 2.1 time: 0.056772 Oct 04 18:05:18.929485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.930141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.938864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.942115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.942831 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 183/322] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.944000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.944910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.946440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.947750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.955102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10c45bb2-6d04-465c-8a27-ef69f929c178 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.104389 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10c45bb2-6d04-465c-8a27-ef69f929c178 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1870817707" status: 202 len: 0 microversion: 2.1 time: 0.154886 Oct 04 18:05:19.107333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 184/323] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:18 2022] DELETE /compute/v2.1/flavors/1870817707 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:19.113351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.114602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.131008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.132809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.136882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.136882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.139852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.140275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.553873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.562924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49915f38-abe7-4c4e-ac73-879865be1dfd tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1472 microversion: 2.1 time: 0.637579 Oct 04 18:05:19.569627 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 140/324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.577936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21b1beb4-8a8c-48fd-b8cb-36a962ee2051 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.613490 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21b1beb4-8a8c-48fd-b8cb-36a962ee2051 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.039296 Oct 04 18:05:19.613490 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 141/325] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.615912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.616934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.623978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.624669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.625260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.626121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.626742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.627169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.658375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.670615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bbc0622-da67-4442-8f33-cc9e95f81b37 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.561993 Oct 04 18:05:19.672143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 185/326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.688425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.692317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.707566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.708480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.709676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.710719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.714557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.715907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.739334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.753277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6467ca4a-985f-4fa3-bb5c-b6e5371956f2 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1278 microversion: 2.1 time: 0.140191 Oct 04 18:05:19.756515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 142/327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.776369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2561d994-00c3-4067-868e-37577500e4e6 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.844840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Request method failure captured: Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955/diagnostics HTTP/1.1 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXJ_2u96JAM49D1d0pFdFgct15seRE1bkkUvBmBEydVVdTFDK8I70BznZQygu3VXhAczjFku6WsSu5ox_JmD46QVvvibVe7wiccVWwZTe9csB4eBT8gxPxWq0n1htAOACL8n4a6ABvQ2iX68t4Nn6Dn9O5Z6HcFrwP3dXuyCQ4p_10 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 57244ffb1da648d6a3a532292184d294 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:19.850828 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_57244ffb1da648d6a3a532292184d294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57244ffb1da648d6a3a532292184d294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57244ffb1da648d6a3a532292184d294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/57244ffb1da648d6a3a532292184d294"}]}] Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 57244ffb1da648d6a3a532292184d294 Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerDiagnosticsNegativeTest-206990123-project Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 775c03ae1cc940d68a1c8c29ad6a82ae Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-206990123-project Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:19.852178 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': 'c52dd8d6-81e7-4f73-9de0-86f502ecb955'} Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:19.852799 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:19.854005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:19.855096 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c274a12-d020-438a-91e2-6b2fe1d53afe tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.175992 Oct 04 18:05:19.855096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 186/328] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955/diagnostics => generated 117 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:19.879893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.880301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.889571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.890129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.890597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.891451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.891958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.892383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.932731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:19.945632 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2561d994-00c3-4067-868e-37577500e4e6 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/726977450" status: 202 len: 0 microversion: 2.1 time: 0.187212 Oct 04 18:05:19.949800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 143/329] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:19 2022] DELETE /compute/v2.1/flavors/726977450 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:19.954601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc19ab82-c858-40f8-85a8-55340b70e2a9 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.005248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc19ab82-c858-40f8-85a8-55340b70e2a9 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.054240 Oct 04 18:05:20.007039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 144/330] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.034798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed2abc8c-2f20-4895-8f72-b016bc5bd7a4 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1223903800", "id": 594511920, "os-flavor-access:is_public": "False"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:20.172501 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed2abc8c-2f20-4895-8f72-b016bc5bd7a4 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.141421 Oct 04 18:05:20.173479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 145/331] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:20 2022] POST /compute/v2.1/flavors => generated 412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:20.186131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bba50901-0d04-436c-8fb5-d91477371025 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.245521 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bba50901-0d04-436c-8fb5-d91477371025 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.060407 Oct 04 18:05:20.248909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 146/332] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.265409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd3778e1-89a7-4ecf-bd77-92f84ea85481 tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.320374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd3778e1-89a7-4ecf-bd77-92f84ea85481 tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.058896 Oct 04 18:05:20.320909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 147/333] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:20.339735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74fa8451-571a-4bba-b275-54166cbfa44c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.390998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af4db071-60f5-4f63-a079-1008249e39ab tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 204 len: 0 microversion: 2.1 time: 0.532203 Oct 04 18:05:20.395862 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 187/334] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:19 2022] DELETE /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:20.404429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.406837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.425566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.427193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.428594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.429340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.431275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.433879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.454527 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74fa8451-571a-4bba-b275-54166cbfa44c tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/594511920" status: 202 len: 0 microversion: 2.1 time: 0.117432 Oct 04 18:05:20.455330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 148/335] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:05:20 2022] DELETE /compute/v2.1/flavors/594511920 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:20.464030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a4480ee-ad6d-4ca5-a1e3-80cf85049861 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.500188 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a4480ee-ad6d-4ca5-a1e3-80cf85049861 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.040459 Oct 04 18:05:20.511506 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 149/336] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:20.541067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fcf38e7c-fc2c-49af-ae2b-a34c20fcd0fe tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1697786250", "id": 1818529560, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:20.634374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:20.640067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fcf38e7c-fc2c-49af-ae2b-a34c20fcd0fe tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.103728 Oct 04 18:05:20.640850 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 150/337] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:20 2022] POST /compute/v2.1/flavors => generated 414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:20.658817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b046e000-9bab-42dc-93fd-e31b9045ff67 tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.717234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b046e000-9bab-42dc-93fd-e31b9045ff67 tempest-FlavorsAdminTestJSON-1944208930 tempest-FlavorsAdminTestJSON-1944208930-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.066703 Oct 04 18:05:20.721430 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 151/338] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.764737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.766371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.780167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.781310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.782689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.783766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.785082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.785795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.970213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.986760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-13868e07-59b6-4d5c-9807-e063fd246427 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1478 microversion: 2.1 time: 0.589296 Oct 04 18:05:20.988437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 188/339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1478 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.008463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36f59c7f-7b9e-4f9b-9bc1-7cdbccd58fa9 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.140436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36f59c7f-7b9e-4f9b-9bc1-7cdbccd58fa9 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1818529560" status: 202 len: 0 microversion: 2.1 time: 0.150301 Oct 04 18:05:21.141494 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 189/340] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:05:20 2022] DELETE /compute/v2.1/flavors/1818529560 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:21.150702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.168252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.199676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.200546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.202131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.204828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.208483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.209854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.404933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.416726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20a56673-cd3d-4e80-aa76-a15362133472 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1278 microversion: 2.1 time: 0.271417 Oct 04 18:05:21.418592 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 190/341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.433016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2dd88917-8cf5-43e2-b5bc-0a6075dcd929 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.500074 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2dd88917-8cf5-43e2-b5bc-0a6075dcd929 tempest-FlavorsAdminTestJSON-1458825189 tempest-FlavorsAdminTestJSON-1458825189-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.079548 Oct 04 18:05:21.504025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 191/342] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.009215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08625ac-e199-462b-9a98-73e05914ad2b", "tag": "bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:22.035131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.040339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.042945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.068901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] Creating event network-changed:bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8 for instance c08625ac-e199-462b-9a98-73e05914ad2b on n-h2-833090-21 Oct 04 18:05:22.088831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-59331816-4563-43d6-b80e-53aa919a4f54 req-b6f4d6d1-9fbf-4509-aee3-3934a5d25750 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090331 Oct 04 18:05:22.089802 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 192/343] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:22.098697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.099415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.111697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.112200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.112647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.115992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.116235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.116685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.463543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.481263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e6415fef-75d0-4634-bed5-a6ff319f5a0c tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 1.740525 Oct 04 18:05:22.484636 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 152/344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.504616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.509421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.526127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.529368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.531833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.535264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.536028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.537579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.614633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.628830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-beef2933-4877-4d0e-b80e-d5e0649b4f78 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1478 microversion: 2.1 time: 0.535015 Oct 04 18:05:22.641833 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 193/345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1478 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:23.507864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.508480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.521601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.522096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.522791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.523528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.523986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.524415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.997961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:24.064884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.075730 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65230d3d-8a12-473c-b5ab-a77b7a6e475d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.570878 Oct 04 18:05:24.076498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 194/346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:24.097282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.103479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.124208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.125053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.125506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.126251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.126744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.127167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.193340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.209897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83e8db4b-2365-48ff-84b8-96cafe9a7c70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 1.723266 Oct 04 18:05:24.210657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 153/347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.253618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.261874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07efeeef-5845-425e-b02f-b190c937601f tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1436 microversion: 2.1 time: 0.168324 Oct 04 18:05:24.265974 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 195/348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1436 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.875187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52dd8d6-81e7-4f73-9de0-86f502ecb955", "name": "network-vif-deleted", "tag": "d97f045d-9a70-4c56-8098-9d80480824c7"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:24.938508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:24.951719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.954423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.955079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.047027 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] Creating event network-vif-deleted:d97f045d-9a70-4c56-8098-9d80480824c7 for instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 on n-h1-833090-21 Oct 04 18:05:25.066370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b5949a-142e-4439-9552-e7c2c2fad742", "tag": "7f4cffa5-75ab-4565-adbf-e17737f2b522"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:25.084154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d0d831d6-c4b4-41c4-ac6b-ae29ee15ccec req-04d2ceaf-74cd-4dfd-a798-1e2a8a4cdc20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224776 Oct 04 18:05:25.088405 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 154/349] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:25.102143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.102900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.103747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.131704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.134334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.157937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.164443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.166904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.168555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.175239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.175703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] Creating event network-changed:7f4cffa5-75ab-4565-adbf-e17737f2b522 for instance c4b5949a-142e-4439-9552-e7c2c2fad742 on n-h2-833090-21 Oct 04 18:05:25.177801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.192686 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c5bdf1f8-d19b-496f-a030-d3e52b38c08d req-aa14c1cc-5433-4448-92b5-2b880ff8a51e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127197 Oct 04 18:05:25.194891 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 196/350] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:25.251670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.252785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.263682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.267536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.268933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.273026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.273735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.274328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.308934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.634714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.650071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97f3a06e-38fb-4412-96fe-6ef7141323c6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.411033 Oct 04 18:05:25.666234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 197/351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:25.674796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.675411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.693822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.694301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.694899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.695791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.696250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.696665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.748282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.749167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.749852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.750533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lazy-loading 'fault' on Instance uuid c52dd8d6-81e7-4f73-9de0-86f502ecb955 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:25.772392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.787263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.802547 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c9e1680-48e4-4976-b152-c380778cd2b8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.704780 Oct 04 18:05:25.803375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 155/352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.846346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '775c03ae1cc940d68a1c8c29ad6a82ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57244ffb1da648d6a3a532292184d294', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.855770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e04c3d82-f062-4afb-baa4-4204f2d5741c tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 200 len: 1312 microversion: 2.1 time: 0.188001 Oct 04 18:05:25.856379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 198/353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.503850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1044797405", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bcca917f-d495-4d05-8cab-ccf60494bd86"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:26.618391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] validate_networks() for [('bcca917f-d495-4d05-8cab-ccf60494bd86', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:26.677221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.677777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.688201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.688693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.689133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.690192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.690658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.691656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.906526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.930418 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69cfd150-5fcc-408d-8810-21ed06bc414c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.258159 Oct 04 18:05:26.931808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 199/354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.937103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.938723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.950245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.951132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.951805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.953303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.953943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.954540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.143173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.152345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39b278e9-4dd4-405c-891c-902ab2f135cf tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.219117 Oct 04 18:05:27.158969 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 200/355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:27.158969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.159340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] [instance: c52dd8d6-81e7-4f73-9de0-86f502ecb955] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.165941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.166554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.167096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.168697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.169414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.170039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.186454 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] HTTP exception thrown: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Request method failure captured: Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 HTTP/1.1 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXJ_2u96JAM49D1d0pFdFgct15seRE1bkkUvBmBEydVVdTFDK8I70BznZQygu3VXhAczjFku6WsSu5ox_JmD46QVvvibVe7wiccVWwZTe9csB4eBT8gxPxWq0n1htAOACL8n4a6ABvQ2iX68t4Nn6Dn9O5Z6HcFrwP3dXuyCQ4p_10 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 57244ffb1da648d6a3a532292184d294 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:27.188216 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_57244ffb1da648d6a3a532292184d294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57244ffb1da648d6a3a532292184d294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57244ffb1da648d6a3a532292184d294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/57244ffb1da648d6a3a532292184d294"}]}] Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 57244ffb1da648d6a3a532292184d294 Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-206990123 Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerDiagnosticsNegativeTest-206990123-project Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 775c03ae1cc940d68a1c8c29ad6a82ae Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-206990123-project Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. Oct 04 18:05:27.189587 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c52dd8d6-81e7-4f73-9de0-86f502ecb955'} Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:27.190301 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. Oct 04 18:05:27.191532 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:27.192593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] Returning 404 to user: Instance c52dd8d6-81e7-4f73-9de0-86f502ecb955 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:27.192593 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-487d3f14-0b7f-4d14-b08c-97c11c94d750 tempest-ServerDiagnosticsNegativeTest-206990123 tempest-ServerDiagnosticsNegativeTest-206990123-project] 10.222.0.40 "GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955" status: 404 len: 111 microversion: 2.1 time: 0.035041 Oct 04 18:05:27.192593 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 201/356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/c52dd8d6-81e7-4f73-9de0-86f502ecb955 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:27.955053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.956373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.971718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.972212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.972655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.973537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.974066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.974505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.264135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.278369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ec5874b-6d8d-47fd-9deb-acb48b0f4bf3 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.326643 Oct 04 18:05:28.282858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 202/357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.295938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.296588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:28.307099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.312161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.312635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.313723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.314353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.314936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.660199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.671873 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd6b9a81-2097-4a08-9bc1-0346e85bcf0a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.391556 Oct 04 18:05:28.674627 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 203/358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.028393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:29.028867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:29.029715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:29.031191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:29.031798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:29.066591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.067768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.068646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.070997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.072856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.077704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.123108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:29.139355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for user 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 and project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:29.163988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:29.168817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:29.310137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.311365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.351069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.354629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.357633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.359241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.366206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.378949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.387956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3720bed8-0817-4365-877c-d305891f8c64 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.446834 Oct 04 18:05:29.393795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 156/359] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3455 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:05:29.412809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.413444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.552413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.571435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.580202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.581840 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4e8606f-7bfb-49be-9445-652ba84142b0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1262 microversion: 2.25 time: 0.180887 Oct 04 18:05:29.592529 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 157/360] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1262 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:29.675433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.685551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb7efbcf-f8e8-49c6-8bbf-508545f196fa tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.383999 Oct 04 18:05:29.687002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 204/361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.706510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.708440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.737544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.740506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.743133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.747329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.752007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.752007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.211384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.237817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cd0cb02-5a23-49ea-abf6-c223e19c42c4 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.536520 Oct 04 18:05:30.258206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 205/362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:30.325144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1391810246", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "738e51fb-23eb-476d-bf15-f770881dd94b"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:30.466420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] validate_networks() for [('738e51fb-23eb-476d-bf15-f770881dd94b', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:30.625644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.626250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.766083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.774736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.776596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.777927 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f4050963-c46b-4121-ad54-a8b1baf59680 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1262 microversion: 2.25 time: 0.157274 Oct 04 18:05:30.779041 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 206/363] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:30.784036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.784891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.792018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.796909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.802787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.804096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.804750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.805356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.097192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.110046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-093ffa21-3fe4-4861-9b0d-2e9830ffdd5a tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.329217 Oct 04 18:05:31.112611 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 207/364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.264841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.265462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.273507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.274009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.277759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.278504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.278975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.279756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.483968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:31.484467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:31.484728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:31.485302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:31.485883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:31.495684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.496456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.497106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.498060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.498740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.499413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.580197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Getting quotas for project 9fca83eac610475d8e69eb5bfc1af3a0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:31.587007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Getting quotas for user f4db97c2518b40e0a17c3115cc01b69f and project 9fca83eac610475d8e69eb5bfc1af3a0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:31.609506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:31.612051 n-d-833090-21 devstack@n-api.service[123886]: WARNING nova.utils [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1391810246 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-139181024 Oct 04 18:05:31.613447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:31.674369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.687998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10c173df-9867-4bb6-a176-9ed33c8b9c6f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.427002 Oct 04 18:05:31.689001 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 208/365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.807144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.808650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.819994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.822769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.823488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.824401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.825061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.826286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.877613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c96bacbc-8b9e-45c7-a04f-7ee64e725e93 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218225 Oct 04 18:05:31.879571 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 158/366] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:31.892860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdccaa6d-365d-4454-aebf-d8b7c9dc6544 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.894747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdccaa6d-365d-4454-aebf-d8b7c9dc6544 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.117558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fdccaa6d-365d-4454-aebf-d8b7c9dc6544 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.129129 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdccaa6d-365d-4454-aebf-d8b7c9dc6544 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1232 microversion: 2.1 time: 0.243063 Oct 04 18:05:32.140098 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 159/367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1232 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.166448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.176420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.201332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.204876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.206577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.207207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.210158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.210926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.212626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.220211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.221709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.222855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14692ad9-3626-46ec-a2bf-3fd04ab5e34b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1266 microversion: 2.25 time: 0.420590 Oct 04 18:05:32.252464 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 209/368] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:32.733841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.756785 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ff8676a-ef0e-4ad9-8a90-1cc05eb82daf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.612700 Oct 04 18:05:32.758030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 160/369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.765514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.766423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.793218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.795667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.796424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.797374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.799864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.801453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.064241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.080216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bd9d8d4-d838-4d77-97b3-01d6a8664647 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.318521 Oct 04 18:05:33.092329 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 161/370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.148877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Calling method '.version_select at 0x7f9009cdaf70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.156355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.157188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.181545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46e452cf-2572-4df8-9d8e-14d396a5c12c tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.184334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46e452cf-2572-4df8-9d8e-14d396a5c12c tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.200530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.236275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.237001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.237580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.360767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.361275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.361717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.387398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.388429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.388429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.451358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.452167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.452754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.462263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b83b7aa2-8ebc-4e83-91f4-390aa91ec7e8 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1919 microversion: 2.53 time: 0.803276 Oct 04 18:05:33.463436 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 210/371] 10.222.0.40 () {60 vars in 1243 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1919 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:33.474758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.475756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.484338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.486189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.486901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.488594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.490798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46e452cf-2572-4df8-9d8e-14d396a5c12c tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.491105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.491793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.499516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46e452cf-2572-4df8-9d8e-14d396a5c12c tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1232 microversion: 2.1 time: 0.340523 Oct 04 18:05:33.502550 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 162/372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1232 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.517399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Calling method '.version_select at 0x7f9009f25f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.536072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.536838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.537570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.578394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.582238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.582974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.640277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.656580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.656580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.656580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.657189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.664963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.668793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28ea531b-a0d4-4dfd-bb58-ff370ccdace7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1322 microversion: 2.25 time: 0.201387 Oct 04 18:05:33.671637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 211/373] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:33.684242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.684242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.684242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.731673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.731673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.731673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.731673 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0cdce5a-437a-4c00-9f52-db7b286910fb tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 609 microversion: 2.53 time: 0.226529 Oct 04 18:05:33.732005 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 163/374] 10.222.0.40 () {60 vars in 1222 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 609 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:33.744043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Calling method '.version_select at 0x7f9009d75dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.749559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.750244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.750896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.768768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.769486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.770089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.778433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d5a4864-c508-4e21-a467-e771e5bc86d6 tempest-HypervisorAdminV253TestBase-357030756 tempest-HypervisorAdminV253TestBase-357030756-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/fb4531f5-1be6-49ad-b09c-4bf043d98c29" status: 200 len: 794 microversion: 2.53 time: 0.038573 Oct 04 18:05:33.779778 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 212/375] 10.222.0.40 () {60 vars in 1298 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/os-hypervisors/fb4531f5-1be6-49ad-b09c-4bf043d98c29 => generated 794 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:33.789412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.790991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.801910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.802433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.802877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.804544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.805024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.805455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.111247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.115877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.121783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.122321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.122811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.123243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.123967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.125764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.126220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.129821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:34.134988 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a37f71b2-0fcd-4fc4-a1ea-7d42bb70eae0 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.355505 Oct 04 18:05:34.135658 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 164/376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:34.374448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08625ac-e199-462b-9a98-73e05914ad2b", "name": "network-vif-plugged", "status": "completed", "tag": "bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.426481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.429018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.433147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.477922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] Creating event network-vif-plugged:bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8 for instance c08625ac-e199-462b-9a98-73e05914ad2b on n-h2-833090-21 Oct 04 18:05:34.502536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-8a99d7db-e718-4cd7-a8ef-799b70c9c507 req-8923c608-201a-478a-a1da-a86f6051f404 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132691 Oct 04 18:05:34.510690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 165/377] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:34.529596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.530300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.552804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.563288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebc86b05-512e-4d50-abd9-3351cbcd3e80 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.461213 Oct 04 18:05:34.566331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.569930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 213/378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:34.574169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.575018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.575952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.578028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.578625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.711683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.712403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.730248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.733735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.733735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.746383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.746906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.747337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.779195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:34.936391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.945464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6200a8f4-71e3-40c4-997f-326ca9f15a4e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1228 microversion: 2.1 time: 0.420654 Oct 04 18:05:34.946043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 166/379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1228 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:35.062958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.071515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.073540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.079307 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8011a89e-82f0-48a2-a254-b64bf8d6b1ed tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.379874 Oct 04 18:05:35.096303 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 214/380] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:35.163456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.164856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.178945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.185445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.186014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.186852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.195659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.196226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.598493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.607827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61f5c4f8-c161-479b-acfa-89388ee9877c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.448062 Oct 04 18:05:35.612505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 167/381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.628528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.629459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.641570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.642067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.642702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.643600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.644207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.644781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.711585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-127717748", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:35.834808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:35.835230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:35.843094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:35.843423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:35.844165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:35.873185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.873697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.874137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.876437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.877023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.880019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.913313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Getting quotas for project 47776374afe649ab82ddac010a0768b7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:35.928105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:35.932559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Getting quotas for user 49f096d1beaf470586d93b5d02e3626c and project 47776374afe649ab82ddac010a0768b7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:35.959361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:35.964883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:36.152657 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15cd9a54-d960-4dad-b31a-0031b740b939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.687221 Oct 04 18:05:36.156766 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 215/382] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:05:36.171890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.190141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.221727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.221727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.222242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.240060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.244948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.247718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.280799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.289329 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a626cb8-a280-4982-8e5c-ee870de7591f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1318 microversion: 2.1 time: 0.675539 Oct 04 18:05:36.289975 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 168/383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.310294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.315416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.353512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.354069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.354514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.357816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.358182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.358679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.717797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.719245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.727398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc63d4cb-40a5-4e0f-8caf-08f12312a672 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1290 microversion: 2.1 time: 0.569047 Oct 04 18:05:36.728012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 216/384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1290 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.737693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.738264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.738410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.741419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.852807 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6636b9c-dab0-42e5-9f77-0f81557bb49f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.442231 Oct 04 18:05:36.852807 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 169/385] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:36.852807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.852807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.852807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.854666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.854666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.854666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.854666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.855033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.855274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.855274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.855666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.855666 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1032de28-c36d-4140-93ad-5e675b7a739c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1452 microversion: 2.91 time: 0.093782 Oct 04 18:05:36.855666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 217/386] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:36.926843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.935659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c2bf159-f9a3-44fc-a1b8-e7521747a048 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.188483 Oct 04 18:05:36.936253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 170/387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.312924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.313821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.329208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.330035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.332053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.332996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.335059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.335701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.766278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924684cc-8e02-41ca-b044-c3663727d075", "tag": "6fa69cb8-230d-4e60-9807-4cdc6b033013"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:37.775701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.787491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.787989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.788423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.794959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3be71778-7166-426b-91b4-e8fa00e72635 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1467 microversion: 2.1 time: 0.486574 Oct 04 18:05:37.798836 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 218/388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1467 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.814442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] Creating event network-changed:6fa69cb8-230d-4e60-9807-4cdc6b033013 for instance 924684cc-8e02-41ca-b044-c3663727d075 on n-h1-833090-21 Oct 04 18:05:37.837677 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5c5b5003-796a-418a-a29a-f25ab7c68ab0 req-35078e38-6d0a-4809-9fe1-265a49fe2f02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070424 Oct 04 18:05:37.842299 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 171/389] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:37.873384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.876766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.896959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.897794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.898402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.901439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.902111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.907305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.190740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1399527519", "block_migration": true, "disk_over_commit": false}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:38.193401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.206084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.206588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.207084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.207843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.208211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.218179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.269957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.286467 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed988b9b-b3fe-4eae-93e1-2bc7b4cf272e tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1290 microversion: 2.1 time: 0.425611 Oct 04 18:05:38.288835 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 172/390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1290 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.305086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.306254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.327868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.333543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.334160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.335309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.336357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.337148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.415264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lazy-loading 'flavor' on Instance uuid c08625ac-e199-462b-9a98-73e05914ad2b {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:38.511583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Going to try to live migrate instance to tempest-host-1399527519 {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:05:38.525256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] HTTP exception thrown: Compute host tempest-host-1399527519 could not be found. Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Request method failure captured: Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b/action HTTP/1.1 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 107 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXVqc7NC5vIVvoGiidNnHMsej-rpOgJ6_F0Lbxm739IyFhl8anmpNwf4tC0OMtEOJa4p_pmZyN37jMYLcJAq855xeL_Y0dHabVQreEM3PM-YsrQ6Qohucsh8JeKwBrBleOyi0IrYg9hV_stLyqGT026igqjcAWRQIPFaIm5YAPWMYM Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 211181f5288d47989009e60554f89f37 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:38.532321 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_211181f5288d47989009e60554f89f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/211181f5288d47989009e60554f89f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/211181f5288d47989009e60554f89f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/211181f5288d47989009e60554f89f37"}]}] Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 211181f5288d47989009e60554f89f37 Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveMigrationNegativeTest-1290275290-project-admin Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 03861b86824a4c1699fac1b720ff2735 Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveMigrationNegativeTest-1290275290-project-admin Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: {"os-migrateLive": {"host": "tempest-host-1399527519", "block_migration": true, "disk_over_commit": false}} Oct 04 18:05:38.534163 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: exception: Compute host tempest-host-1399527519 could not be found. Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c08625ac-e199-462b-9a98-73e05914ad2b', 'body': {'os-migrateLive': {'host': 'tempest-host-1399527519', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:05:38.535247 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1399527519 could not be found. Oct 04 18:05:38.536622 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1399527519 could not be found. Oct 04 18:05:38.537981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1399527519 could not be found. Oct 04 18:05:38.539400 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.540412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Returning 400 to user: Compute host tempest-host-1399527519 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:38.546263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-127c71f7-98c2-45d8-8a16-53509c3763d8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b/action" status: 400 len: 100 microversion: 2.1 time: 0.720127 Oct 04 18:05:38.546263 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 219/391] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 4 18:05:37 2022] POST /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b/action => generated 100 bytes in 722 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:38.552369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.554467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.562826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.563452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.563974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.564937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.565732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.566250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.762286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.777068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.779824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.795030 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b27e3b3-2c6c-4981-883b-4609aa1d0af1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1456 microversion: 2.91 time: 0.251445 Oct 04 18:05:38.798080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 220/392] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1456 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:38.811370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b5949a-142e-4439-9552-e7c2c2fad742", "name": "network-vif-plugged", "status": "completed", "tag": "7f4cffa5-75ab-4565-adbf-e17737f2b522"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:38.833457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.834187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.834788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.849935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] Creating event network-vif-plugged:7f4cffa5-75ab-4565-adbf-e17737f2b522 for instance c4b5949a-142e-4439-9552-e7c2c2fad742 on n-h2-833090-21 Oct 04 18:05:38.855515 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8f8ef30a-60f5-4843-863b-2aae42ec50a1 req-d060e605-a907-4c3a-9543-8bcd35234ad2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056189 Oct 04 18:05:38.856410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 221/393] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:38.862191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.863863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.871233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.872125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.872818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.873719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.874356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.875049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.911528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.925517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.930041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.944239 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ac16b5a-d248-4ae4-b61f-e8e4d200f889 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.641311 Oct 04 18:05:38.944239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 173/394] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:38.944239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.944239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.950626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.951240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.951871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.952639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.953163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.953929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.181124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.192725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b002ce9b-37ee-4bbd-bada-9505d63523e6 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.334796 Oct 04 18:05:39.208385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 222/395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.316538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:39.322941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.324885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.325377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.325816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.326515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.327079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.327896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.597195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.618434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-11ed4d97-db87-4440-a9a0-8cc54d064e45 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.301546 Oct 04 18:05:39.623109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 223/396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.716527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.724465 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a79b51bb-9643-476b-89da-bf6e1b7efc67 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1467 microversion: 2.1 time: 0.791012 Oct 04 18:05:39.739878 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 174/397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1467 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.823189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:39.823972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.837645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.838385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.839049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.840009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.840687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.841353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.900891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-970857650", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:39.988567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.996820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:40.002761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.004380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.011610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00b8d6d9-4f83-473e-85c3-8779db2b0fb5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1504 microversion: 2.91 time: 0.192845 Oct 04 18:05:40.012420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 224/398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:40.059947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.060562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.066926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.067887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.068521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.069617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.070264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.070883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.590142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.606637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.610652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.611828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3ab9d43-4381-464e-9f84-4ef7831ad38d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.598194 Oct 04 18:05:40.612392 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 225/399] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:40.631755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e52a18-f5a7-44a0-9352-a5387586bd61", "tag": "a1e72178-dd4d-462d-8a7b-5fdd4a886085"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:40.643827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.645159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.645777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.659530 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] Creating event network-changed:a1e72178-dd4d-462d-8a7b-5fdd4a886085 for instance e1e52a18-f5a7-44a0-9352-a5387586bd61 on n-h1-833090-21 Oct 04 18:05:40.669640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2c9457df-6657-4517-9249-02fbfa47c3a5 req-e286d29c-4384-45fe-bfe9-a9b4dd3c1c29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051954 Oct 04 18:05:40.670889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 226/400] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:40.676562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.677655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.684588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.685135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.685580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.686276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.687054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.688030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.725585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:40.726008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:40.726494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:40.727378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:40.728100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:40.745285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.745783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.746239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.747914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.748584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.750816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.795264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Getting quotas for project 41462bdf6c6a4c0c9959a8289689ec92. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:40.805567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Getting quotas for user f1faf17db3a745e288d227ce3c8c4294 and project 41462bdf6c6a4c0c9959a8289689ec92. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:40.826870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:40.830706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:40.834585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:40.898834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.907646 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-71647cb2-a682-4f80-8d8d-461e0a577b59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1320 microversion: 2.1 time: 0.235384 Oct 04 18:05:40.908550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 227/401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.913374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.914235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.920324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.921036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.921640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.922602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.923251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.924041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.974892 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02ebeb6c-dde1-486d-a1c3-8972998c6949 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077738 Oct 04 18:05:40.977336 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 175/402] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:40.986935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9adf1677-2f13-4609-a143-c5b461fff015 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.987870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9adf1677-2f13-4609-a143-c5b461fff015 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.105994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9adf1677-2f13-4609-a143-c5b461fff015 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.120296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.120496 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9adf1677-2f13-4609-a143-c5b461fff015 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1218 microversion: 2.1 time: 0.137465 Oct 04 18:05:41.120989 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 176/403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.134966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c1cc0ad-5b7f-458c-b180-2a5475e4b17a tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.222029 Oct 04 18:05:41.135224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.136400 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 228/404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.138405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.168925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.168925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.168925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.168925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.169336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.169336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.373321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.385753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.387200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.396545 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af94ca92-6960-423b-816c-7f2b6ac93ff3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1522 microversion: 2.91 time: 0.269084 Oct 04 18:05:41.397137 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 177/405] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.648457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.649775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.658283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.659067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.659747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.672749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.673634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.678074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.921472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.930076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.930249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.930705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.931605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.932801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e77ee417-01ae-4d2f-b609-f8a7d597389b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.293637 Oct 04 18:05:41.933526 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 229/406] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.937536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.938015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.938442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.939127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.939602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.940022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.145224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1deb9e93-debf-4c69-aa50-2f2573c9de4f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.145760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1deb9e93-debf-4c69-aa50-2f2573c9de4f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.193682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.204002 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-da810c69-dcca-47f5-ba1b-2e04e1148d59 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1469 microversion: 2.1 time: 0.277673 Oct 04 18:05:42.204672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 178/407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:42.211129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.212032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.218113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1deb9e93-debf-4c69-aa50-2f2573c9de4f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.226357 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1deb9e93-debf-4c69-aa50-2f2573c9de4f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1218 microversion: 2.1 time: 0.085737 Oct 04 18:05:42.226995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 230/408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:42.235762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.245357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.245357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.252216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.254193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.256613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.589896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.603868 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-882e1c62-617c-443c-aed2-d12f7ce1b76b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.397405 Oct 04 18:05:42.614414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 179/409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.629191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.633423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.644154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.644941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.645971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.646904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.647416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.648612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.681944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.682434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.690052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.690890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.691316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.692044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.692491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.692908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.748395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.764806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.768979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.774225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:42.782702 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a75f440-df2a-4079-afd3-1b698dd8d4bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1510 microversion: 2.91 time: 0.157915 Oct 04 18:05:42.800997 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 180/410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:43.033919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1422887655", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "286df177-dde3-4675-bad4-0ffd6b0a97f8"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:43.099975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] validate_networks() for [('286df177-dde3-4675-bad4-0ffd6b0a97f8', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:43.264405 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12d55781-2bbc-46ef-98f0-f8f550ca37ac tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 204 len: 0 microversion: 2.1 time: 1.035586 Oct 04 18:05:43.265967 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 231/411] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:42 2022] DELETE /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:43.274387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.275922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.285733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.286221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.286653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.287399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.287903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.288502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.446451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.456096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.457560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.458721 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f33fbcd1-6b35-4c17-bf3d-09aa2dce1a29 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.191007 Oct 04 18:05:43.459829 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 232/412] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:43.465553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.466433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.473314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.474047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.474641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.475707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.476318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.476899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.481175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:43.545463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:43.546061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:43.546551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:43.546993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:43.547410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:43.547618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.557097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-187dae03-7d47-4bd1-959c-e2794bf172f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1270 microversion: 2.1 time: 0.096033 Oct 04 18:05:43.572138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 233/413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.572343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.572343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.572343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.572343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.572651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.572651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.572793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.572793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.574420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.575157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.575627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.576340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.576843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.577273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.581491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:43.588049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for user 97934d1450a94f40b1d7a82d05fb47dc and project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:43.601888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:43.604481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:43.713302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.722998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e611659b-082d-4b67-b26e-9cac5009bae1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1475 microversion: 2.1 time: 0.164227 Oct 04 18:05:43.723789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 234/414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1475 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.795024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8772a158-4b23-474b-abee-fa7bdde66b21 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845545 Oct 04 18:05:43.801968 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 181/415] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:43.807156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.808314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.831149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.831887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.832651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.833573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.835488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.836448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.848218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-565f32cc-b975-42b5-b6c1-43f3a9835e7f tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.849703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-565f32cc-b975-42b5-b6c1-43f3a9835e7f tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-565f32cc-b975-42b5-b6c1-43f3a9835e7f tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin] Request method failure captured: Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHX31keIeOycHHLy0boIX8p32s1UFkGH8ckPVnbMx1zVYR0-wtWJRbIMFRCAadiTd2mMDtYoza3EhQ0oZ-NaTGnsQscJaI8FLQoB5NDkxB8D7pl4-DsCPkorlsbn27SlLhAf_sIUiF_sqkqmL0l22mChnZaWZcmmdcyI6Xb4FiVFchE Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 3fc7bb10f0b342a2bc555753628ce481 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:05:43.857780 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3fc7bb10f0b342a2bc555753628ce481"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3fc7bb10f0b342a2bc555753628ce481"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3fc7bb10f0b342a2bc555753628ce481"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3fc7bb10f0b342a2bc555753628ce481"}]}] Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 3fc7bb10f0b342a2bc555753628ce481 Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9cf46044adfe4a76953dffb2f60d14d6 Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:43.859311 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid timestamp for date invalid_time Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'invalid_time'} Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:43.860163 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 18:05:43.861302 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.862358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-565f32cc-b975-42b5-b6c1-43f3a9835e7f tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:43.863123 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-565f32cc-b975-42b5-b6c1-43f3a9835e7f tempest-InstanceUsageAuditLogNegativeTestJSON-226464958 tempest-InstanceUsageAuditLogNegativeTestJSON-226464958-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.138032 Oct 04 18:05:43.868013 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 235/416] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:05:43.869110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8ed2bdd-999d-4820-baf5-099ce2378701 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.870626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8ed2bdd-999d-4820-baf5-099ce2378701 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.949776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8ed2bdd-999d-4820-baf5-099ce2378701 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.965463 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8ed2bdd-999d-4820-baf5-099ce2378701 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1211 microversion: 2.1 time: 0.100304 Oct 04 18:05:43.969824 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 236/417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.980886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.981498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.990873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.990873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.990873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.991707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.992368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.992733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.065956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.074062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29a1e312-b56d-4477-864d-5fea646f6a79 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.270679 Oct 04 18:05:44.075391 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 182/418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:44.141122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.150201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.151943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.157365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9201a0a-dc3c-4569-ada3-726d952af9cd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1510 microversion: 2.91 time: 0.186321 Oct 04 18:05:44.173083 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 237/419] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:44.217678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6ccf93f-ba49-4fec-8f16-f2a05a9c5a74 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.219409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e6ccf93f-ba49-4fec-8f16-f2a05a9c5a74 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cdc0bf592cbb4e6aaed6278a31bd1755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58670f3018464ec38630ee5c8a079ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6ccf93f-ba49-4fec-8f16-f2a05a9c5a74 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Request method failure captured: Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHX2qoSk8Fkig8rjCjxi9cCeu66zoaiLkozcH_p02-iWC2CMzWL7k55NPUON8q5swiemB31cZATIVuYuaXLKwU26GhYqCLrniZ1bCWUqUfrBjGavcePz5mRN8-kILypF7Jj27sv6p6C3hQZv_tbE3Wmvn15wPtgFOpU_awQQDbc16eQ Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 58670f3018464ec38630ee5c8a079ec2 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:05:44.221288 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/58670f3018464ec38630ee5c8a079ec2"}]}] Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 58670f3018464ec38630ee5c8a079ec2 Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdc0bf592cbb4e6aaed6278a31bd1755 Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project Oct 04 18:05:44.223617 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: action_args: {} Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:44.225362 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 18:05:44.228283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.230644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6ccf93f-ba49-4fec-8f16-f2a05a9c5a74 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:44.230644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e6ccf93f-ba49-4fec-8f16-f2a05a9c5a74 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.146132 Oct 04 18:05:44.230644 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 183/420] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:44.236457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3445366-5723-4846-b7bc-70b49beb6a0f tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.238191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3445366-5723-4846-b7bc-70b49beb6a0f tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cdc0bf592cbb4e6aaed6278a31bd1755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58670f3018464ec38630ee5c8a079ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3445366-5723-4846-b7bc-70b49beb6a0f tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Request method failure captured: Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018:05:44 HTTP/1.1 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHX2qoSk8Fkig8rjCjxi9cCeu66zoaiLkozcH_p02-iWC2CMzWL7k55NPUON8q5swiemB31cZATIVuYuaXLKwU26GhYqCLrniZ1bCWUqUfrBjGavcePz5mRN8-kILypF7Jj27sv6p6C3hQZv_tbE3Wmvn15wPtgFOpU_awQQDbc16eQ Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 58670f3018464ec38630ee5c8a079ec2 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:05:44.240149 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58670f3018464ec38630ee5c8a079ec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/58670f3018464ec38630ee5c8a079ec2"}]}] Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 58670f3018464ec38630ee5c8a079ec2 Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: cdc0bf592cbb4e6aaed6278a31bd1755 Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project Oct 04 18:05:44.241389 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2022-10-04 18:05:44'} Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:05:44.242079 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 18:05:44.244477 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:05:44.246789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3445366-5723-4846-b7bc-70b49beb6a0f tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:44.246789 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3445366-5723-4846-b7bc-70b49beb6a0f tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032 tempest-InstanceUsageAuditLogNegativeTestJSON-1327939032-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 18:05:44" status: 403 len: 128 microversion: 2.1 time: 0.008961 Oct 04 18:05:44.246789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 238/421] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2018%3A05%3A44 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:44.485758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.486388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.494075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.494602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.495017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.495824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.496463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.497050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.582527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.584667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.601940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.602997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.603450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.604969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.605439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.608277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.695264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.704395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.706139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.706440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.708609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-edc65f9b-dc3d-43c0-9e17-fb6ad2d91b51 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.226315 Oct 04 18:05:44.717827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-655cc891-b881-4e8c-bf5e-bc8d24cf1e47 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1270 microversion: 2.1 time: 0.138300 Oct 04 18:05:44.719140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 239/422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:44.724095 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 184/423] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:44.746653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.747259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.753937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.754421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.754910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.755624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.756236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.756650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.989206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ebe12d4e-327c-449d-b34e-7ad386e36590 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.989821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ebe12d4e-327c-449d-b34e-7ad386e36590 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.990305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.002658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4c1f9d7-2f28-48df-a062-430d46d9a68e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1475 microversion: 2.1 time: 0.259956 Oct 04 18:05:45.003264 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 240/424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1475 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.095253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ebe12d4e-327c-449d-b34e-7ad386e36590 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.098122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.099823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.105097 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ebe12d4e-327c-449d-b34e-7ad386e36590 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1211 microversion: 2.1 time: 0.119671 Oct 04 18:05:45.105917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 185/425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:45.122314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.123141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.123821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.124731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.125389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.125973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.189780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.190513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.207452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.208020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.211707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.216207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.216786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.219302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.357234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.377120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f598a4a-279a-41d1-8e0b-4485e3e1a610 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.282635 Oct 04 18:05:45.378262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 241/426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.381621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.393465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.395677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.403340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b43bd7e-3594-4e0d-a953-d0fdb5b3c508 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1510 microversion: 2.91 time: 0.218327 Oct 04 18:05:45.404716 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 186/427] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:45.751545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.751545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.752309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.753093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.754395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.755215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.755856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.756769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.757615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.757979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.760699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.761740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.762339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.766067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:45.777424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.778718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.779413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.874993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.896028 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86cac891-ce20-42a2-a6b1-5066dbada6a8 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1278 microversion: 2.1 time: 0.157366 Oct 04 18:05:45.897561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:45.903123 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 187/428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.917461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b5949a-142e-4439-9552-e7c2c2fad742", "name": "network-vif-deleted", "tag": "7f4cffa5-75ab-4565-adbf-e17737f2b522"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:45.929219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.929743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.930147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.956998 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] Creating event network-vif-deleted:7f4cffa5-75ab-4565-adbf-e17737f2b522 for instance c4b5949a-142e-4439-9552-e7c2c2fad742 on n-h2-833090-21 Oct 04 18:05:45.967052 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1000501b-9c86-4352-95c1-848f5c186755 req-a64b996a-6b3f-465b-b3af-9f72892ea1df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061248 Oct 04 18:05:45.967779 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 188/429] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:46.035976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.037070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.051988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.052847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.053610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.054811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.055745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.056655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.185731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.200703 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08b147f6-41cf-476f-a4cc-38e8221b95d4 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1433 microversion: 2.1 time: 0.171520 Oct 04 18:05:46.202290 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 189/430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1433 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.211550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.213000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.227295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.228897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.229955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.231506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.232813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.233934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.349133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.362652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.364075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.365287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6edad8fb-7e79-4073-afa3-80419eee5678 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.634421 Oct 04 18:05:46.365747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 242/431] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:46.402533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.403204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.411601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.413750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.414237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.419183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.420132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.420754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.421498 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21aeb1a6-7bbf-4a66-be7f-dc94ae5a4d54 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1263 microversion: 2.1 time: 0.217402 Oct 04 18:05:46.422930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 190/432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.423282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.441972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.443133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.460412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.461197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.466275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.466275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.466275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.466275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.622804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.633665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.639057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.642183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.647793 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28a43f13-e325-4fee-bb59-f6c4f1a78180 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1531 microversion: 2.91 time: 0.209918 Oct 04 18:05:46.665649 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 191/433] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1531 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:46.668374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01c5fa98-5bed-42c2-8bce-3a340584cd9b tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.269639 Oct 04 18:05:46.669311 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 243/434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.877409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924684cc-8e02-41ca-b044-c3663727d075", "name": "network-vif-plugged", "status": "completed", "tag": "6fa69cb8-230d-4e60-9807-4cdc6b033013"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:46.902516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.906273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.907047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.941989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] Creating event network-vif-plugged:6fa69cb8-230d-4e60-9807-4cdc6b033013 for instance 924684cc-8e02-41ca-b044-c3663727d075 on n-h1-833090-21 Oct 04 18:05:46.947160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-caa1d8e6-12c7-4c18-a463-e883c2041b79 req-5caedd7d-8fd7-43be-bb50-89a909c6e9ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073349 Oct 04 18:05:46.948217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 244/435] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:46.953892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.954851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.962932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.963648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.964265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.965112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.965709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.966397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.970210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.971321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.990159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.990564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.990997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.991737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.992191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.992634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.149301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.162623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6bc75376-c581-404a-a373-d9e1f0eef53e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1276 microversion: 2.1 time: 0.212895 Oct 04 18:05:47.163806 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 245/436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:47.213835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lazy-loading 'services' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:47.252763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.254685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.270298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.272546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.273149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.276069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.276632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.277760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.365134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.365910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.366746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.367231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lazy-loading 'fault' on Instance uuid c4b5949a-142e-4439-9552-e7c2c2fad742 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:47.384543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e81dbe1e-9050-40d8-966e-0f7382f22a41 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1938 microversion: 2.91 time: 0.708868 Oct 04 18:05:47.386572 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 192/437] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1938 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:47.393143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.394318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.402310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.402929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.403705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.408887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.408887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.408887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.517335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.530510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dab70720-5875-42b9-ab97-803666ff3d80 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 200 len: 1310 microversion: 2.1 time: 0.282884 Oct 04 18:05:47.560319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 246/438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:47.570408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.573082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.592460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.592460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.592460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.592460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.592864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.592864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.813865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lazy-loading 'services' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:47.889344 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d991c5e-5961-4879-8215-d4d82a4e85ce tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1938 microversion: 2.91 time: 0.327470 Oct 04 18:05:47.891909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 247/439] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1938 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:47.904999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.905650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.912166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.912727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.913235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.914005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.915220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.916434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.948172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.957036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.958642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.959788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f6a1d8f-57f2-4d8a-9810-a30215720116 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.571983 Oct 04 18:05:47.965881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 193/440] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:47.966384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.966980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.973035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.973708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.973943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.974641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.975090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.975536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.026621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.040293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-356c8e5f-05be-4436-95da-50e11aa27ae7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1281 microversion: 2.1 time: 0.144622 Oct 04 18:05:48.040854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 248/441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.060591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.064524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.065009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.065513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.066252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.066702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.067123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.106022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a919505-ac11-4b0f-ba75-7dcaa1096918 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.055611 Oct 04 18:05:48.106940 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 249/442] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:48.125185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:48.125891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.128115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:48.134500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.134991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.135597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.136328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.136788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.137211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.171369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lazy-loading 'flavor' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:48.456867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.466712 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab05ca96-6f2d-41c8-b2db-7a17a87cded2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.503833 Oct 04 18:05:48.467286 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 194/443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.472316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.473148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.479820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.480544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.482884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.483680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.484345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.484798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.707235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.719633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac9525f7-9d9c-4b7e-ad41-f073e8ca0277 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.250094 Oct 04 18:05:48.720284 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 195/444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.736776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.741195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.765709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.766099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.766563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.767317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.777866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.777866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.799914 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 HTTP/1.1 Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:05:48.802377 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:05:48.803808 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c4b5949a-142e-4439-9552-e7c2c2fad742'} Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:48.804514 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:05:48.806265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.809838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:48.811098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab275fac-ecf1-4b0a-9eb5-23f3bb7c3ad8 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 404 len: 111 microversion: 2.1 time: 0.085658 Oct 04 18:05:48.812437 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 196/445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:48.954725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1637692609", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:49.040265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4956390-f159-4bb3-9de2-181a73041a8b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action" status: 202 len: 0 microversion: 2.91 time: 0.919070 Oct 04 18:05:49.045452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 250/446] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:05:48 2022] POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:49.048637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:49.052470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.053587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.062255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.063016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.063791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.064681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.065336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.066406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.083215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:49.249489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.258749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.260344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.261514 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a5d44d2-2507-44aa-8173-8879488d4721 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1362 microversion: 2.25 time: 0.214293 Oct 04 18:05:49.270193 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 251/447] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:49.275733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e52a18-f5a7-44a0-9352-a5387586bd61", "name": "network-vif-plugged", "status": "completed", "tag": "a1e72178-dd4d-462d-8a7b-5fdd4a886085"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:49.287118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.287691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.288059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.299368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] Creating event network-vif-plugged:a1e72178-dd4d-462d-8a7b-5fdd4a886085 for instance e1e52a18-f5a7-44a0-9352-a5387586bd61 on n-h1-833090-21 Oct 04 18:05:49.310165 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-eae8066c-a83b-43ba-9318-df847e0cce92 req-cad3da93-f1dd-42d2-9fe9-2b1665bbb110 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Oct 04 18:05:49.310165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 252/448] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:49.310987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.311595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.319654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.320192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.321887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.322086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.322540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.322957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.400189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:49.400635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:49.401107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:49.401512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:49.401969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:49.414500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.414980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.419107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.419107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.419107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.419107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.442026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Getting quotas for project 1ea7b1e2c62244debad4da496575243f. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:49.446556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Getting quotas for user bb87ce6533524ec3aa86764646b52a32 and project 1ea7b1e2c62244debad4da496575243f. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:49.464305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:49.467504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:49.537321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.551074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.551074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.558325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76c4cf30-3219-4035-87f0-e1a69809787a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.251328 Oct 04 18:05:49.558973 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 253/449] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:49.568141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.569128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.578218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.580648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.580648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.581260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.581959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.582927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.661789 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bd04839c-b7a2-4711-9928-9aefe1cca649 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707290 Oct 04 18:05:49.662688 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 197/450] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:05:49.673189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b0714-4871-4f68-a9b8-e4cb0ce894a1", "tag": "a5708688-0ab5-42a1-818b-86e1af7a47df"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:49.688369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.689062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.689679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.741692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] Creating event network-changed:a5708688-0ab5-42a1-818b-86e1af7a47df for instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 on n-h2-833090-21 Oct 04 18:05:49.758008 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d5b518ab-1d28-4aae-9df3-49ac4e340222 req-b4172bdd-3cbf-45f9-9304-d3cd32c4a34e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093139 Oct 04 18:05:49.759288 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 198/451] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:49.766974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.767913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.781842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.782650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.783378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.784640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.785294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.785912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.880509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.894230 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c757247-5953-4eb3-a8c9-c5c81a3f9a89 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.333541 Oct 04 18:05:49.898833 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 254/452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.910233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36c250ba-8293-4428-b7e1-f831e17ba845 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.911124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36c250ba-8293-4428-b7e1-f831e17ba845 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.036371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36c250ba-8293-4428-b7e1-f831e17ba845 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.044882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36c250ba-8293-4428-b7e1-f831e17ba845 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1220 microversion: 2.1 time: 0.144437 Oct 04 18:05:50.046433 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 255/453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.051694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.052488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.059617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.060653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.061275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.062247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.062852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.063423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.093022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.103951 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88b72c71-8e02-44bb-abbb-9cee3328d2be tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1332 microversion: 2.1 time: 0.342958 Oct 04 18:05:50.106903 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 199/454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1332 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.216432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.224011 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fd16a32-f2a9-4060-a2d7-f2f9cf082b0b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.175985 Oct 04 18:05:50.224598 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 256/455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.286757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.287367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.294632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.295120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.295584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.296396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.296854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.297302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.522973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.533691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.535455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.536859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce373840-ccbd-4f61-9bc3-a56f085c6809 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1558 microversion: 2.25 time: 0.254185 Oct 04 18:05:50.537945 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 200/456] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:50.592390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.593027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.604543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.604967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.605399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.606103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.606619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.608669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.707189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.722910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.725814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.733240 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1b3b184-db75-4544-be5c-075bec7d43a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.148732 Oct 04 18:05:50.734079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 201/457] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:50.779918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.780534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.786656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.787146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.787614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.788438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.788792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.790038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.832829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c2c02e-31e1-4c65-9b2c-29e40d5438ec", "tag": "1e560aa1-5d0d-4eb8-8c06-c7ad4002645e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:50.842705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:50.845237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.845900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.846493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.859356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] Creating event network-changed:1e560aa1-5d0d-4eb8-8c06-c7ad4002645e for instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec on n-h2-833090-21 Oct 04 18:05:50.864570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4a1d6a6e-308d-4fa0-8cfb-388f7fcda45e req-c21c7988-23b9-43c8-ace0-5de162d90385 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035439 Oct 04 18:05:50.865596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 202/458] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:50.925844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 924684cc-8e02-41ca-b044-c3663727d075 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:50.926714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.927653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.933743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.934230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.934663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.935357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.935849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.936282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.939450 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b94b1c30-bbbb-4593-ab1d-ded310562abd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 2053 microversion: 2.25 time: 0.380632 Oct 04 18:05:50.940055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 257/459] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 2053 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:50.964320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.964919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.970720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.971192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.971654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.972333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.972777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.973192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.098457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.106420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ead7a49d-161b-41e3-b808-f696e2d2986b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.183841 Oct 04 18:05:51.107006 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 203/460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:51.112058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.112620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.118527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.119016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.119453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.120173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.120535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 924684cc-8e02-41ca-b044-c3663727d075 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:51.120975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.121098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.135524 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdfd7729-1af3-487c-9be1-7aa04e1d5e31 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 2053 microversion: 2.25 time: 0.175246 Oct 04 18:05:51.136188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 258/461] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 2053 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:51.141092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.141703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.148097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.149134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.149571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.150305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.150761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.151203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.208788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.218087 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88021d7b-39e6-4f2e-a93a-74a2f95182fe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1224 microversion: 2.1 time: 0.109878 Oct 04 18:05:51.218667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 204/462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.237753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.244249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.244733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.245172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.245903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.246366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.246860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.272313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19f15873-d317-4e3c-a9a6-6d50ee5c53ce tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038965 Oct 04 18:05:51.273089 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 205/463] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:51.278143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.278750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.287377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.288526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.288526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.289060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.289510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.289932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.297976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.306965 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d273daa-bde9-4b89-ac15-bcf3e8d51124 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1537 microversion: 2.1 time: 0.169232 Oct 04 18:05:51.309510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 259/464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.312750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-21", "block_migration": "auto"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:51.315546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.323071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.323953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.324607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.325521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.326180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.326810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.355699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'flavor' on Instance uuid 924684cc-8e02-41ca-b044-c3663727d075 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:51.371140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Going to try to live migrate instance to n-h2-833090-21 {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:05:51.452613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.460540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c0f6a096-82ea-4bca-9381-5f90c9c848e5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.186068 Oct 04 18:05:51.461157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 206/465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.465713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56f3bed6-34f4-4145-9103-3de96dfe93e7 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'create', calling method: .version_select at 0x7f9009e9ae50>, body: {"pool": "eb22c6fd-47b8-4a9a-aa1e-1a728ea02670"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:53.322742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56f3bed6-34f4-4145-9103-3de96dfe93e7 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.857222 Oct 04 18:05:53.324401 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 207/466] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:05:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:53.331982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.331982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.338428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.339042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.339591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.340361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.341033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.341522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.362814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:53.451564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.463065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.465313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.471246 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3dda6c8-e4b5-46a7-bcf5-c378e45fa492 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.145271 Oct 04 18:05:53.471917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 208/467] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:53.634911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Action: 'update', calling method: .version_select at 0x7f9009dd0b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:53.715766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.716323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.716823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.717611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.718196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.719294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.897701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-787016e1-f980-4c78-a2d5-f4e6cedcbd1a tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9" status: 200 len: 240 microversion: 2.36 time: 0.424548 Oct 04 18:05:53.898433 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 209/468] 10.222.0.40 () {62 vars in 1303 bytes} [Tue Oct 4 18:05:53 2022] PUT /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9 => generated 240 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:53.908259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.909213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.916695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.917389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.918005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.921150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.921150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.921150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.141057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.150146 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16bb5c20-36b5-4361-982d-56e10d889214 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.250185 Oct 04 18:05:54.150736 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 210/469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.156787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.157601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.164404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.164978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.165638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.166380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.167036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.167485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.411022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.419855 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d4c2e06-7422-40ce-bbaa-7759090c98c7 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.267639 Oct 04 18:05:54.420520 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 211/470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.425993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.426670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.433580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.434143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.434656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.435434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.435982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.436483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.579386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.588499 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f50ad5d8-850a-477f-aa71-44b4da1ef629 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.166935 Oct 04 18:05:54.589189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 212/471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.594022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: .version_select at 0x7f900b1c61f0>, body: {"addFloatingIp": {"address": "172.25.3.68"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:54.596519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.603520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.604846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.604846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.605261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.605717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.606166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.676213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:05:54.676620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquired lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:05:54.698710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-923b5064-97bf-4345-865b-af1e7f789539 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075/action" status: 202 len: 0 microversion: 2.25 time: 3.389836 Oct 04 18:05:54.699357 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 260/472] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:05:51 2022] POST /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075/action => generated 0 bytes in 3391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:54.703793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Calling method '.version_select at 0x7f9009d10310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.801628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.802376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.802818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.803702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.804181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.804763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.831382 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-452ada9d-83ab-4614-a454-cfcca3789aed tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9/detail" status: 200 len: 672 microversion: 2.36 time: 0.130871 Oct 04 18:05:54.844247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 261/473] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9/detail => generated 672 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:54.849905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.850726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.858572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.859883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.860056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.860951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.861598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.862211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.967586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.979337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.981040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.988525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-167aa69c-64cc-4931-83a0-71cb2875c72f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.142762 Oct 04 18:05:54.989236 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 262/474] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:54.998940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.999719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.006890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.008012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.011438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.011438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.011438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.011438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.197841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.207265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.209046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.223805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebb1c4bb-5f27-462c-a225-33e613b89607 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.215667 Oct 04 18:05:55.226481 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 263/475] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:55.237597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Action: 'update', calling method: .version_select at 0x7f90098d7670>, body: {"quota_set": {"ram": "2048"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:55.321365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.322020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.322629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.323658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.329094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.329094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.369648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.370351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.370994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.372013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.372546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.373163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.540467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eca7b9fc-f65c-4847-a736-8994b3c2d847 tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9?user_id=a470cc612d1c47269387395cab9511ef" status: 200 len: 240 microversion: 2.36 time: 0.312736 Oct 04 18:05:55.543518 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 264/476] 10.222.0.40 () {62 vars in 1384 bytes} [Tue Oct 4 18:05:55 2022] PUT /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9?user_id=a470cc612d1c47269387395cab9511ef => generated 240 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:55.552016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5794ca9c-ff2c-4f02-94b2-f6f644a178f0", "tag": "e5dbc6f7-bbd7-4246-a970-10b974d6e7e0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:55.562784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.563425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.563881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.575760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] Creating event network-changed:e5dbc6f7-bbd7-4246-a970-10b974d6e7e0 for instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 on n-h1-833090-21 Oct 04 18:05:55.581313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ec11d1c4-a4f7-4e24-b93b-56d023156715 req-a4090ce2-53ec-43d4-9f9f-ba77426589fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 Oct 04 18:05:55.589781 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 265/477] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:55.602001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.603056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.612903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.614596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.616151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.619234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.619234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.619234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.793740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.802209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b2b244b0-5280-4284-8fd8-9f5c216be913 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.205833 Oct 04 18:05:55.811528 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 266/478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.811528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.811528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.815379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.815902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.816364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.817202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.817735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.818161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.948300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.956458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58a22cfe-cd59-43f0-a83b-cb580e3c718f tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.152349 Oct 04 18:05:55.957035 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 267/479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.962700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-204ecc8d-54ba-4e83-9642-2313864abdaf tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] Calling method '.version_select at 0x7f9009b5ba60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.042582 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-204ecc8d-54ba-4e83-9642-2313864abdaf tempest-QuotasAdminTestV236-2142908418 tempest-QuotasAdminTestV236-2142908418-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9?user_id=a470cc612d1c47269387395cab9511ef" status: 200 len: 282 microversion: 2.36 time: 0.084455 Oct 04 18:05:56.052549 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 268/480] 10.222.0.40 () {60 vars in 1364 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/os-quota-sets/fd9902c424c34fe380ec4d52a087e9c9?user_id=a470cc612d1c47269387395cab9511ef => generated 282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:05:56.052549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.052549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.055614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.056178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.056685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.057453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.058230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.058703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.079574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:56.208293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:05:56.215209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.225527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-96cf81bb-c3ef-42f0-9fc4-db760a87e69f tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.178715 Oct 04 18:05:56.225527 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 269/481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.229223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.230110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.236770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.237469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.238080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.249585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.250395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.251042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.339630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.349182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.351040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.357334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f58b032-b65f-4704-b889-ebc77504a736 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.132245 Oct 04 18:05:56.368169 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 270/482] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:56.368169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.368169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.375689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.376260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.376765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.377531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.378647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.379160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.546683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.557354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.559072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.560363 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b47ad98c-d798-4960-94ae-be9dbc8bde20 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.199841 Oct 04 18:05:56.561153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 271/483] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:56.568590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e52a18-f5a7-44a0-9352-a5387586bd61", "tag": "a1e72178-dd4d-462d-8a7b-5fdd4a886085"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:56.599630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.599630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.599630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.604836 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] Creating event network-changed:a1e72178-dd4d-462d-8a7b-5fdd4a886085 for instance e1e52a18-f5a7-44a0-9352-a5387586bd61 on n-h1-833090-21 Oct 04 18:05:56.610030 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5ec816c3-af3e-4802-8b7e-5dcdb487154e req-9a1bc3b3-ee2f-45f1-b2b0-bd2c7a5fd6d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045322 Oct 04 18:05:56.610845 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 272/484] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:56.828350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.829321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.844049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.844635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.845315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.846840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.847381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.847891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.931673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Updating instance_info_cache with network_info: [{"id": "a1e72178-dd4d-462d-8a7b-5fdd4a886085", "address": "fa:16:3e:da:de:44", "network": {"id": "738e51fb-23eb-476d-bf15-f770881dd94b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1705555750-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9fca83eac610475d8e69eb5bfc1af3a0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1e72178-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:05:57.041765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Releasing lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:05:57.042915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-879c140b-d907-4525-b168-2d82d56b6fa8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 202 len: 0 microversion: 2.1 time: 2.452635 Oct 04 18:05:57.043907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 213/485] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:54 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 0 bytes in 2454 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:05:57.049040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.050229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.063785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.064561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.065154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.066038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.066651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.067229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.098054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.109261 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1abe7a5-83cf-43e7-8d93-c91ccbbff42b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.284515 Oct 04 18:05:57.111211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 273/486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:57.120860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd168c80-9cf2-4c3e-b9a3-d25cecb2f575 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'create', calling method: .version_select at 0x7f90098f19d0>, body: {"pool": "eb22c6fd-47b8-4a9a-aa1e-1a728ea02670"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:57.312895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.342847 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ccf987b-b40f-4a58-aeb3-461903728dbe tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.286604 Oct 04 18:05:57.345868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 214/487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.357091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.357091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.382824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.387364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.387364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.387364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.387364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.387775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.764665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.774418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90cc1377-822a-4a44-a3d4-18dfac60041d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.424240 Oct 04 18:05:57.775270 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 215/488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.781755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.782633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.793312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.793906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.794578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.795352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.796046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.796534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.887906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.908052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.909821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.916739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eac9bf1b-930b-43d0-a332-011a0124b0e3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.140234 Oct 04 18:05:57.917319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 216/489] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:57.921804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.922426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.929291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.930041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.930705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.931678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.932359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.932989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.151424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.160707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.162311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.164180 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e297638e-56e7-4cbb-bdc0-d55746fd3737 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.245931 Oct 04 18:05:58.164746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 217/490] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:58.175789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b0714-4871-4f68-a9b8-e4cb0ce894a1", "name": "network-vif-plugged", "status": "completed", "tag": "a5708688-0ab5-42a1-818b-86e1af7a47df"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:58.191079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.192143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.192589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.205082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] Creating event network-vif-plugged:a5708688-0ab5-42a1-818b-86e1af7a47df for instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 on n-h2-833090-21 Oct 04 18:05:58.210617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a154636f-b8ab-49e7-851d-2f6042de24bb req-c7b10b1b-3358-44dc-a140-0366053a535b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043817 Oct 04 18:05:58.211285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 218/491] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:58.216868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.217625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.223920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.224414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.224856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.226132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.226584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.227174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.448921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.457789 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ff52629-c8e1-49a4-a1b1-ec0f98246d66 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.245024 Oct 04 18:05:58.458413 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 219/492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.464800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.465432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.473566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.474278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.474867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.477149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.477149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.477916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.627659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.637286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-629bb2ea-89ba-4f40-ac0b-a1ba5eb18c64 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.177690 Oct 04 18:05:58.637879 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 220/493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.798512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.799126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.805169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.805657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.806097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.806794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.807248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.807731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.940575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.951718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1adf9d61-b51e-479b-b74d-6bae68839535 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.157112 Oct 04 18:05:58.964711 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 221/494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:58.975943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.977422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.983714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.984206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.984641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.985534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.985992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.986419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.061062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.070191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.071736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.077243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fb7c7ff-2636-475d-bb51-f79023f7ad70 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.111418 Oct 04 18:05:59.077754 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 222/495] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:59.192598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.193212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.200085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.200577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.201034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.201729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.202187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.202612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.415249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.428212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.430801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.432057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d4d65fc-9a08-4e52-a46e-3363398d382f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.243914 Oct 04 18:05:59.434023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 223/496] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:05:59.486385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.487580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.501686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.502862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.511841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.512962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.513624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.514635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.679610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.692470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ffa1a85-147e-4508-9b11-d13bd47231cb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.212801 Oct 04 18:05:59.693657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 224/497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:59.699379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.700147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.714875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.715282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.715642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.716345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.716795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.718551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.857360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.859689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:59.866292 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59028a6c-8fd8-4217-a51f-9599ee9608ba tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.171122 Oct 04 18:05:59.867084 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 225/498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.880696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd168c80-9cf2-4c3e-b9a3-d25cecb2f575 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.768087 Oct 04 18:05:59.888895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 274/499] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:05:57 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:59.894557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.5"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:59.897690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.904076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.904548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.905047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.905678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.907093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.907093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.935349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:05:59.935777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquired lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:05:59.980061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.982588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.991201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.992038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.992722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.993690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.994376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.995040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.424364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.440562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd8a7104-ffe2-459c-8d2a-15df1d3da206 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1318 microversion: 2.1 time: 0.460939 Oct 04 18:06:00.441443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 275/500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:00.465058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.465907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.500483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.509285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.509747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.513198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.514106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.514925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.643622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670.", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:06:00.644608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Releasing lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:06:00.645598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.645598 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Request method failure captured: Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action HTTP/1.1 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 44 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXp8gBWymuZbOmrTNEZJDfTuyaAx0n2WVnPQ6RZK3de1aBhw6JUrZhZUSZLQ9KNyly7J5Ay2naVIO4yxXLuDX9uXcRN6eoFJsbNrfCUDgoWe5EmryyP-v4NhvTfNhc81IXbOSKiut38NEQx4aSfEFBb6lnmrnF2tzcdCno8LeRwBiw Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:00.662489 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fca83eac610475d8e69eb5bfc1af3a0"}]}] Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f4db97c2518b40e0a17c3115cc01b69f Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: {"addFloatingIp": {"address": "172.25.3.5"}} Oct 04 18:06:00.665180 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e1e52a18-f5a7-44a0-9352-a5387586bd61', 'body': {'addFloatingIp': {'address': '172.25.3.5'}}} Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.665913 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:06:00.666897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.667890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.668816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Returning 400 to user: Cannot associate floating IP 172.25.3.5 (cbb5172b-6451-4523-9f93-de6f3a0cf9ab) with port a1e72178-dd4d-462d-8a7b-5fdd4a886085 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network eb22c6fd-47b8-4a9a-aa1e-1a728ea02670. Oct 04 18:06:00.669839 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-3d619ecb-7839-4d64-818e-b252d0a2d88d'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:00.670486 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b54a442-a39d-455f-b201-37c78fa40ba5 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 400 len: 380 microversion: 2.1 time: 0.774121 Oct 04 18:06:00.670486 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 226/501] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:59 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 380 bytes in 776 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:06:00.673540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924684cc-8e02-41ca-b044-c3663727d075", "name": "network-vif-unplugged", "status": "completed", "tag": "6fa69cb8-230d-4e60-9807-4cdc6b033013"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:00.685964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.686690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.687438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.701367 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] Creating event network-vif-unplugged:6fa69cb8-230d-4e60-9807-4cdc6b033013 for instance 924684cc-8e02-41ca-b044-c3663727d075 on n-h1-833090-21 Oct 04 18:06:00.707943 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-13846861-58b7-440e-bb34-62b6f4a5de4e req-f2823543-6cef-4832-817d-5fad1a608621 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040663 Oct 04 18:06:00.709143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 227/502] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:00.716161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.716629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.717315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.726377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.727159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.727930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.728954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.729603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.730268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.748371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.753063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.761227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7cd2a439-0909-423f-8073-29d3a760f601 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.318063 Oct 04 18:06:00.762105 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 276/503] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:00.769253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae51b04-9c08-4208-b5e6-da3e0ce5e498 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '.version_select at 0x7f90098d74c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.907255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.916517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.918056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.919820 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44451933-b1cd-4c33-b569-561e0bde10e6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.209205 Oct 04 18:06:00.920542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 228/504] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:00.925458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.926029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.939031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.940188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.940642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.941357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.941820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.942344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.118796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.126938 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01db79ea-49e7-4907-8b0b-26f341b8cf63 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.205232 Oct 04 18:06:01.127953 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 229/505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.133093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.133962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.147546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.148395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.149121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.150187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.150859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.151487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.304621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.312579 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c3d5267-7047-4f2c-8a27-21847b72b65d tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.183359 Oct 04 18:06:01.313385 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 230/506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.488849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.489566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.497250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.498149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.498588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.499287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.499765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.500427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.699125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.712420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-735c43cb-d6ca-46be-90ad-af721e542f49 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1468 microversion: 2.1 time: 0.227244 Oct 04 18:06:01.714706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 231/507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:01.737173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:01.738033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.744754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.745248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.745685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.746445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.746921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.747240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.810762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lazy-loading 'flavor' on Instance uuid b06b0714-4871-4f68-a9b8-e4cb0ce894a1 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:01.933838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bae51b04-9c08-4208-b5e6-da3e0ce5e498 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/cbb5172b-6451-4523-9f93-de6f3a0cf9ab" status: 202 len: 0 microversion: 2.1 time: 1.170021 Oct 04 18:06:01.934494 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 277/508] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:06:00 2022] DELETE /compute/v2.1/os-floating-ips/cbb5172b-6451-4523-9f93-de6f3a0cf9ab => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:01.939381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c2c02e-31e1-4c65-9b2c-29e40d5438ec", "name": "network-vif-plugged", "status": "completed", "tag": "1e560aa1-5d0d-4eb8-8c06-c7ad4002645e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:01.950811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.951304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.951772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.964172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] Creating event network-vif-plugged:1e560aa1-5d0d-4eb8-8c06-c7ad4002645e for instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec on n-h2-833090-21 Oct 04 18:06:01.969477 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5feeaa32-baad-49f5-bd6e-3bb2f50288e3 req-bedbeb7a-79ad-4035-b4f6-a7bfa92d06f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Oct 04 18:06:01.970242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 278/509] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.976104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.977039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:01.983749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.984370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.984875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.985620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:01.986183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:01.986489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.062368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.074564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.076590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.083124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73c62e2f-5653-4ae3-9cc3-d2cf026c87c1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.111624 Oct 04 18:06:02.087785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 279/510] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:02.107788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: .version_select at 0x7f900b1c8e50>, body: {"removeFloatingIp": {"address": "172.25.3.68"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:02.235449 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ff56fc0-1135-4086-a979-01fb7137ed6c tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1/action" status: 202 len: 0 microversion: 2.1 time: 0.501429 Oct 04 18:06:02.237365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 232/511] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:01 2022] POST /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:02.245910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.247997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.255267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.256154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.256941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.257941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.258867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.259780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.361537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.370456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:02.376058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.376728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.377346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.378104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.378586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.379096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.430553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.441540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.443204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.445763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffeacb61-607f-4bb3-922e-a08ba9b8ad23 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.205397 Oct 04 18:06:02.446530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 233/512] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:02.451580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.452442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.458707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.459955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.460394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.461096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.461726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.462117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.604856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.613346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22375c76-636e-49ad-9f95-22dda636c7bf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.165827 Oct 04 18:06:02.613923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 234/513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.618946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.619889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.626238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.627003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.627434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.630546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.630546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.630546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.664117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:06:02.664552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquired lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:06:02.773691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.781437 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eed66d7e-700e-43fa-b186-95768c72283b tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1476 microversion: 2.1 time: 0.166244 Oct 04 18:06:02.782039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 235/514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.786477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.787087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.793004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.793709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.794314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.795018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.795493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.795927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.954037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.963265 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec54c120-d9b0-4ed2-9ddb-c952cd0e455c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.180180 Oct 04 18:06:02.963888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 236/515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.148993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-183cf63f-6eb4-44b5-95ec-68264550766f tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] Action: 'create', calling method: .version_select at 0x7f9009c18280>, body: {"security_group": {"name": "tempest-securitygroup-1964131107", "description": "tempest-description-276668338"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.639415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Building network info cache for instance {{(pid=123887) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:06:03.710913 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-183cf63f-6eb4-44b5-95ec-68264550766f tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.745699 Oct 04 18:06:03.711948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 237/516] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.718140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "924684cc-8e02-41ca-b044-c3663727d075", "tag": "6fa69cb8-230d-4e60-9807-4cdc6b033013"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.730730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.731563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.732365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.748257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=14 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:03.764328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] Creating event network-changed:6fa69cb8-230d-4e60-9807-4cdc6b033013 for instance 924684cc-8e02-41ca-b044-c3663727d075 on n-h1-833090-21 Oct 04 18:06:03.770363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-44bcf83b-87c5-4814-b197-7f0e768ca5ce req-2c97b0c2-3ad6-400a-b879-1fffd6e7c1d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056691 Oct 04 18:06:03.772014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 238/517] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.778381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.779151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.786294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.786714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.787226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.791275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.791862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.792307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.864845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.874968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.876881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.884069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-285e4b29-b690-4737-96ca-a44b29dc1fba tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.110293 Oct 04 18:06:03.897741 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 239/518] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:03.897741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.897741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.902256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=48 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:03.908599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.909396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.910164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.911148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.911915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.912356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.099550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.108692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.110523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.112551 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cef0b617-3615-49bc-8f82-262290fa9b85 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.226340 Oct 04 18:06:04.114536 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 240/519] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:04.119502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.120195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.127111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.127984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.128812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.130013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.131236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.132247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.301602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.311652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-96aebe1b-a69c-41a4-88fc-a32f903df7e6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1311 microversion: 2.1 time: 0.195744 Oct 04 18:06:04.312078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 241/520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1311 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.316842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6eeee80-3727-44f6-a4c2-b67a9e631058 tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] Action: 'create', calling method: .version_select at 0x7f9009f98af0>, body: {"security_group": {"name": "tempest-securitygroup-1275367866", "description": "tempest-description-537452706"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:04.477369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Updating instance_info_cache with network_info: [{"id": "a1e72178-dd4d-462d-8a7b-5fdd4a886085", "address": "fa:16:3e:da:de:44", "network": {"id": "738e51fb-23eb-476d-bf15-f770881dd94b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1705555750-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9fca83eac610475d8e69eb5bfc1af3a0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1e72178-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123887) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:06:04.547775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Releasing lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:06:04.548969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69f5c19c-7827-424e-86b9-8797d71589ae tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 202 len: 0 microversion: 2.1 time: 2.458537 Oct 04 18:06:04.550128 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 280/521] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 0 bytes in 2462 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:06:04.557229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.557853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.565063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.565516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.566006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.566749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.567208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.567663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.707100 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6eeee80-3727-44f6-a4c2-b67a9e631058 tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.393846 Oct 04 18:06:04.711239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 242/522] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:06:04 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:04.715189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.715962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.718416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.723067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.723601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.724045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.724792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.725249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.725678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.727081 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33eb1461-9986-4514-9bcf-d6f3a590640a tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1459 microversion: 2.1 time: 0.175420 Oct 04 18:06:04.727704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 281/523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.744632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5794ca9c-ff2c-4f02-94b2-f6f644a178f0", "name": "network-vif-plugged", "status": "completed", "tag": "e5dbc6f7-bbd7-4246-a970-10b974d6e7e0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:04.755129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.756221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.756675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.769090 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] Creating event network-vif-plugged:e5dbc6f7-bbd7-4246-a970-10b974d6e7e0 for instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 on n-h1-833090-21 Oct 04 18:06:04.775070 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9f36ae17-59e2-4eec-b309-5ac9e45c61f0 req-96416fca-6883-4706-9ec1-75bee2560e97 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037671 Oct 04 18:06:04.775720 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 282/524] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:04.785552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec4cbea0-9464-4128-8f1f-2e94021957bf tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '.version_select at 0x7f90098d7e50>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.881615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:04.890346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42513898-1480-450e-ab44-5fa77ad7e6f1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.181098 Oct 04 18:06:04.890863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 243/525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:04.958137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2be3ffab-bac9-49be-96f4-0dfc60ca05e1 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] Action: 'create', calling method: .version_select at 0x7f9009e9a040>, body: {"security_group": {"name": "tempest-securitygroup-1219243842", "description": "tempest-description-774196834"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:05.390488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=9 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:05.465313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2be3ffab-bac9-49be-96f4-0dfc60ca05e1 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.573058 Oct 04 18:06:05.473626 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 244/526] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:06:04 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:05.473626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.473626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.474973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:05.478880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.479380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.480511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.480649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.480987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.481408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.500137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:05.659935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec4cbea0-9464-4128-8f1f-2e94021957bf tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a0f5f7c6-d575-4837-8e7a-c6870b4b00e0" status: 202 len: 0 microversion: 2.1 time: 0.873580 Oct 04 18:06:05.659935 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 283/527] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:06:04 2022] DELETE /compute/v2.1/os-floating-ips/a0f5f7c6-d575-4837-8e7a-c6870b4b00e0 => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:05.661248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.662066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.668721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.669271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.669767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.670464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.670910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.671322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.737876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.746838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.748305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.753914 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f4e81647-7fe8-4500-81fa-a4e38dc4fcbf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.096913 Oct 04 18:06:05.754415 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 284/528] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:05.759691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.760553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.767301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.767831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.768285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.769011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.769492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.769907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.806893 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-607e0c67-cb01-4745-9699-bf9b86105523 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1612 microversion: 2.1 time: 0.339811 Oct 04 18:06:05.807516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 245/529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1612 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:05.820177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.820788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:05.826987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.827502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.827940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.828639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:05.829087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:05.829506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:05.909841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.918132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.919612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.920921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3795351b-ba69-40a2-bb6f-1d2d48eb33eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.165581 Oct 04 18:06:05.922804 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 285/530] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:05.926089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-457c11c5-a6ab-450c-9319-356616c54323 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] Action: 'create', calling method: .version_select at 0x7f90098aae50>, body: {"security_group": {"name": "tempest-securitygroup-1021121471", "description": "tempest-description-162587957"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.034488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=34 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:06.221612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:06.231023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5bd717c9-9877-4774-9fed-5e99c0e50db1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1495 microversion: 2.1 time: 0.415330 Oct 04 18:06:06.231756 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 246/531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1495 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:06.236898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4ec7c16-2cb6-4572-bef3-7a7108aeadfd tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4ec7c16-2cb6-4572-bef3-7a7108aeadfd tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Request method failure captured: Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action HTTP/1.1 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 34 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXp8gBWymuZbOmrTNEZJDfTuyaAx0n2WVnPQ6RZK3de1aBhw6JUrZhZUSZLQ9KNyly7J5Ay2naVIO4yxXLuDX9uXcRN6eoFJsbNrfCUDgoWe5EmryyP-v4NhvTfNhc81IXbOSKiut38NEQx4aSfEFBb6lnmrnF2tzcdCno8LeRwBiw Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:06.242429 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fca83eac610475d8e69eb5bfc1af3a0"}]}] Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f4db97c2518b40e0a17c3115cc01b69f Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: {"addFloatingIp": {"address": ""}} Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:06:06.243948 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e1e52a18-f5a7-44a0-9352-a5387586bd61', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '' Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:06.255876 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:06:06.257378 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:06:06.258693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 18:06:06.258693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.258693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4ec7c16-2cb6-4572-bef3-7a7108aeadfd tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:06.258693 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4ec7c16-2cb6-4572-bef3-7a7108aeadfd tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 400 len: 142 microversion: 2.1 time: 0.013999 Oct 04 18:06:06.258693 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 247/532] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 142 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:06:06.260232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e52a18-f5a7-44a0-9352-a5387586bd61", "tag": "a1e72178-dd4d-462d-8a7b-5fdd4a886085"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.271300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.271838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.272276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.284038 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] Creating event network-changed:a1e72178-dd4d-462d-8a7b-5fdd4a886085 for instance e1e52a18-f5a7-44a0-9352-a5387586bd61 on n-h1-833090-21 Oct 04 18:06:06.289662 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b10f26c9-68f3-42db-9764-33a1dc3bcb40 req-56be6c86-4c8f-420f-b69d-e88e5508fd57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040710 Oct 04 18:06:06.290267 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 248/533] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:06.295261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.298950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.299436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.304307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.304307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.304307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.304307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.327593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ddc35a7-490d-49d6-bbef-ab103d96e4a0 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036085 Oct 04 18:06:06.328205 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 249/534] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:06.332730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.333457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.342974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.342974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.342974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.342974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.343385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.343385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.360464 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-457c11c5-a6ab-450c-9319-356616c54323 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.437813 Oct 04 18:06:06.361313 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 286/535] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:06:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:06.375400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: .version_select at 0x7f900b1c8ee0>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.377910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.384227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.384696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.385137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.385833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.386283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.386703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.420020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:06:06.420423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquired lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:06:06.475371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:06.483515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6a204d2-3fef-43f2-9447-2db76ddab2db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1320 microversion: 2.1 time: 0.154240 Oct 04 18:06:06.495900 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 250/536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:06.572006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Releasing lock "refresh_cache-e1e52a18-f5a7-44a0-9352-a5387586bd61" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:06:06.572578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] HTTP exception thrown: floating IP not found Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Request method failure captured: Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action HTTP/1.1 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 41 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXp8gBWymuZbOmrTNEZJDfTuyaAx0n2WVnPQ6RZK3de1aBhw6JUrZhZUSZLQ9KNyly7J5Ay2naVIO4yxXLuDX9uXcRN6eoFJsbNrfCUDgoWe5EmryyP-v4NhvTfNhc81IXbOSKiut38NEQx4aSfEFBb6lnmrnF2tzcdCno8LeRwBiw Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:06:06.576250 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fca83eac610475d8e69eb5bfc1af3a0"}]}] Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f4db97c2518b40e0a17c3115cc01b69f Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:06:06.577546 n-d-833090-21 devstack@n-api.service[123887]: exception: floating IP not found Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e1e52a18-f5a7-44a0-9352-a5387586bd61', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.578299 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 18:06:06.580900 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.582296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Returning 404 to user: floating IP not found {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:06.582296 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b5939f7-e5e0-4e5b-86e0-466d8d3f0cb6 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 404 len: 67 microversion: 2.1 time: 0.206771 Oct 04 18:06:06.582296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 287/537] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 67 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:06.591966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": true, "disk_over_commit": false}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.594767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.603640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.604519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.604966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.605708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.606169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.606594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.629237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.629860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.636537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.637038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.637323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Lazy-loading 'flavor' on Instance uuid b06b0714-4871-4f68-a9b8-e4cb0ce894a1 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:06.637476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.638178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.638665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.639090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.651327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 while it is in vm_state suspended Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Request method failure captured: Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1/action HTTP/1.1 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 98 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXVqc7NC5vIVvoGiidNnHMsej-rpOgJ6_F0Lbxm739IyFhl8anmpNwf4tC0OMtEOJa4p_pmZyN37jMYLcJAq855xeL_Y0dHabVQreEM3PM-YsrQ6Qohucsh8JeKwBrBleOyi0IrYg9hV_stLyqGT026igqjcAWRQIPFaIm5YAPWMYM Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 211181f5288d47989009e60554f89f37 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:06:06.653418 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_211181f5288d47989009e60554f89f37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/211181f5288d47989009e60554f89f37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/211181f5288d47989009e60554f89f37"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/211181f5288d47989009e60554f89f37"}]}] Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 211181f5288d47989009e60554f89f37 Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1290275290 Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveMigrationNegativeTest-1290275290-project-admin Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 03861b86824a4c1699fac1b720ff2735 Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveMigrationNegativeTest-1290275290-project-admin Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": true, "disk_over_commit": false}} Oct 04 18:06:06.654756 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'os-migrateLive' instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 while it is in vm_state suspended Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b06b0714-4871-4f68-a9b8-e4cb0ce894a1', 'body': {'os-migrateLive': {'host': 'n-h1-833090-21', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:06:06.655536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.659072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 while it is in vm_state suspended Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 while it is in vm_state suspended Oct 04 18:06:06.660884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.664890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 while it is in vm_state suspended {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:06.664890 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66d0b446-f6dc-4705-a2c3-05ab22712ca8 tempest-LiveMigrationNegativeTest-1290275290 tempest-LiveMigrationNegativeTest-1290275290-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1/action" status: 409 len: 155 microversion: 2.1 time: 0.075788 Oct 04 18:06:06.664890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 288/538] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1/action => generated 155 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:06.667358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe77873b-fcb2-459b-a99a-9470d2fd4dfe tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] Calling method '.version_select at 0x7f9009ac8820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.780692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d14c15a-9d20-4495-8e5e-3032b29b01d8 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1648 microversion: 2.1 time: 0.295464 Oct 04 18:06:06.781270 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 251/539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1648 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:06.786291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1edd0979-3da4-4807-8241-def835ca62ef tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Action: 'action', calling method: .version_select at 0x7f900b1c6820>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.835199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-1edd0979-3da4-4807-8241-def835ca62ef tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1edd0979-3da4-4807-8241-def835ca62ef tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Request method failure captured: Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action HTTP/1.1 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 44 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXp8gBWymuZbOmrTNEZJDfTuyaAx0n2WVnPQ6RZK3de1aBhw6JUrZhZUSZLQ9KNyly7J5Ay2naVIO4yxXLuDX9uXcRN6eoFJsbNrfCUDgoWe5EmryyP-v4NhvTfNhc81IXbOSKiut38NEQx4aSfEFBb6lnmrnF2tzcdCno8LeRwBiw Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:06.838062 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fca83eac610475d8e69eb5bfc1af3a0"}]}] Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f4db97c2518b40e0a17c3115cc01b69f Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:06:06.839668 n-d-833090-21 devstack@n-api.service[123886]: exception: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e1e52a18-f5a7-44a0-9352-a5387586bd61', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:06.840468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 18:06:06.841600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.842787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1edd0979-3da4-4807-8241-def835ca62ef tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:06.842787 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1edd0979-3da4-4807-8241-def835ca62ef tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action" status: 404 len: 88 microversion: 2.1 time: 0.057293 Oct 04 18:06:06.842787 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 252/540] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61/action => generated 88 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:06.845992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.846487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.854445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.854976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.855418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.856154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.856604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.857045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.883137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:07.275937 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2439addf-1c1c-44f9-affd-0f7ed1a2399e tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 204 len: 0 microversion: 2.1 time: 0.433523 Oct 04 18:06:07.277186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 253/541] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:06 2022] DELETE /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:07.283584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.284466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.291614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.292208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.292738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.293604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.294159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.294726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.369799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.378609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.381292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:07.386371 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-132179c7-79c4-4310-a727-b0b40ed04c57 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.107882 Oct 04 18:06:07.386965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 254/542] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:07.392035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.392920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.399996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.400502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.400936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.401811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.402430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.403017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.537000 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7fd55e7-5338-4e34-9661-bedf79ecd7d3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1648 microversion: 2.1 time: 0.148854 Oct 04 18:06:07.537583 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 255/543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1648 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:07.542148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.542641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.554122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.554612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.555391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.556189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.556643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.557086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.583135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:08.435439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0349ba41-7de2-4d63-901c-e85d47214da8 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 204 len: 0 microversion: 2.1 time: 0.896615 Oct 04 18:06:08.436171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 256/544] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:07 2022] DELETE /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:08.443906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.444707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.450655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.451247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.451730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.452456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.452914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.453345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.602781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.607936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.609366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.610573 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7dd54b94-37b9-4d82-ba48-992b5b7b862a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.171013 Oct 04 18:06:08.611155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 257/545] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:08.615480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.616135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.622802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.623292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.623755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.624958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.625103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.625409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.777644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.787091 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9bfd7cf3-5c29-4eba-8e54-d8eda77074b5 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1465 microversion: 2.1 time: 0.173723 Oct 04 18:06:08.787091 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 258/546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.793547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.793547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.798427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.798862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.799315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.800068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.800509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.800930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.845104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe77873b-fcb2-459b-a99a-9470d2fd4dfe tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11740 microversion: 2.1 time: 2.188520 Oct 04 18:06:08.845883 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 289/547] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11740 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:06:08.851128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.854964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.855458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.855919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.856682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.857141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.857566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.881595 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7f315b8-6b2e-434e-a51f-1fb33f881601 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.034634 Oct 04 18:06:08.882206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 290/548] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:08.887100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.887732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.894157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.894728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.895226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.896531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.897049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.897550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.939636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.951038 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66be2e8e-482e-43bf-addf-0430307448e5 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1469 microversion: 2.1 time: 0.162814 Oct 04 18:06:08.951864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 259/549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.956404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.957150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.964220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.964427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.964923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.965714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.966186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.966674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.967494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.976780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.978217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.983222 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f0adcbf-678a-4781-9015-9f3f3b8a187d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.100059 Oct 04 18:06:08.983825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 291/550] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:08.988456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffd1a4a8-c2ba-4915-82bb-cd0efad73363 tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] Calling method '.version_select at 0x7f90097a0700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.100765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:09.116317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4554e0e-b22b-4719-a218-f0a1ac72c459 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1543 microversion: 2.1 time: 0.163332 Oct 04 18:06:09.117100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 260/551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1543 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.121861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": true, "disk_over_commit": false}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:09.124389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.131316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.131851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.132289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.132987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.133442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.133867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.166045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ffd1a4a8-c2ba-4915-82bb-cd0efad73363 tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.180899 Oct 04 18:06:09.166994 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 292/552] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.171624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:09.173810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.180845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.181328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.181756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.182440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.182884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.183302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.212128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lazy-loading 'flavor' on Instance uuid 98c2c02e-31e1-4c65-9b2c-29e40d5438ec {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:09.224975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Going to try to live migrate instance to n-h1-833090-21 {{(pid=123886) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:06:09.228844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:09.283061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:09.452246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f05ca519-bcc7-4048-be6e-820271c839d8 tempest-DeleteServersAdminTestJSON-352918181 tempest-DeleteServersAdminTestJSON-352918181-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0/action" status: 202 len: 0 microversion: 2.1 time: 0.283983 Oct 04 18:06:09.452921 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 293/553] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:09 2022] POST /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:09.457490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36009dd2-6e52-4a8d-8812-6246dc2cc426 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] Calling method '.version_select at 0x7f9009bc7ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.948697 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36009dd2-6e52-4a8d-8812-6246dc2cc426 tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7af3e540-e1db-4d58-a4f3-b27c745d30f3" status: 202 len: 0 microversion: 2.1 time: 0.494681 Oct 04 18:06:09.950072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 294/554] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:06:09 2022] DELETE /compute/v2.1/os-security-groups/7af3e540-e1db-4d58-a4f3-b27c745d30f3 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:09.954623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.955242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.961456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.961939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.962378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.963105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.963597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.964046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.999134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.999880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.000473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.001079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lazy-loading 'fault' on Instance uuid 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:10.292689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.306194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df774cd3-3335-489b-ae0b-84984c5ce32c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1452 microversion: 2.1 time: 0.355324 Oct 04 18:06:10.318817 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 295/555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1452 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.341827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.342448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.359190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.359708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.360141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.360843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.361292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.361704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.604892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.614139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.615293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.616539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8a4443f-c6d3-44cd-912c-f90fd5ca68b1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.283885 Oct 04 18:06:10.630769 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 296/556] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:10.630769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.630769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.630769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.631103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.631103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.631531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.632181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.632754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.709790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.719801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1d2ae0f-cdd9-4e05-8bfe-1ef419bd04bd tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 200 len: 1423 microversion: 2.1 time: 0.100827 Oct 04 18:06:10.720706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 297/557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.725760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7ff21f6-9891-43d2-bc99-73e820d75e7e tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] Calling method '.version_select at 0x7f90097a0940>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.120579 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7ff21f6-9891-43d2-bc99-73e820d75e7e tempest-SecurityGroupsTestAdminJSON-1237063999 tempest-SecurityGroupsTestAdminJSON-1237063999-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/4db38cff-9754-4dbb-a5c3-855afd08cf82" status: 202 len: 0 microversion: 2.1 time: 0.398579 Oct 04 18:06:11.125150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 298/558] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:06:10 2022] DELETE /compute/v2.1/os-security-groups/4db38cff-9754-4dbb-a5c3-855afd08cf82 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:11.128687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.129645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.138845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.139763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.140998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.142484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.143566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.144347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.215734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.224873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.228349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.232897 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b30f527-c96e-46c4-bc11-6be1dc6a6c5e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.109889 Oct 04 18:06:11.233616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 299/559] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:11.238129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.238846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.244553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.245094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.245668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.246410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.246920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.247396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.290524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.291395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.291515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.291951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lazy-loading 'fault' on Instance uuid e1e52a18-f5a7-44a0-9352-a5387586bd61 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:11.346181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.355169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39d44b4a-46cc-474f-ba1b-525dac3e9546 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1322 microversion: 2.1 time: 0.120284 Oct 04 18:06:11.366216 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 300/560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1322 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:11.370157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.370784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.378428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.379042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.380315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.381119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.382297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.383273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.418959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:11.755925 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7525dcdd-f0fe-448b-8dd3-df66124793ac tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 204 len: 0 microversion: 2.1 time: 0.391359 Oct 04 18:06:11.756781 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 301/561] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:11 2022] DELETE /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:11.762151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b0714-4871-4f68-a9b8-e4cb0ce894a1", "name": "network-vif-deleted", "tag": "a5708688-0ab5-42a1-818b-86e1af7a47df"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:11.789796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.790350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.790852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.812342 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] Creating event network-vif-deleted:a5708688-0ab5-42a1-818b-86e1af7a47df for instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 on n-h2-833090-21 Oct 04 18:06:11.820610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1df5216e-2e12-4cb9-a04d-1b93a9f9d7cd req-41616a79-c611-49c7-bcac-831271aa28f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062391 Oct 04 18:06:11.822096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 302/562] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:11.827614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e52a18-f5a7-44a0-9352-a5387586bd61", "name": "network-vif-deleted", "tag": "a1e72178-dd4d-462d-8a7b-5fdd4a886085"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:11.839429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.844534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.844534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.853037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] Creating event network-vif-deleted:a1e72178-dd4d-462d-8a7b-5fdd4a886085 for instance e1e52a18-f5a7-44a0-9352-a5387586bd61 on n-h1-833090-21 Oct 04 18:06:11.857826 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a4fe3cd0-ae13-400f-b2e7-68a899379eae req-c6129c54-efd9-45fe-80ee-f65b674f189f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034291 Oct 04 18:06:11.858625 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 303/563] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:11.864496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4f987e8-4154-4bdf-81ee-7b96435f93ba tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] Calling method '.version_select at 0x7f90097a0ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.342523 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4f987e8-4154-4bdf-81ee-7b96435f93ba tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/845f1385-846f-4dcb-ac67-de740c06af34" status: 202 len: 0 microversion: 2.1 time: 0.482409 Oct 04 18:06:12.348092 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 304/564] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:06:11 2022] DELETE /compute/v2.1/os-security-groups/845f1385-846f-4dcb-ac67-de740c06af34 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:12.354444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.357673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.365605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.366101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.366532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.367294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.368232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.368664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.381345 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4e460ba-b87c-4951-8763-89f85ca7e9e7 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec/action" status: 202 len: 0 microversion: 2.1 time: 3.263241 Oct 04 18:06:12.386416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 261/565] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:09 2022] POST /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec/action => generated 0 bytes in 3265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:12.389339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.389973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: b06b0714-4871-4f68-a9b8-e4cb0ce894a1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.398660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.399156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.399625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.400338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.400795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.401225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.419192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] HTTP exception thrown: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Request method failure captured: Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 HTTP/1.1 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXS97h2_KOPgk2LMmbKT1aqBzEoZPoRZ1hIIfW9KqecdVPYUGINQf4LVYZdLqwkR9Dh26TmWfWF81sUhqvPCix4wYJKbsiRygtH5_soh8aKZ4ZhxemQPIFLw04fw5J9Tt2ZZzVqv68gGTS-GtyY0SjdvdZUeLJKFOAi6410sm631Eg Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 41462bdf6c6a4c0c9959a8289689ec92 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:12.421277 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41462bdf6c6a4c0c9959a8289689ec92"}]}] Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 41462bdf6c6a4c0c9959a8289689ec92 Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveMigrationNegativeTest-2086757347-project Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f1faf17db3a745e288d227ce3c8c4294 Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveMigrationNegativeTest-2086757347-project Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. Oct 04 18:06:12.422808 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b06b0714-4871-4f68-a9b8-e4cb0ce894a1'} Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:12.423740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. Oct 04 18:06:12.425134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.428295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Returning 404 to user: Instance b06b0714-4871-4f68-a9b8-e4cb0ce894a1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:12.429353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8d6f8a0-f163-431b-96ad-fd43b72c8794 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1" status: 404 len: 111 microversion: 2.1 time: 0.045910 Oct 04 18:06:12.430072 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 262/566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/b06b0714-4871-4f68-a9b8-e4cb0ce894a1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:12.435318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.436181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.446373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.449588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.449588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.449588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.449588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.449973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.493957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.494452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.494892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.495390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lazy-loading 'fault' on Instance uuid 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:12.544545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.553647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.555196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.556479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24526f7a-1999-4d28-9cc7-112f3d7f9392 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1568 microversion: 2.25 time: 0.206557 Oct 04 18:06:12.557139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 305/567] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:12.561837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.562504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.570585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.570585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.570585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.570585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.570944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.571056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.649451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.657697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.659146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.664903 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef592db7-e523-4dc7-b387-0a38f37864d2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.106610 Oct 04 18:06:12.665476 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 306/568] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:12.666631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.670487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29ac4906-8e5a-45ca-89e9-13a3ee80066a tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] Calling method '.version_select at 0x7f900979f5e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.675532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e083e3dd-9c27-4f5b-b3ac-77835a55f0be tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1458 microversion: 2.1 time: 0.244048 Oct 04 18:06:12.676217 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 263/569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1458 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.696124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.696934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.704200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.704700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.705144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.706137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.706776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.707197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.743897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.744465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.744903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.745353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lazy-loading 'fault' on Instance uuid e1e52a18-f5a7-44a0-9352-a5387586bd61 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:12.793354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4db97c2518b40e0a17c3115cc01b69f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca83eac610475d8e69eb5bfc1af3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.801633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-302541c1-d4b3-4665-a37e-d586769dbf51 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 200 len: 1322 microversion: 2.1 time: 0.112641 Oct 04 18:06:12.802389 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 264/570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.806872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.809423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.813265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.813753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.814190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.814883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.815530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.815961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.947934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.955957 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-65bd702d-8116-40c9-b6a5-2867471e7bb2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.152347 Oct 04 18:06:12.956325 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 265/571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.961358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.961858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.967904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.968396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.968832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.969538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.969994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.970454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.997109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:13.045335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29ac4906-8e5a-45ca-89e9-13a3ee80066a tempest-SecurityGroupsTestAdminJSON-754631688 tempest-SecurityGroupsTestAdminJSON-754631688-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/578e36f6-3998-4d80-965f-7d106b9575d2" status: 202 len: 0 microversion: 2.1 time: 0.378608 Oct 04 18:06:13.046018 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 307/572] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:06:12 2022] DELETE /compute/v2.1/os-security-groups/578e36f6-3998-4d80-965f-7d106b9575d2 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:13.350566 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4bd8ea7e-66c7-42d8-a628-fa4e7f3e21f3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 204 len: 0 microversion: 2.1 time: 0.392550 Oct 04 18:06:13.351691 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 266/573] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:12 2022] DELETE /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:13.362039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.362954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.370463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.371129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.371690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.372470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.372930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.373512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.587727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.590741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.597704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.598724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.599162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.599915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.600371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.600853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.644538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.653729 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a4aa590a-a536-4d1a-87b1-94affccb5c32 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1473 microversion: 2.1 time: 0.297101 Oct 04 18:06:13.654589 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 308/574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.698689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.699298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.705611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.706203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.706626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.708063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.708063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.713974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.803369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.805718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.814304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.816419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.817769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.818723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca631508-9e79-42eb-9a70-83ba431c310b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1558 microversion: 2.25 time: 0.236339 Oct 04 18:06:13.819414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.820144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 267/575] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:13.825505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.826260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.828891 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7657333e-52d1-43df-a550-d6f180e88aa9 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.134981 Oct 04 18:06:13.830505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 309/576] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:13.835729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.836684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] [instance: e1e52a18-f5a7-44a0-9352-a5387586bd61] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.838333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.839193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.842262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.843273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.843924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.845087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.845645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.846314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.849071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.849951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.850560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.851262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.876438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] HTTP exception thrown: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Request method failure captured: Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 HTTP/1.1 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXp8gBWymuZbOmrTNEZJDfTuyaAx0n2WVnPQ6RZK3de1aBhw6JUrZhZUSZLQ9KNyly7J5Ay2naVIO4yxXLuDX9uXcRN6eoFJsbNrfCUDgoWe5EmryyP-v4NhvTfNhc81IXbOSKiut38NEQx4aSfEFBb6lnmrnF2tzcdCno8LeRwBiw Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:06:13.878995 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9fca83eac610475d8e69eb5bfc1af3a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9fca83eac610475d8e69eb5bfc1af3a0"}]}] Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9fca83eac610475d8e69eb5bfc1af3a0 Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304 Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f4db97c2518b40e0a17c3115cc01b69f Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:06:13.880685 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e1e52a18-f5a7-44a0-9352-a5387586bd61'} Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:13.881563 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. Oct 04 18:06:13.882933 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:13.885952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] Returning 404 to user: Instance e1e52a18-f5a7-44a0-9352-a5387586bd61 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:13.887063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.887676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.888013 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00394708-b850-4d87-a236-225326ce30d2 tempest-FloatingIPsAssociationNegativeTestJSON-893299304 tempest-FloatingIPsAssociationNegativeTestJSON-893299304-project] 10.222.0.40 "GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61" status: 404 len: 111 microversion: 2.1 time: 0.055997 Oct 04 18:06:13.888157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.888562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lazy-loading 'fault' on Instance uuid 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:13.893347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 310/577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/e1e52a18-f5a7-44a0-9352-a5387586bd61 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:13.898693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b8e4622-7ec9-468f-925f-2cc2f05936dd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '.version_select at 0x7f90097b8ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.902334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b8e4622-7ec9-468f-925f-2cc2f05936dd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.902801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b8e4622-7ec9-468f-925f-2cc2f05936dd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.903408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b8e4622-7ec9-468f-925f-2cc2f05936dd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.921638 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b8e4622-7ec9-468f-925f-2cc2f05936dd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1354 microversion: 2.25 time: 0.027114 Oct 04 18:06:13.922243 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 311/578] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/os-migrations => generated 1354 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:13.937936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.939041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.945887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.946668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.947107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.948079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.948545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.948971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.135858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.144770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c0fb854-0128-4e21-895d-66ff2326b3db tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1458 microversion: 2.1 time: 0.323237 Oct 04 18:06:14.145978 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 268/579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1458 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.151324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.152233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.159800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.161260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.161988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.162816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.163691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.163968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.231383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 924684cc-8e02-41ca-b044-c3663727d075 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:14.253246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-964c46d6-5bcf-4c42-89a5-5bea7c121730 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 2053 microversion: 2.25 time: 0.319110 Oct 04 18:06:14.253958 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 312/580] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 2053 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:14.382400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5794ca9c-ff2c-4f02-94b2-f6f644a178f0", "name": "network-vif-deleted", "tag": "e5dbc6f7-bbd7-4246-a970-10b974d6e7e0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:14.404572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.405251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.405692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.430533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] Creating event network-vif-deleted:e5dbc6f7-bbd7-4246-a970-10b974d6e7e0 for instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 on n-h1-833090-21 Oct 04 18:06:14.444510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-93986a53-eca4-4e78-bd10-dad5f87543ff req-0a077028-2ac1-4c11-a34a-b2fba2162cbf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064016 Oct 04 18:06:14.447890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 313/581] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:14.460410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.469218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1902865724", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bcca917f-d495-4d05-8cab-ccf60494bd86"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:14.470412 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f812b22-d7cd-4492-b45a-074650de276c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.322630 Oct 04 18:06:14.471774 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 269/582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.538798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] validate_networks() for [('bcca917f-d495-4d05-8cab-ccf60494bd86', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:14.679880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.680464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.691382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.691907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.692342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.693074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.693532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.693957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.843324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.852637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-563e641c-65e0-46b0-8658-bdfc8e06c5d3 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1473 microversion: 2.1 time: 0.177087 Oct 04 18:06:14.853218 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 270/583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:14.875191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.875916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.881798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.882272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.882842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.883415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.883923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.884347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.950626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.959992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.961458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.967039 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b714dd8-3172-4c5c-a8f7-bed4157663d0 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.095531 Oct 04 18:06:14.967817 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 271/584] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:15.169675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.170290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.186181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.189769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.189769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.190351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.190830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.192290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.227964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.228674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.229268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.230086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lazy-loading 'fault' on Instance uuid 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:15.288023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb87ce6533524ec3aa86764646b52a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea7b1e2c62244debad4da496575243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:15.298046 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36fa4360-bd8b-48ba-a027-721ec73964d1 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 200 len: 1310 microversion: 2.1 time: 0.132354 Oct 04 18:06:15.298944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 272/585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:15.496451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.497160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.508085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.510935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.513113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.515120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.517592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.519879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.743035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:15.755675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f0b0526-b1d7-4fa2-8f81-1443d9c6e027 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.263716 Oct 04 18:06:15.764309 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 273/586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:15.773927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:15.773927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:15.773927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:15.773927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:15.773927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:15.782529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c2c02e-31e1-4c65-9b2c-29e40d5438ec", "name": "network-vif-unplugged", "status": "completed", "tag": "1e560aa1-5d0d-4eb8-8c06-c7ad4002645e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:15.789005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.789482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.790128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.791002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.791823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.792493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.796957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.797566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.799115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.806708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:15.820059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:15.826600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for user 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 and project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:15.840509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:15.844363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:15.844667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] Creating event network-vif-unplugged:1e560aa1-5d0d-4eb8-8c06-c7ad4002645e for instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec on n-h2-833090-21 Oct 04 18:06:15.858886 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e798c9a6-f460-402c-be4b-6a320db117df req-093317f6-c420-430f-ad86-e1f783d47463 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092250 Oct 04 18:06:15.864324 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 274/587] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:15.879527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.880804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.893579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.895566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.896241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.898278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.899034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.900891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.909515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:15.967054 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0735c869-3525-4b7e-862f-cb1309fa0704 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.515069 Oct 04 18:06:15.968068 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 314/588] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:06:15.980920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.981941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.184450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.186665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.198110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.203732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.226167 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75fe208f-4418-4f96-bac2-a38c8ad27a63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1262 microversion: 2.25 time: 0.228570 Oct 04 18:06:16.226167 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 315/589] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1262 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:16.226167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.226167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.226167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.227282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.228693 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d65394e2-6214-4143-af22-d4434e1e2608 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1473 microversion: 2.1 time: 0.350162 Oct 04 18:06:16.235908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.237925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.247200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.247898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.254492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 275/590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:16.323214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.325127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.335808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:16.335808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.335808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.335808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.338107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.338767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.339175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.363522 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 HTTP/1.1 Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:16.363665 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.365031 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5794ca9c-ff2c-4f02-94b2-f6f644a178f0'} Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.365739 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.366935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.368030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.368030 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e489f1e6-c5ee-4a86-8a17-ffcaae474e70 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 404 len: 111 microversion: 2.1 time: 0.047036 Oct 04 18:06:16.368030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 276/591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.374909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.377312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.377845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.384611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.385122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.385742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.387370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.388049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.388643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.401515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.403656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.410086 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4b326a3-fea2-44ce-ac42-1abf38c1497b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.201271 Oct 04 18:06:16.421635 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 HTTP/1.1 Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:16.423651 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.424999 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5794ca9c-ff2c-4f02-94b2-f6f644a178f0'} Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.425955 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.427946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.430403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 316/592] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:16.433113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.433113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aab1ecc8-7934-490e-9a75-794f3574a478 tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 404 len: 111 microversion: 2.1 time: 0.059165 Oct 04 18:06:16.438362 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 277/593] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:16 2022] DELETE /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.446130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.446836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: 5794ca9c-ff2c-4f02-94b2-f6f644a178f0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.453984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.454471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.455027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.456276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.459179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.460463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.463496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08625ac-e199-462b-9a98-73e05914ad2b", "name": "network-vif-deleted", "tag": "bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.479331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.479926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.481021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.485640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 HTTP/1.1 Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:06:16.487457 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.489140 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5794ca9c-ff2c-4f02-94b2-f6f644a178f0'} Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.489831 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. Oct 04 18:06:16.491575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.493061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance 5794ca9c-ff2c-4f02-94b2-f6f644a178f0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.493061 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66a6b508-5266-4d2d-ac43-a1260382349e tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0" status: 404 len: 111 microversion: 2.1 time: 0.047730 Oct 04 18:06:16.493061 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 317/594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/5794ca9c-ff2c-4f02-94b2-f6f644a178f0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.497408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.497905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.500913 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] Creating event network-vif-deleted:bbfaa70d-4e5e-4841-93d0-8e8b0f588cd8 for instance c08625ac-e199-462b-9a98-73e05914ad2b on n-h2-833090-21 Oct 04 18:06:16.509639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3c47e62f-0ef2-4b5e-b470-a3d4f6a32d2f req-a0ae9481-fd60-4967-9fe6-6b48519fa200 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047072 Oct 04 18:06:16.509639 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 278/595] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:16.511444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.511963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.514464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.516352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.516862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.517376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.534004 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 HTTP/1.1 Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:06:16.536204 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.537744 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c4b5949a-142e-4439-9552-e7c2c2fad742'} Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.538573 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.540515 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.541759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.541759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a4ee288-25ec-4aed-a753-8d82c6037cbf tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 404 len: 111 microversion: 2.1 time: 0.044526 Oct 04 18:06:16.541759 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 318/596] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:16 2022] DELETE /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.550147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.550147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] [instance: c4b5949a-142e-4439-9552-e7c2c2fad742] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.557929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.558440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.558885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.561005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.561357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.561842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.591443 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] HTTP exception thrown: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Request method failure captured: Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 HTTP/1.1 Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXXlM-wfg-wwtv7iLDkSfNSrx25CsDR_bC_oeR5dE0TLyvkWSRcnFJb-LmbBO669md2TcMuuoTAG4dqexKld4CkvQvE-BEa52oX-cNDwi5Jc4twe4ucqY_g5IqaxhMWxaabpdQtfFoF9KmhBDTRjYfB4Cj3EuDQlJxuoLlaQY_41JI Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:16.593417 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ea7b1e2c62244debad4da496575243f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ea7b1e2c62244debad4da496575243f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ea7b1e2c62244debad4da496575243f"}]}] Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1ea7b1e2c62244debad4da496575243f Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669465012 Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bb87ce6533524ec3aa86764646b52a32 Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669465012-project Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.594667 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c4b5949a-142e-4439-9552-e7c2c2fad742'} Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:16.595562 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. Oct 04 18:06:16.596934 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:16.598553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] Returning 404 to user: Instance c4b5949a-142e-4439-9552-e7c2c2fad742 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:16.598553 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dd0371b-3ba1-431a-b571-d8bc0e85d30c tempest-DeleteServersAdminTestJSON-1669465012 tempest-DeleteServersAdminTestJSON-1669465012-project] 10.222.0.40 "GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742" status: 404 len: 111 microversion: 2.1 time: 0.052067 Oct 04 18:06:16.598553 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 279/597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/c4b5949a-142e-4439-9552-e7c2c2fad742 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:16.783991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.786952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.797771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:16.802996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.802996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.802996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.802996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.803847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.804314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.135777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.147179 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-324031ed-c0c9-41e8-a430-709223626ad0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.368873 Oct 04 18:06:17.147808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 319/598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.244141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.245706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.252227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:17.260722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.260722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.272476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.273092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.275884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.275884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.275884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.275884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.384974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.385649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.386208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.386796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lazy-loading 'fault' on Instance uuid c08625ac-e199-462b-9a98-73e05914ad2b {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:17.395722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.405388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.407179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.408669 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59b4ba66-a9e7-4e84-9251-5ec37825dbdc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1262 microversion: 2.25 time: 0.172458 Oct 04 18:06:17.409442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 280/599] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:17.452716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.454007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.493453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.495049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.496507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.497427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.498238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.499406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.590573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.600474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.602963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.610307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53924470-7dfd-48c8-8264-ef74e1025e1e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.167198 Oct 04 18:06:17.612951 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 281/600] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:17.666552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1faf17db3a745e288d227ce3c8c4294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41462bdf6c6a4c0c9959a8289689ec92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.678769 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ffcfc17-e066-4d1c-9a1d-9dea17a4433d tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 200 len: 1308 microversion: 2.1 time: 0.423469 Oct 04 18:06:17.690741 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 320/601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.977734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c2c02e-31e1-4c65-9b2c-29e40d5438ec", "tag": "1e560aa1-5d0d-4eb8-8c06-c7ad4002645e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:17.991673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.992481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.993075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.011851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] Creating event network-changed:1e560aa1-5d0d-4eb8-8c06-c7ad4002645e for instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec on n-h2-833090-21 Oct 04 18:06:18.022858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f1e721ab-5532-4a2c-a8d4-a5208c650573 req-a881eaa6-a1ae-4b73-a557-ec89fb615cba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052148 Oct 04 18:06:18.024814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 282/602] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.171577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.172802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.180128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.180976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.181570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.182790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.183397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.186693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.560968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.567525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.568157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.569095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.570129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.571882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.574318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.634711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.634711 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd2d1e13-0fb8-4486-bf91-207562b78425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.447605 Oct 04 18:06:18.634711 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 321/603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:18.635620 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bf454cb9-c74d-458c-b919-a7c026b1deec tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.253036 Oct 04 18:06:18.635620 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 283/604] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:18.643131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.643755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.649996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.656033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.656785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.657407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.658249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.658849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.659511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.661124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.661669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.662107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.663855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.665671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.666763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.690422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43eded82-9b5c-4121-b2dc-54c0439310ca tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.055334 Oct 04 18:06:18.700965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 284/605] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.705580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.709439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.714246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.714736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.715395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.716182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.716692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.717276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.744656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.756733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.759297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.761314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49e249c9-8572-4a12-af9f-24a6f9cf516f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1314 microversion: 2.25 time: 0.131786 Oct 04 18:06:18.766869 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 322/606] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:18.780172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.788941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.789429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.789921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.790643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.791087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.791723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.797331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.808017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.809655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.815481 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92e7f539-6fbf-4aff-97e8-15d10322dcbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.117449 Oct 04 18:06:18.825234 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 285/607] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:18.828973 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aba16c4b-bbdc-4b1a-a720-a55fd3437114 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.061091 Oct 04 18:06:18.829568 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 323/608] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.833031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.833764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] [instance: c08625ac-e199-462b-9a98-73e05914ad2b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.843614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.847268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.847268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.847554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.847674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.847674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.847674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.848972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.849449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.849878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.850594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.851031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.851662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.868046 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] HTTP exception thrown: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Request method failure captured: Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b HTTP/1.1 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXS97h2_KOPgk2LMmbKT1aqBzEoZPoRZ1hIIfW9KqecdVPYUGINQf4LVYZdLqwkR9Dh26TmWfWF81sUhqvPCix4wYJKbsiRygtH5_soh8aKZ4ZhxemQPIFLw04fw5J9Tt2ZZzVqv68gGTS-GtyY0SjdvdZUeLJKFOAi6410sm631Eg Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 41462bdf6c6a4c0c9959a8289689ec92 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:18.870209 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/41462bdf6c6a4c0c9959a8289689ec92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/41462bdf6c6a4c0c9959a8289689ec92"}]}] Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 41462bdf6c6a4c0c9959a8289689ec92 Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2086757347 Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveMigrationNegativeTest-2086757347-project Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f1faf17db3a745e288d227ce3c8c4294 Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveMigrationNegativeTest-2086757347-project Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. Oct 04 18:06:18.871801 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c08625ac-e199-462b-9a98-73e05914ad2b'} Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:18.872674 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. Oct 04 18:06:18.875116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.882944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] Returning 404 to user: Instance c08625ac-e199-462b-9a98-73e05914ad2b could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:18.882944 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-772c85f9-019b-41e1-b8cb-6a02f9638cb0 tempest-LiveMigrationNegativeTest-2086757347 tempest-LiveMigrationNegativeTest-2086757347-project] 10.222.0.40 "GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b" status: 404 len: 111 microversion: 2.1 time: 0.051165 Oct 04 18:06:18.882944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 286/609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/c08625ac-e199-462b-9a98-73e05914ad2b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:18.887127 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51a1e511-cc3b-40e2-ac88-12b4788bc04f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-833090-21&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.045711 Oct 04 18:06:18.895230 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 324/610] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services?host=n-d-833090-21&binary=xxx => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:06:18.905644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.910267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.926357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.926357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.926357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.926357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.926920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.942319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb69b598-2453-4be2-955b-114f8eaf8c7f tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040464 Oct 04 18:06:18.943420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 287/611] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.960946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.961703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.961703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.962109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.962818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.963420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.964045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.995022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-527cc4c3-ca7c-477b-a10e-420a47b6c1b5 tempest-ServicesAdminNegativeTestJSON-882836394 tempest-ServicesAdminNegativeTestJSON-882836394-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.039156 Oct 04 18:06:18.995022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 325/612] 10.222.0.40 () {58 vars in 1198 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:19.223684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e9a0368-37c2-4b70-bbe0-ffb1a9a3a0a4 tempest-ServicesAdminNegativeTestJSON-98548946 tempest-ServicesAdminNegativeTestJSON-98548946-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.227396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e9a0368-37c2-4b70-bbe0-ffb1a9a3a0a4 tempest-ServicesAdminNegativeTestJSON-98548946 tempest-ServicesAdminNegativeTestJSON-98548946-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a280a3549fc746b59b3d532236546cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2995a41bec4285bc74770a1309cf60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e9a0368-37c2-4b70-bbe0-ffb1a9a3a0a4 tempest-ServicesAdminNegativeTestJSON-98548946 tempest-ServicesAdminNegativeTestJSON-98548946-project] Request method failure captured: Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYZcql4AZIBBo7h029qFY8nQirXLOz7iD9hFrtjY5hd6Wn7qOZqVVIcLLzpLHuABY6WZlK3N7HwwiWkS6OC59TZvkA7N8WTENrtWaeuMjRpjRekXKaGF4t6kyRMLH6-rsBXAN9AkbEDmKwbDPMQwBPJzFUocPkIF2uukgZQHARl6pQ Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2a2995a41bec4285bc74770a1309cf60 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-98548946 Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:06:19.229518 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2a2995a41bec4285bc74770a1309cf60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a2995a41bec4285bc74770a1309cf60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2a2995a41bec4285bc74770a1309cf60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2a2995a41bec4285bc74770a1309cf60"}]}] Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-98548946 Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2a2995a41bec4285bc74770a1309cf60 Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-98548946 Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServicesAdminNegativeTestJSON-98548946-project Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: a280a3549fc746b59b3d532236546cc4 Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-98548946-project Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:06:19.231030 n-d-833090-21 devstack@n-api.service[123886]: action_args: {} Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:06:19.234471 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:06:19.237308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.239762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e9a0368-37c2-4b70-bbe0-ffb1a9a3a0a4 tempest-ServicesAdminNegativeTestJSON-98548946 tempest-ServicesAdminNegativeTestJSON-98548946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:19.239762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e9a0368-37c2-4b70-bbe0-ffb1a9a3a0a4 tempest-ServicesAdminNegativeTestJSON-98548946 tempest-ServicesAdminNegativeTestJSON-98548946-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.230622 Oct 04 18:06:19.239762 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 288/613] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 232 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:19.642578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.644722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.654240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.660457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.660457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.660457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.660457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.660855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.791269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.792121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.821253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.821253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.821833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.822785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.823626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.824289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.923035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.928042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.939386 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1db0b6f-886a-4f1c-9575-c74ec532393a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.301612 Oct 04 18:06:19.943656 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 326/614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.944852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.946610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.947930 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24c50ad6-8f2f-402b-b6be-a12dfd084902 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1320 microversion: 2.25 time: 0.161913 Oct 04 18:06:19.972868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 289/615] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:19.984177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.986762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.001669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.004488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.005264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.007858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.011203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.013910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.224478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.240810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.242595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.252543 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb202690-ddba-4973-a98c-3be94354863d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.289101 Oct 04 18:06:20.275032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 327/616] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:20.966112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.966775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.973315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.973800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.974254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.974927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.975382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.976566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.982205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.982736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.990586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.991271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.991899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.992819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.993290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.993715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.166929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.177697 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5fef400-75e9-4f0b-81ba-4ae911387821 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.215746 Oct 04 18:06:21.180038 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 290/617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:21.284444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.285600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.294300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.294814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.295252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.296013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.296661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.297354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.370870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.379653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.381392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.388908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0debe7f-479a-4d91-a350-cbc83e171a46 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1558 microversion: 2.91 time: 0.106707 Oct 04 18:06:21.388908 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 291/618] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1558 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:21.476821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.497575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.499033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.501427 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5eecfaf6-10c9-4f1b-b576-537865e63794 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.522692 Oct 04 18:06:21.504516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 328/619] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:22.203891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.204508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.214783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.216659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.218549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.221428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.222155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.225512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.418300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.421458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.441856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.442817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.443276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.444565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.445655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.446426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.578063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.591113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fb07b1a-3a68-4d6f-a70b-0061857d604f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.390905 Oct 04 18:06:22.594466 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 292/620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.623271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.629672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.646962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.647491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.648022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.648695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.649164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.649609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.725465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.743402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.746876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.758549 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-045c5e2a-28cf-4994-8cec-7dd61fd1c122 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.344367 Oct 04 18:06:22.760324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 329/621] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:22.771453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f549322e-f89f-48d9-92f7-7a10bdf098f4", "tag": "7c365027-ebc4-494b-aabb-affbfd8293f4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:22.794166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.794907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.795814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.837067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] Creating event network-changed:7c365027-ebc4-494b-aabb-affbfd8293f4 for instance f549322e-f89f-48d9-92f7-7a10bdf098f4 on n-h1-833090-21 Oct 04 18:06:22.843148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1500aebe-0365-476a-b5b7-98043201d38c req-74baf302-ae15-438d-ac6c-eb0e8459f3df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079408 Oct 04 18:06:22.845341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 330/622] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:22.918225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.948516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.952321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.953657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2b7721b-46e0-4898-ac3e-3871c8c7abbb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.357921 Oct 04 18:06:22.971616 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 293/623] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:23.616966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.617667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.634715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.635009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.635450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.636199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.636681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.637115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.798162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.800825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.813777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.815449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.817742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.823763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.823763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.823763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.917802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.926480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.930903 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-032e0c0b-54b3-4aac-a3b8-8ca6d433fdc5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.316307 Oct 04 18:06:23.940588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 331/624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:23.954430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.955930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.963516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4112363b-cd73-4cb2-bc57-478858b8b169 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.170576 Oct 04 18:06:23.966031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 294/625] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:24.003908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.017886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.043156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.044041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.044269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.044945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.045392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.045827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.326320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.351679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.353743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.358763 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adb7ebe7-d61c-4151-bd42-83478dca3fe8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.376545 Oct 04 18:06:24.378546 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 332/626] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:24.960015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.961523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.970225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.978511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.979058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.979915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.980590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.981023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.095918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0bbcb0e-bb7b-456b-b1a4-4496be321cc5 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1877022575", "id": 858162135, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:25.255910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0bbcb0e-bb7b-456b-b1a4-4496be321cc5 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.867172 Oct 04 18:06:25.258192 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 295/627] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:06:24 2022] POST /compute/v2.1/flavors => generated 446 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:06:25.271750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.275702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.290223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.301904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29fecc3e-5e4b-4cd8-bd57-8b43965182b9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.345358 Oct 04 18:06:25.307103 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 333/628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:25.310288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.310673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.311133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.311909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.312367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.312796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.497767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.510911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.522868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.539297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa9a16ec-7525-47ac-97fa-5500068f6908 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.278372 Oct 04 18:06:25.542762 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 296/629] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:25.567712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.568676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.580392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.585878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.588637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.588637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.588637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.588637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.993125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.004185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.008438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.016470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e53494a-0a4d-4b0e-9b4d-6733e462b7d6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.471684 Oct 04 18:06:26.017367 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 297/630] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:26.093435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4ed01f4-28c3-4902-b1d7-0c0241ddc848 tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.127562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4ed01f4-28c3-4902-b1d7-0c0241ddc848 tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] 10.222.0.40 "GET /compute/v2.1/flavors/858162135" status: 200 len: 446 microversion: 2.55 time: 0.806581 Oct 04 18:06:26.128989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 334/631] 10.222.0.40 () {60 vars in 1196 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/flavors/858162135 => generated 446 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:06:26.154843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-434e65fd-938a-4fc0-a1b7-c7c122a65a49 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:26.274639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-434e65fd-938a-4fc0-a1b7-c7c122a65a49 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/858162135" status: 200 len: 447 microversion: 2.55 time: 0.128725 Oct 04 18:06:26.275594 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 298/632] 10.222.0.40 () {62 vars in 1216 bytes} [Tue Oct 4 18:06:26 2022] PUT /compute/v2.1/flavors/858162135 => generated 447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:06:26.293022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4421e16f-880f-41ad-9234-003c6d363fe4 tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.300983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:26.336711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.340577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.373444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.373444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.374668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.375726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.376375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.377005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.386506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4421e16f-880f-41ad-9234-003c6d363fe4 tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.099889 Oct 04 18:06:26.393234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 335/633] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:26.432618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6222fb11-d3e5-4581-a400-ff810190dcbd tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.469918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6222fb11-d3e5-4581-a400-ff810190dcbd tempest-FlavorsV255TestJSON-522101579 tempest-FlavorsV255TestJSON-522101579-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.053263 Oct 04 18:06:26.470569 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 336/634] 10.222.0.40 () {60 vars in 1166 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:26.495261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5eef96b3-670d-4449-ad35-71806fc4f5c1 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.589794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5eef96b3-670d-4449-ad35-71806fc4f5c1 tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/858162135" status: 202 len: 0 microversion: 2.55 time: 0.102893 Oct 04 18:06:26.591571 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 337/635] 10.222.0.40 () {60 vars in 1199 bytes} [Tue Oct 4 18:06:26 2022] DELETE /compute/v2.1/flavors/858162135 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:26.793999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.807313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe46ebbf-6f41-4024-8b4e-ceea95cb1c28 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1505 microversion: 2.1 time: 0.474595 Oct 04 18:06:26.829782 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 299/636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:26.836309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.837735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.849495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.850262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.851074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.852169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.852780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.853357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.959199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.968406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.970482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.976595 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-749369d9-723f-49d6-8e83-c4beb27608ea tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.145506 Oct 04 18:06:26.977818 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 300/637] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:26.982859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ebd4a0b1-22b9-4b1c-b646-2724c5b1ce4e tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.004592 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ebd4a0b1-22b9-4b1c-b646-2724c5b1ce4e tempest-FlavorsV255TestJSON-1057255808 tempest-FlavorsV255TestJSON-1057255808-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6152 microversion: 2.55 time: 0.025483 Oct 04 18:06:27.005274 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 301/638] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/flavors/detail => generated 6152 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:27.046082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.046955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.054387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.055220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.055913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.056856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.057513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.058137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.105514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-832759062", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:27.199399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:27.281691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.285084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:27.298724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.301225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.303172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dba97dcf-2d6a-4d89-8139-f13f718fa56b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.260662 Oct 04 18:06:27.318775 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 302/639] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:06:27.729443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:27.729984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:27.730819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:27.731378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:27.732034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:27.760954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.764118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.765828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.769907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.770414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.772879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.829391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Getting quotas for project f71b036680f9444bae3d0e89ea8ea81c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:27.834330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.835190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.839164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:27.842467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Getting quotas for user 07c5df6fbd0b4aa3aa4e3db55ca35360 and project f71b036680f9444bae3d0e89ea8ea81c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:27.857960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.860603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.862571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.863914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.865070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.866547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.869375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:27.879509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:28.075537 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cd86a1d-ca27-428c-b4b6-4db42a284de1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482301 Oct 04 18:06:28.082321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 338/640] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:28.092670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.095855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.104813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.105591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.132192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.134150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.136754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.137444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.155387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.166265 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aac9f682-bcf8-4778-bdea-2c20db5bcf42 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1495 microversion: 2.1 time: 0.337023 Oct 04 18:06:28.167078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 303/641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.173641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-37cd6e5b-7bf4-46ef-b92c-464c0b2990a6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.174851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-37cd6e5b-7bf4-46ef-b92c-464c0b2990a6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.325388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-37cd6e5b-7bf4-46ef-b92c-464c0b2990a6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.334863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-37cd6e5b-7bf4-46ef-b92c-464c0b2990a6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1216 microversion: 2.1 time: 0.166468 Oct 04 18:06:28.339126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 304/642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.342123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e50fcd1-c236-4520-865f-b94a2ee1e9ed tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '.version_select at 0x7f9009a3faf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.346787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e50fcd1-c236-4520-865f-b94a2ee1e9ed tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.347553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e50fcd1-c236-4520-865f-b94a2ee1e9ed tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.348484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e50fcd1-c236-4520-865f-b94a2ee1e9ed tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.366468 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e50fcd1-c236-4520-865f-b94a2ee1e9ed tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.029068 Oct 04 18:06:28.367917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 305/643] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:28.373781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.375078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.386802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.387601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.388549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.389466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.391242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.391898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.499557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.512293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.518821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.536255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d82a12a-6fe0-4117-951f-ef5fe92da413 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.448905 Oct 04 18:06:28.554163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 339/644] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:28.587219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.587902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.596173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.596881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.597503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.598373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.599077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.599858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.748605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.765597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.767516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.782107 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08d6a356-90a9-4627-b52a-4489856b95b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.412426 Oct 04 18:06:28.787513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 306/645] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:28.922694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:29.045221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-584074753", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:29.076368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:29.084340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4f96812-eb9e-4674-9cea-7a2cba051b27 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1648 microversion: 2.1 time: 0.528286 Oct 04 18:06:29.085317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 340/646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1648 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:29.106554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.129300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.165589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.165589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.165589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.165589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.168991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.171974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.207924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:29.225644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:29.626448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:29.626967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:29.627903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:29.628308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:29.628720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:29.638458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.638948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.639393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.640167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.640625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.641055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.659716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Getting quotas for project 6e2f0b93483044ea8f9dd20340b7acdd. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:29.664960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Getting quotas for user d53e51ea1ceb4f778ea589144c3758eb and project 6e2f0b93483044ea8f9dd20340b7acdd. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:29.678567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:29.681235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:30.109996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0e67b8c-44a6-4b6d-a71f-6bb1e064f803 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313684 Oct 04 18:06:30.112176 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 307/647] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:30.121246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f549322e-f89f-48d9-92f7-7a10bdf098f4", "name": "network-vif-plugged", "status": "completed", "tag": "7c365027-ebc4-494b-aabb-affbfd8293f4"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:30.160455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.165578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.166337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.211105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc586447-f915-4dd3-af74-1a51546b5d89 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 204 len: 0 microversion: 2.1 time: 1.120979 Oct 04 18:06:30.211105 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 341/648] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:29 2022] DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:30.222147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dede9584-9197-4fd8-a569-d90021d1fb39 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.222885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dede9584-9197-4fd8-a569-d90021d1fb39 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.224113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] Creating event network-vif-plugged:7c365027-ebc4-494b-aabb-affbfd8293f4 for instance f549322e-f89f-48d9-92f7-7a10bdf098f4 on n-h1-833090-21 Oct 04 18:06:30.249061 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f49aa2e6-2e53-46fa-9523-9205c28dea12 req-fd4b96df-b5ca-4d5e-b427-21e34b7035c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135509 Oct 04 18:06:30.254612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 308/649] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:30.272950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-417746917", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "286df177-dde3-4675-bad4-0ffd6b0a97f8"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:30.338767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dede9584-9197-4fd8-a569-d90021d1fb39 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.373198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dede9584-9197-4fd8-a569-d90021d1fb39 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1216 microversion: 2.1 time: 0.162653 Oct 04 18:06:30.389335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 342/650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.397280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.397943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.407092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.407908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.409513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.410524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.411145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.411749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.449294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] validate_networks() for [('286df177-dde3-4675-bad4-0ffd6b0a97f8', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:30.510472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.521215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.522769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.529211 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e56f2a56-d0e9-4091-8b13-91d6488481ff tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.137350 Oct 04 18:06:30.530348 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 343/651] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:30.545544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.546242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.553672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.554612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.555120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.556035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.556519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.557012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.767880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.777462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.779347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.780771 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2cf88eff-f417-4fba-917d-b6997f5998fd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1362 microversion: 2.25 time: 0.249053 Oct 04 18:06:30.781942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 344/652] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:30.787494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60578a06-9535-4c01-9aee-68c0884a2a7e tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.788707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60578a06-9535-4c01-9aee-68c0884a2a7e tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.903986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60578a06-9535-4c01-9aee-68c0884a2a7e tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.918238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60578a06-9535-4c01-9aee-68c0884a2a7e tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1221 microversion: 2.1 time: 0.133258 Oct 04 18:06:30.920994 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 345/653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.926924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-93520160", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "432728042", "adminPass": "***", "networks": [{"uuid": "4db24dda-d1df-423d-b4e8-7ba3a23d704a"}], "security_groups": [{"name": "tempest-securitygroup--978806416"}], "key_name": "tempest-keypair-1829553481", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:31.236760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] validate_networks() for [('4db24dda-d1df-423d-b4e8-7ba3a23d704a', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:31.244497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:31.245038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:31.245415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:31.245828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:31.246265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:31.265766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.266263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.266702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.276346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.277222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.277876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.313651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:31.332157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:31.343794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for user 97934d1450a94f40b1d7a82d05fb47dc and project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:31.358771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:31.361275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:31.671292 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-707ea3b0-70a2-4714-a839-a02f4f2da2e7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409355 Oct 04 18:06:31.671292 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 309/654] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:31.673457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.674357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.683577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.684382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.685096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.685948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.686549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.687276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.791505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:31.867037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.888545 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c4e88bc-67f5-4f78-872e-9ffd999ccbc0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1220 microversion: 2.1 time: 0.207370 Oct 04 18:06:31.891643 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 310/655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.899769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.900668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.911824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.913242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.913946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.914861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.916049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.916653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.031509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.060507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.061960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.089189 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f9169ab-83f4-4468-aadb-0598748be423 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.194400 Oct 04 18:06:32.089921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 311/656] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:32.125675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f371dd5-e53d-4a6c-b174-fc8cba0fc986 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.133663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4f371dd5-e53d-4a6c-b174-fc8cba0fc986 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.309753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f371dd5-e53d-4a6c-b174-fc8cba0fc986 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.323047 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f371dd5-e53d-4a6c-b174-fc8cba0fc986 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1210 microversion: 2.1 time: 0.213389 Oct 04 18:06:32.328532 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 312/657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.335810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.341228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.382116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.384091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.386484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.389023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.391570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.398161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.899345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.946004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.952185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.961747 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc92f0dc-2318-4eac-833a-0e99d9bc0032 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1557 microversion: 2.25 time: 0.631616 Oct 04 18:06:32.980253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:32.980253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:32.980253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:32.980253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:32.981052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:32.986331 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 313/658] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1557 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:33.001732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.002640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.004621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.010265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.010467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.010910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.011904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.013652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.014595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.016389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.021607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.021607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.021964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.033513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.083459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for project fedc406ff3744145837933a196352fff. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:33.089211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Getting quotas for user 447d091b94834e6188a45ba773e4477d and project fedc406ff3744145837933a196352fff. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:33.104486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:33.107963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:33.180858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.190382 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee5ab7d6-d8c0-47ed-a3ae-37dc52f9cb45 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1217 microversion: 2.1 time: 0.202612 Oct 04 18:06:33.203628 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 314/659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.221852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.222897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.239555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.239555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.239555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.239811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.240106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.240530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.316900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0a29485-d2e6-4dcc-8b4f-3e04633bfa0c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.395991 Oct 04 18:06:33.331715 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 346/660] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:33.353593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.354593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.370719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.374831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.375497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.377127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.378598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.379232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.711195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.723507 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7334fa10-c196-454f-8a75-5ae640c30aec tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1268 microversion: 2.1 time: 0.514806 Oct 04 18:06:33.747061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 315/661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1268 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.760995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.765156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.779271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.782475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.783867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.785481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.787325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.789209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.880490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:33.903864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.918218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.920266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.932908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4877aedd-9134-478c-ba42-4a49e2d59b1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.181030 Oct 04 18:06:33.933595 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 316/662] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:33.945850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-590674a9-ffbe-4d0a-859f-e2566e675a79 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.948359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-590674a9-ffbe-4d0a-859f-e2566e675a79 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.953006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-989f28a2-413e-43f9-80a0-1a2377611fcd tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 2052 microversion: 2.25 time: 0.617000 Oct 04 18:06:33.957996 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 347/663] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 2052 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:33.966773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.969863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.992347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.996224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.997384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.000183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.001319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.003278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.222776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-590674a9-ffbe-4d0a-859f-e2566e675a79 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.234042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-590674a9-ffbe-4d0a-859f-e2566e675a79 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1261 microversion: 2.1 time: 0.293315 Oct 04 18:06:34.237895 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 317/664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1261 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.254370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.256857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.284831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.285515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.286063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.293720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.294331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.295372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.301928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.336190 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1cf8a85d-2de6-44e1-83db-c02bc8c2178e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1214 microversion: 2.1 time: 0.362071 Oct 04 18:06:34.347776 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 348/665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1214 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.390795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.394858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.436648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.437588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.444646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.444646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.444646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.453738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.757944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.770903 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-442a9bd6-03d0-47fa-8faa-2313f638ba26 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1273 microversion: 2.1 time: 0.418723 Oct 04 18:06:34.772147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 349/666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.780195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.781370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.790759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.791710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.792328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.794656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.795744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.801418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.843763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:34.883934 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2238a7f-80c7-4097-a770-ff928be75830 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 2052 microversion: 2.25 time: 0.641892 Oct 04 18:06:34.886245 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 318/667] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 2052 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:34.927719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.955851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.956464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.956923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.957763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.958249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.958732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.086245 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fc151d6-77c9-4e10-874b-3d3183fa7682 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.169666 Oct 04 18:06:35.090746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 319/668] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:06:35.100790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.104686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.118973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.119542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.123375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.125218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.125726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.126176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.836608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.847129 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6557c8f-b841-44b8-94a6-f35f9be4403c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1274 microversion: 2.1 time: 1.073477 Oct 04 18:06:35.852098 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 350/669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1274 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.870495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:35.871055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.879040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.883744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.884550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.885532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.886228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.887084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.050459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.070538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.074889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.090845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-feeac672-fe47-4aad-99f8-338aebbbb2ab tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.996291 Oct 04 18:06:36.093215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 320/670] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:36.104418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.107878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.126996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.126996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.127891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.129767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.130757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.134781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.207632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-692fa6d6-12e7-48c7-928d-5a84aed25bef tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4/action" status: 202 len: 0 microversion: 2.25 time: 0.353916 Oct 04 18:06:36.208749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 351/671] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:06:35 2022] POST /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:36.219378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.222070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.247716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.249437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.250218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.251452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.252162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.252742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.269808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.283512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a33d3c2-3c64-43d1-8336-ba9fee2000e5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1257 microversion: 2.1 time: 0.188203 Oct 04 18:06:36.289243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 321/672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1257 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.310679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.312674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.331773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.333123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.335195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.338264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.341330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.343434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.540991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.554008 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e624bb6-7398-48d8-8757-a9b7db4721c5 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1279 microversion: 2.1 time: 0.263394 Oct 04 18:06:36.568984 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 322/673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.579887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.580932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.589713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.590572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.591039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.591888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.592382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.592818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.044642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:37.075865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e86d0d57-8fda-466c-8ff9-2874b6236611 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 2057 microversion: 2.25 time: 0.505363 Oct 04 18:06:37.078935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 323/674] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 2057 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:37.099561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69", "name": "network-vif-deleted", "tag": "7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:37.128262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.128743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.129176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.164955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] Creating event network-vif-deleted:7da83ef0-6b2e-44f5-aa74-0947b5d0d9cc for instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 on n-h2-833090-21 Oct 04 18:06:37.175124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d2609803-a292-4dcd-a8eb-52614b28ca99 req-4f2874c9-2286-4a1a-8046-1563f79a9aed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092407 Oct 04 18:06:37.179023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 324/675] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:37.201119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.201981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.222058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.222559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.222991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.223721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.224253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.224652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.431113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.445542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:37.464572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.465214 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71e38e86-535e-4f0b-baeb-454281cd440b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1274 microversion: 2.1 time: 0.278594 Oct 04 18:06:37.470386 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 325/676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.480370 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da437483-899a-4fa7-bfb5-d32c002037b7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1262 microversion: 2.1 time: 1.269895 Oct 04 18:06:37.484286 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 352/677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1262 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.506360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.509238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.537626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.538627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.540697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.543876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.544388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.545029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.878270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f9009a22c10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.881121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.885925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.886419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.920164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.936509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.943901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.944095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.944095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.944265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.952619 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1331b233-e33e-4863-b897-eb962ab58abb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.464803 Oct 04 18:06:37.988397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 353/678] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:38.014262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.014786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.015296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.015793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.016361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.030795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.034197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.036379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.038968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.040419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.041902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.072282 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88ab6719-dc21-48ad-bb99-4d91ba1b893f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.600903 Oct 04 18:06:38.082330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 326/679] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:38.109389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.112223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.144061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.150235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.150235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.153567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.156238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.156920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.322508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.335047 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2bc7f0c7-a834-4110-9576-53f2102f690a tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1321 microversion: 2.1 time: 0.341619 Oct 04 18:06:38.356115 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 354/680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.367992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097531f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.370383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.372456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.376147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.400316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.404353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.404971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.454668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.455622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.456220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.498662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a915096-c15e-4e09-980a-e869d9108fdf tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.141143 Oct 04 18:06:38.524796 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 355/681] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.547283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.547874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.573073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.573627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.574069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.574793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.580251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.580997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.696294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.732495 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e973e8c-9ab2-4ab9-8381-85a292137064 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1279 microversion: 2.1 time: 0.642709 Oct 04 18:06:38.735902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 327/682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1279 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.762764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.765585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.795211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.800693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.801313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.803640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.808845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.813103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.976231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.015864 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdc6bf0a-dc17-479a-b586-d2e6efc50740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1274 microversion: 2.1 time: 0.277441 Oct 04 18:06:39.033472 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 328/683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1274 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.038420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.039110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.046660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.047218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.047763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.048766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.049388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.049972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.071989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:39.081001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:39.106325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06cfac3e-3b96-46f4-9eb6-015e55089c94 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 2037 microversion: 2.25 time: 0.580107 Oct 04 18:06:39.109679 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 356/684] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 2037 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:39.121509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097a0dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.134469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.135323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.139644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.200483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.200986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.201432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.237624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.238498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.239174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.248716 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0bb143d-15dc-4dd7-b2de-433206e9146f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.137414 Oct 04 18:06:39.257232 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 357/685] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:39.263023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.264010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.272610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.273490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.274293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.275195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.276805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.276805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.380631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.488613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af84d5a7-15a0-4f4c-a9b3-494c0c146093 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1268 microversion: 2.1 time: 0.356406 Oct 04 18:06:39.488613 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 329/686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1268 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.488613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-21", "block_migration": "auto"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:39.488613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.491691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.491691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.491691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.491691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.492371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.492371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.504696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.519138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.525431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.542578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-113bbca4-1a08-4e9f-99b1-fa5ffba52e03 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.283257 Oct 04 18:06:39.543856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'flavor' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:39.545804 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 358/687] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:39.564380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097c1700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.566746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.567412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.570149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.580638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Going to try to live migrate instance to n-h2-833090-21 {{(pid=123886) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:06:39.612778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.617610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.618344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.631102 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43fb302b-3068-4079-bfa0-5cf9ca4ed29f tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.080970 Oct 04 18:06:39.641086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 359/688] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:39.647992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.650246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.662574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.663338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.663952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.664904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.665643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.666717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.782272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.794480 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65378e54-5887-499d-80da-48d7cdcb3f21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1319 microversion: 2.1 time: 0.152095 Oct 04 18:06:39.795270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 360/689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.805956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0817ac9-0a07-4d79-b3b7-4a0a60aaf606 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097a09d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.808482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0817ac9-0a07-4d79-b3b7-4a0a60aaf606 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.809058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0817ac9-0a07-4d79-b3b7-4a0a60aaf606 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.809577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0817ac9-0a07-4d79-b3b7-4a0a60aaf606 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.828912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0817ac9-0a07-4d79-b3b7-4a0a60aaf606 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027714 Oct 04 18:06:39.829656 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 361/690] 10.222.0.40 () {58 vars in 1179 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:39.834369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.834788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.842425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.842950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.843406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.844144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.845147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.845615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.966786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.977445 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c889e6b-58af-4e80-aecb-4511d9b5d5cb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1279 microversion: 2.1 time: 0.146835 Oct 04 18:06:39.979870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 362/691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.986064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097840d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.989793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.990615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.001769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.054130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.054478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.055032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.071111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.071985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.072788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.081912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce2aa631-6b16-42a4-a362-2f5536550f53 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.098145 Oct 04 18:06:40.081912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 363/692] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:40.088035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.088323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.096335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.096953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.097453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.098241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.098765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.099258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.567306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:40.580957 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b721e1d3-465e-47aa-a3c7-f2853e06ea40 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1274 microversion: 2.1 time: 0.497814 Oct 04 18:06:40.593659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 364/693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1274 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:40.604662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097854c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.606975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.611937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.613370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.649751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.656785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.664617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.700850 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c7a03b2-189a-41c6-9dcf-bfbe272318e0 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.099964 Oct 04 18:06:40.702030 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 365/694] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:40.710763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.710763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.717925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.718659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.719455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.732168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.733006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.734215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.152176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.172688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1627b1f-e205-4045-8812-ddfa1e87392f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.467207 Oct 04 18:06:41.174882 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 366/695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:41.210003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.216276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.257160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.258316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.258316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.259021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.259456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.260219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.515815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.529521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.538193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.552572 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6b58843-da8e-4df1-a147-79813445b0f1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.371879 Oct 04 18:06:41.562852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 367/696] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:41.564750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90097a01f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.577717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.584099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.587538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.620542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.623844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.624608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.651398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce66d01f-7eb8-42f6-ab84-49302aee4a27 tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.096412 Oct 04 18:06:41.653414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 368/697] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:41.664359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.665882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.680871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.691519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.692523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.696060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.697245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.698300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.457898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.503655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de095ccd-7d3b-4b93-a43b-a8c339181982 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.846824 Oct 04 18:06:42.517163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 369/698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.517163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.517163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.535502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.539991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.539991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.539991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.539991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.540401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.971314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.987140 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74bd8c52-6a38-4fa8-857d-c416cccb7fa7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.477998 Oct 04 18:06:42.988123 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 370/699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.994189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.995131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:43.023779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.026789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.029779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.030860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.033509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.035795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.091874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:43.118312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:43.368216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.396555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca6ee185-0508-4f03-a1f8-7e8f012d0424 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.405102 Oct 04 18:06:43.411507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 371/700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.411507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Calling method '.version_select at 0x7f90096d8e50>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:43.411507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.412151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.412151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.435433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.436340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.438898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.481392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.488481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.489006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.543761 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f614cab5-79f2-4c5e-ba0f-0e1e101b51fc tempest-HypervisorAdminTestJSON-402050497 tempest-HypervisorAdminTestJSON-402050497-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.139745 Oct 04 18:06:43.546510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 372/701] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:06:43 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:43.565021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:43.565967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:43.582364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.585636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.588990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.591062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.592963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.595962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.228541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=18 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:44.401158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.421052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12b16cf1-0bb7-48f9-9485-3234b8c99383 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.871262 Oct 04 18:06:44.423873 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 373/702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:43 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.434208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.434208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.461189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.462785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.462785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.463496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.463963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.464401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.737027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.751926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.757783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.779156 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fdff7428-e4fe-40ed-94e4-489c20f605c5 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.353969 Oct 04 18:06:44.782604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 374/703] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:44.798704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e", "tag": "f812e491-76c3-4004-bb2f-361e75518b6c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:44.823420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.841879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.841879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.848879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:44.865262 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] Creating event network-changed:f812e491-76c3-4004-bb2f-361e75518b6c for instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e on n-h2-833090-21 Oct 04 18:06:44.892038 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d6017aed-918f-42de-9672-e81b06daab8e req-a1579850-3433-4570-b6d0-1dafbc6fa255 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106056 Oct 04 18:06:44.894215 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 375/704] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:44.908348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.909279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.918816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.922762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.922762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.922762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.923934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.924746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.988715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5c0d4d8-01a7-4846-9d4b-018582c74ff1 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4/action" status: 202 len: 0 microversion: 2.25 time: 5.593661 Oct 04 18:06:44.992004 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 330/705] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:06:39 2022] POST /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4/action => generated 0 bytes in 5597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:45.018949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.018949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.033798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:45.036628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.037347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.038432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.039439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.040207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.040877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.461722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.480774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bd90827-654f-4bb9-857a-c43df4c040af tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.481516 Oct 04 18:06:45.496460 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 331/706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.506637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.506637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.519315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.519849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.520285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.521346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.521971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.522568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.810982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.816276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7fe54ec2-b66e-4835-82ec-6300465e8a41 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.919231 Oct 04 18:06:45.825665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 376/707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.831523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.836502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.840683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.850694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c95342f6-32ed-41d5-9020-507e213ff367 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.350934 Oct 04 18:06:45.851652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 332/708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.856419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.857185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.861021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.864657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.865302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.867008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.868044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.868669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.869371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.869805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.870518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.870966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.871666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.877338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.364336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.394114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.397653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.400259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b93b5d3-070c-4b12-a44c-1aa5ba89f07b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.572189 Oct 04 18:06:46.401510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 377/709] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:46.409462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.410464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.420114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.420953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.421888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.423872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.424757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.427612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.663146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.714729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.727082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.745284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.746123 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ad949d5-967b-4e84-8d2c-7894c2ae3fbb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.342297 Oct 04 18:06:46.747299 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 378/710] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:46.753425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d11131-0a96-41d8-9e15-fb32b602331f", "tag": "31aed3e7-7714-4f9c-bdbe-08087cf13294"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:46.754745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98117be5-b61a-4e96-89eb-43503cbe2435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.901866 Oct 04 18:06:46.766230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.767905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.772340 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 333/711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:46.783602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.806386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.806386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.806386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.806386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.806917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.806917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.806917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.807171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] Creating event network-changed:31aed3e7-7714-4f9c-bdbe-08087cf13294 for instance 57d11131-0a96-41d8-9e15-fb32b602331f on n-h2-833090-21 Oct 04 18:06:46.937383 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0d447496-5c3e-4509-aa43-2fe29edcf501 req-e99ddfbf-23ee-4639-a018-6da2999e236c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187048 Oct 04 18:06:46.939243 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 379/712] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:46.969963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.970826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.045506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.075675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.078528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.082263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.087420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.089326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.304072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.304072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-649448e5-2074-4030-adb2-822957c34474 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.499235 Oct 04 18:06:47.304072 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 334/713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.324169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.325896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.350399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.351385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.353485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.357024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.357951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.358957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.411622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.433174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6346a10-5866-425e-b894-adc22a654224 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.490427 Oct 04 18:06:47.447170 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 380/714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.450570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82579517-bc2e-41d8-99f0-15466f04bc51", "tag": "b7f7784b-a9ac-4f5e-8509-797a8a9efcfe"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:47.470311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:47.474339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.474524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.475063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.509027 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] Creating event network-changed:b7f7784b-a9ac-4f5e-8509-797a8a9efcfe for instance 82579517-bc2e-41d8-99f0-15466f04bc51 on n-h1-833090-21 Oct 04 18:06:47.516092 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9c9a1d17-6a63-40b6-8f35-9f898bd1cb47 req-12078801-6eb2-42f7-b9d2-af61df49b898 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080487 Oct 04 18:06:47.517450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 381/715] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:47.525199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.526888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.534676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.535620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.536279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.537240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.537891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.538510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.589631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.606248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46607546-3e39-4a10-b1d8-5dcc57cacf0d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.308196 Oct 04 18:06:47.622527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 335/716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.815683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-916041398", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "7ed068f6-8d02-4f55-b9b5-2b9d328aedb5"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:47.909000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.912305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] validate_networks() for [('7ed068f6-8d02-4f55-b9b5-2b9d328aedb5', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:47.944080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.951005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.957142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24c21e91-49c6-4514-99b6-3f948df5d85e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.438152 Oct 04 18:06:47.964653 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 382/717] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:47.970360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.974784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.983371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.983915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.984395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.985176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.985636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.986062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.575081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.593091 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-886b6e90-ecaf-442e-85c4-c698fc37a3bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.626984 Oct 04 18:06:48.593747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 383/718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:48.625698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.625938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.643833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.644318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.645829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.646777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.647243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.647696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.004217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:49.004778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:49.005032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:49.005452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:49.005871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:49.022718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.071594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.071594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.071594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.071594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.072798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.072798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Getting quotas for project c4020867e2244872a9954ecdf1f021df. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:49.072798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Getting quotas for user f2ba9c28cb114030a3b5b56b95a44f10 and project c4020867e2244872a9954ecdf1f021df. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:49.076088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:49.077280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.079325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:49.097302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.099732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.106154 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f1ef063-0944-47e0-9974-b230146f8a9a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.488742 Oct 04 18:06:49.107778 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 384/719] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:49.130623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.131589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.141199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.142208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.143019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.143980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.144645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.145303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.356765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70bfac4e-caf9-4716-8ca6-c6045ee42855 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725477 Oct 04 18:06:49.356765 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 336/720] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:49.368188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.368849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.384474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.385243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.385492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.388538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.389041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.389484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.572350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.601882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e078b8fb-a586-4c54-8812-9caaa07e59e6 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.492136 Oct 04 18:06:49.603931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 385/721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.620071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.624340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.650641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.650641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.650641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.650641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.655708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.656839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.861200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.870606 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-619de3ad-323e-452c-ae17-c157c1b18175 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.517820 Oct 04 18:06:49.887849 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 337/722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.887849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.887849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.888324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.889470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.890184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.891148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.891865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.892499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.950928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.960228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90c8ea74-a381-4665-b2cc-f368bc9cd78b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.354999 Oct 04 18:06:49.960827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 386/723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.965435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:49.983166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.983689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.984669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.000905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] Creating event network-changed:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:06:50.006809 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3adb2b6e-8767-46a5-a544-28020a6b4999 req-1ac3853f-b411-4591-b83f-1eed5707fd79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044706 Oct 04 18:06:50.011580 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 387/724] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:50.020627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7b5e975-4b4b-4484-b6e2-b0fab81422a4 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.026248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7b5e975-4b4b-4484-b6e2-b0fab81422a4 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.098552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7b5e975-4b4b-4484-b6e2-b0fab81422a4 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.108528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7b5e975-4b4b-4484-b6e2-b0fab81422a4 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1215 microversion: 2.1 time: 0.095201 Oct 04 18:06:50.111598 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 388/725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:50.128072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.131320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.136945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.137440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.138093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.138973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.139691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.140343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.182714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.197958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.204285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.206523 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21c9b434-33e1-4b88-bf84-144adae3febb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.329695 Oct 04 18:06:50.220577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 338/726] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:50.233760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.235316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.241551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:50.243545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.244297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.246966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.248044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.248816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.249519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.446924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.455040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.462645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.463955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.468059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5d1cb09-879b-4a10-8953-b16fa99f5422 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.355125 Oct 04 18:06:50.472080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 389/727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:50.478564 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6282dcc5-0a1c-4685-9398-cda3df26773d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.255554 Oct 04 18:06:50.482914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 339/728] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:50.633840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.634907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.663293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.663824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.664300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.669375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.669887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.670333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.902388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.903025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.918699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.919236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.919708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.920425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.920891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.921358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.110022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.132452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.140662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0419b72c-91c5-4a3c-9e63-3cc36e046422 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.512931 Oct 04 18:06:51.148270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 390/729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.155418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.156958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.165668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.166808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.167542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.168742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.169927 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22e1b8f8-6d6a-44bc-acb0-d1d486e949f8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.270175 Oct 04 18:06:51.173684 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 340/730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:51.181305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.182533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.184842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.186942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.213468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.214957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.216312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.218808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.219751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.233303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.233303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:51.303670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.313274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94dcd5a8-18bc-46a5-95d2-e2ef06952de7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1219 microversion: 2.1 time: 0.137775 Oct 04 18:06:51.315112 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 341/731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.322008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.323015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.330509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.331540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.332251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.333179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.333913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.334560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.422221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.431036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d33aa15d-e305-4659-abff-abb26d0df158 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.281361 Oct 04 18:06:51.435508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 391/732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.494338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.496211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.504614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.507834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.508502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.509289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.509552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.510036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.510732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.519745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.521917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.523317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4bcbd43-f37a-4bac-a279-db351b9d0ef7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.206126 Oct 04 18:06:51.524126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 342/733] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:51.545746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.547042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.553617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.556627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.556627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.556627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.556627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.556994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.640797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.651005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.653687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.660076 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2aafeeb3-62be-40b5-8098-92d57e07f3ee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1535 microversion: 2.91 time: 0.121273 Oct 04 18:06:51.664248 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 343/734] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1535 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:51.816895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.829367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94b2414c-8876-4d7a-b10b-00ed29a3d9e2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.338638 Oct 04 18:06:51.832052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 392/735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:52.069020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e", "name": "network-vif-plugged", "status": "completed", "tag": "f812e491-76c3-4004-bb2f-361e75518b6c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:52.079737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.080833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.080833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.092808 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] Creating event network-vif-plugged:f812e491-76c3-4004-bb2f-361e75518b6c for instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e on n-h2-833090-21 Oct 04 18:06:52.098966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-00690496-46e8-4bac-b70c-678976bb9eb9 req-482a5732-0f3a-4d43-997b-cc9468bbe556 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Oct 04 18:06:52.099606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 344/736] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:52.163129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.164011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.170857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.171973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.172629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.184628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.186073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.187382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.201479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.204159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.216737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.217513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.220627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.221654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.224056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.225225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.397872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.414337 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a50bd2d-721b-4c3d-aced-eb4452401e21 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.211554 Oct 04 18:06:52.414337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 345/737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:52.456256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.465835 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c52595c-a109-4f85-a254-07119f94fd04 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.308091 Oct 04 18:06:52.466762 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 393/738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.473138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.473795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.480670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.481203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.481722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.482560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.483013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.483496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.558894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.571663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adaff6e6-6b4b-4902-a94e-b53f9285bbb0 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1219 microversion: 2.1 time: 0.100013 Oct 04 18:06:52.571663 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 394/739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.571918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c6f48b1-b027-4d56-8cac-b087c573c27d tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] Calling method '.version_select at 0x7f90099cfaf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.573150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.573977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.580937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.581764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.582205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.583046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.583753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.584352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.624068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:52.731841 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c6f48b1-b027-4d56-8cac-b087c573c27d tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 6752 microversion: 2.1 time: 0.314552 Oct 04 18:06:52.731841 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 346/740] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/os-networks => generated 6752 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.732781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.733419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.740446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.740939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.741378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.742140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.742885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.743508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.766510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.772499 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aac757d8-8d70-403f-8732-98b432f7a978 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.202922 Oct 04 18:06:52.773555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 395/741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.781256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.782750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.789891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.790445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.790942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.791743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.792318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.792836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.871652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.881511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.883259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.889098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b76d6429-62a8-468b-8254-5bd26e8b32a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1535 microversion: 2.91 time: 0.114257 Oct 04 18:06:52.889693 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 396/742] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1535 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:52.910877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb05e79b-0dd1-433a-864d-24e294fc4841 tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] Calling method '.version_select at 0x7f900969b3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.911050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.917223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.918988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.920339 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7540fad-83e6-49b0-b62f-649ec7cfbc3c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.192500 Oct 04 18:06:52.920964 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 347/743] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:52.926518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.927343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.933609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.934086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.934521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.935217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.935710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.936136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.036308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb05e79b-0dd1-433a-864d-24e294fc4841 tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks/eb22c6fd-47b8-4a9a-aa1e-1a728ea02670" status: 200 len: 652 microversion: 2.1 time: 0.138811 Oct 04 18:06:53.036904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 397/744] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/os-networks/eb22c6fd-47b8-4a9a-aa1e-1a728ea02670 => generated 652 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:53.046502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6b66b3f-c2eb-48bb-af9a-34aafb0a00d6 tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] Calling method '.version_select at 0x7f900969b670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.090523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.098925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdeaa030-8da7-4bfa-a9f9-94650788dada tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.175962 Oct 04 18:06:53.111593 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 348/745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.241548 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6b66b3f-c2eb-48bb-af9a-34aafb0a00d6 tempest-NetworksTest-446329415 tempest-NetworksTest-446329415-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 6752 microversion: 2.1 time: 0.198861 Oct 04 18:06:53.245705 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 398/746] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/os-networks => generated 6752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:53.430876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.431559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.438891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.439374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.439839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.440578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.441035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.441460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.490359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.491025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.497898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.498487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.499508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.500302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.500829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.501325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.580843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.589387 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0622a393-1134-4aca-a26b-38eeb4ec3615 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.162704 Oct 04 18:06:53.589982 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 349/747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.594659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.599385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.601676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.602367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.602802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.603709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.604163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.604747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.645211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.653256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdeee032-4456-4a60-9414-e6be85bc737c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.166857 Oct 04 18:06:53.654409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 399/748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:53.668190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.676697 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81f69c00-0625-4b2b-8c9f-969d873fa65a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1267 microversion: 2.1 time: 0.085593 Oct 04 18:06:53.677312 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 350/749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.797352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.798328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.806800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.807576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.808181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.809349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.809809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.810295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.921914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.922736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.930104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.932778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.933483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.934603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.935238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.935860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.970787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.980256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68b2b375-e9f2-4299-ab07-639722888ea5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.187286 Oct 04 18:06:53.983051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 400/750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.003067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.003703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.011084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.011825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.012441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.013521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.014185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.014870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.125001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.140175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.142699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.150428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbeda853-8634-47fd-b19e-8e4e8aa1149f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1538 microversion: 2.91 time: 0.234939 Oct 04 18:06:54.156871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 351/751] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1538 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:54.162644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82579517-bc2e-41d8-99f0-15466f04bc51", "name": "network-vif-plugged", "status": "completed", "tag": "b7f7784b-a9ac-4f5e-8509-797a8a9efcfe"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:54.173734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.174647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.175323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.182081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.189839 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] Creating event network-vif-plugged:b7f7784b-a9ac-4f5e-8509-797a8a9efcfe for instance 82579517-bc2e-41d8-99f0-15466f04bc51 on n-h1-833090-21 Oct 04 18:06:54.192337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.193844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.194952 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f08bca1-dc23-4ac0-bca0-9ec1c5952b19 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.210095 Oct 04 18:06:54.195708 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4584bc32-213d-4115-bce9-8b4361da9bb8 req-ee45cc61-6e68-4a1b-97cb-a46aefb9a163 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 Oct 04 18:06:54.195857 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 401/752] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:54.196980 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 352/753] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:54.200778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.201372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.208044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.208553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:54.208942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.209535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.210415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.211033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.211663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.212223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.222374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.227545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.227545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.227545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.227545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.228166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.323787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-833090-21". {{(pid=123886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:06:54.576137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.586904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b642b9d6-4d41-4d7f-bf48-61dc7b201111 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.389632 Oct 04 18:06:54.587620 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 402/754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.613664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.614456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.637593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.637593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.637593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.637593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.637953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.643623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.900733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.903824 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-342e5c62-d603-48ff-868b-6cf585cb7660 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action" status: 202 len: 0 microversion: 2.91 time: 0.704577 Oct 04 18:06:54.908229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 353/755] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:06:54 2022] POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:54.916746 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6451b81-5c99-4678-abd3-5ed138df5b1d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.306441 Oct 04 18:06:54.918399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 403/756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.932467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.933205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.942468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.946708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.947016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.947554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.947681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.948411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.948874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.949301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.963670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.966693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.968726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.975922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.975922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.975922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.123481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.136130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61b19b93-db7f-4c6b-bccf-3c091fdd0b8a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1273 microversion: 2.1 time: 0.216626 Oct 04 18:06:55.143136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 404/757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.150818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.152688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.159208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.159744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.160169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.161224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.161413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.162004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.195367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.203185 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1922ff84-9859-41c5-b1fa-1ce6eca19778 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.293865 Oct 04 18:06:55.206201 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 354/758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.211966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.212757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.223029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.224661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.225149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.225873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.226337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.226765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.246382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.260927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.262704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.268647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d454b23b-ae38-4883-bb72-a2bb0fc77817 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1486 microversion: 2.91 time: 0.123662 Oct 04 18:06:55.269465 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 405/759] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1486 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:55.275239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f549322e-f89f-48d9-92f7-7a10bdf098f4", "name": "network-vif-unplugged", "status": "completed", "tag": "7c365027-ebc4-494b-aabb-affbfd8293f4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:55.286359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.287376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.288082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.302336 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] Creating event network-vif-unplugged:7c365027-ebc4-494b-aabb-affbfd8293f4 for instance f549322e-f89f-48d9-92f7-7a10bdf098f4 on n-h1-833090-21 Oct 04 18:06:55.312056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bab4355b-ed09-48ab-920d-bcfb4fb379ff req-60196f41-1598-463b-a7fd-aa22dc2bc183 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040727 Oct 04 18:06:55.313023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 406/760] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:55.322677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.326313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.330185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.330712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.331156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.331896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.332945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.332945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.495546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.504242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f8daeac-1095-48d7-b642-a11a1c2f46ca tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.296849 Oct 04 18:06:55.508057 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 355/761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.602312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.602312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.602875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.602875 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f076529f-8dc1-49e6-828b-6f30d326c2e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.283021 Oct 04 18:06:55.602875 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 407/762] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:55.612103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.612839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.624425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.625079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.625521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.626257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.626713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.627144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.846159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.862307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4ed592a-a297-4831-be8e-c9fcf495d33e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1310 microversion: 2.1 time: 0.254469 Oct 04 18:06:55.881965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 356/763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.940782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.941615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.956822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.957271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.957701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.958441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.958893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.959552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.167053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.168240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.193031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.194072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.197229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.211239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.211239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.211239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.215569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.228668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b80708df-c1a1-4ae4-8180-4ab344c932f5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1386 microversion: 2.1 time: 0.293158 Oct 04 18:06:56.230361 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 408/764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.236707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.237952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.244387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.251173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.251173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.251173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.251173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.251610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.440730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.449002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a2a0af59-b26a-4f10-b237-f27682065940 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.216516 Oct 04 18:06:56.449673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 409/765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.454701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.455668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.462004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.462895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.463563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.464488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.466760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.467949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.547126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.559426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.561559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.569936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0eb0f449-907b-4c96-994d-2fb3beba006c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1486 microversion: 2.91 time: 0.119021 Oct 04 18:06:56.571556 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 410/766] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1486 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:56.582183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.583359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.594186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.595274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.595851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.596683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.597291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.597891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.772173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.781883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c234e55-5770-4166-8de7-033cce116b73 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.204820 Oct 04 18:06:56.787106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 411/767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.787506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-plugged", "status": "completed", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:56.797942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.798417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.798874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.811384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] Creating event network-vif-plugged:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:06:56.816620 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-02c7a74e-6bbf-423f-a8dd-d651eee26ece req-2bff6472-2ddc-4a13-b523-2b6f0278ad9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Oct 04 18:06:56.817229 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 412/768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:56.822737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.823446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.830589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.836659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.836659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.836659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.836659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.837164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.942186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.944840 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0037560-581c-4dd2-9580-3c4973843954 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.783134 Oct 04 18:06:56.946022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 357/769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:56.951688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.953229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.960905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.961738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.962448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.963260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.963944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.964513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.028304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.038055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.043596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.043596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-001f74e1-3131-4593-b289-df2657e4f4eb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.222501 Oct 04 18:06:57.048870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 413/770] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:57.218111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.220526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:57.228454 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad51dac9-5ca8-45e9-b602-970fa3c1ec5a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1493 microversion: 2.1 time: 0.281158 Oct 04 18:06:57.229259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 358/771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1493 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.254509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.254928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.255415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.255637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.262350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.262716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.262934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.263386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.263632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.264123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.265035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.265501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.265699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.265930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.266303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.266966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.502551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.513887 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f2e5820-63ce-4a69-b3b1-5398b14e0162 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1585 microversion: 2.1 time: 0.263697 Oct 04 18:06:57.522645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 414/772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1585 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.533997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f549322e-f89f-48d9-92f7-7a10bdf098f4", "tag": "7c365027-ebc4-494b-aabb-affbfd8293f4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:57.558058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.562601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.562601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.562812 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc4dd965-f0ce-41d0-bbe1-05e1b25ea79e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1646 microversion: 2.1 time: 0.310958 Oct 04 18:06:57.575705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] Creating event network-changed:7c365027-ebc4-494b-aabb-affbfd8293f4 for instance f549322e-f89f-48d9-92f7-7a10bdf098f4 on n-h1-833090-21 Oct 04 18:06:57.578448 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 359/773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1646 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.582381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fd084197-57d2-4010-836f-a831154f3313 req-366f13e1-4fc1-49d8-842e-782652d61881 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057995 Oct 04 18:06:57.586717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 415/774] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:57.593772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.594899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.598782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.600706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.604072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.604880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.605492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.606383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.607173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.607824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.609882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.610637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.611355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.612418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.613080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.613688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.615111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:57.827146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.836403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-34f6aa9d-8b06-457f-bfa4-c670ecbe5fe0 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.256695 Oct 04 18:06:57.837230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 360/775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.843243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.843882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.851106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.851912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.852741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.853795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.854253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.854857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.068188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21292959-b349-41c5-9971-59b1bb99d4e8 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.479997 Oct 04 18:06:58.069072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 416/776] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51/os-interface => generated 284 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:58.080491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.080491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.087026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.087718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.088309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.089385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.090028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.090610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.213313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b0410a9-1478-4475-b11e-e0e7173e7e1e tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1646 microversion: 2.1 time: 0.373696 Oct 04 18:06:58.214334 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 361/777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1646 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.235295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.236143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.242973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.243631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.244186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.244982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.245544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.246061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.273499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.284812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.286604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.292490 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44740b8d-b1f0-41f4-a88b-1c2d1004a14e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.222103 Oct 04 18:06:58.293214 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 417/778] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:58.324450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f72278e-4111-41cd-98ea-b05a7cfff098", "tag": "ae4f2114-d754-4355-b22b-a80ea6583574"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:58.330058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.330783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.331757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.351995 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] Creating event network-changed:ae4f2114-d754-4355-b22b-a80ea6583574 for instance 0f72278e-4111-41cd-98ea-b05a7cfff098 on n-h1-833090-21 Oct 04 18:06:58.374781 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f84d007d-833f-4e77-ba17-94bed275c01a req-4b1aa0d7-46b9-47cf-90fc-63d4ea8571d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069107 Oct 04 18:06:58.379280 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 418/779] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:58.388605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.389354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.400898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.401840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.402387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.403211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.404011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.404822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.441998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.456914 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71bf124f-c699-497a-9664-2248df38da17 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1316 microversion: 2.1 time: 0.238337 Oct 04 18:06:58.458900 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 362/780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.470546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.473549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.490926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.491947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.492613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.493835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.494753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.495843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.663703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.672517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.674212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.675429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd712b1e-d4be-48ee-a0f3-588ccc7d4e58 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.214724 Oct 04 18:06:58.676021 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 363/781] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:58.680944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.685728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.686547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.689420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.693597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.693924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.694372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.749470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db7b3776-ba48-4ff6-a568-7d1e6bffbd06 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.071896 Oct 04 18:06:58.750506 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 364/782] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:58.763724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:58.764366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.771727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.772345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.773006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.774118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.774817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.775347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.001559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.011274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2afb3cd-1826-4c62-b7a4-04f18555dfe5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.629949 Oct 04 18:06:59.012248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 419/783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.018307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.019068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.037518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.038331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.038331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.039176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.039675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.040098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.068920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:59.232309 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-47361753-1345-46b8-a61c-f4822eba1dbb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e/action" status: 202 len: 0 microversion: 2.1 time: 0.471411 Oct 04 18:06:59.247275 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 365/784] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:58 2022] POST /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:59.264599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.272492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.289369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.293317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.294033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.295086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.300019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.300788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.671886 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5dc6ec9-d897-42cc-b8ea-b894d802cd11 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1651 microversion: 2.1 time: 0.420672 Oct 04 18:06:59.673760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 366/785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1651 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.683082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.684458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.692015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.692606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.693260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.694175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.694773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.695568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.805381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.811541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-033f8ce4-97e2-4190-a2fd-61ba7cf4cff9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.797176 Oct 04 18:06:59.812143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 420/786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.824500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.828315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.841823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.844591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.845855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.853260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.853260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.853260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.869567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.885489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.890931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.913870 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd09319c-a1b8-4a07-8a26-2535c628d6a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.237188 Oct 04 18:06:59.947197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 367/787] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:06:59.952662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d11131-0a96-41d8-9e15-fb32b602331f", "name": "network-vif-plugged", "status": "completed", "tag": "31aed3e7-7714-4f9c-bdbe-08087cf13294"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:59.976221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.978883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.979624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.995681 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] Creating event network-vif-plugged:31aed3e7-7714-4f9c-bdbe-08087cf13294 for instance 57d11131-0a96-41d8-9e15-fb32b602331f on n-h2-833090-21 Oct 04 18:07:00.005161 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1089a085-67ca-4b24-82e4-185787b7ffa0 req-1f7b816e-a49a-41b6-a599-f9c214013870 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056254 Oct 04 18:07:00.007215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 368/788] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:00.019163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.020170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.029171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.029870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.030942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.034119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.035085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.035709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.104012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:00.291991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.304241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.305724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.306955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88b859bd-9b59-4a0c-a084-1b8a39c877f9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.293385 Oct 04 18:07:00.307661 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 369/789] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:00.312635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.313172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.320397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.320898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.321606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.322592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.323049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.323605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.475843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.483057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb5ba3cf-2e5d-4662-b723-8dd46f77d644 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.174427 Oct 04 18:07:00.484014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 370/790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:00.492428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.504887 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1859d3e6-09de-4d6c-9c64-ab92756fe0c8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1466 microversion: 2.1 time: 0.685977 Oct 04 18:07:00.509275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 421/791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1466 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:00.529116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1618767982", "metadata": {"image_type": "test"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:00.537777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.538281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.538668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.539102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.539829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.541132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.541132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.580573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Getting quotas for project f71b036680f9444bae3d0e89ea8ea81c. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:00.585465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Getting quotas for user 07c5df6fbd0b4aa3aa4e3db55ca35360 and project f71b036680f9444bae3d0e89ea8ea81c. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:00.698089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.699391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.711121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.718153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.721259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.721259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.721259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.721259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.898047 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-977ba924-56ce-4278-bcc5-7692b2932577 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1631 microversion: 2.1 time: 0.205725 Oct 04 18:07:00.898706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 422/792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1631 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.049390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-032273f3-0056-4223-b72e-b282cf1f8162 tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A07%3A00.714560&end=2022-10-05T18%3A07%3A00.714560" status: 404 len: 112 microversion: - time: 0.149509 Oct 04 18:07:01.049911 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 423/793] 10.222.0.40 () {58 vars in 1316 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T18%3A07%3A00.714560&end=2022-10-05T18%3A07%3A00.714560 => generated 112 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:07:01.058768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.066760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.066760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.066760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.067215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.067585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.068042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.068463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.137014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-223fa584-8eb2-46f5-8248-e58acc1b1123 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "POST /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562/action" status: 202 len: 0 microversion: 2.1 time: 0.610493 Oct 04 18:07:01.139750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 371/794] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:00 2022] POST /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:07:01.146533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": true, "disk_over_commit": false}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:01.149472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.168235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.169018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.169627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.171203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.171856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.172455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.206624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lazy-loading 'flavor' on Instance uuid 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:01.231291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Going to try to live migrate instance to n-h1-833090-21 {{(pid=123886) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:07:01.260776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.272438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d70e8ad6-2a84-4263-83fe-a0e56676af9c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.220782 Oct 04 18:07:01.273199 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 424/795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.278895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.279860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.286793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.292510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.292510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.292510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.292510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.292866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.364103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.376346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.377849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.383606 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd4e2375-b235-48d7-869f-75e37c84c8c3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.108996 Oct 04 18:07:01.385438 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 425/796] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:01.388172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:01.393465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.394117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.401683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.402190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.402816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.403567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.404340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.405031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.591757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.604037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-709d9931-977d-4b56-835e-85ea646157a6 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1585 microversion: 2.1 time: 0.217262 Oct 04 18:07:01.604689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 426/797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1585 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.611016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82579517-bc2e-41d8-99f0-15466f04bc51", "tag": "b7f7784b-a9ac-4f5e-8509-797a8a9efcfe"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:01.626326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:01.629333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.629826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.630330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.645425 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] Creating event network-changed:b7f7784b-a9ac-4f5e-8509-797a8a9efcfe for instance 82579517-bc2e-41d8-99f0-15466f04bc51 on n-h1-833090-21 Oct 04 18:07:01.651459 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b5d9cd8a-2aab-4f97-b2bf-c09847560f73 req-fde0259b-750c-4fc1-a6fc-f8a4b4417398 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Oct 04 18:07:01.652509 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 427/798] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:01.659042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecca53f1-cbc9-4e0f-bafb-a8902a7c236a tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] Calling method '.version_select at 0x7f9009992670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.666029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ecca53f1-cbc9-4e0f-bafb-a8902a7c236a tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecca53f1-cbc9-4e0f-bafb-a8902a7c236a tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] Request method failure captured: Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-simple-tenant-usage/f02f4a52409c4501b4167cacb4bff770?start=2022-10-05T18%3A07%3A00.714560&end=2022-10-03T18%3A07%3A00.714560 HTTP/1.1 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHZEyfelSobYbwS672mYzFvHa75KlF1p6ksFxiYbpEVbv8FJrC3OtgJ2w-eCe6RhwrkVdDXV_d3oY4OkjyBC65rDKFWsqd-__gyiFmIf9Pfd0JEqHWHzy0Hz5fDBbxGW11XlEgwLqbbhYiR-oe6clZ-Hk46ChD_UbDp-jrHqTcn2VEE Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 035df478678d48d0b61e3d95ad72f074 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-928706807 Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:07:01.669067 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_035df478678d48d0b61e3d95ad72f074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/035df478678d48d0b61e3d95ad72f074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/035df478678d48d0b61e3d95ad72f074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/035df478678d48d0b61e3d95ad72f074"}]}] Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-928706807 Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 035df478678d48d0b61e3d95ad72f074 Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-928706807 Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TenantUsagesNegativeTestJSON-928706807-project-admin Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: a5a980e068994386b0781eeb93d56b26 Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-928706807-project-admin Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 18:07:01.671142 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'f02f4a52409c4501b4167cacb4bff770'} Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:07:01.672043 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecca53f1-cbc9-4e0f-bafb-a8902a7c236a tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:01.673423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecca53f1-cbc9-4e0f-bafb-a8902a7c236a tempest-TenantUsagesNegativeTestJSON-928706807 tempest-TenantUsagesNegativeTestJSON-928706807-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/f02f4a52409c4501b4167cacb4bff770?start=2022-10-05T18%3A07%3A00.714560&end=2022-10-03T18%3A07%3A00.714560" status: 400 len: 111 microversion: 2.1 time: 0.017782 Oct 04 18:07:01.675083 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 428/799] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/os-simple-tenant-usage/f02f4a52409c4501b4167cacb4bff770?start=2022-10-05T18%3A07%3A00.714560&end=2022-10-03T18%3A07%3A00.714560 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:07:01.677824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-482ed57e-a8eb-4231-a9ec-d9f798c509bd tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009937f70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.742625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-482ed57e-a8eb-4231-a9ec-d9f798c509bd tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.068537 Oct 04 18:07:01.743295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 429/800] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.749131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.749943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.770801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.773634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.775424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.777807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.783600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.783600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.010513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.023384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.026204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.026898 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-667805b1-2223-4cd6-b840-3ae629013d1e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.282358 Oct 04 18:07:02.040035 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 430/801] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:02.061713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.063579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.074033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.074913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.075621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.080800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.080800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.080800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.285966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.299415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62d135e0-3e77-4b00-8bdb-889b5ba0d779 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.258077 Oct 04 18:07:02.300905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 431/802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.514893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9fa9e5c4-2fa7-4d6f-bfc5-88409e4f6506 tempest-TenantUsagesNegativeTestJSON-737747177 tempest-TenantUsagesNegativeTestJSON-737747177-project] Calling method '.version_select at 0x7f90098f1f70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.520708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9fa9e5c4-2fa7-4d6f-bfc5-88409e4f6506 tempest-TenantUsagesNegativeTestJSON-737747177 tempest-TenantUsagesNegativeTestJSON-737747177-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7e2993529ff94e1ca9175020f6d8c3be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f02f4a52409c4501b4167cacb4bff770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9fa9e5c4-2fa7-4d6f-bfc5-88409e4f6506 tempest-TenantUsagesNegativeTestJSON-737747177 tempest-TenantUsagesNegativeTestJSON-737747177-project] Request method failure captured: Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A07%3A00.714560&end=2022-10-05T18%3A07%3A00.714560&detailed=1 HTTP/1.1 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHZDwj9mdSx9ItywA6-xXP4VPWCZqa_PEFEPSiOVXw1w45HJ6jo63BAHf3FxDo3-8r__OSCmhEzrhvj4TS4hOCOtd6S_xhBlLNXXJ4w-yI33tllSh2J7V1tyRI7l34ZMEBgcTCZHGMnDxYOWlZ0uN4ilkEl7DluSyS9ZKXtEOjaOF8Q Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f02f4a52409c4501b4167cacb4bff770 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-737747177 Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:02.522730 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f02f4a52409c4501b4167cacb4bff770"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f02f4a52409c4501b4167cacb4bff770"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f02f4a52409c4501b4167cacb4bff770"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f02f4a52409c4501b4167cacb4bff770"}]}] Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-737747177 Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f02f4a52409c4501b4167cacb4bff770 Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-737747177 Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TenantUsagesNegativeTestJSON-737747177-project Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e2993529ff94e1ca9175020f6d8c3be Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-737747177-project Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:07:02.524291 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:07:02.525238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:07:02.526584 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:07:02.529044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 18:07:02.529044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.533854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9fa9e5c4-2fa7-4d6f-bfc5-88409e4f6506 tempest-TenantUsagesNegativeTestJSON-737747177 tempest-TenantUsagesNegativeTestJSON-737747177-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:02.535415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9fa9e5c4-2fa7-4d6f-bfc5-88409e4f6506 tempest-TenantUsagesNegativeTestJSON-737747177 tempest-TenantUsagesNegativeTestJSON-737747177-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A07%3A00.714560&end=2022-10-05T18%3A07%3A00.714560&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.232784 Oct 04 18:07:02.536574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 432/803] 10.222.0.40 () {58 vars in 1335 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A07%3A00.714560&end=2022-10-05T18%3A07%3A00.714560&detailed=1 => generated 123 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:02.548269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.549128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.557840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.558570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.559196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.560171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.560821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.561391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.822494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.837482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c11f1f7-3161-4daf-8d3d-669649e567bf tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1321 microversion: 2.1 time: 0.298894 Oct 04 18:07:02.838288 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 433/804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.847276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.847924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.856872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.883929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.884660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.885434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.885871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.886293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.978623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.989234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.990641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.996930 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2a9aadb-8aa4-496c-965b-57e0d69481b8 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.157702 Oct 04 18:07:02.997783 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 434/805] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:03.025511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9baba09a-0787-46c7-8c2f-69c60d96e1da tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900969b820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.118174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9baba09a-0787-46c7-8c2f-69c60d96e1da tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.119116 Oct 04 18:07:03.118788 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 435/806] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.153178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.154184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.175055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.175647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.182435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.183582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.184217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.184808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.397978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.418156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.420720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.423663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf220a58-44fe-4f57-b335-1218cec2b0dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.292444 Oct 04 18:07:03.424303 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 436/807] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:03.439200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.439859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.454153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.454639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.455081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.455910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.456246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.456823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.986599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.998114 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16a237ae-f457-4220-ac60-2f74fa31cbcd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.572755 Oct 04 18:07:04.015574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 437/808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:04.020478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.021092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.033581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.034224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.034629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.035426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.035926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.036350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.347103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.358550 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-158bb72f-2445-4a67-8d39-b3f64be00414 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1471 microversion: 2.1 time: 0.341777 Oct 04 18:07:04.363496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 438/809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1471 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:04.375232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.375877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.395135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.395662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.396309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.397312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.398041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.398691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.444264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:04.578226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.598449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.603103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.631965 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b28c36b1-f6d4-4c87-a7b2-256a73fa849b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.262120 Oct 04 18:07:04.632692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 439/810] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:04.653456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-339662c0-1b2f-4a71-990d-b40974803ee8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90097c1160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.757696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-339662c0-1b2f-4a71-990d-b40974803ee8 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.120113 Oct 04 18:07:04.758448 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 440/811] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:05.342161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:05.342905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] [instance: 0e30ff3e-a393-4428-aa99-573a08f6daa8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.368285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] HTTP exception thrown: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Request method failure captured: Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/0e30ff3e-a393-4428-aa99-573a08f6daa8/action HTTP/1.1 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 15 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHYk-nWzQ6YPt8IAYw6Vc1lu_LuhTPp9RQB3J0wD00UEvJR_JpjiOi9hY0ZPToE7574cPFbIWcsWhMeHKcsIaj-McghxQfnRSRbd93_EXWjNEd-HXRu8D_fWWc4JN0fuHKUJCxhpAWQmJgfFOoOByu-fWAFSLGfYeFK5-C_XupMNvB8 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:07:05.375228 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/156f5bb9c0b0470e8f5b6feb98d9d339"}]}] Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e6a37cc386414727b4fe7208e3bb0d0e Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: {"migrate": {}} Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:05.376607 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0e30ff3e-a393-4428-aa99-573a08f6daa8', 'body': {'migrate': {}}} Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:05.377553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. Oct 04 18:07:05.379338 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.382060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Returning 404 to user: Instance 0e30ff3e-a393-4428-aa99-573a08f6daa8 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:05.384990 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-358a12f1-812d-4aa6-b100-0365ab93c8d5 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0e30ff3e-a393-4428-aa99-573a08f6daa8/action" status: 404 len: 111 microversion: 2.1 time: 0.625315 Oct 04 18:07:05.398951 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 441/812] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:04 2022] POST /compute/v2.1/servers/0e30ff3e-a393-4428-aa99-573a08f6daa8/action => generated 111 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:05.398951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:05.416426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.432543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.435891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.437388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.450668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.452029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.453236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.734594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.744650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.746095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:05.747361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e8ac713-b0ae-4275-9f44-e2d07e505d16 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.356613 Oct 04 18:07:05.748022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 442/813] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:05 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:05.752746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:05.753343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.760076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.760496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.761118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.761796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.762251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.762744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.803383 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2eaa0c9-1b03-4351-9ca7-b57fa2c25551 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e/action" status: 202 len: 0 microversion: 2.1 time: 4.661998 Oct 04 18:07:05.804028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 372/814] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:01 2022] POST /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e/action => generated 0 bytes in 4663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:05.812126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f72278e-4111-41cd-98ea-b05a7cfff098", "name": "network-vif-plugged", "status": "completed", "tag": "ae4f2114-d754-4355-b22b-a80ea6583574"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:06.047711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.064379 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1644e228-d6b9-4d92-bfec-5726c976d085 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.314104 Oct 04 18:07:06.066251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.066445 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 443/815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:05 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.067497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.068494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.077269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-777476436", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:06.093261 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] Creating event network-vif-plugged:ae4f2114-d754-4355-b22b-a80ea6583574 for instance 0f72278e-4111-41cd-98ea-b05a7cfff098 on n-h1-833090-21 Oct 04 18:07:06.103569 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-67671bd6-9829-45a0-b43c-3ad91b6cdf85 req-c6328561-5e44-4ef7-ad75-1c0e7bf77a3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297836 Oct 04 18:07:06.106024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 373/816] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:06.118459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.125169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.155173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.155173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.161284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.163365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.167359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.168607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.228977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:06.329941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.362457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.368008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.381553 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce4d14d8-3544-43ae-b71f-be554f1f37bf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.272163 Oct 04 18:07:06.411687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 374/817] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:06.423401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0056308-acfc-4bce-a0dd-e20301e0cbdb tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009997310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.513352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0056308-acfc-4bce-a0dd-e20301e0cbdb tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.095857 Oct 04 18:07:06.515578 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 375/818] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.528311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.529229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.539144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.540413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.541428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.542590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.543423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.545159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.837776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.856629 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-60c5b1c1-9728-4073-995a-c044910e9b19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.339413 Oct 04 18:07:06.877134 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 376/819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.897705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.898689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.912376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:06.914843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.915647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.921696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.921696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.921696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.921696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.083376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:07.083984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:07.084679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:07.085296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:07.085891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:07.111312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.112583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.113269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.114771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.115791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.116618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.140921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Getting quotas for project 6e2f0b93483044ea8f9dd20340b7acdd. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:07.154978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Getting quotas for user d53e51ea1ceb4f778ea589144c3758eb and project 6e2f0b93483044ea8f9dd20340b7acdd. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:07.197134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:07.204037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:07.252031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.266115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.273422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.276065 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0f23bb2-b43e-4e6e-aab6-47184b4e8401 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.397657 Oct 04 18:07:07.288211 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 377/820] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:07.294593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.300207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.314398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.315285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.317908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.318919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.319719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.321696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.411697 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1bafb5aa-2760-4e79-976c-cbef23512e46 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343314 Oct 04 18:07:07.413014 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 444/821] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:07.418198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.419593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.439166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.440186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.440899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.442021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.442721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.454460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.590749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.600766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-be06aa5b-fb61-4de1-9458-aa513264d5f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1315 microversion: 2.1 time: 0.311035 Oct 04 18:07:07.601362 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 378/822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:07.621918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ce6f9c4-8288-4fc7-a02d-bd2ef36c8e3b tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.623086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ce6f9c4-8288-4fc7-a02d-bd2ef36c8e3b tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.680169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.721248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.721248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.745166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a0e08bf-f5fd-484b-ad95-28a341adfa5b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.330748 Oct 04 18:07:07.759555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 445/823] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:07.759555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ecb6ce4-ff39-4f14-bd92-a2bb32bb7844 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009bc74c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.805415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ce6f9c4-8288-4fc7-a02d-bd2ef36c8e3b tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.837784 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ce6f9c4-8288-4fc7-a02d-bd2ef36c8e3b tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1221 microversion: 2.1 time: 0.217460 Oct 04 18:07:07.837784 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 379/824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:07.882001 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ecb6ce4-ff39-4f14-bd92-a2bb32bb7844 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.131491 Oct 04 18:07:07.882818 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 446/825] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:07.897921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.898948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.922012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.922012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.922012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.922012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.922375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.922375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.226517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.236484 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b484983-a53e-4bbf-93d0-f19e2564df82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.354013 Oct 04 18:07:08.237977 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 380/826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:08.335936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.336633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.345348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.348222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.348222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.348222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.348222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.348564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.560320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.584518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.590015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.590015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d9890ba-3dd1-4880-aba4-56c2712c1753 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1567 microversion: 2.25 time: 0.259249 Oct 04 18:07:08.592453 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 447/827] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:08.627022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.629183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.640322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.641376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.642138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.644088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.644893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.645650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.719268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:08.779388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.780092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.799773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.800570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.801003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.801715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.802162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.802581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.885223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.892049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e64b3db6-751d-41d3-a126-350e5955a7f7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1503 microversion: 2.1 time: 0.271412 Oct 04 18:07:08.906767 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 381/828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:08.911191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.911851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.925418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.925418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.925418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.925418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.925904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.925904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.059546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.071236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5df229ef-c97e-489a-b1b4-5ea90b33c719 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1225 microversion: 2.1 time: 0.171654 Oct 04 18:07:09.073707 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 382/829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1225 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:09.086016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-da3e29da-5e4b-4905-ba93-deb0a9649218 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009ae0ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.212109 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-da3e29da-5e4b-4905-ba93-deb0a9649218 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.137495 Oct 04 18:07:09.223133 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 383/830] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:09.234918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.235422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.266371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.269635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.269635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.269635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.269635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.275657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.329877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.364713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.367675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.378442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5c012e4-42a4-4779-a49d-e2179d06ce55 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.603357 Oct 04 18:07:09.379802 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 448/831] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:07:09.386234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:09.398119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.399150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.409774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.416854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.416854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.416854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.416854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.417351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.887106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.910761 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-845ffcc7-55d9-4d50-95a9-75a631af37d5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.529563 Oct 04 18:07:09.914414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 449/832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:09.919374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-plugged", "status": "completed", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:09.938649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.939127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.939707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.973012 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] Creating event network-vif-plugged:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:07:09.979180 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b7f1dda1-a006-4bf7-8b71-0cecbd666915 req-2f2bf6b5-8b97-4252-b5d0-dfb25d085a7f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063094 Oct 04 18:07:09.980023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 450/833] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:09.986542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.987244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.993954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.995373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.995373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.995625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.996071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.996496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.075130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7da79878-aff3-48fb-b849-987f2f6a1716 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 204 len: 0 microversion: 2.1 time: 0.850084 Oct 04 18:07:10.076148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 384/834] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:09 2022] DELETE /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:10.091310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.092036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.104179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.104671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.105301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.106194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.107519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.108118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.189215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.203152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.205962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.207553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cc0c1a6-4414-493e-8848-f6fcc46ac97c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1542 microversion: 2.25 time: 0.226223 Oct 04 18:07:10.230109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 451/835] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:10.230109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.230109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.237567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.238162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.238664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.239380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.240042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.240567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.328151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.343683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-767f743d-d0ee-4dd8-8cc3-7af6ed16a840 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1217 microversion: 2.1 time: 0.121286 Oct 04 18:07:10.344363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 452/836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:10.349938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4ee16d0-6c58-44ec-af1b-9c8084ca003b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90096ab790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.362134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.370367 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-157a10d1-a7ce-478b-8143-160fdb76e650 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1509 microversion: 2.1 time: 0.283796 Oct 04 18:07:10.383741 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 385/837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:10.391852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02ebc4ab-0f69-4ba5-9f63-588f1ab4276f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '.version_select at 0x7f9009b810d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.395110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebc4ab-0f69-4ba5-9f63-588f1ab4276f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.395617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebc4ab-0f69-4ba5-9f63-588f1ab4276f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.396053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02ebc4ab-0f69-4ba5-9f63-588f1ab4276f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.406528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02ebc4ab-0f69-4ba5-9f63-588f1ab4276f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2202 microversion: 2.25 time: 0.021612 Oct 04 18:07:10.407167 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 386/838] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/os-migrations => generated 2202 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:10.413391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.414546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.421179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.421779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.422284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.423530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.423945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.424373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.492715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.513611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.513611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.513611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8cf9a6a4-6f26-4500-a6dd-67c83d6c85fc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.101934 Oct 04 18:07:10.524227 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 387/839] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:07:10.535700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.540551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.543133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.543657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.544127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.544924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.545319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.545775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.710110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:10.726810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bce5fdb4-6eee-452b-8eb0-c928b097171c tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 2037 microversion: 2.25 time: 0.200854 Oct 04 18:07:10.728178 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 388/840] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 2037 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:10.784236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: .version_select at 0x7f90099c71f0>, body: {"keypair": {"name": "tempest-keypair-936672898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdZFVuILi6PP+73hSCZk2QGD00ChHm1Wv6gy2bJAMb5VfdaT0BajnKHhYLe924H2/AxkKNl2kzVMMnHVSFeVBpYAHIixOkmb3xEYdmEyxcMmlSUKcF+r7hw8UnPBQUYaw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:10.806896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:10.817105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for user 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 and project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:10.874807 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [2486dde6-bef4-4f1f-9970-a457178f7981] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:07:11.851194 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [2486dde6-bef4-4f1f-9970-a457178f7981] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36996. Oct 04 18:07:12.222458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-740728e5-c066-4fd1-9e6b-26c8046f2e4a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 1.442987 Oct 04 18:07:12.243422 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 389/841] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:07:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1465 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:07:12.256450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.263267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.280135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.281202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.281841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.282746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.283648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.284277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.548045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.560272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-808467e8-5783-44cf-906b-5115edfc04f3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.313774 Oct 04 18:07:12.579445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 390/842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.590308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.597638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.609440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.609950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.610396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.611118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.611756 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4ee16d0-6c58-44ec-af1b-9c8084ca003b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 2.264979 Oct 04 18:07:12.616824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.617281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.622614 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 453/843] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.628213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.631931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.636756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.637688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.638345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.639282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.639950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.640560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.788115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.795919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:12.799986 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ef9aefc-5453-480c-b954-842dbd9f8291 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1217 microversion: 2.1 time: 0.218302 Oct 04 18:07:12.799986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 391/844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.805157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.810110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.812901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.813574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.814007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.815085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.815217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.815597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.832940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.852413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ba5c5ce-a82a-435b-bfc5-7d25944a4dad tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1509 microversion: 2.1 time: 0.228029 Oct 04 18:07:12.855612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 454/845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.914464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.924633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.936532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.945630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f175b548-3608-4078-8399-ca012d4a9a3a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.144637 Oct 04 18:07:12.947894 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 392/846] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:13.591735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.591735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.608355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.609387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.609930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.610954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.611425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.611883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.630383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-845a3eb1-d79f-47ec-a4eb-c7c86ae217bf tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009b81f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.687441 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-845a3eb1-d79f-47ec-a4eb-c7c86ae217bf tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.062938 Oct 04 18:07:13.699852 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 393/847] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.833820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.837521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.842247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.915567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-959a43fa-302e-4294-9c31-bc8b019ad72d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.328274 Oct 04 18:07:13.930769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.933689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 455/848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.942874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.945733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.946996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.955359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.958572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.959259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.961349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.984335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.985610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.991993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.993135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.994056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.995305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.148867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.166785 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04a184f1-dcb4-4303-a7d9-55dee9313c97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1273 microversion: 2.1 time: 0.345429 Oct 04 18:07:14.168085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 394/849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.175170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.176276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.205959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.206832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.207634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.208895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.209746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.210504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.444283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.473052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.480477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.496012 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2ffc91b-bc5b-42e7-90cf-7758f53e7957 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.325525 Oct 04 18:07:14.498244 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 395/850] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:14.561925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.574433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3106e5a5-2e71-4b59-a80d-843042e65694 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1509 microversion: 2.1 time: 0.638514 Oct 04 18:07:14.575486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 456/851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1509 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.707250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ea6fb6b-f195-459a-bd51-23c306fd6aee tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009997ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.767806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ea6fb6b-f195-459a-bd51-23c306fd6aee tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.066707 Oct 04 18:07:14.769970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 396/852] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:14.971615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.972212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.979772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.980543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.981197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.982098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.982731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.983325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.079670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e", "name": "network-vif-unplugged", "status": "completed", "tag": "f812e491-76c3-4004-bb2f-361e75518b6c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:15.101658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.102534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.103609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.123804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] Creating event network-vif-unplugged:f812e491-76c3-4004-bb2f-361e75518b6c for instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e on n-h2-833090-21 Oct 04 18:07:15.131132 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-884cec86-72e2-4fb9-99af-ec5f3523b421 req-9e5756d4-cf1c-4253-9c01-04d542fa0329 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058791 Oct 04 18:07:15.132060 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 397/853] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:15.175868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.184801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bd5c398-24ff-4c91-86dd-0c3d09073e3d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.217006 Oct 04 18:07:15.185723 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 457/854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:15.195868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.196673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.204739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.205273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.205720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.206447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.206917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.207377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.464869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f72278e-4111-41cd-98ea-b05a7cfff098", "name": "network-vif-deleted", "tag": "ae4f2114-d754-4355-b22b-a80ea6583574"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:15.485008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.485597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.486063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.574136 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] Creating event network-vif-deleted:ae4f2114-d754-4355-b22b-a80ea6583574 for instance 0f72278e-4111-41cd-98ea-b05a7cfff098 on n-h1-833090-21 Oct 04 18:07:15.587735 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1875126d-fecf-4159-bb7b-8cf279246962 req-2331552e-ea06-43f1-85f9-0ef1a52dc86f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126355 Oct 04 18:07:15.592813 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 458/855] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:15.609053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.612529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.633530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.637964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.650077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.650932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.656703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.082143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.094302 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-719f684b-0cd5-4717-9018-48645a62c3d4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1273 microversion: 2.1 time: 0.903119 Oct 04 18:07:16.095111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 398/856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1273 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.113076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.113869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.133430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.140799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.140799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.140799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.140799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.141372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.271084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.272018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.272914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.273561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lazy-loading 'fault' on Instance uuid 0f72278e-4111-41cd-98ea-b05a7cfff098 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:16.371218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.390415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.397812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.399329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.402413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9d5fb02-8f56-4397-b036-2e1f0bf1d45c tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1305 microversion: 2.1 time: 0.284073 Oct 04 18:07:16.410524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 399/857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.434843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-334bb3e1-3ca2-4d69-8d35-4d8f4d40676c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a3f820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.453800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4a22407-c82b-4eea-b111-01776b0dd89f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.858851 Oct 04 18:07:16.455189 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 459/858] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:16.477435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.478262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.493492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.493492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.493492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.493492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.493949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.493949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.989799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.004528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8455d856-a556-4052-a7d1-8927573c3a19 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.547425 Oct 04 18:07:17.008833 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 460/859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:17.128235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.128235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.150450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:17.154696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.155330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.156977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.156977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.164768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.165324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.185852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:17.900206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:17.911892 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2aa1388c-c529-4dcf-a8dd-6aaff03608b7 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1279 microversion: 2.1 time: 0.791378 Oct 04 18:07:17.932396 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 461/860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1279 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:17.949338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e", "tag": "f812e491-76c3-4004-bb2f-361e75518b6c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:17.966279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.966866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.970811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.982709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:17.998071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] Creating event network-changed:f812e491-76c3-4004-bb2f-361e75518b6c for instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e on n-h2-833090-21 Oct 04 18:07:18.009488 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f079d883-d3b3-4f63-b821-4e9d31e60b6b req-6ca1d943-c8c4-4df9-8ada-721dae5807f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075234 Oct 04 18:07:18.012163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 462/861] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:18.022277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.024836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.047367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.047882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.048317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.049017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.049464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.049882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.148634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.155057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.156796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.157442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lazy-loading 'fault' on Instance uuid 0f72278e-4111-41cd-98ea-b05a7cfff098 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:18.244630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-334bb3e1-3ca2-4d69-8d35-4d8f4d40676c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 1.830464 Oct 04 18:07:18.257913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 400/862] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.280280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.287069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.317659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.318048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.325197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.329667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.329667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.329667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.408841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ba9c28cb114030a3b5b56b95a44f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4020867e2244872a9954ecdf1f021df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.423653 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5860e00a-99ac-4777-b4e0-1ed75d6b80fd tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 200 len: 1305 microversion: 2.1 time: 0.409899 Oct 04 18:07:18.433271 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 463/863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 1305 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.439315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.441978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.456502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.461523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.461523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.461523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.461523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.461955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.563759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.579027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.589273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.604944 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ecdb029-f000-494f-961a-4444842d6d5f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.342125 Oct 04 18:07:18.606492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 401/864] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:18.945098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.945723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.957904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.958405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.958868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.961984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.962643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.962974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.334767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.347657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4548b347-1fb1-4a7e-be31-c8df84a92cb8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.405408 Oct 04 18:07:19.352114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 402/865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.362961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5cf9bd56-5253-4231-ac49-d355fe4e9ef1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a17ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.364997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.378346 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e0ae804-825e-4a3c-8af7-59add2b8225b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.939832 Oct 04 18:07:19.401907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 464/866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.461763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.468630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.498488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.504789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.506904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.511452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.513352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5cf9bd56-5253-4231-ac49-d355fe4e9ef1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.157864 Oct 04 18:07:19.514943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.518723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.520899 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 403/867] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.564813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 HTTP/1.1 Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:19.569000 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.570466 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0f72278e-4111-41cd-98ea-b05a7cfff098'} Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.571249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.572770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.573866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.574263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26d1b335-d6d5-43ee-9526-43f5d1e45c2a tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 404 len: 111 microversion: 2.1 time: 0.118227 Oct 04 18:07:19.577535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 465/868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:19.584616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-752139189", "metadata": {"image_type": "test"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:19.590234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.601028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.602587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.603689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.607122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.608696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.613136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.644099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.645178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.662907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.664745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.665959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.670299 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.672769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.673558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.675486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098/action HTTP/1.1 Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 111 Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:19.680672 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-752139189", "metadata": {"image_type": "test"}}} Oct 04 18:07:19.689812 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0f72278e-4111-41cd-98ea-b05a7cfff098', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-752139189', 'metadata': {'image_type': 'test'}}}} Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.690819 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.692312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.693933 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-686f7188-4fc9-47bf-8801-791c71e728f2 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "POST /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098/action" status: 404 len: 111 microversion: 2.1 time: 0.103689 Oct 04 18:07:19.701041 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 404/869] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 4 18:07:19 2022] POST /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:19.709304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1078357292", "metadata": {"image_type": "test"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:19.726394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Failed to fetch instance by id tempest-invalid-1622142312 {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:07:19.728176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance tempest-invalid-1622142312 could not be found. Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/tempest-invalid-1622142312/action HTTP/1.1 Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 112 Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:19.730229 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1078357292", "metadata": {"image_type": "test"}}} Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:19.734255 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance tempest-invalid-1622142312 could not be found. Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'tempest-invalid-1622142312', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1078357292', 'metadata': {'image_type': 'test'}}}} Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1622142312 could not be found. Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.735165 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1622142312 could not be found. Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1622142312 could not be found. Oct 04 18:07:19.736605 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.739815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance tempest-invalid-1622142312 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.747798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e5fcd73-5c1b-45b0-b6a8-f8205b352772 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "POST /compute/v2.1/servers/tempest-invalid-1622142312/action" status: 404 len: 101 microversion: 2.1 time: 0.045078 Oct 04 18:07:19.749547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 405/870] 10.222.0.40 () {60 vars in 1249 bytes} [Tue Oct 4 18:07:19 2022] POST /compute/v2.1/servers/tempest-invalid-1622142312/action => generated 101 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:19.760932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-527573496"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:19.770658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:07:19.772086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 56 Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:19.781907 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-test-snap-527573496"}} Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:19.784637 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-527573496'}}} Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.786341 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.788951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.801051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.806694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-028f3080-94e9-42b5-a925-eb762a52aad7 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.049344 Oct 04 18:07:19.813247 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 406/871] 10.222.0.40 () {60 vars in 1275 bytes} [Tue Oct 4 18:07:19 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:19.839077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-834010899"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:19.850583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:07:19.851675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 56 Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:19.854387 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-test-snap-834010899"}} Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:19.860961 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-834010899'}}} Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.862203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 18:07:19.864611 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.866345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.866345 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21a93a31-c712-4813-ba73-2cbdca9aa304 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.038033 Oct 04 18:07:19.883403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 407/872] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 4 18:07:19 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:19.895919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.896881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.914453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.916297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.917383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.920543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.922676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.923822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.961319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 HTTP/1.1 Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:19.966317 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.969186 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0f72278e-4111-41cd-98ea-b05a7cfff098'} Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.970769 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:19.974779 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.983305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.985324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e410688f-6b0d-47e0-a02d-b3ea7cda0af5 tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 404 len: 111 microversion: 2.1 time: 0.098378 Oct 04 18:07:19.988361 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 408/873] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:19 2022] DELETE /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:20.003741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.004685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] [instance: 0f72278e-4111-41cd-98ea-b05a7cfff098] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.014108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.035692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.035692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.035692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.035692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.036614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.074243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] HTTP exception thrown: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Request method failure captured: Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 HTTP/1.1 Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHY3bk5EUSqEpdNByJeNp2qQZXK_zPDKj8DChw58-xRc6Frsl10D5GSEUSQhdSwsc7DmgbXT4LFwE6FLCN-3oxGJ6T7_OGb8B8aLlMEMrakjGcxhnxfg2yZY_prTZngthOFnz92LSVjdlqW-Re1B7el-_rEcQxUCxbpdoYoLaEnmk7w Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:20.075869 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4020867e2244872a9954ecdf1f021df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4020867e2244872a9954ecdf1f021df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4020867e2244872a9954ecdf1f021df"}]}] Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c4020867e2244872a9954ecdf1f021df Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-625060846 Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2ba9c28cb114030a3b5b56b95a44f10 Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesNegativeTestJSON-625060846-project Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:20.077343 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0f72278e-4111-41cd-98ea-b05a7cfff098'} Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:20.078256 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. Oct 04 18:07:20.079736 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:20.081126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] Returning 404 to user: Instance 0f72278e-4111-41cd-98ea-b05a7cfff098 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:20.081126 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44b94f88-b487-4581-98a0-eec81aace94f tempest-ImagesNegativeTestJSON-625060846 tempest-ImagesNegativeTestJSON-625060846-project] 10.222.0.40 "GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098" status: 404 len: 111 microversion: 2.1 time: 0.084625 Oct 04 18:07:20.081126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 409/874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/0f72278e-4111-41cd-98ea-b05a7cfff098 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:20.378049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.378691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.389771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.390505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.391035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.391809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.392276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.392708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.677194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.677776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.692515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.695627 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df770619-12bb-4c85-8015-370805a0dcd1 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.320986 Oct 04 18:07:20.696455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.701813 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 410/875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:20.710593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.712901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5137837f-fac4-4171-97ec-7265f0894a8f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1531 microversion: 2.91 time: 1.078218 Oct 04 18:07:20.715192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.731448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.742015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.742015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.742015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.742015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.742351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.742436 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 466/876] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1531 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:20.748366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c137d562-9b9b-4e8d-b138-ff309e695692 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009754310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.832555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c137d562-9b9b-4e8d-b138-ff309e695692 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.091570 Oct 04 18:07:20.833140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:20.834576 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 467/877] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:20.847985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:20.852391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:20.872406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.873257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.873915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:20.874860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:20.875498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:20.876090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.180491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lazy-loading 'services' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:21.233002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4ac57e3-f16b-479b-93fb-ae2a231c4b40 tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1938 microversion: 2.91 time: 0.397145 Oct 04 18:07:21.234512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 468/878] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1938 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:21.265613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:21.266605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.274635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.275550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.276335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.277971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.278700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.279442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.323294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lazy-loading 'flavor' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:21.560826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.571513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a278a00b-89cf-467c-8b0f-8452fd885cdc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.868737 Oct 04 18:07:21.572770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 411/879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:21.578040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1785147273", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bcca917f-d495-4d05-8cab-ccf60494bd86"}], "security_groups": [{"name": "tempest-securitygroup--498548260"}], "key_name": "tempest-keypair-936672898", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:21.991381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25f68c3e-2b3f-4835-bb15-3cb7037815bc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action" status: 202 len: 0 microversion: 2.91 time: 0.730990 Oct 04 18:07:21.992396 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 469/880] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:07:21 2022] POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:07:22.008105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.014238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.019857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:22.039160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.048218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.048999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.049950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.050631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.051239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.390557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] validate_networks() for [('bcca917f-d495-4d05-8cab-ccf60494bd86', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:22.721691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.735632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cece7e91-6151-40a4-9ad3-b48aeaf2a18a tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.741633 Oct 04 18:07:22.742848 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 470/881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.748919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38514e3d-9e12-485f-a2f4-30fc0fd08304 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900977c280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.883843 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38514e3d-9e12-485f-a2f4-30fc0fd08304 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.109727 Oct 04 18:07:22.883843 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 471/882] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.883843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.883843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.888395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.890904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.891803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.894988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.897794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.898794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.130427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.143221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.145163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.152344 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83cac89c-aed1-451b-9b58-43092bf8a889 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.295628 Oct 04 18:07:23.153477 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 472/883] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:23.158560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.159214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.166105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.166885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.168181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.169161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.169844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.170535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.359831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.370787 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-873b0000-6f77-473f-a087-4080cffc2825 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.216176 Oct 04 18:07:23.378005 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 473/884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:23.389802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152461ff-d8e9-479f-9393-23db0fab945e", "tag": "cd793a9b-4f9d-441f-87ab-7bc99f8672bd"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:23.442276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.447604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.448134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.482232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] Creating event network-changed:cd793a9b-4f9d-441f-87ab-7bc99f8672bd for instance 152461ff-d8e9-479f-9393-23db0fab945e on n-h1-833090-21 Oct 04 18:07:23.491687 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2f775344-2372-41ac-96f1-8ed27f18f359 req-c9a9af0c-6acd-4bbe-a001-a30ee895ca87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116175 Oct 04 18:07:23.492764 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 474/885] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:23.770123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.770984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.786314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.789962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.790549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.793697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.796440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.798015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.019587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:24.020825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:24.021587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:24.022191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:24.023319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:24.057934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.061810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.063107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.064183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.066007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.066879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.115066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:24.119114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for user 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 and project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:24.165766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:24.168768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:24.370326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-650d2198-2087-4ef3-a6be-051af2820b2d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.794801 Oct 04 18:07:24.372022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 412/886] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:07:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 2798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:07:24.389962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79c4cb11-c202-41c9-971e-e4cd87e77ce1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a3f1f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.517794 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79c4cb11-c202-41c9-971e-e4cd87e77ce1 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.144494 Oct 04 18:07:24.525064 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 413/887] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:24.546266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.548190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.550318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.559252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35e716a1-dbf4-45e8-9beb-ba582c8f8bd9 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.794619 Oct 04 18:07:24.577021 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 475/888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:24.577833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.578386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.578875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.579635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.580251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.580681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.814045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.825157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.828523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.834372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:24.837330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac7e85cc-23df-4e49-b89f-de7ba4cff622 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.309881 Oct 04 18:07:24.838078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 414/889] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:24.844581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.845468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.985777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.986783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e1966f0-4991-4ec3-97c3-4dde32a0d711 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Action: 'create', calling method: .version_select at 0x7f900970c550>, body: {"pool": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:25.035928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.043984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.046579 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19507557-1321-4749-bb97-706fc2b15e3b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1285 microversion: 2.25 time: 0.206940 Oct 04 18:07:25.048332 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 415/890] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:25.058568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.060070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.071212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.073119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.073499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.075750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.076922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.077968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.375952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.403524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d8f1fb94-b294-4db7-8f4e-3f1e1db0b60a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.350219 Oct 04 18:07:25.405217 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 416/891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.543005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fb249f2-9cb7-444c-bba6-21c7e8657d6d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a22b80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.624110 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fb249f2-9cb7-444c-bba6-21c7e8657d6d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.086872 Oct 04 18:07:25.627852 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 417/892] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:25.650002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.657274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.693593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.698186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.699264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.703515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.710349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.710933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.736746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.747567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4002d08-9562-49ed-9b05-c5216d759d35 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 1.112035 Oct 04 18:07:26.750282 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 418/893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:26.762458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.768212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.782176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.782932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.783422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.787838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.791287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.791999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.070277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.098742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.107158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.122321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ebe56ab-fe83-4634-80ce-afc6d3a434de tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.370131 Oct 04 18:07:27.123713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 419/894] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:27.132388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.133407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.151962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.152831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.153784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.155628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.158033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.160364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.416522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.430408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.437265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.441609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3156be90-5c5e-4828-8643-2020515201af tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1281 microversion: 2.25 time: 0.316463 Oct 04 18:07:27.457844 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 420/895] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:27.457844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.458990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.480682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.480682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.480682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.480682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.481069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.488138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.555751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:28.087857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.096649 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5ee9b19-3bfb-4e85-ba9f-d2ac92a6f783 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1503 microversion: 2.1 time: 0.649042 Oct 04 18:07:28.098006 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 421/896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1503 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:28.104687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b725613-4950-4612-b52a-31a1924490f2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a7a310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.219812 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b725613-4950-4612-b52a-31a1924490f2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.120124 Oct 04 18:07:28.221422 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 422/897] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:28.240215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.241107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.249178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.250159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.250842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.253166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.253937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.254618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.319755 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:07:28.320617 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:07:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.40) !!! Oct 04 18:07:28.673475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.688475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2440a42a-7325-4c87-b729-c16143520a12 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.458550 Oct 04 18:07:28.690077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 423/898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:28.698881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.707170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.730311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.731179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.731879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.733335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.735587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.754336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.873093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.889447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.893713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:28.921353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3321d85e-223c-49c1-a58b-ceb069c50910 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.221779 Oct 04 18:07:28.922383 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 424/899] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:28.939839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.940801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.974098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.974628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.975072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.976607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.976607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.976839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.115309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:29.128780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:29.134803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:29.136075 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9280060-f463-4e27-b83c-8ce802947f68 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1345 microversion: 2.25 time: 0.212690 Oct 04 18:07:29.136652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 425/900] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:29.153285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.153815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:29.180257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.181138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.181754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.183914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.184572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.185330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.419384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:29.429575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4632f35a-a209-48b0-9c38-e9df58e05b3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1478 microversion: 2.1 time: 0.290459 Oct 04 18:07:29.440458 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 426/901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.453693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2cfbf1ba-3173-470a-9473-58d1fcca2ceb tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90099f69d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.514079 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2cfbf1ba-3173-470a-9473-58d1fcca2ceb tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.072238 Oct 04 18:07:29.515182 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 427/902] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.524494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67406ed8-3d7f-408f-ba07-575fde7e7950 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '.version_select at 0x7f9009a22c10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.529029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67406ed8-3d7f-408f-ba07-575fde7e7950 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.529858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67406ed8-3d7f-408f-ba07-575fde7e7950 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.530407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67406ed8-3d7f-408f-ba07-575fde7e7950 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.544402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67406ed8-3d7f-408f-ba07-575fde7e7950 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.026954 Oct 04 18:07:29.545914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 428/903] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.567555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.568468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:29.577246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.578141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.578795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.580180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.580860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.581647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.937021 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3db25e07-8412-4de3-bfa0-130e3bec0562 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1631 microversion: 2.1 time: 0.380517 Oct 04 18:07:29.948637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 429/904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1631 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.954552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152461ff-d8e9-479f-9393-23db0fab945e", "name": "network-vif-plugged", "status": "completed", "tag": "cd793a9b-4f9d-441f-87ab-7bc99f8672bd"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:29.992476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.993292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.994225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.063858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] Creating event network-vif-plugged:cd793a9b-4f9d-441f-87ab-7bc99f8672bd for instance 152461ff-d8e9-479f-9393-23db0fab945e on n-h1-833090-21 Oct 04 18:07:30.072671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d0a0a93b-8fe6-4031-a49a-95f3b2f2cd2a req-2b02d747-7ddc-4ced-b0bb-317150fbfc9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119251 Oct 04 18:07:30.087009 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 430/905] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:30.087009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.089135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.104198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.107715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.109392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.111945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.116519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.116519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.304327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e1966f0-4991-4ec3-97c3-4dde32a0d711 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.708409 Oct 04 18:07:30.305095 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 476/906] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:07:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:30.319725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.320773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.343222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.343907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.345526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.350674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.351878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.352582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.366175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.377708 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e8637ed-6090-4e02-b5f5-f0f2ed3b602c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.301938 Oct 04 18:07:30.378859 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 431/907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.418830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d431b65d-664f-4e7b-b3b3-c69f705be5b6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: .version_select at 0x7f9009c185e0>, body: {"keypair": {"name": "tempest-keypair-1271000355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyvSeJnN9a/hRm0M9VKS0OBeODUBaiMW5k9LXXuFo4+dq0tDoFfW7rq7GEtezHRHXjRKVFvOw/k/otqQle+XiSkl5grroTlZS7jef5IrWA5CdhopiazXtZSw/EBpGAClg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:30.440235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d431b65d-664f-4e7b-b3b3-c69f705be5b6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:30.448818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d431b65d-664f-4e7b-b3b3-c69f705be5b6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for user 97934d1450a94f40b1d7a82d05fb47dc and project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:30.538174 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d431b65d-664f-4e7b-b3b3-c69f705be5b6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142157 Oct 04 18:07:30.547339 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 432/908] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:07:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:30.555691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.556936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.582693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.587677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.591818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.592905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:30.593612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:30.594262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.630593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.656457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.661706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.676377 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c05022e-4758-4794-a6cd-e1a108c32d1b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.367057 Oct 04 18:07:30.712292 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 477/909] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:30.724734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4833ca48-3e02-4059-92cb-9be73c95162a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f9009712310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.762027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.781447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.784006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.787956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e9403972-6de1-4719-a0a8-967dd22643b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1343 microversion: 2.25 time: 0.238217 Oct 04 18:07:30.809114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 433/910] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1343 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:30.814399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9047fe40-e335-41b7-b36f-89cecff377c2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009c188b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.905158 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9047fe40-e335-41b7-b36f-89cecff377c2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.094594 Oct 04 18:07:30.906343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 434/911] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:31.069553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4833ca48-3e02-4059-92cb-9be73c95162a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/33b76fdb-a804-467d-a4a5-f053aafa2ffe" status: 200 len: 142 microversion: 2.1 time: 0.355593 Oct 04 18:07:31.071145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 478/912] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/os-floating-ips/33b76fdb-a804-467d-a4a5-f053aafa2ffe => generated 142 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:31.084932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6500ba64-786c-4e5a-ac78-7470a13e2dd2 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f9009a22ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.356167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6500ba64-786c-4e5a-ac78-7470a13e2dd2 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.275701 Oct 04 18:07:31.356760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 435/913] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:31.369045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf3a023b-ce21-406a-abf1-b38e0d5c96ff tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f90096ea670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.408108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.408842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.415917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.417144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.417653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.418378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.418860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.419293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.864947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.879435 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08f34914-2838-4989-b5e6-c6941027225c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1321 microversion: 2.1 time: 0.475192 Oct 04 18:07:31.897481 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 436/914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:31.915035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.916331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.924990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.925855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.926538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.927735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.929432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.930155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.129506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.144177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.145913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.169853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-740fb681-50d5-4f2d-810a-7bb5825c98fd tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.267775 Oct 04 18:07:32.172918 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 437/915] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:32.190267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.190984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:32.208029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.212673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.215806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.216665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.219405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.220428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.600065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.632279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.636995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.638934 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d31bf763-912e-4cdb-95b0-c79d8515d467 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.464689 Oct 04 18:07:32.640547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 438/916] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:32.655189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b84f38d9-fe59-4d6d-bad3-a6f02006d32c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a3f310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.718239 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b84f38d9-fe59-4d6d-bad3-a6f02006d32c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1424 microversion: 2.1 time: 0.073284 Oct 04 18:07:32.719838 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 439/917] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:32.912208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.913074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:32.920572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.921073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.921511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.922292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.922756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.923183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.250650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf3a023b-ce21-406a-abf1-b38e0d5c96ff tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/33b76fdb-a804-467d-a4a5-f053aafa2ffe" status: 202 len: 0 microversion: 2.1 time: 1.884749 Oct 04 18:07:33.255676 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 479/918] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:07:31 2022] DELETE /compute/v2.1/os-floating-ips/33b76fdb-a804-467d-a4a5-f053aafa2ffe => generated 0 bytes in 1891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:33.256987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.265798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.270296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.276372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-346bd474-5a0f-4f80-b2f5-5ae9f40614f4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1471 microversion: 2.1 time: 0.369460 Oct 04 18:07:33.277678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.277806 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 440/919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:33.281836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.282887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66ebd5cc-ed74-4ae6-81af-90a88374dd89 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Action: 'create', calling method: .version_select at 0x7f9009a22c10>, body: {"pool": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.291500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.292953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.293617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.294572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.428139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.444833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.446755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:33.454049 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-323ee98f-6963-4088-b6bf-54223f28144f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.193711 Oct 04 18:07:33.471506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 480/920] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:33 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:33.471506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.471506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.471506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.471980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.471980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.471980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.471980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.473572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.501410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lazy-loading 'flavor' on Instance uuid 152461ff-d8e9-479f-9393-23db0fab945e {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:33.645756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:33.857292 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97e26f5c-3f89-4949-8775-692ae0ae8138 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e/action" status: 202 len: 0 microversion: 2.1 time: 0.400916 Oct 04 18:07:33.858533 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 481/921] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:33.866940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.868104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.877773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.878269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.878853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.879617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.880100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.880526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.087709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:34.537433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.564006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.571790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.575907 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c797c356-343e-4e14-97a6-ffa06dd2804e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.715639 Oct 04 18:07:34.578017 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 482/922] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:33 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:34.584539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:34.598765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.599407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.601127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.615744 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] Creating event network-changed:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h2-833090-21 Oct 04 18:07:34.623975 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-99772f0b-1c17-477d-91e7-d283eedf68ff req-9f73280f-3ddc-4fac-a74f-1d2cc4e31a6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043571 Oct 04 18:07:34.627263 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 483/923] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:34.633092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d1bfe33-f890-4148-8157-212d44d884f4 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90096ab670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.690779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d1bfe33-f890-4148-8157-212d44d884f4 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1433 microversion: 2.1 time: 0.062191 Oct 04 18:07:34.692323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 484/924] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1433 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.696568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.697289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:34.704059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.704557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.704995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.705694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:34.706360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:34.706789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.216997 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66ebd5cc-ed74-4ae6-81af-90a88374dd89 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.937829 Oct 04 18:07:35.217627 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 441/925] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:35.222602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.223379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.229915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.230396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.230830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.231577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.232129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.232667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.303448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.313542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.315253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.326229 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15da384b-4897-457d-8af4-f10001d68e17 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.102579 Oct 04 18:07:35.326229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 442/926] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:35.328320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b03022ce-2f92-42f3-8b73-98d06058be98 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a22af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.358609 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d8a90d0-2332-493b-acc3-74dd2f203a25 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1615 microversion: 2.1 time: 0.665285 Oct 04 18:07:35.359236 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 485/927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1615 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:35.370917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-899e5794-33f4-4fc1-9c0d-b7a627aeb2df tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f9009d754c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.384288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b03022ce-2f92-42f3-8b73-98d06058be98 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 200 len: 1433 microversion: 2.1 time: 0.060417 Oct 04 18:07:35.385511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 443/928] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 1433 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:35.390466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:35.391114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.397370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.397856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.398339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.399024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.399498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.399920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.492119 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] HTTP exception thrown: Cannot 'migrate' instance 152461ff-d8e9-479f-9393-23db0fab945e while it is in vm_state suspended Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Request method failure captured: Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e/action HTTP/1.1 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 15 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYk-nWzQ6YPt8IAYw6Vc1lu_LuhTPp9RQB3J0wD00UEvJR_JpjiOi9hY0ZPToE7574cPFbIWcsWhMeHKcsIaj-McghxQfnRSRbd93_EXWjNEd-HXRu8D_fWWc4JN0fuHKUJCxhpAWQmJgfFOoOByu-fWAFSLGfYeFK5-C_XupMNvB8 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:07:35.495041 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/156f5bb9c0b0470e8f5b6feb98d9d339"}]}] Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e6a37cc386414727b4fe7208e3bb0d0e Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: {"migrate": {}} Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:35.506072 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot 'migrate' instance 152461ff-d8e9-479f-9393-23db0fab945e while it is in vm_state suspended Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '152461ff-d8e9-479f-9393-23db0fab945e', 'body': {'migrate': {}}} Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 152461ff-d8e9-479f-9393-23db0fab945e in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.507233 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 152461ff-d8e9-479f-9393-23db0fab945e while it is in vm_state suspended Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:35.508689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 152461ff-d8e9-479f-9393-23db0fab945e while it is in vm_state suspended Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Returning 409 to user: Cannot 'migrate' instance 152461ff-d8e9-479f-9393-23db0fab945e while it is in vm_state suspended {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d648e57c-6eee-4d08-a07f-43d0c7b479b9 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e/action" status: 409 len: 148 microversion: 2.1 time: 0.110279 Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 444/929] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:35 2022] POST /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e/action => generated 148 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:07:35.510729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.511564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.512724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.513255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.513689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.515086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.515605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.516063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.675459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:35.685335 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a7bd7e1-7aaf-4d40-88c0-3544af0b2558 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1466 microversion: 2.1 time: 0.186617 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 445/930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1466 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9647a85-5a64-4e49-9438-9b53f022f136 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9647a85-5a64-4e49-9438-9b53f022f136 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Request method failure captured: Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action HTTP/1.1 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 39 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYk-nWzQ6YPt8IAYw6Vc1lu_LuhTPp9RQB3J0wD00UEvJR_JpjiOi9hY0ZPToE7574cPFbIWcsWhMeHKcsIaj-McghxQfnRSRbd93_EXWjNEd-HXRu8D_fWWc4JN0fuHKUJCxhpAWQmJgfFOoOByu-fWAFSLGfYeFK5-C_XupMNvB8 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:07:35.697343 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/156f5bb9c0b0470e8f5b6feb98d9d339"}]}] Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e6a37cc386414727b4fe7208e3bb0d0e Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: {"os-resetState": {"state": "invalid"}} Oct 04 18:07:35.699177 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '57d11131-0a96-41d8-9e15-fb32b602331f', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:35.700388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:07:35.701798 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 18:07:35.703072 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:35.703072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9647a85-5a64-4e49-9438-9b53f022f136 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:35.703072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9647a85-5a64-4e49-9438-9b53f022f136 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action" status: 400 len: 144 microversion: 2.1 time: 0.009283 Oct 04 18:07:35.703456 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 446/931] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:35 2022] POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action => generated 144 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:07:35.709186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-456620322", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "286df177-dde3-4675-bad4-0ffd6b0a97f8"}], "security_groups": [{"name": "tempest-securitygroup--899301294"}], "key_name": "tempest-keypair-1271000355", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:35.849994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] validate_networks() for [('286df177-dde3-4675-bad4-0ffd6b0a97f8', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:36.270879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-899e5794-33f4-4fc1-9c0d-b7a627aeb2df tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57" status: 202 len: 0 microversion: 2.1 time: 0.908908 Oct 04 18:07:36.278440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:36.278857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:36.279109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 486/932] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:07:35 2022] DELETE /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57 => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:36.279332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:36.279775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:36.280188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:36.284254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.284855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.289132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.289614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.290060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.290790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.291903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.292115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.292338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.292589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.293018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.293706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.294153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.294568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.310748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:36.317518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for user 97934d1450a94f40b1d7a82d05fb47dc and project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:36.329410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:36.331830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:36.427081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.437193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.439056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.440291 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bdb0ab5-91c5-45de-aca4-65004f277294 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.160007 Oct 04 18:07:36.440847 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 487/933] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:36.446203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e2e6db7-d6c4-4564-8c4a-4967f11f5bd0 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e2e6db7-d6c4-4564-8c4a-4967f11f5bd0 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Request method failure captured: Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action HTTP/1.1 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 31 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHYk-nWzQ6YPt8IAYw6Vc1lu_LuhTPp9RQB3J0wD00UEvJR_JpjiOi9hY0ZPToE7574cPFbIWcsWhMeHKcsIaj-McghxQfnRSRbd93_EXWjNEd-HXRu8D_fWWc4JN0fuHKUJCxhpAWQmJgfFOoOByu-fWAFSLGfYeFK5-C_XupMNvB8 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:07:36.450091 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/156f5bb9c0b0470e8f5b6feb98d9d339"}]}] Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e6a37cc386414727b4fe7208e3bb0d0e Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: {"os-resetState": {"state": 1}} Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:36.451685 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '57d11131-0a96-41d8-9e15-fb32b602331f', 'body': {'os-resetState': {'state': 1}}} Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 1 Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:36.456718 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 18:07:36.458309 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.460939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e2e6db7-d6c4-4564-8c4a-4967f11f5bd0 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:36.460939 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e2e6db7-d6c4-4564-8c4a-4967f11f5bd0 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action" status: 400 len: 120 microversion: 2.1 time: 0.009679 Oct 04 18:07:36.460939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 488/934] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:36 2022] POST /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:07:36.460939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e845abc4-8f83-47e9-a4fd-4296651d23f6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90096d88b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.461402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86e645d3-7d4a-4864-852a-3e16876352e1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756546 Oct 04 18:07:36.462514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 447/935] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:36.504971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e845abc4-8f83-47e9-a4fd-4296651d23f6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6" status: 200 len: 784 microversion: 2.1 time: 0.051164 Oct 04 18:07:36.506218 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 489/936] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6 => generated 784 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:36.510818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f9009937ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.560105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 42aa0c0e-c858-4884-940c-749ff082eb57 could not be found", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:07:36.560803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] HTTP exception thrown: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Request method failure captured: Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57 HTTP/1.1 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHZccQvioBxhi-y7-AEDfXrug31BJV9jgxJf_pbTjpz6RTY15brwGCxUiXtYU1duF85mHF9Xuc7rSGr259h7xb-sh6hRXuAU82GAernmLFeEtiWROaSl2U2QDpu-9XGV2SnoQK2lenq0lie_A9cXQbb-EoxSNA3KAC7rIsR7l6X3m6o Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b42fe105994b4121885133fc91deb859 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:36.563981 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b42fe105994b4121885133fc91deb859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b42fe105994b4121885133fc91deb859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b42fe105994b4121885133fc91deb859"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b42fe105994b4121885133fc91deb859"}]}] Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b42fe105994b4121885133fc91deb859 Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsTestJSON-2101237240-project Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f5db96167c8b456987a4dc11da89bab3 Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsTestJSON-2101237240-project Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: exception: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '42aa0c0e-c858-4884-940c-749ff082eb57'} Oct 04 18:07:36.565323 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:07:36.566127 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 42aa0c0e-c858-4884-940c-749ff082eb57 could not be found Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2eb70d2-871a-4bc9-8112-765d59f875b7'] Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57. Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.567447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:36.568770 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:36.569987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.569987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.569987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Returning 404 to user: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:36.569987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74b49e3c-90c4-4b6e-a670-e7d7984bc031 tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57" status: 404 len: 111 microversion: 2.1 time: 0.059787 Oct 04 18:07:36.569987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 490/937] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:36.573213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.573895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.583081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.583081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.583081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.583333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.583709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.584338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.624353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dcef8157-4928-4468-b022-d907bdf0e886 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f9009a22d30>, body: {"keypair": {"name": "tempest-keypair-789012598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsT2kdLU0Q33hZHVOGWWa+WTADxdDkE1KtAtvr+E0z+FwBeQWMbfQNyUDlEkBG8dkzAG+cGFNU/ebjyZqZ8U5ObGKtujbuj6gTX5PxNpeQBwFGHWWWc7tYpQH3KL5udWQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:36.642574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-dcef8157-4928-4468-b022-d907bdf0e886 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:36.648255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-dcef8157-4928-4468-b022-d907bdf0e886 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:36.652816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.662059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.662527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.670800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3124c9b7-0900-4d11-80c5-11d21dd57714 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.102065 Oct 04 18:07:36.671602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 491/938] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:36.676746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:36.678540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Failed to fetch instance by id 999 {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:07:36.679039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Request method failure captured: Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 37 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHYk-nWzQ6YPt8IAYw6Vc1lu_LuhTPp9RQB3J0wD00UEvJR_JpjiOi9hY0ZPToE7574cPFbIWcsWhMeHKcsIaj-McghxQfnRSRbd93_EXWjNEd-HXRu8D_fWWc4JN0fuHKUJCxhpAWQmJgfFOoOByu-fWAFSLGfYeFK5-C_XupMNvB8 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:07:36.686186 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/156f5bb9c0b0470e8f5b6feb98d9d339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/156f5bb9c0b0470e8f5b6feb98d9d339"}]}] Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 156f5bb9c0b0470e8f5b6feb98d9d339 Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266523596 Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e6a37cc386414727b4fe7208e3bb0d0e Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266523596-project-admin Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: {"os-resetState": {"state": "error"}} Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:36.687749 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 999 could not be found. Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:07:36.688671 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:07:36.690198 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.692132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:36.693314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17628d32-f145-45c5-92e7-674e931d9065 tempest-ServersAdminNegativeTestJSON-1266523596 tempest-ServersAdminNegativeTestJSON-1266523596-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020449 Oct 04 18:07:36.694576 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 492/939] 10.222.0.40 () {60 vars in 1179 bytes} [Tue Oct 4 18:07:36 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:07:36.699447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e001408f-889c-46e5-aeb4-f10ab47337f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.700077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e001408f-889c-46e5-aeb4-f10ab47337f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.754573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e001408f-889c-46e5-aeb4-f10ab47337f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.761841 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e001408f-889c-46e5-aeb4-f10ab47337f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1234 microversion: 2.1 time: 0.066166 Oct 04 18:07:36.762407 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 493/940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.766892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8c0554d-1f19-40fc-a06c-1aa93093d7a2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.774451 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8c0554d-1f19-40fc-a06c-1aa93093d7a2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011092 Oct 04 18:07:36.774991 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 494/941] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:36.779396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Calling method '.version_select at 0x7f9009937ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.786073 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dcef8157-4928-4468-b022-d907bdf0e886 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.322375 Oct 04 18:07:36.786674 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 448/942] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 323 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:36.791758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.792257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:36.798648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.799138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.799609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.800307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:36.800991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:36.801419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.828077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:36.839190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 42aa0c0e-c858-4884-940c-749ff082eb57 could not be found", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:07:36.839977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] HTTP exception thrown: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Request method failure captured: Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57 HTTP/1.1 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHZccQvioBxhi-y7-AEDfXrug31BJV9jgxJf_pbTjpz6RTY15brwGCxUiXtYU1duF85mHF9Xuc7rSGr259h7xb-sh6hRXuAU82GAernmLFeEtiWROaSl2U2QDpu-9XGV2SnoQK2lenq0lie_A9cXQbb-EoxSNA3KAC7rIsR7l6X3m6o Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b42fe105994b4121885133fc91deb859 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:36.841832 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b42fe105994b4121885133fc91deb859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b42fe105994b4121885133fc91deb859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b42fe105994b4121885133fc91deb859"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b42fe105994b4121885133fc91deb859"}]}] Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b42fe105994b4121885133fc91deb859 Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2101237240 Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsTestJSON-2101237240-project Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f5db96167c8b456987a4dc11da89bab3 Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsTestJSON-2101237240-project Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: exception: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '42aa0c0e-c858-4884-940c-749ff082eb57'} Oct 04 18:07:36.843300 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:07:36.845862 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 42aa0c0e-c858-4884-940c-749ff082eb57 could not be found Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb9e76c9-9ffa-494a-9c93-3e049a7ae064'] Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57. Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.847348 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:36.849088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:36.850920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 Oct 04 18:07:36.850920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:36.850920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] Returning 404 to user: Floating IP not found for ID 42aa0c0e-c858-4884-940c-749ff082eb57 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:36.850920 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72e7a5c3-9589-476e-b76f-140d4eaa6a3a tempest-FloatingIPsTestJSON-2101237240 tempest-FloatingIPsTestJSON-2101237240-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57" status: 404 len: 111 microversion: 2.1 time: 0.067235 Oct 04 18:07:36.850920 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 495/943] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:07:36 2022] DELETE /compute/v2.1/os-floating-ips/42aa0c0e-c858-4884-940c-749ff082eb57 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:36.852261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0210c68-69f7-4950-a0a1-c66bf8bec25b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900970f8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.860230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:37.090642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:37.165899 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4cfbb5e6-4d23-4842-9051-c8cbac33c935 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 204 len: 0 microversion: 2.1 time: 0.377812 Oct 04 18:07:37.173582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 449/944] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:36 2022] DELETE /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:37.180389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1347950a-2260-472a-aca0-b12f50492c0b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f90099ca700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.191192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1347950a-2260-472a-aca0-b12f50492c0b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-789012598" status: 200 len: 511 microversion: 2.2 time: 0.015078 Oct 04 18:07:37.192504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 450/945] 10.222.0.40 () {60 vars in 1255 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-789012598 => generated 511 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:37.199645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.202789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.209917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.210500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.211190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.212212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.213581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.214318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.587668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:37.595536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69224afc-3934-4a21-a853-a603cee63f1f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1468 microversion: 2.1 time: 0.401589 Oct 04 18:07:37.596079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 451/946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:37.616155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23f24d20-e31a-4a04-ad49-d310e1efcc63 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009a76430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.725092 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23f24d20-e31a-4a04-ad49-d310e1efcc63 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789012598" status: 204 len: 0 microversion: 2.2 time: 0.112672 Oct 04 18:07:37.725689 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 452/947] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 4 18:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789012598 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:37.733082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-unplugged", "status": "completed", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:37.743435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.744510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.744946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.755934 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] Creating event network-vif-unplugged:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:07:37.761963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-897c5bf9-563a-468e-9d64-11a0b3817a23 req-a07af513-b77e-487a-a646-a67870cf72d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035091 Oct 04 18:07:37.762565 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 453/948] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:37.767852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.768557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.774745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.775251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.775773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.776476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.776936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.777386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.995982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.005305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.007065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.008276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f321b082-ab12-4bf5-9b9f-9ddc0c6a6b70 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.244627 Oct 04 18:07:38.008851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 454/949] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:38.014165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.014782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.020870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.021715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.022340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.023202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.023863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.024460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.107124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.118088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.119651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.126058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-416609a8-9ba2-46f8-b596-a94708517193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.115882 Oct 04 18:07:38.126679 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 455/950] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:38.131630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81204a00-7a19-4a5a-bafd-bb20595874bc tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f9009bc8c10>, body: {"keypair": {"name": "tempest-keypair-1707606716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCya3WPGslAp6uG7LXmQdgQjW42ERXRVqn2ceemRbWQUYQgCD2qlbVHAlnMoFCkb7l3n8vDe7Q5PLN2BiGsmx8ivQKvxmaNXxuIcXEtcGuEmMzv+X3stqAiWmg0zaBnIHA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:38.151694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-81204a00-7a19-4a5a-bafd-bb20595874bc tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:38.156968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-81204a00-7a19-4a5a-bafd-bb20595874bc tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:38.216639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0210c68-69f7-4950-a0a1-c66bf8bec25b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "DELETE /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 204 len: 0 microversion: 2.1 time: 1.371822 Oct 04 18:07:38.217245 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 496/951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:36 2022] DELETE /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 0 bytes in 1373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:38.222396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.223095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.229480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.230047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.230561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.231364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.231932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.232575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.308465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.313598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81204a00-7a19-4a5a-bafd-bb20595874bc tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.185876 Oct 04 18:07:38.314511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 456/952] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:38.326739 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1330441-2a72-40a7-a9f1-9ddfa28716da tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1238 microversion: 2.1 time: 0.104860 Oct 04 18:07:38.326739 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 497/953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:38.326953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d793e30-2cd4-4dce-80aa-62e4a3da282b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009eccb80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.328789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58fc530a-6a32-4e06-8c4f-574a99c6a5be tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009992160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.353725 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8d793e30-2cd4-4dce-80aa-62e4a3da282b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] HTTP exception thrown: Image not found. Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d793e30-2cd4-4dce-80aa-62e4a3da282b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Request method failure captured: Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 HTTP/1.1 Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYi98sFL_Zcis_ibIjCYx1ladt00PuP3hHxdDo43m6tVZ8CfmBYh65Jjca1YLTJRo1cWfR9ZIeq7W60jevmCoB42kQC3EZk4bLyJ8zUNn3B9UVsyoAa9hfX6eQs_zf8ExTkohZj5GQp53FOebmWtbkyh4zs3QBDHfFYWYc3-p847nE Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:38.366281 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f71b036680f9444bae3d0e89ea8ea81c"}]}] Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 07c5df6fbd0b4aa3aa4e3db55ca35360 Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '402f9f23-b474-45b7-ba92-b4257f3b8287'} Oct 04 18:07:38.367959 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:07:38.369418 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 402f9f23-b474-45b7-ba92-b4257f3b8287 Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:07:38.370703 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 402f9f23-b474-45b7-ba92-b4257f3b8287 could not be found. Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:07:38.372201 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:07:38.373643 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:38.376233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d793e30-2cd4-4dce-80aa-62e4a3da282b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:38.382962 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d793e30-2cd4-4dce-80aa-62e4a3da282b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 404 len: 62 microversion: 2.1 time: 0.060932 Oct 04 18:07:38.382962 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 457/954] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:07:38.398832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-559330944"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:38.401766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.410444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.411161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.411818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.412698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.413320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.413912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.446082 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58fc530a-6a32-4e06-8c4f-574a99c6a5be tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707606716" status: 204 len: 0 microversion: 2.2 time: 0.121095 Oct 04 18:07:38.448017 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 498/955] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Oct 4 18:07:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707606716 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:38.458886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-edbed77f-544b-406d-954d-474d17c64d5b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f90096ab700>, body: {"keypair": {"name": "tempest-keypair-1423562130", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:38.502830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-edbed77f-544b-406d-954d-474d17c64d5b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:38.513268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-edbed77f-544b-406d-954d-474d17c64d5b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:38.627972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-edbed77f-544b-406d-954d-474d17c64d5b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.168479 Oct 04 18:07:38.627972 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 499/956] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:38 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:38.629423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.631184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.638759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.640216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.640883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.642059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.642692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.643718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.899051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.907577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27c2dbf9-34a3-46f5-b718-031ddae8c156 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1468 microversion: 2.1 time: 0.282571 Oct 04 18:07:38.908814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 500/957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:38.914259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-545da9a9-8069-4f9a-8c47-8ceefebb472c tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f90096ba280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.942031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-879a9b74-4d4b-4fed-b29f-e6a32007b00d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "POST /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562/action" status: 202 len: 0 microversion: 2.1 time: 0.557450 Oct 04 18:07:38.949414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 458/958] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:38 2022] POST /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:07:38.949414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.949828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:38.956497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.956843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.957282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.958000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.958690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.959127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.989442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:39.060140 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-545da9a9-8069-4f9a-8c47-8ceefebb472c tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423562130" status: 204 len: 0 microversion: 2.2 time: 0.148916 Oct 04 18:07:39.065399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 501/959] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Oct 4 18:07:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423562130 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:39.067877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d263685-7e18-4bb2-ab31-f9d55ebfae68 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900970faf0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.127130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d263685-7e18-4bb2-ab31-f9d55ebfae68 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.065206 Oct 04 18:07:39.134511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 502/960] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.144125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.146695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.159442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.159978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.164325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.167593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.168584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.170874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.399199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d37533a-9efb-4ec3-a6c1-3ef02520f5c9 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 204 len: 0 microversion: 2.1 time: 0.454451 Oct 04 18:07:39.399830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 459/961] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:38 2022] DELETE /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:39.409809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad2de191-0fcb-443f-992b-d73dd010803d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f900a572670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-559514425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7BmP9H+ocKRq/v+C1slWhLetlsyObWkBwTD+1BxN0gHnVlSut1Q5sXa0n3l22Q3S2uSMzL1hR9SCO4P+ogOPMyoTeG4YTBJ4+RELydvJXwceceN92/DC09M6TxLzcitw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:39.433219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.452882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.458816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.462192 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2284c2e8-13ca-4eb9-a713-c44ec7d4e0aa tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.324210 Oct 04 18:07:39.462839 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 503/962] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:39.470214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.470858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.476907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ad2de191-0fcb-443f-992b-d73dd010803d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:39.487229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.488217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ad2de191-0fcb-443f-992b-d73dd010803d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:39.488630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.489512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.490617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.496944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.497810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.588991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.592381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad2de191-0fcb-443f-992b-d73dd010803d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.187020 Oct 04 18:07:39.604132 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 460/963] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:39.610418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.611543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.618673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.620305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.621002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.621609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.622516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.623273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.623917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.627980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.639753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c94ee253-9b80-4c3c-8958-ee3b5748b33e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.173191 Oct 04 18:07:39.641223 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 504/964] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:39.647377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.648084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.659855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.661727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.663058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.667090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.667748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.668257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.762713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.778711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3e7eb89-716d-4c5b-a34d-2181e3e54e4f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1286 microversion: 2.1 time: 0.173125 Oct 04 18:07:39.779323 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 461/965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.785353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22dce244-2408-446f-afc9-afc074704ee6 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f9009b81d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1512047970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZMiHVN0W3fMxLcvpYC1BEcD2HW0EMo0/EJ2P709noSn0Cqc7H4UNjc+UiizOZZIMUjepX3c14X7MZZyxAX6oyNVetJKCqjvvvO5UiY14z9Uxym58W5uZNUhW+JI9pAJw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:39.805340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-22dce244-2408-446f-afc9-afc074704ee6 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:39.813010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-22dce244-2408-446f-afc9-afc074704ee6 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:39.827515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.836399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-446069e9-3ed5-4e8d-938b-d0d45be0d2d4 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1710 microversion: 2.1 time: 0.194032 Oct 04 18:07:39.837126 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 505/966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.930470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22dce244-2408-446f-afc9-afc074704ee6 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.149581 Oct 04 18:07:39.932528 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 462/967] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:39.942088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.943039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.950943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.951618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.952293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.953254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.953921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.954580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.971664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b79a4e7f-34b7-44e2-a9ce-6ce549638d6f tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f90099978b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-42729484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDphJNoK9eFS11vB9rIRCIoSI/Wuc+VkZZJZqsTY+mQoVg+UNVZX4JWOmwZ24CzL7tJt3bz0wiu/Tx0jCfjw5FDRzdSLDl/ifgX9NIPPnweL1iULDkQpPeNJjjrftG19Vw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:40.014618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b79a4e7f-34b7-44e2-a9ce-6ce549638d6f tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:40.059840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b79a4e7f-34b7-44e2-a9ce-6ce549638d6f tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:40.100301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.100301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f133776-180d-444f-9ccb-1bf2447dde97 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1426 microversion: 2.1 time: 0.154100 Oct 04 18:07:40.100301 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 506/968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1426 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.107661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152461ff-d8e9-479f-9393-23db0fab945e", "name": "network-vif-deleted", "tag": "cd793a9b-4f9d-441f-87ab-7bc99f8672bd"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:40.118418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.118990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.119425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.139204 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] Creating event network-vif-deleted:cd793a9b-4f9d-441f-87ab-7bc99f8672bd for instance 152461ff-d8e9-479f-9393-23db0fab945e on n-h1-833090-21 Oct 04 18:07:40.147305 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-924355ce-5673-4b70-bdf4-881f8fc169c9 req-724de201-4508-4b24-bacb-e98b54266a77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044141 Oct 04 18:07:40.148710 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 507/969] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:40.155626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-911b0b6f-b892-40ff-ba16-6b106adb67f2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009712820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.213611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b79a4e7f-34b7-44e2-a9ce-6ce549638d6f tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.254165 Oct 04 18:07:40.214119 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-911b0b6f-b892-40ff-ba16-6b106adb67f2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.064059 Oct 04 18:07:40.214519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 463/970] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:39 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 256 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:07:40.217764 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 508/971] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.225857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6189978b-ef54-4d92-aebe-6094c12f880b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009a3ff70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.229922 n-d-833090-21 devstack@n-api.service[123886]: WARNING oslo_db.sqlalchemy.utils [None req-6189978b-ef54-4d92-aebe-6094c12f880b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:07:40.244491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6189978b-ef54-4d92-aebe-6094c12f880b tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.022483 Oct 04 18:07:40.245091 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 464/972] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.260094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e49fe5a8-cd6f-415e-b0e2-82e4b5b6b4b4 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f90096eaee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.376867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e49fe5a8-cd6f-415e-b0e2-82e4b5b6b4b4 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-42729484" status: 204 len: 0 microversion: 2.2 time: 0.122813 Oct 04 18:07:40.385942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 509/973] 10.222.0.40 () {60 vars in 1315 bytes} [Tue Oct 4 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-42729484 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:40.387648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bc0ac1f-3154-45a3-b49f-2b7285f2f514 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f900a0fc280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.476742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bc0ac1f-3154-45a3-b49f-2b7285f2f514 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1512047970" status: 204 len: 0 microversion: 2.2 time: 0.093864 Oct 04 18:07:40.482604 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 465/974] 10.222.0.40 () {60 vars in 1321 bytes} [Tue Oct 4 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1512047970 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:40.488045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04d9967d-edd9-4f68-9201-45ae45a82fec tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009754b80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.491547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.492160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.507862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.508648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.509272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.510820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.511734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.513414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.595381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04d9967d-edd9-4f68-9201-45ae45a82fec tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-559514425" status: 204 len: 0 microversion: 2.2 time: 0.113396 Oct 04 18:07:40.596358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 510/975] 10.222.0.40 () {60 vars in 1318 bytes} [Tue Oct 4 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-559514425 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:40.612095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-027acf41-a480-4624-8fcf-4eb03b7ad903 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f90096ba820>, body: {"keypair": {"name": "tempest-keypair-887123641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiIBCsfrDaQ4xI6D1CJsvcd0Kh3/GZT4QsoxN3Y/LtgORFUBnonrgbScDlx4ihnvuALAZluf37snH/wfZdXQ7Lt+BlGdnpX2zT4Mas84avYfjf1bgMTAGL8M6PSzyGI6Q=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:40.632389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-027acf41-a480-4624-8fcf-4eb03b7ad903 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:40.638656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-027acf41-a480-4624-8fcf-4eb03b7ad903 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:40.727547 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-027acf41-a480-4624-8fcf-4eb03b7ad903 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.122740 Oct 04 18:07:40.734207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 511/976] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 4 18:07:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:07:40.734207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.734207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.740804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.741292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.741780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.742467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.743412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.743412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.814685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.831730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.833523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.836689 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf561b31-5e5e-4235-bccd-27f5f6665843 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.347424 Oct 04 18:07:40.838120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 466/977] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:40.842371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.843529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e13dc8e-bcf5-409f-bfa9-450df48626c1 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009f251f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.855766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.858005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.863972 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e13dc8e-bcf5-409f-bfa9-450df48626c1 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-887123641" status: 200 len: 512 microversion: 2.2 time: 0.024522 Oct 04 18:07:40.864241 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62c6b8df-a906-426c-ae80-34abaffa1fb6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.134901 Oct 04 18:07:40.864617 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 467/978] 10.222.0.40 () {60 vars in 1255 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-887123641 => generated 512 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:40.870102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.870895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.872338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 512/979] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:40.877106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.878001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.878611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.879104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.879572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.880636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.881086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.881676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.886192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:40.888059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.888801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.889176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.889966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.890333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.890920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.951781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:40.963351 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ccae00a6-546c-4723-9e12-a7a029e4b476 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1286 microversion: 2.1 time: 0.096796 Oct 04 18:07:40.964761 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 468/980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.975833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4551d3f-9daa-4468-8426-64d1eee7329d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009eccca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.980840 n-d-833090-21 devstack@n-api.service[123886]: WARNING oslo_db.sqlalchemy.utils [None req-c4551d3f-9daa-4468-8426-64d1eee7329d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:07:40.988263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4551d3f-9daa-4468-8426-64d1eee7329d tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.020718 Oct 04 18:07:40.989354 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 469/981] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:41.009414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d08ef736-dc5b-4060-ae69-5c490f3b9636 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009f259d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.129665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.138232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d08ef736-dc5b-4060-ae69-5c490f3b9636 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887123641" status: 204 len: 0 microversion: 2.2 time: 0.137232 Oct 04 18:07:41.143791 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 470/982] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 4 18:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887123641 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:07:41.148781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.149529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bda5f9e5-057c-4127-bdb5-be084cca82f7 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1710 microversion: 2.1 time: 0.275347 Oct 04 18:07:41.149800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.163114 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 513/983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1710 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.163441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.163441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.167381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.167381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.167381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.167381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.168389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Action: 'create', calling method: .version_select at 0x7f9009992160>, body: {"keypair": {"name": "tempest-keypair-1237330865", "type": "x509"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:41.187768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:41.193515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:41.219793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.processutils [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpfzb7pfeo/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfzb7pfeo/temp.key -subj /CN=a504e6e7c24a417a918dd1c918a94aad -extensions v3_req_client {{(pid=123887) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:07:41.266674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.275092 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-014f6026-6fa4-4848-b239-fb06e7364f63 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1297 microversion: 2.1 time: 0.130190 Oct 04 18:07:41.275957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 471/984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.280525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-295eeb48-892e-4218-8672-459c92cb8e9d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900a229e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.338973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-295eeb48-892e-4218-8672-459c92cb8e9d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.062068 Oct 04 18:07:41.339640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 472/985] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.356183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.processutils [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpfzb7pfeo/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfzb7pfeo/temp.key -subj /CN=a504e6e7c24a417a918dd1c918a94aad -extensions v3_req_client" returned: 0 in 0.136s {{(pid=123887) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:07:41.357704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.processutils [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpfzb7pfeo/temp.key -password pass: {{(pid=123887) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:07:41.404917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.processutils [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpfzb7pfeo/temp.key -password pass:" returned: 0 in 0.046s {{(pid=123887) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:07:41.531742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:41.560296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Getting quotas for user a504e6e7c24a417a918dd1c918a94aad and project af6227e453d241ebab3b98a3aae44dbf. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:41.594837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b9d59ce-d2cc-409c-852c-1e5b6ef17c02 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.434058 Oct 04 18:07:41.597138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 514/986] 10.222.0.40 () {62 vars in 1198 bytes} [Tue Oct 4 18:07:41 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 437 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:41.612238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3816585-b743-4caa-a16e-f4b6a66cd377 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f900998eaf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.642604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:41.647129 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3816585-b743-4caa-a16e-f4b6a66cd377 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1237330865" status: 200 len: 1534 microversion: 2.2 time: 0.040916 Oct 04 18:07:41.649229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 473/987] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1237330865 => generated 1534 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.678994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28955f38-7685-49a7-b7f6-13294b156cd9 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009712820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.687961 n-d-833090-21 devstack@n-api.service[123887]: WARNING oslo_db.sqlalchemy.utils [None req-28955f38-7685-49a7-b7f6-13294b156cd9 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:07:41.697243 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28955f38-7685-49a7-b7f6-13294b156cd9 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.038860 Oct 04 18:07:41.699532 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 515/988] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.710753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46ed3bfc-41d1-4a0a-8c07-b83a46f7b564 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] Calling method '.version_select at 0x7f9009d97430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.823928 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46ed3bfc-41d1-4a0a-8c07-b83a46f7b564 tempest-KeyPairsV22TestJSON-670867834 tempest-KeyPairsV22TestJSON-670867834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237330865" status: 204 len: 0 microversion: 2.2 time: 0.117953 Oct 04 18:07:41.827941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 474/989] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Oct 4 18:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237330865 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:41.873269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.874933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.904190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.905353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:41.915778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.917586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.918611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.924380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.925777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.926475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.929251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.930019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.930970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.937235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:41.939581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:41.943435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.161820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.172938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.174808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.187911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a74e09b2-a441-44b6-9928-fa39db6df95f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.291624 Oct 04 18:07:42.189672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 475/990] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:07:42.207981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.209724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.217340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.217841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.218282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.219018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.220296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.220296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.341921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.351901 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ff2d0b9-a9bf-46a4-bde3-ede254881588 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1304 microversion: 2.1 time: 0.159543 Oct 04 18:07:42.353197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 476/991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.363058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.363741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.379211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.383855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.384103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.391752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.392667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.393306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.510102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.520290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.524997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.531421 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79e921b6-4e7c-4b93-931d-f8bd4cc708cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.668634 Oct 04 18:07:42.534128 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 516/992] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:42.539877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "name": "network-vif-plugged", "status": "completed", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:42.571127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.571854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.572493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.605415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] Creating event network-vif-plugged:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h2-833090-21 Oct 04 18:07:42.615906 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-55498dc9-6f36-4887-9a86-cc9d73aeb047 req-3fed75f8-4770-4751-8084-34fffb0fb0a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079456 Oct 04 18:07:42.617916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 517/993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:42.626721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.627855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.638506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.639824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.641791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.643574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.644291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.644817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.717543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.718375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.719729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.720414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lazy-loading 'fault' on Instance uuid 152461ff-d8e9-479f-9393-23db0fab945e {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:42.898768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.904659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.908458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b9f5e7a-6ba0-45ab-a67d-d79c87f1dbb5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1710 microversion: 2.1 time: 0.554620 Oct 04 18:07:42.909186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 477/994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1710 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.914141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0802f44-aa6e-4060-a015-f8b7462b03aa tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009a761f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.915120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aefdf4b2-464f-4a13-95ad-b608fa543e65 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 200 len: 1311 microversion: 2.1 time: 0.294944 Oct 04 18:07:42.948297 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 518/995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.986416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0802f44-aa6e-4060-a015-f8b7462b03aa tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.067704 Oct 04 18:07:42.986416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 478/996] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:43.219821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.221028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.235973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.235973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.235973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.235973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.236387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.236387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.347445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.351755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:43.357351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.358820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.364208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36217f05-a455-4da0-a095-9b36875eb44c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.149817 Oct 04 18:07:43.364780 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 519/997] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:43.389555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.391919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.402375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.402375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.402375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.402375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.404402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.405665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.410440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:43.493568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82579517-bc2e-41d8-99f0-15466f04bc51", "name": "network-vif-deleted", "tag": "b7f7784b-a9ac-4f5e-8509-797a8a9efcfe"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:43.495785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.506299 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51d4a3e2-b569-4e8e-8e24-d853f9008252 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1292 microversion: 2.1 time: 0.123646 Oct 04 18:07:43.507263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 479/998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1292 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:43.537358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.537358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.537358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.554255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] Creating event network-vif-deleted:b7f7784b-a9ac-4f5e-8509-797a8a9efcfe for instance 82579517-bc2e-41d8-99f0-15466f04bc51 on n-h1-833090-21 Oct 04 18:07:43.581610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5780ab87-6ca7-4a69-93a2-fb95c05558cc req-420a1d32-9ced-483c-872d-cf5d21618273 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092783 Oct 04 18:07:43.583673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 520/999] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:43.592496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.595218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.605871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.607518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.608602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.609745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.610755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.611252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.874351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.885562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.888625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.889127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-476b5a13-6d87-42a4-96c9-a45f3027fecb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.324755 Oct 04 18:07:43.900184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 480/1000] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:43.938727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.939491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.942710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.943282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 152461ff-d8e9-479f-9393-23db0fab945e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.955367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.955895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.956341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.956846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.957896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.958028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.958429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.959058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.960290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.967977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.968768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.970432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.980766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] HTTP exception thrown: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Request method failure captured: Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e HTTP/1.1 Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYhbw_JKrboSyBE5hJVqN-6eN3kvVLIH_wkb9bbahNqnMNYKc8I5s56_8AuGOm4wsIesoToUJFyuPPUFbGcShlUdsMDCl-13nEnoQiWQR5LVz_EYJnPaEAQonxOGOzrMuWX6fhvAx7sWkKC7gAXJ69rGl1og_xjUFoF6VH-48ody2Y Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6e2f0b93483044ea8f9dd20340b7acdd Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:43.982669 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2f0b93483044ea8f9dd20340b7acdd"}]}] Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6e2f0b93483044ea8f9dd20340b7acdd Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminNegativeTestJSON-111785614-project Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d53e51ea1ceb4f778ea589144c3758eb Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-111785614-project Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. Oct 04 18:07:43.984257 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '152461ff-d8e9-479f-9393-23db0fab945e'} Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:43.985015 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. Oct 04 18:07:43.986203 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:43.989493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Returning 404 to user: Instance 152461ff-d8e9-479f-9393-23db0fab945e could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:43.990638 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9086312a-57a5-4791-8cfc-d4286e0e8e87 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e" status: 404 len: 111 microversion: 2.1 time: 0.052379 Oct 04 18:07:43.991793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 481/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/152461ff-d8e9-479f-9393-23db0fab945e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:44.000574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2188e62-4eb6-4270-aec8-32644cc109af tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90099c7dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.052254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.053026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.053197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2188e62-4eb6-4270-aec8-32644cc109af tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.056769 Oct 04 18:07:44.055305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.056024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lazy-loading 'fault' on Instance uuid 82579517-bc2e-41d8-99f0-15466f04bc51 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:44.062291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 482/1002] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.067948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.068460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.091158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.092102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.092693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.093545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.094005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.094433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.135875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:44.549726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447d091b94834e6188a45ba773e4477d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedc406ff3744145837933a196352fff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.564552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03e87da8-61f9-4269-914d-46c506e83e4c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 200 len: 1351 microversion: 2.1 time: 0.630833 Oct 04 18:07:44.565176 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 521/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 1351 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.571152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e78a3ed6-5fb6-4afa-ae0e-7bd239e34a2c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "DELETE /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 204 len: 0 microversion: 2.1 time: 0.507486 Oct 04 18:07:44.575066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.578270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.578489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 483/1004] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:44 2022] DELETE /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:44.584243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.584433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.584983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.585224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.597064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.598012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.598497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.598940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.604452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.605688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.606136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.610221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.610784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.611238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.727345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.742551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.762778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.763883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-741926ed-1e2a-4bb2-b585-88a6478a4c4b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.197227 Oct 04 18:07:44.764535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 522/1005] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:44.789152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.792399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.798456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.799369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.800121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.800831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.801637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.802258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.902663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.911377 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b92c6bc-f1c2-4db4-9607-eec4fad9925b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.332497 Oct 04 18:07:44.911991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 484/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.920603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.921243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:44.927410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.927974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.928413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.929119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:44.929800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:44.930234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:44.973049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.983169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01137cb6-68d3-4267-9231-8c717f656aeb tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1477 microversion: 2.1 time: 0.212819 Oct 04 18:07:44.983904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 523/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:45.068832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e114e38-e848-48a4-b1a6-8bedb55b020b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009673ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.079125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.086185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.088226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.089370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f80afd9-af1e-488f-9939-ec1a316d622c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1410 microversion: 2.25 time: 0.172601 Oct 04 18:07:45.089925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 485/1008] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1410 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:45.114387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e114e38-e848-48a4-b1a6-8bedb55b020b tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.049501 Oct 04 18:07:45.114967 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 524/1009] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:45.592602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.593937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.601264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.606271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.606271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.606271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.606657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.606657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.641072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 HTTP/1.1 Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:45.645297 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:45.647913 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '82579517-bc2e-41d8-99f0-15466f04bc51'} Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:45.648971 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:45.650573 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.652395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:45.653091 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3151bd6e-5ee1-46ea-97df-a27ab9184e0b tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 404 len: 111 microversion: 2.1 time: 0.065194 Oct 04 18:07:45.654326 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 486/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:45.663156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.663980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.676094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.676863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.677207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.677945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.678409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.678840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.710902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 HTTP/1.1 Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:45.718340 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.720011 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69'} Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:45.720986 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.722440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.723898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:45.723998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9944c09f-bcef-44d0-8574-cf2577397149 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 404 len: 111 microversion: 2.1 time: 0.065411 Oct 04 18:07:45.726629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 525/1011] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:45 2022] DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:45.735743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.737449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.746587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.749088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.753941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.755251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.758055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.762453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.789702 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 HTTP/1.1 Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:45.792354 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.793905 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69'} Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:45.794777 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:45.796190 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:45.797685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.798334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.798639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:45.799860 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-741a4aa0-2716-4a9e-b109-b7f1c7a6c69f tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 404 len: 111 microversion: 2.1 time: 0.068296 Oct 04 18:07:45.801282 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 487/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:45.811452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce53d961-2ec8-4b96-962b-f6b68e3b7f00 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '.version_select at 0x7f9009997160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.815680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.816477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.817221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.817986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.818450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.818892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.893385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce53d961-2ec8-4b96-962b-f6b68e3b7f00 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829553481" status: 202 len: 0 microversion: 2.1 time: 0.087799 Oct 04 18:07:45.895029 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 488/1013] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:07:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829553481 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:07:45.902075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-plugged", "status": "completed", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:45.919373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.919992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.920588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.938717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] Creating event network-vif-plugged:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:07:45.946207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2f87b0e6-dc7a-4131-b445-a99793e5ae2a req-fceeb04d-d2b3-4add-baec-a31fa08d83ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048973 Oct 04 18:07:45.947453 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 489/1014] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:45.956237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.973758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.975517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.976334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.980694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.992458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92fdc611-6f8d-4e78-8110-c42761ae8205 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.197153 Oct 04 18:07:45.993973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.994586 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 526/1015] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:45.995711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.996246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.997833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.998303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.998781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.010578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.013851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.047746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.047746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.047746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.052776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.054592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.055203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.301142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:46.308107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.316954 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-acf0818d-f997-4e34-8fb5-d73192a5e77a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.368068 Oct 04 18:07:46.318255 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 490/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:46.324604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.325479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.331900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.334296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.334296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.334296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.334296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.335148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.396557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.408619 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9db41b02-f6a0-46e6-9507-bcae46e93d7f tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1477 microversion: 2.1 time: 0.401768 Oct 04 18:07:46.408619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 527/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:46.412957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb7a5c3c-afdc-4ec0-895d-a4693fe60740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90096ba1f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.468298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb7a5c3c-afdc-4ec0-895d-a4693fe60740 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.058618 Oct 04 18:07:46.478349 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 528/1018] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:46.498268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.511959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.513667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.515560 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0b3a595-4ffd-4ffa-9fb9-96387c49b7bd tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1605 microversion: 2.25 time: 0.195488 Oct 04 18:07:46.517000 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 491/1019] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:46.543497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.544016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.550579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.551076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.551807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.552681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.553339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.554173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.633210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:46.644783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.645271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.645883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.659196 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] Creating event network-changed:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h1-833090-21 Oct 04 18:07:46.664130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ba080c98-b01d-47c9-9cbd-703d7e1cfcba req-9d775ac8-4b37-435c-ba7f-542b03a4b082 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038197 Oct 04 18:07:46.664792 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 492/1020] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:46.799503 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7487546-212f-4abc-bda8-443f0ef0d180 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.261338 Oct 04 18:07:46.800622 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 529/1021] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:07:47.031583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.032533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.043604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.048799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.049506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.050433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.050891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.051320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.188160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.198498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.200877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.207225 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7dc6e812-c1bf-4b6a-93ad-b2c9a6c16238 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.180630 Oct 04 18:07:47.208421 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 493/1022] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:47.342333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.343027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.349661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.350295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.351130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.352173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.353485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.354404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.429783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.430566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.442172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.442172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.442172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.442172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.442502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.442502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.634847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.648518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27219e1a-0f3a-4608-9d5c-554fd9e2d9b4 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1477 microversion: 2.1 time: 0.222577 Oct 04 18:07:47.650911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 494/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:47.656990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6cad169-e688-4f6c-8152-096f88c415f9 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900998e700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.718115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6cad169-e688-4f6c-8152-096f88c415f9 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.065832 Oct 04 18:07:47.718987 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 495/1024] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:47.777431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.787300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66a07153-05d5-42f5-a356-a8db6fb07ee6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.450454 Oct 04 18:07:47.788398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 530/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.239623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.240548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f566c06-45f8-4758-8d3b-c78c997b252d tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.241463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.257127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.257952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.259315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.260512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.261212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.261863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.371185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.392735 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f566c06-45f8-4758-8d3b-c78c997b252d tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1690840264" status: 202 len: 0 microversion: 2.1 time: 0.162218 Oct 04 18:07:48.393962 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 496/1026] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:07:48 2022] DELETE /compute/v2.1/flavors/1690840264 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:48.399061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.407706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:48.408484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.421869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.422375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e70ba6ef-492a-42af-887f-e6b93cd4a171 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1558 microversion: 2.91 time: 0.189253 Oct 04 18:07:48.422791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.423401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.425982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 531/1027] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:48.436808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e070a2d-9e6a-4446-8bac-267d841795f3 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.439169 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] Creating event network-changed:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h2-833090-21 Oct 04 18:07:48.447365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b06ed57d-287b-437e-acf2-969a0e562ca4 req-2e9cdd29-d17f-41c7-93c3-7dfdcdb94876 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050598 Oct 04 18:07:48.448261 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 497/1028] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:48.467191 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e070a2d-9e6a-4446-8bac-267d841795f3 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5401 microversion: 2.1 time: 0.039282 Oct 04 18:07:48.468155 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 532/1029] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/flavors/detail => generated 5401 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.490082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43579283-659e-4c1b-b2ae-7e816ad0a2c6 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.606063 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43579283-659e-4c1b-b2ae-7e816ad0a2c6 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/432728042" status: 202 len: 0 microversion: 2.1 time: 0.121085 Oct 04 18:07:48.610368 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 498/1030] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:07:48 2022] DELETE /compute/v2.1/flavors/432728042 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:48.621288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd2f8849-4784-4d62-9285-430cbb029854 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.658721 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd2f8849-4784-4d62-9285-430cbb029854 tempest-ServersWithSpecificFlavorTestJSON-963584126 tempest-ServersWithSpecificFlavorTestJSON-963584126-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042768 Oct 04 18:07:48.676490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 533/1031] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.694047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.704625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.712854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d11131-0a96-41d8-9e15-fb32b602331f", "name": "network-vif-deleted", "tag": "31aed3e7-7714-4f9c-bdbe-08087cf13294"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:48.722324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.724073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.728094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.729168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.730294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.731058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.731752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.732870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.733447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.761133 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] Creating event network-vif-deleted:31aed3e7-7714-4f9c-bdbe-08087cf13294 for instance 57d11131-0a96-41d8-9e15-fb32b602331f on n-h2-833090-21 Oct 04 18:07:48.767973 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6f419c9b-137b-4cac-86d9-71fcb0fb6dcd req-7b185ee5-1be9-4e00-bf3e-a7dd07eeaef5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067161 Oct 04 18:07:48.771346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 534/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:48.781173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.782373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.790201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.795080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.795080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.795080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.795421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.795421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.825803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 HTTP/1.1 Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:48.836025 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.837516 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '82579517-bc2e-41d8-99f0-15466f04bc51'} Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:48.838246 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.839575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.843099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:48.843099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8185009b-6e04-4d80-806a-31ac29c94094 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 404 len: 111 microversion: 2.1 time: 0.056405 Oct 04 18:07:48.843099 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 535/1033] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:48 2022] DELETE /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:48.843099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afa7c2ca-87fb-47c8-ba9b-85ae2ca44ff2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009d494c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.846025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:48.859221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd3c28fb-b8db-45a4-83c0-7c483cdde2b8 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1306 microversion: 2.1 time: 0.186418 Oct 04 18:07:48.859909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 499/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:48.891042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.899095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.908888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.909626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.910253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.911271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.912271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.924278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.934530 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afa7c2ca-87fb-47c8-ba9b-85ae2ca44ff2 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.099427 Oct 04 18:07:48.935181 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 536/1035] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:48.951105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.952436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: 82579517-bc2e-41d8-99f0-15466f04bc51] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.961175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.961726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.962164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.963118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.964361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.964803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.981062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 HTTP/1.1 Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:48.982686 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.984317 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '82579517-bc2e-41d8-99f0-15466f04bc51'} Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:48.985279 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. Oct 04 18:07:48.987216 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:48.990019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance 82579517-bc2e-41d8-99f0-15466f04bc51 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:48.990019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4659d15b-cac4-41e1-9177-f61e80df95a5 tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51" status: 404 len: 111 microversion: 2.1 time: 0.048096 Oct 04 18:07:49.009942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 537/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/82579517-bc2e-41d8-99f0-15466f04bc51 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:49.017249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.021163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.037962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.038655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.039103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.039880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.040495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.041347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.067946 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 HTTP/1.1 Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:49.071520 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.073324 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69'} Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:49.074103 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.075382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.079115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:49.080268 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d08228cb-db67-4ceb-a50c-9a38b04cdf4d tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 404 len: 111 microversion: 2.1 time: 0.069173 Oct 04 18:07:49.090125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 538/1037] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:49 2022] DELETE /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:49.096151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.096808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] [instance: ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.103623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.104165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.104656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.106188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.106188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.106413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.140797 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] HTTP exception thrown: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Request method failure captured: Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 HTTP/1.1 Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHWkRL5QonSjDAZiHD_iyrHgLwz92FnfWi23G7VtAaSuEKx993ea93hBgQ6bbcgMBnrGszMcPCNDyB047a_570ZpHNhQNleTCAYcf4-vDa9CwylXjVEnADNBbPfvUuyQKtPADzTPWNgendap5HHHY3FGz8IcrDE8wHskLJIjoEwoQ3E Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:07:49.145100 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fedc406ff3744145837933a196352fff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fedc406ff3744145837933a196352fff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fedc406ff3744145837933a196352fff"}]}] Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fedc406ff3744145837933a196352fff Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351 Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 447d091b94834e6188a45ba773e4477d Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1209237351-project Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.147028 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69'} Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:49.147944 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. Oct 04 18:07:49.149729 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:07:49.151324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] Returning 404 to user: Instance ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:49.151324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9f2b9b84-f820-4f84-8a01-a3c1e607ab5c tempest-ServersWithSpecificFlavorTestJSON-1209237351 tempest-ServersWithSpecificFlavorTestJSON-1209237351-project] 10.222.0.40 "GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69" status: 404 len: 111 microversion: 2.1 time: 0.055044 Oct 04 18:07:49.154283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 539/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/ffd90e4f-0bbd-4cb8-a28a-0e5cf24abc69 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:49.214796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.230005 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d389d56a-8825-43e8-bc1b-7e9c7d6fb8c6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.349209 Oct 04 18:07:49.233029 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 500/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.452465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.458111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.466474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.466881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.467405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.472158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.472927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.473559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.886647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.888023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.897443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.898503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.901630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.903783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.905570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.906232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.996962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.000089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.000784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.003045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lazy-loading 'fault' on Instance uuid 57d11131-0a96-41d8-9e15-fb32b602331f {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:50.018067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.048530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.053661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.060511 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3594b06b-be26-4e46-8465-04e1b2e4d62f tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1558 microversion: 2.91 time: 0.614238 Oct 04 18:07:50.062605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 540/1040] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1558 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:50.068208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-261ba0d4-faa9-4c93-9e3d-f304a2763ca5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90098f14c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.072034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=38 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:50.107211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53e51ea1ceb4f778ea589144c3758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2f0b93483044ea8f9dd20340b7acdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.115892 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e45c9fbe-3387-4532-a8ff-0d49216ed38c tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 200 len: 1311 microversion: 2.1 time: 0.233385 Oct 04 18:07:50.121584 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 501/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:50.140080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-261ba0d4-faa9-4c93-9e3d-f304a2763ca5 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.075983 Oct 04 18:07:50.140672 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 541/1042] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:50.259668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.260604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.272251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.272608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.275802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.276938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.278825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.282403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.558431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:50.560940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:50.576645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8e58f9b-1b5c-4406-a470-9feb081c37c5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.322136 Oct 04 18:07:50.583831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 502/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:51.094616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.096069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.117120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.121501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.122254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.125415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.126144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.130651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.147189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.157009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] [instance: 57d11131-0a96-41d8-9e15-fb32b602331f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.176203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.177054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.179306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.182509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.191125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.192229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.238211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] HTTP exception thrown: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Request method failure captured: Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f HTTP/1.1 Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYhbw_JKrboSyBE5hJVqN-6eN3kvVLIH_wkb9bbahNqnMNYKc8I5s56_8AuGOm4wsIesoToUJFyuPPUFbGcShlUdsMDCl-13nEnoQiWQR5LVz_EYJnPaEAQonxOGOzrMuWX6fhvAx7sWkKC7gAXJ69rGl1og_xjUFoF6VH-48ody2Y Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6e2f0b93483044ea8f9dd20340b7acdd Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:07:51.253301 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2f0b93483044ea8f9dd20340b7acdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2f0b93483044ea8f9dd20340b7acdd"}]}] Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6e2f0b93483044ea8f9dd20340b7acdd Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-111785614 Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminNegativeTestJSON-111785614-project Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d53e51ea1ceb4f778ea589144c3758eb Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-111785614-project Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. Oct 04 18:07:51.255006 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '57d11131-0a96-41d8-9e15-fb32b602331f'} Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:51.255767 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. Oct 04 18:07:51.256926 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:07:51.269504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] Returning 404 to user: Instance 57d11131-0a96-41d8-9e15-fb32b602331f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:51.270874 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a459285-ef11-4a34-8cb8-6bfcca4c88b2 tempest-ServersAdminNegativeTestJSON-111785614 tempest-ServersAdminNegativeTestJSON-111785614-project] 10.222.0.40 "GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f" status: 404 len: 111 microversion: 2.1 time: 0.127504 Oct 04 18:07:51.272417 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 503/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/57d11131-0a96-41d8-9e15-fb32b602331f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:51.281310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5784fea-ee17-4b6d-81f2-589bbe114d7c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f900a572670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.393808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.416486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.418142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.433527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eddbd938-ebf9-431d-9285-1b853926dc18 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.344602 Oct 04 18:07:51.434144 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 542/1045] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:51.602577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.603191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.612650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:51.620337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.620951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.625147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.629021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.629780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.630290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.768440 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5784fea-ee17-4b6d-81f2-589bbe114d7c tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1428 microversion: 2.1 time: 0.494626 Oct 04 18:07:51.769406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 504/1046] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1428 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.472209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.472809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.500508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.500920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.501869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.504603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.506044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.506566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.691189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.708256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.714050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.729908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b70f40f4-66bf-4084-8d26-856abf9125ce tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.263166 Oct 04 18:07:52.730892 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 505/1047] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:07:52.787120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20a50f0a-ff08-4fbf-aa31-2bd883282ab3 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009bcbca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.817506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.838529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f11a1635-8db5-4968-aad0-8914c9f0c435 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 1.239816 Oct 04 18:07:52.841574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 543/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:53.769354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:53.769755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:53.789022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.791954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.792679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:53.801162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:53.802852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:53.803544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.264624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.283103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.290300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.304587 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1743b0fc-9003-4a50-8a99-94a9586ea627 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.541666 Oct 04 18:07:54.307000 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 544/1049] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:53 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:54.318897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.321408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.337664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.340813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.341517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.345820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.347656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.348406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.727687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.741549 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbcdd066-3004-4eba-92fb-d0e0027e0249 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 0.433048 Oct 04 18:07:54.744196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 545/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:55.339391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.341042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.360125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.364104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.368342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.370579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.371386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.375801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.780753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.793904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.808647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.828422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82d84d5f-109a-46ba-9437-aaa8a4e0a61c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.493688 Oct 04 18:07:55.833071 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 546/1051] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:55.850841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.852608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:55.873078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:55.879407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.880363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.883675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.884710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.887772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.890685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.895752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:57.570286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.584005 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-331d5508-da92-40c5-a94e-f96cafdc49f5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 1.746511 Oct 04 18:07:57.585459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 547/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.611109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.611907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.629316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.629824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.630269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.631025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.631512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.631928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.836532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.852621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.865771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.904359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5fa9b49a-e747-46f4-87da-3cad5adc55bb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.317311 Oct 04 18:07:57.907885 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 548/1053] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:58.611584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.612240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.631369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.644637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.645341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.646276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.647432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.648116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.697670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.716805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c350c698-1f6f-415c-97b7-103694488c86 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 1.112607 Oct 04 18:07:59.721579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 549/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:59.733287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.746953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.768785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.772275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.774902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.778379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.780007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.781519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.047456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.062682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.067449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.076458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5959379-95cf-45ff-b4b1-a1c2c79559e4 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.353511 Oct 04 18:08:00.078629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 550/1055] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:00.378153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "name": "network-vif-plugged", "status": "completed", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:00.401495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.407115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.407115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.427742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] Creating event network-vif-plugged:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h1-833090-21 Oct 04 18:08:00.436684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6edd2f03-130a-4a14-9a7d-da3aa350a4d6 req-2db6befa-d06b-467a-8213-5412eda6d36e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064129 Oct 04 18:08:00.438248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 551/1056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:00.756348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.757081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.825575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.826319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.826788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.827595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.828074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.828510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.161211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.188502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebf74742-edf5-460b-8ea8-bb0261880412 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 1.444996 Oct 04 18:08:02.191064 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 552/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:02.202906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.205052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.223076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.227044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.227701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.228479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.233959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.234591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.721108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:02.864777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.874940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.876494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.904119 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40f47611-54c6-4c17-8148-78c8129e3cf3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.711366 Oct 04 18:08:02.905615 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 553/1058] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:02.932076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:03.281753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.281753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.281753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.281753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.282429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.282635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.288183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.402244 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8b57f8d-ef86-42f1-86b0-dc45cff3731e tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.495348 Oct 04 18:08:03.417961 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 554/1059] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/os-services => generated 949 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:03.430750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.431362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.453224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.453748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.454190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.454913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.455371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.455831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.928382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.945412 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9f7eeca9-a46d-41ec-8813-c7ed17ec1762 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1359 microversion: 2.1 time: 1.526196 Oct 04 18:08:04.950483 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 555/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1359 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:04.955291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.975033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.979709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.983975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.985218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.986094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.986781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.068287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b93c46b2-e5cd-4c38-a057-e3b633bc531d tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-833090-21" status: 200 len: 581 microversion: 2.1 time: 0.116467 Oct 04 18:08:05.081534 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 556/1061] 10.222.0.40 () {58 vars in 1174 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/os-services?host=n-d-833090-21 => generated 581 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:05.089277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.092446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.106974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.110352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.112090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.114939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.118179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.119381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.327031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.349065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.356879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.375117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-002942f8-59b9-44e4-ad4f-24d34b63feee tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.290921 Oct 04 18:08:05.377032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 557/1062] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:05.400949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.402400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.403319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.403952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.412338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.414375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.415065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.503813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e035447-a758-426b-9890-30e393c0fe83 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.124706 Oct 04 18:08:05.504555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 558/1063] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:05.522146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.526952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.527665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.528237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.529179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.530969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.531550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.570274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79332de2-1d72-4f07-9a56-1c9e04dab443 tempest-ServicesAdminTestJSON-1445613360 tempest-ServicesAdminTestJSON-1445613360-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.052250 Oct 04 18:08:05.576859 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 559/1064] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:05.980988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.983379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.996486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.997702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.998771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.008387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.009733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.010908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.237253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.257846 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1fa1d5b-acd3-41c2-9497-db4e213b1abf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1542 microversion: 2.1 time: 1.284281 Oct 04 18:08:07.258538 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 560/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1542 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:07.273494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.274868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.291863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.292901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.293580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.297426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.297426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.297426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.650486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.736198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.736198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.736198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d976a0c0-001e-488b-9069-8d1520b30a9e tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.430027 Oct 04 18:08:07.736553 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 561/1066] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:07.736553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.736553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.736553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.736553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.736894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.736894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.736894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.736894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.954576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75caf674-2e07-47e5-ab8e-9cd3a39b0860 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259038 Oct 04 18:08:07.955948 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 562/1067] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:08.741891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:08.742523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:08.760033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.764136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.766539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.767343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.767864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.768311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.465946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.481524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.487055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.501911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f565dbd3-28d9-4332-8e29-c966c1ac50cf tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.764409 Oct 04 18:08:09.503387 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 563/1068] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:08 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:10.536944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:10.538818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:10.554582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.560698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.563524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.567044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.570465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.573114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.926630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.940181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.941888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.968674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62aade17-8cf6-4c15-8176-06292c5cb5a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.432957 Oct 04 18:08:10.969965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 564/1069] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:10 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:12.002316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:12.003503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:12.030895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.030895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.030895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.046663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.047171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.054306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.457422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.466756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.473338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.486169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60473f58-945c-4883-a558-b232fb404797 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.489206 Oct 04 18:08:12.487041 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 565/1070] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:13.369312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff7425bc-f370-432e-8639-79eb01bd9454 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Action: 'create', calling method: .version_select at 0x7f90096895e0>, body: {"pool": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:15.543963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:16.968508 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20a50f0a-ff08-4fbf-aa31-2bd883282ab3 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1437 microversion: 2.1 time: 24.185554 Oct 04 18:08:16.986633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 506/1071] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1437 bytes in 24200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:16.989256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:17.039917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.042743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.045098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.081024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] Creating event network-changed:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h1-833090-21 Oct 04 18:08:17.089291 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-10a3e53d-3438-4756-a2f7-15800dc64210 req-72c3afc8-0144-4bde-9202-ccd20327813d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106230 Oct 04 18:08:17.090016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 507/1072] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:17.096571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.097357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.109502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.110040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.118699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.119831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.121879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.122511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.243137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff7425bc-f370-432e-8639-79eb01bd9454 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.120802 Oct 04 18:08:17.244106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 566/1073] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:08:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:17.249733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1139515450", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "163ed567-c199-4e78-b123-61d7104165d3"}, {"uuid": "ff353dd2-3d9b-43a2-87aa-c15ea67b38bf"}, {"uuid": "163ed567-c199-4e78-b123-61d7104165d3"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:17.366601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.394511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.396126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.405509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] validate_networks() for [('163ed567-c199-4e78-b123-61d7104165d3', None, None, None, None, None), ('ff353dd2-3d9b-43a2-87aa-c15ea67b38bf', None, None, None, None, None), ('163ed567-c199-4e78-b123-61d7104165d3', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:17.419211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56a66081-6071-4ef2-a1cf-3bb9588a8a54 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1553 microversion: 2.91 time: 0.327646 Oct 04 18:08:17.421152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 508/1074] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:17.427073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62d939ce-7f23-4141-8109-fbf3bc63eed6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90098fcf70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.496973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62d939ce-7f23-4141-8109-fbf3bc63eed6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 200 len: 1437 microversion: 2.1 time: 0.074454 Oct 04 18:08:17.503978 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 509/1075] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:17.515868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1019c361-5fb5-4d54-a236-48e07abf7d11 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Action: 'create', calling method: .version_select at 0x7f90098ed310>, body: {"pool": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:19.539076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:19.540178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:19.540855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:19.541342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:19.542032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:19.555900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.556452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.557095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.558051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.558708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.559783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.594746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Getting quotas for project db7e35a897f64e069255d3946bbb22f5. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:19.602452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Getting quotas for user 7a0a0453d12e41ff87520a0a6735ce20 and project db7e35a897f64e069255d3946bbb22f5. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:19.618818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:19.621948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:19.809754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fae98ff7-3654-42e6-9b23-294976b70695 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.564355 Oct 04 18:08:19.810814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 567/1076] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:19.815696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:19.816410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.823268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.823910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.824343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.826817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.826817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.826817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.133223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.146641 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dac9ed9f-3efd-402e-a872-bd44ddc49be0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1466 microversion: 2.1 time: 0.334210 Oct 04 18:08:20.149463 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 568/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1466 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.152539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.153176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.159393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.159948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.160450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.161156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.161646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.162035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.169979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:20.260192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.270753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.272946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.281579 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-014f4df6-d35c-42ae-b11a-69f3c703beca tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1535 microversion: 2.91 time: 0.131154 Oct 04 18:08:20.282678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 569/1078] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1535 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:20.519303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9713db42-d460-4dfd-b9ab-c0dcddc5b1b7 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-85274083", "id": 1267977460, "os-flavor-access:is_public": "False"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:20.678793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9713db42-d460-4dfd-b9ab-c0dcddc5b1b7 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.394376 Oct 04 18:08:20.680588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 570/1079] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:20 2022] POST /compute/v2.1/flavors => generated 429 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:20.743381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Action: 'update', calling method: .version_select at 0x7f9009649af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:20.755160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.755160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.755160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.758648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.759204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.759817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.767580 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] HTTP exception thrown: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Request method failure captured: Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d HTTP/1.1 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 56 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHaTJo_v6lzB93JokD1b4LSYbq-xYhiUPJvkT3hOAvJ0hia6xA0LpbBRQSSyZFTC-807heIEHd4sM4QiMDJWBHrTgU695-KSBbRqmi_BRzoBUMuAnIqK9xJ1LA_MTg3B2mKwil5doW5siGS3wEBDXratGMq1BjlJaYuN2h57OVZUFO0 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:08:20.770089 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78e6d2039d4d412791ce04fd5ae4a8ad"}]}] Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 26c1d253fbff415ba203b70da7b2af60 Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:20.772156 n-d-833090-21 devstack@n-api.service[123887]: exception: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a772bc9b-79e6-4aeb-b525-33e07d1f173d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.773169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:20.774682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:20.776274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:20.776274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:20.776274 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:20.776274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Returning 404 to user: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:20.776274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-664d1355-16e0-4e6e-b39d-6d5e655d9aee tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d" status: 404 len: 110 microversion: 2.53 time: 0.091706 Oct 04 18:08:20.778920 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 571/1080] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 4 18:08:20 2022] PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d => generated 110 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:20.785746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a4429a0-55ae-44a7-bf67-40134ed27118 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.786363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6a4429a0-55ae-44a7-bf67-40134ed27118 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.807753 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1019c361-5fb5-4d54-a236-48e07abf7d11 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.307479 Oct 04 18:08:20.815831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 510/1081] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:08:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:20.815831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73a2146d-9d40-4124-8071-129884a71e93 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f90098e7040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.866961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6a4429a0-55ae-44a7-bf67-40134ed27118 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.874813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a4429a0-55ae-44a7-bf67-40134ed27118 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1213 microversion: 2.1 time: 0.093165 Oct 04 18:08:20.875382 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 572/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.880959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1cc9dde-af37-42f0-a77c-cb5bd9dfb7aa tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "310f890ba63b4d9eabd47c6d5c3a54d9"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:21.100031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1cc9dde-af37-42f0-a77c-cb5bd9dfb7aa tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1267977460/action" status: 200 len: 97 microversion: 2.1 time: 0.220645 Oct 04 18:08:21.100031 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 573/1083] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:08:20 2022] POST /compute/v2.1/flavors/1267977460/action => generated 97 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:21.104942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Action: 'update', calling method: .version_select at 0x7f90095e0280>, body: {"status": "disabled"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:21.110307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.110808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.111249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.119176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.119906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.120588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.126829 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] HTTP exception thrown: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Request method failure captured: Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d HTTP/1.1 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 22 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHaTJo_v6lzB93JokD1b4LSYbq-xYhiUPJvkT3hOAvJ0hia6xA0LpbBRQSSyZFTC-807heIEHd4sM4QiMDJWBHrTgU695-KSBbRqmi_BRzoBUMuAnIqK9xJ1LA_MTg3B2mKwil5doW5siGS3wEBDXratGMq1BjlJaYuN2h57OVZUFO0 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:08:21.129419 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78e6d2039d4d412791ce04fd5ae4a8ad"}]}] Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 26c1d253fbff415ba203b70da7b2af60 Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: {"status": "disabled"} Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: exception: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:21.131194 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a772bc9b-79e6-4aeb-b525-33e07d1f173d', 'body': {'status': 'disabled'}} Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.132441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:21.134325 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:21.135510 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:21.135510 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.135510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Returning 404 to user: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:21.135510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-11cd8aac-4543-47b6-99b9-0160bacaef44 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d" status: 404 len: 110 microversion: 2.53 time: 0.032024 Oct 04 18:08:21.135510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 574/1084] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 4 18:08:21 2022] PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:21.137138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac5f47d0-988d-49be-8022-98ba04cfb70f tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Action: 'create', calling method: .version_select at 0x7f900967c3a0>, body: {"pool": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:22.402158 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73a2146d-9d40-4124-8071-129884a71e93 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "DELETE /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246" status: 204 len: 0 microversion: 2.1 time: 1.591687 Oct 04 18:08:22.403361 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 511/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:20 2022] DELETE /compute/v2.1/images/7a363d90-8daa-4468-b051-a85170ecf246 => generated 0 bytes in 1594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:22.519115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f755c06-04ec-4801-9188-de0c0559086e tempest-FlavorsAccessTestJSON-1004056926 tempest-FlavorsAccessTestJSON-1004056926-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.542144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f755c06-04ec-4801-9188-de0c0559086e tempest-FlavorsAccessTestJSON-1004056926 tempest-FlavorsAccessTestJSON-1004056926-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.137593 Oct 04 18:08:22.542758 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 512/1086] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:22.561262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Action: 'update', calling method: .version_select at 0x7f900a0fce50>, body: {"status": "enabled"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:22.565017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.565729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.566174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.574529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.575022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.575574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.582572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] HTTP exception thrown: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Request method failure captured: Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d HTTP/1.1 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 21 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaTJo_v6lzB93JokD1b4LSYbq-xYhiUPJvkT3hOAvJ0hia6xA0LpbBRQSSyZFTC-807heIEHd4sM4QiMDJWBHrTgU695-KSBbRqmi_BRzoBUMuAnIqK9xJ1LA_MTg3B2mKwil5doW5siGS3wEBDXratGMq1BjlJaYuN2h57OVZUFO0 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:08:22.584370 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/78e6d2039d4d412791ce04fd5ae4a8ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/78e6d2039d4d412791ce04fd5ae4a8ad"}]}] Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 78e6d2039d4d412791ce04fd5ae4a8ad Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290 Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 26c1d253fbff415ba203b70da7b2af60 Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: {"status": "enabled"} Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: exception: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:22.585963 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a772bc9b-79e6-4aeb-b525-33e07d1f173d', 'body': {'status': 'enabled'}} Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.586832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:22.588258 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:22.589540 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. Oct 04 18:08:22.589540 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.589540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Returning 404 to user: Service a772bc9b-79e6-4aeb-b525-33e07d1f173d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:22.589540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7866ce35-b50e-42ba-b963-9b7beda58be9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d" status: 404 len: 110 microversion: 2.53 time: 0.041906 Oct 04 18:08:22.590632 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 513/1087] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 4 18:08:22 2022] PUT /compute/v2.1/os-services/a772bc9b-79e6-4aeb-b525-33e07d1f173d => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:22.597953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.598574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.608990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.608990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.608990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.608990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.609326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.609326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.696322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:22.704775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:22.706323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:22.712483 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9363cc17-269a-4e74-a58b-8a8398a5d8da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1478 microversion: 2.91 time: 0.120786 Oct 04 18:08:22.723524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 514/1088] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1478 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:22.723524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-unplugged", "status": "completed", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:22.727892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.728386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.734660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.741097 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] Creating event network-vif-unplugged:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:08:22.746089 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fe278ef9-c636-4385-aff1-e2f98f7ffd5c req-de0738e4-f0a5-4520-94f5-256cb0c2e301 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031606 Oct 04 18:08:22.746682 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 515/1089] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:22.752140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.752849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.760015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.760507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.760946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.761648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.762109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.762538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.827547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:22.835082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a90f3782-3d2c-4579-9498-34adb9be5d54 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1265 microversion: 2.1 time: 0.087283 Oct 04 18:08:22.835911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 516/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:22.840363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bcb8617-8913-4851-ad23-cf0ca1bf8be6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '.version_select at 0x7f9009bcbca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.898077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7bcb8617-8913-4851-ad23-cf0ca1bf8be6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] HTTP exception thrown: Image not found. Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bcb8617-8913-4851-ad23-cf0ca1bf8be6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Request method failure captured: Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 HTTP/1.1 Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYi98sFL_Zcis_ibIjCYx1ladt00PuP3hHxdDo43m6tVZ8CfmBYh65Jjca1YLTJRo1cWfR9ZIeq7W60jevmCoB42kQC3EZk4bLyJ8zUNn3B9UVsyoAa9hfX6eQs_zf8ExTkohZj5GQp53FOebmWtbkyh4zs3QBDHfFYWYc3-p847nE Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:22.900376 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f71b036680f9444bae3d0e89ea8ea81c"}]}] Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 07c5df6fbd0b4aa3aa4e3db55ca35360 Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '402f9f23-b474-45b7-ba92-b4257f3b8287'} Oct 04 18:08:22.902126 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 402f9f23-b474-45b7-ba92-b4257f3b8287 to delete Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.902908 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 402f9f23-b474-45b7-ba92-b4257f3b8287 could not be found. Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:22.905964 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bcb8617-8913-4851-ad23-cf0ca1bf8be6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:22.907920 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7bcb8617-8913-4851-ad23-cf0ca1bf8be6 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "DELETE /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287" status: 404 len: 62 microversion: 2.1 time: 0.065189 Oct 04 18:08:22.909040 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 517/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:22 2022] DELETE /compute/v2.1/images/402f9f23-b474-45b7-ba92-b4257f3b8287 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:22.910507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7834a8bc-2a63-4043-968c-657985c08033 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "310f890ba63b4d9eabd47c6d5c3a54d9"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:23.050136 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac5f47d0-988d-49be-8022-98ba04cfb70f tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.917115 Oct 04 18:08:23.050791 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 575/1092] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:08:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:23.059099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.062687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.063961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.064408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.065935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.066461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.066913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.080134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:23.086937 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7834a8bc-2a63-4043-968c-657985c08033 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1267977460/action" status: 200 len: 21 microversion: 2.1 time: 0.183482 Oct 04 18:08:23.087679 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 518/1093] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 4 18:08:22 2022] POST /compute/v2.1/flavors/1267977460/action => generated 21 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:23.091017 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9b30921-07c7-4559-b62e-737b83098271 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038891 Oct 04 18:08:23.098185 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 576/1094] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.098324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:23.098324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.102358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.102881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.103410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.104078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.104204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.104700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.104808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.105131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.110890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.111357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.111817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.112510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.112960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.113606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.147769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-833090-21". {{(pid=123886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:08:23.148107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:23.445114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-560325b2-9fab-4545-b5c5-ecbbab76fdba tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action" status: 202 len: 0 microversion: 2.91 time: 0.355958 Oct 04 18:08:23.451006 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 519/1095] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:08:23 2022] POST /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:23.460192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dce6c31a-f766-4f82-9357-afa8a2d9ecc0 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Action: 'create', calling method: .version_select at 0x7f90099e04c0>, body: {"pool": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:23.554001 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b9c8089-352d-4cc2-a439-da08d376754d tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 204 len: 0 microversion: 2.1 time: 0.453012 Oct 04 18:08:23.556482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 577/1096] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:23 2022] DELETE /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:23.572728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d823ea14-a554-4cd4-b9ca-fde0f9fcad6a tempest-FlavorsAccessTestJSON-1004056926 tempest-FlavorsAccessTestJSON-1004056926-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.602658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d823ea14-a554-4cd4-b9ca-fde0f9fcad6a tempest-FlavorsAccessTestJSON-1004056926 tempest-FlavorsAccessTestJSON-1004056926-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043750 Oct 04 18:08:23.603256 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 578/1097] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.624616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.628383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.629029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.630028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.630798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.631247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.631714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.657573 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d2d9467-d572-4f00-a4d9-a5373b15fc4d tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036243 Oct 04 18:08:23.658159 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 579/1098] 10.222.0.40 () {60 vars in 1211 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.663388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.668134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.670411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.670891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.671322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.672043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.672489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.672962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.744399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.753563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.754997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.760805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-56a1cf56-c1dd-4751-8eb5-d5b157bc5417 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1486 microversion: 2.91 time: 0.101688 Oct 04 18:08:23.761383 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 580/1099] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1486 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.765911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.766516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.772925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.773404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.773835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.774523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.774975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.775398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.917626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.925799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c2b2c30f-5316-4a9c-bf66-855e4d6c41b0 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1472 microversion: 2.1 time: 0.163420 Oct 04 18:08:23.926384 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 581/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.930766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15620e2e-5adc-45cb-9f47-fcffcfe17c76 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.013225 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15620e2e-5adc-45cb-9f47-fcffcfe17c76 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1267977460" status: 202 len: 0 microversion: 2.1 time: 0.085690 Oct 04 18:08:24.013970 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 582/1101] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:08:23 2022] DELETE /compute/v2.1/flavors/1267977460 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:24.019180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.023800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.024392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.024911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.025728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.026320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.026867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.053625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54007f75-5110-4ac6-a3bc-30f627d12bc9 tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038501 Oct 04 18:08:24.054358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 583/1102] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:24.059331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.060068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.066889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.067386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.068513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.069225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.069692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.070120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.136290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.144649 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ab8e1ba-4876-4428-9425-848e733b28f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1271 microversion: 2.1 time: 0.089136 Oct 04 18:08:24.145248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 584/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.150022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a55e5fa8-beab-4d06-8bff-d50666dd83cd tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.170907 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a55e5fa8-beab-4d06-8bff-d50666dd83cd tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024315 Oct 04 18:08:24.171432 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 585/1104] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.176235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.180469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.180965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.181425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.182163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.182618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.183043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.207674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92bfb58a-f12d-4917-bec4-a9ee1a8cce0a tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-833090-21&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034998 Oct 04 18:08:24.208323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 586/1105] 10.222.0.40 () {60 vars in 1237 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/os-services?host=n-d-833090-21&binary=xxx => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.212971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0b10d18-aa1d-4ac2-854f-fc13c45474a9 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-187239784", "id": 2059599547, "os-flavor-access:is_public": "False"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:24.295505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0b10d18-aa1d-4ac2-854f-fc13c45474a9 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.085793 Oct 04 18:08:24.296919 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 587/1106] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:24.301639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.306846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.307653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.308259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.308991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.309442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.309863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.335255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f48b860-65d3-465d-8fab-8434c3170d3c tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.037261 Oct 04 18:08:24.336260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 588/1107] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:24.341049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be29a14f-d609-4799-8952-2ff34af18e66 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.353330 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be29a14f-d609-4799-8952-2ff34af18e66 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/2059599547/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.015961 Oct 04 18:08:24.354247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 589/1108] 10.222.0.40 () {58 vars in 1209 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/flavors/2059599547/os-flavor-access => generated 21 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:24.358867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.362696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.363435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.364141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.365544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.366162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.366741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.392169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d0bcff-c04e-47d7-a375-41202dbde12e tempest-ServicesAdminNegativeV253TestJSON-1557953290 tempest-ServicesAdminNegativeV253TestJSON-1557953290-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036726 Oct 04 18:08:24.392872 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 590/1109] 10.222.0.40 () {60 vars in 1239 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.405727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b11eb33d-ff76-4e01-a6a4-9a6542a213e0 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.488709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b11eb33d-ff76-4e01-a6a4-9a6542a213e0 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2059599547" status: 202 len: 0 microversion: 2.1 time: 0.094547 Oct 04 18:08:24.489337 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 591/1110] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:08:24 2022] DELETE /compute/v2.1/flavors/2059599547 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:24.606818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-271db5ff-5df3-45e7-b712-4cae5e61ba87 tempest-ServicesAdminNegativeV253TestJSON-832575716 tempest-ServicesAdminNegativeV253TestJSON-832575716-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.610280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-271db5ff-5df3-45e7-b712-4cae5e61ba87 tempest-ServicesAdminNegativeV253TestJSON-832575716 tempest-ServicesAdminNegativeV253TestJSON-832575716-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '58484e3ef1c84da6a02faeb089ded2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f42794987744e149ac420838fdee7b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-271db5ff-5df3-45e7-b712-4cae5e61ba87 tempest-ServicesAdminNegativeV253TestJSON-832575716 tempest-ServicesAdminNegativeV253TestJSON-832575716-project] Request method failure captured: Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHaRZYQP8QcEHGR7KoL6SwYlrnTYaTxk174B3gAoNxPE9qscHTll5kABhLmMgonu_y0lSFHAozqIzqHQIMYkiDpKzHA4sF7rU6ZCVAs1KU-axJbDXHHF6F00kyqxr3N3agyg2lgXsFNTu8Y1eFYcJ_n9s9swnfXv6VMp9-xTVyaYN3g Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7f42794987744e149ac420838fdee7b0 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-832575716 Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:24.612274 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f42794987744e149ac420838fdee7b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f42794987744e149ac420838fdee7b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f42794987744e149ac420838fdee7b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f42794987744e149ac420838fdee7b0"}]}] Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-832575716 Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7f42794987744e149ac420838fdee7b0 Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-832575716 Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServicesAdminNegativeV253TestJSON-832575716-project Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 58484e3ef1c84da6a02faeb089ded2f8 Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-832575716-project Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:08:24.613976 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:08:24.615956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 18:08:24.617702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:24.619391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-271db5ff-5df3-45e7-b712-4cae5e61ba87 tempest-ServicesAdminNegativeV253TestJSON-832575716 tempest-ServicesAdminNegativeV253TestJSON-832575716-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:24.619391 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-271db5ff-5df3-45e7-b712-4cae5e61ba87 tempest-ServicesAdminNegativeV253TestJSON-832575716 tempest-ServicesAdminNegativeV253TestJSON-832575716-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.122759 Oct 04 18:08:24.619391 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 592/1111] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:24.625033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04b598a7-9c12-4ac8-a2a1-6f4a06ed7687 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.644679 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04b598a7-9c12-4ac8-a2a1-6f4a06ed7687 tempest-FlavorsAccessTestJSON-6410466 tempest-FlavorsAccessTestJSON-6410466-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027976 Oct 04 18:08:24.645261 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 593/1112] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:24.794460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.795325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.808879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.809518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.810065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.811000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.811783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.812617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.886631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.896329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.897884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:24.903246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35e02da3-f10b-45de-b5cd-2c746bd8487d tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1486 microversion: 2.91 time: 0.113649 Oct 04 18:08:24.903874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 594/1113] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1486 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:24.951768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.952395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.959862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.960453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.961329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.962109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.962577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.963001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.134256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.143664 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6bb3bbac-d515-453e-9e87-677bf760af82 tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1472 microversion: 2.1 time: 0.197455 Oct 04 18:08:25.144258 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 595/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.170091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.170713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.179735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.180648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.181121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.182111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.182584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.183018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.361806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.371714 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbbdc291-d983-4fc1-b73b-3284de814222 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1313 microversion: 2.1 time: 0.205120 Oct 04 18:08:25.374173 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 596/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.934770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.935871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.942599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.943221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.943695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.944593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.945063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.945492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.122364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.136413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.145513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.155512 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1db5fb33-7d1b-41a1-a272-85f74f95898a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1488 microversion: 2.91 time: 0.225482 Oct 04 18:08:26.156966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 597/1116] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1488 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:26.190585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.194199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.205820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.207194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.208339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.210058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.211247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.212218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.575088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.584176 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-268861c0-cfe1-48a2-9783-11e3dc2f77ff tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1472 microversion: 2.1 time: 0.404960 Oct 04 18:08:26.585145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 598/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.605352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.606458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.613946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.614443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.615073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.616070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.616645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.617075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.988148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dce6c31a-f766-4f82-9357-afa8a2d9ecc0 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.535663 Oct 04 18:08:26.989444 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 520/1118] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:08:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:26.999108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.005049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d079d6b5-7b39-4161-b47a-6b1d97fa240b tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f9009f25160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.006141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3e353c56-8e15-4fee-94f5-ed78fa0efdcb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1334 microversion: 2.1 time: 0.419491 Oct 04 18:08:27.008437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 599/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1334 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.191032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f95b6c6-3024-45a5-967c-2d78c0ce9562", "name": "network-vif-deleted", "tag": "682ffc6c-8293-40d2-b07b-c10e28b15b07"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:27.202764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.203536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.205492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.222759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] Creating event network-vif-deleted:682ffc6c-8293-40d2-b07b-c10e28b15b07 for instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 on n-h2-833090-21 Oct 04 18:08:27.232059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-61365da4-9c95-4afd-a77c-a06dbdc8a3d3 req-11646f2c-0da6-488b-acc3-08e5fb9ee910 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045997 Oct 04 18:08:27.246238 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 600/1120] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:27.246238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.249340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.265897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.267440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.268033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.268828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.269617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.270113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.349591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.358434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.359900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.365112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8794200f-b489-4b5a-9b61-ad2328e73c6a tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.126200 Oct 04 18:08:27.366055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 601/1121] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:27.368334 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d079d6b5-7b39-4161-b47a-6b1d97fa240b tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/f8445ab5-56d8-4838-a0ea-4dd6134d6fe0" status: 200 len: 142 microversion: 2.1 time: 0.367505 Oct 04 18:08:27.369402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 521/1122] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/os-floating-ips/f8445ab5-56d8-4838-a0ea-4dd6134d6fe0 => generated 142 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:27.392121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdae4445-798b-48fa-b43f-167d20f6c292 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f9009649820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.645168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.646429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.652780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.653273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.653708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.654413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.657654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.658109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.691853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.692854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.693299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.693756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lazy-loading 'fault' on Instance uuid 2f95b6c6-3024-45a5-967c-2d78c0ce9562 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:27.775630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c5df6fbd0b4aa3aa4e3db55ca35360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71b036680f9444bae3d0e89ea8ea81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.799643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10e72f6c-64d1-4b09-bdf0-94c1f424301f tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 200 len: 1306 microversion: 2.1 time: 0.155625 Oct 04 18:08:27.818188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 522/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 1306 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:28.035021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.035514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.045067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.047181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.047665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.048391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.049680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.056067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.467764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.500823 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1aa96b52-c35a-4840-8020-05c750faebd8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.467333 Oct 04 18:08:28.503979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 523/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:28.531735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.536092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.580780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.583755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.584482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.587582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.589279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.590066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.744474 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdae4445-798b-48fa-b43f-167d20f6c292 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/f8445ab5-56d8-4838-a0ea-4dd6134d6fe0" status: 202 len: 0 microversion: 2.1 time: 1.359167 Oct 04 18:08:28.751909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 602/1125] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:08:27 2022] DELETE /compute/v2.1/os-floating-ips/f8445ab5-56d8-4838-a0ea-4dd6134d6fe0 => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:28.763646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf890b52-7912-4cdd-b16a-919a61e2884e tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f90096739d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.852889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.863286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.865341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.885127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c98fc9fe-ddac-4f32-9cca-4962768e9fa3 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.378301 Oct 04 18:08:28.900377 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 524/1126] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:28.915369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.918077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] [instance: 2f95b6c6-3024-45a5-967c-2d78c0ce9562] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.932167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.934867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.935340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.937248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.941355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.941856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.970941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] HTTP exception thrown: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Request method failure captured: Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 HTTP/1.1 Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHYi98sFL_Zcis_ibIjCYx1ladt00PuP3hHxdDo43m6tVZ8CfmBYh65Jjca1YLTJRo1cWfR9ZIeq7W60jevmCoB42kQC3EZk4bLyJ8zUNn3B9UVsyoAa9hfX6eQs_zf8ExTkohZj5GQp53FOebmWtbkyh4zs3QBDHfFYWYc3-p847nE Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:28.977802 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f71b036680f9444bae3d0e89ea8ea81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f71b036680f9444bae3d0e89ea8ea81c"}]}] Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f71b036680f9444bae3d0e89ea8ea81c Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1971118750 Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 07c5df6fbd0b4aa3aa4e3db55ca35360 Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerTestJSON-1971118750-project Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. Oct 04 18:08:28.979522 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2f95b6c6-3024-45a5-967c-2d78c0ce9562'} Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:28.980535 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. Oct 04 18:08:28.982095 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:28.986171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] Returning 404 to user: Instance 2f95b6c6-3024-45a5-967c-2d78c0ce9562 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:28.986171 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b30fd84-edde-4d2c-97a8-57114c13a63e tempest-ImagesOneServerTestJSON-1971118750 tempest-ImagesOneServerTestJSON-1971118750-project] 10.222.0.40 "GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562" status: 404 len: 111 microversion: 2.1 time: 0.077317 Oct 04 18:08:28.986171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 525/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/2f95b6c6-3024-45a5-967c-2d78c0ce9562 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:29.031649 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf890b52-7912-4cdd-b16a-919a61e2884e tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.277109 Oct 04 18:08:29.034011 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 603/1128] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:29.044534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a2a9889-5311-45d1-bc72-9f3a5f9519fe tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f90098e70d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.440276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a2a9889-5311-45d1-bc72-9f3a5f9519fe tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.399960 Oct 04 18:08:29.441270 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 526/1129] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:29.458154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a743ed6-e35f-4694-a036-b9b118c1c1c1 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f90096d88b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.535053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.537725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.545932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.546632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.547371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.548178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.548862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.550147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.861719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.873912 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8857942a-f584-4d77-bf6b-5bc5b34070ef tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.345622 Oct 04 18:08:29.875236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 527/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:29.881043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "tag": "55b72c93-84bf-4a5b-958d-5e52f758298e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:29.891028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.894652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.894652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.925614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] Creating event network-changed:55b72c93-84bf-4a5b-958d-5e52f758298e for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:29.932373 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-85f995f9-b9d4-4182-a658-af7f33f58318 req-a0783f38-898e-4dd1-b541-83fa7c1cbf4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055143 Oct 04 18:08:29.934151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 528/1131] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:29.951197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.954052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.967681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.968569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.969238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.970214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.971806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.972503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.103334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.113661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.118738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.133310 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ef537b3-fa38-4a55-bc85-60a49a6b4db2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.196969 Oct 04 18:08:30.136431 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 529/1132] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:30.871825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:30.898727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.901726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:30.910354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.919635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.920348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.921269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.921890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.922493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.199604 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a743ed6-e35f-4694-a036-b9b118c1c1c1 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a9fda6a5-83a9-4072-b9e7-2f3b42848996" status: 202 len: 0 microversion: 2.1 time: 1.737404 Oct 04 18:08:31.199604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 604/1133] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:08:29 2022] DELETE /compute/v2.1/os-floating-ips/a9fda6a5-83a9-4072-b9e7-2f3b42848996 => generated 0 bytes in 1741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:31.202290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.203115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.225533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.230617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.230617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.233457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.235394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.235877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.253759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:31.389143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.408122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.410244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.427697 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e784d123-39bc-4b09-8e22-727dbce6d602 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.222719 Oct 04 18:08:31.443505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 605/1134] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:31.443505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3b24343-8b05-4a74-ae43-cf9219e24078 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f9009603280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.673519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.685683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-356419c5-1117-459f-aca3-844683e84dff tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.790816 Oct 04 18:08:31.688163 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 530/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.093658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "tag": "3a45b9b9-8705-4c2c-9236-5d9b253c57d3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:32.115174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.115683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.125122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.155042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] Creating event network-changed:3a45b9b9-8705-4c2c-9236-5d9b253c57d3 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:32.161795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e86fe278-d17d-4c96-a27f-4e1b27ec7e4b req-be800b78-1656-4cb5-bb25-f9f13720195a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077906 Oct 04 18:08:32.162834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 531/1136] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:32.468921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.469660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.486779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.487414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.487901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.489306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.489848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.490333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.574490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:32.757831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.780708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.784941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.795740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-125f0021-9c5c-4d12-b7a2-3507a3b19ddb tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.329566 Oct 04 18:08:32.797111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 532/1137] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:32.818847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.819700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.837282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.837789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.840059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.840942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.841267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.842789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.248094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.258218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6c5a0ddd-4296-41e7-bb74-74a7f65da40f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.458539 Oct 04 18:08:33.259782 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 533/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:33.725630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3b24343-8b05-4a74-ae43-cf9219e24078 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/d14cbbb1-97a7-4934-8106-a1cc07808d7a" status: 202 len: 0 microversion: 2.1 time: 2.295589 Oct 04 18:08:33.727915 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 606/1139] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:08:31 2022] DELETE /compute/v2.1/os-floating-ips/d14cbbb1-97a7-4934-8106-a1cc07808d7a => generated 0 bytes in 2298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:33.737709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28722d47-f57e-48f6-82a7-146bfbe5d157 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] Calling method '.version_select at 0x7f9009997820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.837529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.838798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.849484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.850558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.851785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.853404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.854612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.857054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.955883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.972299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.974795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.982088 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a1d212f-63b1-4090-a867-3abb3d22f9da tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.159852 Oct 04 18:08:33.983399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 607/1140] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:34.246234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a301ce30-d055-40ac-9a8f-67879319a49b tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1441410710", "ram": 512, "vcpus": 1, "disk": 10, "id": 723513879, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:34.344364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a301ce30-d055-40ac-9a8f-67879319a49b tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.358566 Oct 04 18:08:34.345618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 608/1141] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:34.351035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "tag": "3ec60193-f655-440b-a1a5-2d30b37a56a8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:34.378509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:34.387610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:34.387610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.387610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.387610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.420413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] Creating event network-changed:3ec60193-f655-440b-a1a5-2d30b37a56a8 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:34.436854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-79f5b557-92f2-445a-8edb-30397a3ab25a req-175a9601-ddb6-4efb-9749-64f95931ac16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089924 Oct 04 18:08:34.437746 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 609/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:34.443129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.448607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.469492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.470250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.471459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.472388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.473536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.474252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.774080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.783480 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e254600d-8f92-453b-90fc-26194714b06c tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.344231 Oct 04 18:08:34.800911 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 610/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.807753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5ab9694-bddb-4e0a-a9b2-18f6d97eea09 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:34.894462 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5ab9694-bddb-4e0a-a9b2-18f6d97eea09 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091302 Oct 04 18:08:34.903923 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 611/1144] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:08:34 2022] POST /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:35.140165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dec348e-2f43-4eae-bbdd-afeef44dadd5 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] Calling method '.version_select at 0x7f9009626430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.210932 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8dec348e-2f43-4eae-bbdd-afeef44dadd5 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] 10.222.0.40 "GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6" status: 200 len: 784 microversion: 2.1 time: 0.304239 Oct 04 18:08:35.211696 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 612/1145] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6 => generated 784 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:35.303426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-904249377", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:35.386613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:35.509924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28722d47-f57e-48f6-82a7-146bfbe5d157 tempest-FloatingIPDetailsTestJSON-1046702424 tempest-FloatingIPDetailsTestJSON-1046702424-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/2d07e2e1-ede4-4e29-85c6-5f70457d5019" status: 202 len: 0 microversion: 2.1 time: 1.777224 Oct 04 18:08:35.512085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 534/1146] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:08:33 2022] DELETE /compute/v2.1/os-floating-ips/2d07e2e1-ede4-4e29-85c6-5f70457d5019 => generated 0 bytes in 1781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:35.748316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84039039-618c-453d-bcf4-b405bf913892 tempest-FlavorsExtraSpecsTestJSON-1444359368 tempest-FlavorsExtraSpecsTestJSON-1444359368-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.774879 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84039039-618c-453d-bcf4-b405bf913892 tempest-FlavorsExtraSpecsTestJSON-1444359368 tempest-FlavorsExtraSpecsTestJSON-1444359368-project] 10.222.0.40 "GET /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.261557 Oct 04 18:08:35.783428 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 535/1147] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:35.789979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.790942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.798760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.799738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.802111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.803819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.805473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.806367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.881515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:08:35.882190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:08:35.882410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:08:35.882817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:08:35.883641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:08:35.903267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.903822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.904266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.905003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.905466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.905909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.943831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.954331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Getting quotas for project 1180e10561f24006b6e2bdaeaae0d003. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:35.955577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:35.969059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.969059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.973556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Getting quotas for user d59f54f1d9a44769a17eebf2e5a58e24 and project 1180e10561f24006b6e2bdaeaae0d003. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:35.983166 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-255f8f30-81d9-4972-94b5-1331d59e0ea1 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.194136 Oct 04 18:08:35.984876 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 536/1148] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:36.003656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26e36f9b-0041-48ac-b5c1-6dc82effb577 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] Calling method '.version_select at 0x7f90098ed040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.012955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:08:36.012955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:08:36.167790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26e36f9b-0041-48ac-b5c1-6dc82effb577 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] 10.222.0.40 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.178817 Oct 04 18:08:36.179874 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 537/1149] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/images => generated 445 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:36.209908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75b5f09a-236f-4c82-b05a-355049241ff9 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.239425 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b7d69f8-85dd-42e1-85e7-d5258d51c517 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026094 Oct 04 18:08:36.242648 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 613/1150] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:08:36.258973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.260295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.276840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.277629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.278279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.279172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.279979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.280723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.330561 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75b5f09a-236f-4c82-b05a-355049241ff9 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.143053 Oct 04 18:08:36.331277 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 538/1151] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:08:36 2022] POST /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:36.342441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-914144e2-330a-42e1-9cc0-85faf56a60d7 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] Calling method '.version_select at 0x7f90098bb670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.445189 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-914144e2-330a-42e1-9cc0-85faf56a60d7 tempest-ListImagesTestJSON-1253258552 tempest-ListImagesTestJSON-1253258552-project] 10.222.0.40 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.112755 Oct 04 18:08:36.458167 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 539/1152] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:36.461963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a1c8a61-14e0-4a3f-a7c6-a7bf82cf616d tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.462586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a1c8a61-14e0-4a3f-a7c6-a7bf82cf616d tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.596767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a1c8a61-14e0-4a3f-a7c6-a7bf82cf616d tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.607613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a1c8a61-14e0-4a3f-a7c6-a7bf82cf616d tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1213 microversion: 2.1 time: 0.157891 Oct 04 18:08:36.608200 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 540/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.630666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97181001-3cda-4a85-9c20-37c171f4cb42 tempest-FlavorsExtraSpecsTestJSON-1444359368 tempest-FlavorsExtraSpecsTestJSON-1444359368-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.664366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97181001-3cda-4a85-9c20-37c171f4cb42 tempest-FlavorsExtraSpecsTestJSON-1444359368 tempest-FlavorsExtraSpecsTestJSON-1444359368-project] 10.222.0.40 "GET /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.054641 Oct 04 18:08:36.667627 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 541/1154] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes => generated 22 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:36.686858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e207fc3-17e3-42b4-8cf1-2e6c0abc6e2d tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.754559 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e207fc3-17e3-42b4-8cf1-2e6c0abc6e2d tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080065 Oct 04 18:08:36.755597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 542/1155] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 4 18:08:36 2022] POST /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:08:36.767028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b4845f3-deb6-40ea-a2c9-24aa4147bfba tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.772915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.792740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b4845f3-deb6-40ea-a2c9-24aa4147bfba tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030532 Oct 04 18:08:36.792994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad6f2c7f-b3f2-4c49-8efd-ecd4d6a56d87 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.546672 Oct 04 18:08:36.798265 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 543/1156] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:08:36.805982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1012c832-4e93-4f9d-bd72-1c66fce41739 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.808268 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 614/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.827002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:SAVEPOINT=6,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:37.026999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.028961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.037570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.043353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.043746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.044513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.045123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.045516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.157359 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1012c832-4e93-4f9d-bd72-1c66fce41739 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.356553 Oct 04 18:08:37.158159 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 544/1158] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:08:36 2022] PUT /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes => generated 22 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:08:37.168392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d073056-e8ee-4231-8740-38609f7eb53c tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.177471 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9d073056-e8ee-4231-8740-38609f7eb53c tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013103 Oct 04 18:08:37.178350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 545/1159] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/flavors/723513879/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:37.193106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-507fc3a5-b1c2-4a8a-b669-0aac6b90e3b8 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.219914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.230165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.232225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.239821 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68aa48bd-f194-4993-b723-b85a4f057193 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.222982 Oct 04 18:08:37.240631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 615/1160] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:37.292744 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-507fc3a5-b1c2-4a8a-b669-0aac6b90e3b8 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.105181 Oct 04 18:08:37.297103 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 546/1161] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:08:37 2022] DELETE /compute/v2.1/flavors/723513879/os-extra_specs/hw:numa_nodes => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:08:37.303162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f4bbbe9-a2ee-42bc-af8d-7eb2b1a9c70e tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.429607 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f4bbbe9-a2ee-42bc-af8d-7eb2b1a9c70e tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/723513879/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.131281 Oct 04 18:08:37.430501 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 616/1162] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:08:37 2022] DELETE /compute/v2.1/flavors/723513879/os-extra_specs/hw:cpu_policy => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:08:37.439575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73f5fa55-dba6-4d23-98c8-09d414366144 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.449886 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73f5fa55-dba6-4d23-98c8-09d414366144 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/723513879/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014386 Oct 04 18:08:37.451081 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 547/1163] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/flavors/723513879/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:08:37.464066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05ebb544-4043-48c2-96da-fc959473c0b4 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.612364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05ebb544-4043-48c2-96da-fc959473c0b4 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/723513879" status: 202 len: 0 microversion: 2.1 time: 0.154295 Oct 04 18:08:37.616651 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 617/1164] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:08:37 2022] DELETE /compute/v2.1/flavors/723513879 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:37.621898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a03f79c9-2cdc-42c9-8b8a-0e92d38bb768 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.639885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca77f2eb-acbf-4faf-9d13-827cbfbf460e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.643002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca77f2eb-acbf-4faf-9d13-827cbfbf460e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.692180 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a03f79c9-2cdc-42c9-8b8a-0e92d38bb768 tempest-FlavorsExtraSpecsTestJSON-2012090769 tempest-FlavorsExtraSpecsTestJSON-2012090769-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073319 Oct 04 18:08:37.706885 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 548/1165] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.787710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca77f2eb-acbf-4faf-9d13-827cbfbf460e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.808867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca77f2eb-acbf-4faf-9d13-827cbfbf460e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1213 microversion: 2.1 time: 0.173521 Oct 04 18:08:37.809729 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 618/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1213 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:37.834310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.836167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.846027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.847117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.847942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.849093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.849867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.850588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.274540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.280248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.280875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.285513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b89c0818-4b41-4e0f-94b7-f71525422848 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.457514 Oct 04 18:08:38.288902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 549/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.305833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.306673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.307661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.322765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.323723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.324328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.525081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.545326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.555700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.583679 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dc5b2141-9ae8-4e3a-9956-a3e62b14ad5c tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.296006 Oct 04 18:08:38.590290 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 619/1168] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:38.840144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.840899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:38.852438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.853432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.854081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:38.855130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:38.856012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:38.857587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.092870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.107918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e905aaf-7648-4cbb-a61a-e87f37e24a90 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1217 microversion: 2.1 time: 0.271914 Oct 04 18:08:39.108530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 550/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:39.317283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.317896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.325900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.326969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.327369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.328482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.329112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.329703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.549131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.577770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9684d64-46ab-4cd5-abb2-2e07a234311f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.264774 Oct 04 18:08:39.578410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 620/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.604412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.606212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.614044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.614759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.615596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.616316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.616951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.617526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.061522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.080028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.080028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.081620 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9e40a8bc-20af-4b42-8243-994937f1deb7 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.483951 Oct 04 18:08:40.096909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 551/1171] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:40.144357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.145411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.154067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.156027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.156027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.156831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.157530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.158109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.245793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.254563 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9b814a2-c6c6-43ce-a2ad-726226bcda03 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1265 microversion: 2.1 time: 0.120578 Oct 04 18:08:40.268375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 621/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:40.601325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.601965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.618370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.619174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.619818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.620735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.621540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.622133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.818556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.832716 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1406fb8-8621-410a-9ef6-2dab4d6f6e7e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.235068 Oct 04 18:08:40.833925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 552/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.111440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.114727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.119128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.119913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.120849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.121470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.121940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.122375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.209152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.217729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Calling method '.version_select at 0x7f9009626670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.222025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.223518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.228913 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4bd37b3-34e0-41d0-827d-6d58c6c45748 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.122199 Oct 04 18:08:41.229811 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 553/1174] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:41.229951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.230636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.231154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.232040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.232595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.233117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.262799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1881c48f-6122-4763-bdd0-508940a53fb8 tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.184863 Oct 04 18:08:41.263406 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 622/1175] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:41.278048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.278798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.284948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.285517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.286048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.286824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.288066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.288066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.320602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1135557668", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:41.384692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:41.404683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8879ad6a-03da-429c-b091-bca75ea92fd2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1265 microversion: 2.1 time: 0.128970 Oct 04 18:08:41.406527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 554/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.429914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:08:41.771290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Getting quotas for project 2ef068d364e84b1b9a3300610980ec2e. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:41.776801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Getting quotas for user 886a5b535a6340cebce3dc646d27e587 and project 2ef068d364e84b1b9a3300610980ec2e. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:41.792556 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Request method failure captured: Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 1752 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHaoEMyujz2gsSq2NKEKZ-Kb8x3s4IRp73Cp61SFXj5_Q_zcyKj96F7X4Y019wpQsrIsmOFD_lQZanPF6TP_0JzAe6CopmP2cmXSq5KsB7cA02GfwRZox2M9LqaZIhD8r9IVSdfHcFLXBF6o75X2S3yIU4D_VDKobpM39tN4M3VIzuI Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2ef068d364e84b1b9a3300610980ec2e Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-159224841 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2ef068d364e84b1b9a3300610980ec2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ef068d364e84b1b9a3300610980ec2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2ef068d364e84b1b9a3300610980ec2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2ef068d364e84b1b9a3300610980ec2e"}]}] Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-159224841 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2ef068d364e84b1b9a3300610980ec2e Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-159224841 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-159224841-project Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 886a5b535a6340cebce3dc646d27e587 Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-159224841-project Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1135557668", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:08:41.796747 n-d-833090-21 devstack@n-api.service[123887]: exception: Maximum number of metadata items exceeds 128 Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1135557668', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:41.799331 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcfb66fe-4c1f-4798-8be3-240dea7dacee tempest-AbsoluteLimitsNegativeTestJSON-159224841 tempest-AbsoluteLimitsNegativeTestJSON-159224841-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.482549 Oct 04 18:08:41.809884 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 623/1177] 10.222.0.40 () {60 vars in 1148 bytes} [Tue Oct 4 18:08:41 2022] POST /compute/v2.1/servers => generated 87 bytes in 484 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:08:41.858450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.859066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.867049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.868814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.868814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.868814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.869196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.869820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.210734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.252743 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0aff9af4-fd72-4cfa-b4ce-c0d972083172 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.397216 Oct 04 18:08:42.261124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.261905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.288678 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 555/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.291289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.291814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.292292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.293026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.293479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.293892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.441700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.442466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:42.445749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.463363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.467506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.469524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.470564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.472073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:42.479661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.485146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:42.485924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.493872 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-421bd542-552a-4c37-84d5-bddb7a60d531 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.235254 Oct 04 18:08:42.507821 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 624/1179] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:42.589992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.601227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7cca0b2-43ac-47b8-ae50-d77966d63be7 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1265 microversion: 2.1 time: 0.176385 Oct 04 18:08:42.602085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 556/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.292347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.292893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.300020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.300569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.305175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.305175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.305175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.305175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.476314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.484131 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0f0f053-700c-4608-9b65-5387804a5b0f tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.195745 Oct 04 18:08:43.484721 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 625/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.524334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.525007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.531578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.532075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.532559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.533215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.533689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.534098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.606038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.615004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.616587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.622197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68560cc5-bba8-4fc0-a256-a73c2e0db939 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.101822 Oct 04 18:08:43.622867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 557/1182] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:43.625284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.644905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.702490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.710335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f4a5d20-83f9-4bb5-b6f0-f3a6a9802902 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1265 microversion: 2.1 time: 0.089483 Oct 04 18:08:43.710920 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 626/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.507158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.507800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.513889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.514381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.514821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.515544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.516003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.516433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.661222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.661866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.669243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.669576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.670053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.670199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.670982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.671544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.672072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.677447 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c9a3c59-4b95-4d64-bec0-9f9d23ee7872 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.174218 Oct 04 18:08:44.678021 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 558/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:44.682706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.683589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.689657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.690333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.691420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.692334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.692948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.693571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.759998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.768619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.770699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.775722 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c25c174-c7eb-456b-bd49-d484bf6f699b tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.096547 Oct 04 18:08:44.776300 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 559/1185] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:44.781123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.782513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.787797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.788290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.788726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.789596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.790061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.790536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.806423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80bbfc02-c3ad-4009-bc01-fd933698f3e0 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1814 microversion: 2.1 time: 0.149600 Oct 04 18:08:44.807005 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 627/1186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1814 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.833459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.837300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.837847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.838299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.839039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.839512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.840105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.863030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:44.865995 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3049820f-d5c7-4034-aa6f-f52d90c21fa3 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038873 Oct 04 18:08:44.866781 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 628/1187] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:44.875573 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-540c6b4e-2ccb-4d5f-b4ab-f5862094c2ea tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1265 microversion: 2.1 time: 0.097864 Oct 04 18:08:44.877065 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 560/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.118347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-plugged", "status": "completed", "tag": "3a45b9b9-8705-4c2c-9236-5d9b253c57d3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:45.132502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.133422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.133928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.146004 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] Creating event network-vif-plugged:3a45b9b9-8705-4c2c-9236-5d9b253c57d3 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:45.152326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e5705f81-8d95-4857-b0fc-15e099296134 req-827fbefe-7f25-4177-9f69-c55578854c9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038892 Oct 04 18:08:45.155825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 629/1189] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:45.702270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.703134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:45.721137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.722267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.722958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.724228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:45.724976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:45.726046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.976858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1393abcb-5f1e-4302-b270-f3b19d40fabd tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Calling method '.version_select at 0x7f900d8b8670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.989788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.998470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d71147b1-124a-482c-b309-088c61c27f07 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.300884 Oct 04 18:08:45.999375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 561/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.009426 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1393abcb-5f1e-4302-b270-f3b19d40fabd tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.012391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.013637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1393abcb-5f1e-4302-b270-f3b19d40fabd tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/images/dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1/metadata/os_distro HTTP/1.1 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'image_id': 'dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1', 'id': 'os_distro'} Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1 Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.016192 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1 could not be found. Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.020883 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.027210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.030684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1393abcb-5f1e-4302-b270-f3b19d40fabd tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.031900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1393abcb-5f1e-4302-b270-f3b19d40fabd tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "DELETE /compute/v2.1/images/dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.234876 Oct 04 18:08:46.032750 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 630/1191] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 4 18:08:45 2022] DELETE /compute/v2.1/images/dd0ce020-cbd7-40ea-99d0-a83ddbfddcb1/metadata/os_distro => generated 62 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:08:46.044130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.049166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.054408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.055265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.056063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.057000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.057719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.058368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.186765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.200783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.202232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.208751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f61ebabf-0423-4a1d-ac7b-1d1c635684a6 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.207943 Oct 04 18:08:46.209461 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 562/1192] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:46.220823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26fd9167-0bcb-4cfa-a5a9-759e161f33ae tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Calling method '.version_select at 0x7f90098c7e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.247961 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-26fd9167-0bcb-4cfa-a5a9-759e161f33ae tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26fd9167-0bcb-4cfa-a5a9-759e161f33ae tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/images/3b405080-721b-4c39-b15a-ac1ba528bd34/metadata/os_version HTTP/1.1 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'image_id': '3b405080-721b-4c39-b15a-ac1ba528bd34', 'id': 'os_version'} Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3b405080-721b-4c39-b15a-ac1ba528bd34 Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.257574 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b405080-721b-4c39-b15a-ac1ba528bd34 could not be found. Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.262035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.266216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26fd9167-0bcb-4cfa-a5a9-759e161f33ae tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.267374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26fd9167-0bcb-4cfa-a5a9-759e161f33ae tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "GET /compute/v2.1/images/3b405080-721b-4c39-b15a-ac1ba528bd34/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.056608 Oct 04 18:08:46.268418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 563/1193] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/images/3b405080-721b-4c39-b15a-ac1ba528bd34/metadata/os_version => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:46.282533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:46.292760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e33616bd-7562-43a1-ad31-129b7ffe859b tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Calling method '.version_select at 0x7f90098e7550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.308893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bb9a67f-102a-4166-ab04-116791f31557 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1273 microversion: 2.1 time: 0.269313 Oct 04 18:08:46.310706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 631/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.325204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e33616bd-7562-43a1-ad31-129b7ffe859b tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e33616bd-7562-43a1-ad31-129b7ffe859b tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/images/d3daa35a-5308-4703-986c-4669be866f41/metadata HTTP/1.1 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'image_id': 'd3daa35a-5308-4703-986c-4669be866f41'} Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d3daa35a-5308-4703-986c-4669be866f41 Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.327676 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3daa35a-5308-4703-986c-4669be866f41 could not be found. Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e33616bd-7562-43a1-ad31-129b7ffe859b tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e33616bd-7562-43a1-ad31-129b7ffe859b tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "GET /compute/v2.1/images/d3daa35a-5308-4703-986c-4669be866f41/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055480 Oct 04 18:08:46.333028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 564/1195] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/images/d3daa35a-5308-4703-986c-4669be866f41/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:46.340603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bc7ea26-c122-45b6-96a4-76010df44da3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Action: 'update_all', calling method: .version_select at 0x7f90096073a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:46.365553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0bc7ea26-c122-45b6-96a4-76010df44da3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bc7ea26-c122-45b6-96a4-76010df44da3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/images/4d5c08d7-3ba1-4acc-993e-d51358d17bb4/metadata HTTP/1.1 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 57 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'image_id': '4d5c08d7-3ba1-4acc-993e-d51358d17bb4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4d5c08d7-3ba1-4acc-993e-d51358d17bb4 Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.367755 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d5c08d7-3ba1-4acc-993e-d51358d17bb4 could not be found. Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.372408 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.384256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bc7ea26-c122-45b6-96a4-76010df44da3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.384256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bc7ea26-c122-45b6-96a4-76010df44da3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "PUT /compute/v2.1/images/4d5c08d7-3ba1-4acc-993e-d51358d17bb4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047423 Oct 04 18:08:46.387249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 632/1196] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:08:46 2022] PUT /compute/v2.1/images/4d5c08d7-3ba1-4acc-993e-d51358d17bb4/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:08:46.398642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86d6c505-debe-4e0b-bf7d-509b002e9f23 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Action: 'update', calling method: .version_select at 0x7f900a572670>, body: {"meta": {"os_distro": "alt"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:46.456904 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-86d6c505-debe-4e0b-bf7d-509b002e9f23 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86d6c505-debe-4e0b-bf7d-509b002e9f23 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/images/5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14/metadata/os_distro HTTP/1.1 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 30 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: {"meta": {"os_distro": "alt"}} Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'image_id': '5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14 Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.459816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14 could not be found. Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.463687 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.470884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86d6c505-debe-4e0b-bf7d-509b002e9f23 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.470884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86d6c505-debe-4e0b-bf7d-509b002e9f23 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "PUT /compute/v2.1/images/5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.076931 Oct 04 18:08:46.470884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 565/1197] 10.222.0.40 () {60 vars in 1310 bytes} [Tue Oct 4 18:08:46 2022] PUT /compute/v2.1/images/5b3e274e-ddbb-4493-b6b9-e5e9b5dc1d14/metadata/os_distro => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:46.480208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60d79f15-d395-4a78-8650-5b8181a279d3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Action: 'create', calling method: .version_select at 0x7f90096039d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:46.504684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-60d79f15-d395-4a78-8650-5b8181a279d3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] HTTP exception thrown: Image not found. Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60d79f15-d395-4a78-8650-5b8181a279d3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Request method failure captured: Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/images/f5633ce0-a157-4292-9d2c-6085208d9710/metadata HTTP/1.1 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 57 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHatkaAFp8cmPVZR2MT2dN7sNsgB8QcNxJEDwB3D0bDeLiwigKO_yrS4JuAxkgThqQE475WDkvGuPApTE3ddZUgWF72bkgbb67_Ye9nRNKaY4zBewkgEulKwCP-CYvN1V7YrmJpBkXUCKoLcsnwORzJpoFQMtMP84vBIFONqZ9b6rPw Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c057a8750610407aa7435ef9f2835292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c057a8750610407aa7435ef9f2835292"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c057a8750610407aa7435ef9f2835292"}]}] Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c057a8750610407aa7435ef9f2835292 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6bb7b2b1946440c2bd5b2214535596f9 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1798125034-project Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'image_id': 'f5633ce0-a157-4292-9d2c-6085208d9710', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5633ce0-a157-4292-9d2c-6085208d9710 Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:46.506949 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5633ce0-a157-4292-9d2c-6085208d9710 could not be found. Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60d79f15-d395-4a78-8650-5b8181a279d3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60d79f15-d395-4a78-8650-5b8181a279d3 tempest-ImagesMetadataNegativeTestJSON-1798125034 tempest-ImagesMetadataNegativeTestJSON-1798125034-project] 10.222.0.40 "POST /compute/v2.1/images/f5633ce0-a157-4292-9d2c-6085208d9710/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032572 Oct 04 18:08:46.516603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 633/1198] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 4 18:08:46 2022] POST /compute/v2.1/images/f5633ce0-a157-4292-9d2c-6085208d9710/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:47.021175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:47.030103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.030903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.037624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.038240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.038871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.039923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.040488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.040916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.187126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-plugged", "status": "completed", "tag": "55b72c93-84bf-4a5b-958d-5e52f758298e"}, {"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-plugged", "status": "completed", "tag": "3ec60193-f655-440b-a1a5-2d30b37a56a8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:47.224474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.224953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.229316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.258056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Creating event network-vif-plugged:55b72c93-84bf-4a5b-958d-5e52f758298e for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:47.258803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] Creating event network-vif-plugged:3ec60193-f655-440b-a1a5-2d30b37a56a8 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:47.265465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-430fd46d-3720-45df-ad60-7d59dcb6c108 req-04e1f015-23af-4d7a-8bfc-8d835e98add8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089823 Oct 04 18:08:47.266339 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 634/1199] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:47.273273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.274328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.277732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:47.295576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.314784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.315256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.320646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.321258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.321710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.572119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.581907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.583349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.600286 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb5a61af-b848-494f-b1a2-cb6fd8fa9097 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.332420 Oct 04 18:08:47.601228 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 635/1200] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:47.605947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.612838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:47.625058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.626232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.627280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.632025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:47.632672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:47.633292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.764802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.768923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:47.773713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb60f287-7ea8-46d2-9996-0558b15aa95b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1271 microversion: 2.1 time: 0.171237 Oct 04 18:08:47.774874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 636/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.817062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.825959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f9b2545-625a-49f8-af07-7569662ffd45 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.805430 Oct 04 18:08:47.826535 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 566/1202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:48.638991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.640388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.663548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.664356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.665191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.668995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.669762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.670421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.800821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.801457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.821078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.821576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.823366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.826609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.827376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.830571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.849525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.879373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.884864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.905055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-96404a7e-c2b6-4bbe-af3d-8a29ea0b69a2 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1544 microversion: 2.91 time: 0.272852 Oct 04 18:08:48.907871 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 637/1203] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:48.915320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.920291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.931348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.932139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.932921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.934433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.935649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.936240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.108857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.118877 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9749f5c7-b86b-4ae1-be57-4ef18dd3f2a2 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1271 microversion: 2.1 time: 0.324426 Oct 04 18:08:49.119494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 567/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.305285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:49.314810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4808cbcb-ff3b-4a1e-bbfe-daf8e25f7ca8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1355 microversion: 2.1 time: 0.405308 Oct 04 18:08:49.317138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 638/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1355 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.783540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9377b64e-4653-4e77-9cff-90b1cb6e2aaf", "device": "/dev/xvdb"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:49.787323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.808028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.808719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.810672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.810672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.810672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.810672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.864717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:49.940943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.942175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.961370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.961874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.968144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.968947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.969443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.969880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.317141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.335248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.336937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.371015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eacfb268-9010-4fc5-a5ab-68b99a22b151 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1531 microversion: 2.91 time: 0.422806 Oct 04 18:08:50.372991 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 639/1206] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1531 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:50.383955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.386618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.422164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.422905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.423563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.424571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.425736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.426350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.685192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.695064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-234495b4-b749-4419-bc55-d766f60703f8 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.320709 Oct 04 18:08:50.699087 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 640/1207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:50.722875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:50.722875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.744526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.745311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.745915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.746865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.747641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.748260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.028514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:51.039857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92943ae8-72d1-4c6b-9cf4-5051d38a6bd5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1804 microversion: 2.1 time: 0.338324 Oct 04 18:08:51.047554 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 641/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1804 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.064392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.065206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.071823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.072435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.073210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.074327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.075210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.075836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.185543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0951a8f-c4e5-4c98-a7b3-79a503976fd9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.412956 Oct 04 18:08:51.187079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 568/1209] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:08:49 2022] POST /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 194 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:51.204571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.205682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.220823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.224819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.225568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.227216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.227971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.228601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.278033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] Lazy-loading 'services' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:51.301890 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-396cf489-56c3-40d5-885d-ffe925805d64 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2/ips" status: 200 len: 217 microversion: 2.1 time: 0.111660 Oct 04 18:08:51.304205 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 569/1210] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2/ips => generated 217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:51.336855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d9f75d2-c8b6-4410-b489-49168a6c24eb tempest-UnshelveToHostMultiNodesTest-152154681 tempest-UnshelveToHostMultiNodesTest-152154681-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1938 microversion: 2.91 time: 0.285933 Oct 04 18:08:51.341682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 642/1211] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1938 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:51.363062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.365409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.387578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.389405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.394706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.394706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.395826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.401233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.478047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:51.537707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-873c0eec-9485-43e3-89aa-f0c0295c6e22 tempest-ListImageFiltersNegativeTestJSON-174488902 tempest-ListImageFiltersNegativeTestJSON-174488902-project] Calling method '.version_select at 0x7f900981fd30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.573130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-873c0eec-9485-43e3-89aa-f0c0295c6e22 tempest-ListImageFiltersNegativeTestJSON-174488902 tempest-ListImageFiltersNegativeTestJSON-174488902-project] HTTP exception thrown: Image not found. Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-873c0eec-9485-43e3-89aa-f0c0295c6e22 tempest-ListImageFiltersNegativeTestJSON-174488902 tempest-ListImageFiltersNegativeTestJSON-174488902-project] Request method failure captured: Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/images/b3f4ed07-2571-4c45-8911-ca4726dfaf12 HTTP/1.1 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHayF6dBMstEhUC2HXDsaM1s-TfSZX-im_DLsk1XtVhqLmObpjnLbN4p5-Nw5mpqLmeIM6ZF7DfHoqlFI4-IHNg3oUY9SI5YnDueh3imnMCZtTqx-ZMFGCG7-4VMEXEnILGkiSRN6u4AyPA0XgAym98k_QtzbB76esGW7JY-Zx8xqQw Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 19211c6e29bd414d87bed0bc3f48986f Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-174488902 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19211c6e29bd414d87bed0bc3f48986f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19211c6e29bd414d87bed0bc3f48986f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19211c6e29bd414d87bed0bc3f48986f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19211c6e29bd414d87bed0bc3f48986f"}]}] Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-174488902 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 19211c6e29bd414d87bed0bc3f48986f Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-174488902 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListImageFiltersNegativeTestJSON-174488902-project Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bf520592850d43e4844094acfde303b5 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-174488902-project Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b3f4ed07-2571-4c45-8911-ca4726dfaf12'} Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3f4ed07-2571-4c45-8911-ca4726dfaf12 Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:08:51.575715 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3f4ed07-2571-4c45-8911-ca4726dfaf12 could not be found. Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:08:51.580637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:51.584830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-873c0eec-9485-43e3-89aa-f0c0295c6e22 tempest-ListImageFiltersNegativeTestJSON-174488902 tempest-ListImageFiltersNegativeTestJSON-174488902-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:51.585761 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-873c0eec-9485-43e3-89aa-f0c0295c6e22 tempest-ListImageFiltersNegativeTestJSON-174488902 tempest-ListImageFiltersNegativeTestJSON-174488902-project] 10.222.0.40 "GET /compute/v2.1/images/b3f4ed07-2571-4c45-8911-ca4726dfaf12" status: 404 len: 62 microversion: 2.1 time: 0.280561 Oct 04 18:08:51.586496 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 570/1212] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/images/b3f4ed07-2571-4c45-8911-ca4726dfaf12 => generated 62 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:51.601921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.602513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.618512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.619068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.619607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.620631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.621959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.622576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.718570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:51.784509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:52.046106 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3505fd43-b032-4cea-b715-f0fdf307e7ac tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 204 len: 0 microversion: 2.1 time: 0.700555 Oct 04 18:08:52.048667 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 643/1213] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:51 2022] DELETE /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:52.057207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.059182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.074670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.075458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.077271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.081447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.081447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.081447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.216783 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff5c1595-e0c9-423b-8a89-dfc854a9c6dc tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "DELETE /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 204 len: 0 microversion: 2.91 time: 0.628845 Oct 04 18:08:52.218016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 571/1214] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:08:51 2022] DELETE /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:08:52.237657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.238547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.244902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.245552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.246090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.246928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.247490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.248035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.710765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.720687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a78de4c4-c82c-404e-bd9f-5d951e81b181 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1810 microversion: 2.1 time: 0.501215 Oct 04 18:08:52.724219 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 572/1215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1810 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.749515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.751918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:52.761401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.762163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.763306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.763780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.764205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.807399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.824834 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7dc9fcf-1696-44fc-951f-01fc4177f8c4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.774016 Oct 04 18:08:52.826277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 644/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.848372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04aaefb8-9322-4662-8a98-25fa406c2beb", "tag": "89ca96fe-d90c-48af-b678-80f2e514b564"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:52.862002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:52.862002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:52.862002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.884442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] Creating event network-changed:89ca96fe-d90c-48af-b678-80f2e514b564 for instance 04aaefb8-9322-4662-8a98-25fa406c2beb on n-h2-833090-21 Oct 04 18:08:52.905486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.917513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e722b7f4-841f-4a41-87d3-3bbc7ed72b27 req-85e48704-bd7c-4008-8d8d-70fc4ad79782 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076237 Oct 04 18:08:52.931239 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 645/1217] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:52.932112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.934083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.953661 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4dbadb7c-0190-4060-8e5d-22b108796496 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.211473 Oct 04 18:08:52.954796 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 573/1218] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:53.754964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.756436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.778629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.787091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.787861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.788633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.789713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.790160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.855825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.856669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.871817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.881837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.882630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.883841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.887330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.888100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.263526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.288695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e99a31c3-5d7b-4306-9eba-7f6e755d50b7 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1810 microversion: 2.1 time: 0.539202 Oct 04 18:08:54.322938 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 646/1219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1810 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:54.341485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.342272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.353142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.353567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.354004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.354715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.371953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.371953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.507585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.524160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.533572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.563622 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9fb6466-11e3-48b1-afc9-28c819e8ae96 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1537 microversion: 2.91 time: 0.239365 Oct 04 18:08:54.564837 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 647/1220] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:54.722919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:54.737289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1532073-518c-4e36-8695-55783c1e5981 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.888794 Oct 04 18:08:54.762450 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 574/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.006418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-deleted", "tag": "3ec60193-f655-440b-a1a5-2d30b37a56a8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:55.024728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:55.043276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.043827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.047785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.094277 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] Creating event network-vif-deleted:3ec60193-f655-440b-a1a5-2d30b37a56a8 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:55.100949 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cea5ad02-30f0-4a3a-85c2-f53b12707f0e req-ea5584df-0032-4522-8fa8-9a796b42975b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098704 Oct 04 18:08:55.105505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 648/1222] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:55.334996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.335920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.349447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.354560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.355246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.368210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.371816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.375627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.596614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.597632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.607960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.613570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.614288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.615298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.615972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.616581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.702705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.705317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.706021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.708854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lazy-loading 'fault' on Instance uuid 16e99ef1-b807-47c8-940c-5c644b738ed0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:55.958872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.970880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.973146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49f096d1beaf470586d93b5d02e3626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47776374afe649ab82ddac010a0768b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.991171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-634f0ffc-6147-4830-bc25-bc1e67e64226 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 200 len: 1542 microversion: 2.91 time: 0.398929 Oct 04 18:08:55.992425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 649/1223] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:56.009347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.010671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.024786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.032213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.032772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.036683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b134da4-cb1e-4fb5-a135-755f2a061b04 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1674 microversion: 2.1 time: 0.706158 Oct 04 18:08:56.037795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 575/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1674 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:56.038130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.038979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.039456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.040113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.305788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:56.318293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adf7bd6b-0839-429d-9723-add736a7329e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.324534 Oct 04 18:08:56.323353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 650/1225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:56.452222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cfc4fa9-51fc-4bbb-900b-9b6eada0556f tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f9009833af0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9u9KWBsTEoWyBzttWIrM+8hI++7kz1Anm2+YcJ1m9xKDRBuCcKOrEw3OAqj0LX2Lbt+8bZSCe9EUNcMwT1mgkR2Jr/TiL/opU7JhuIdwjFO1YuvHH7wfrJYQ70eqCzGA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cfc4fa9-51fc-4bbb-900b-9b6eada0556f tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 257 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9u9KWBsTEoWyBzttWIrM+8hI++7kz1Anm2+YcJ1m9xKDRBuCcKOrEw3OAqj0LX2Lbt+8bZSCe9EUNcMwT1mgkR2Jr/TiL/opU7JhuIdwjFO1YuvHH7wfrJYQ70eqCzGA=="}} Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9u9KWBsTEoWyBzttWIrM+8hI++7kz1Anm2+YcJ1m9xKDRBuCcKOrEw3OAqj0LX2Lbt+8bZSCe9EUNcMwT1mgkR2Jr/TiL/opU7JhuIdwjFO1YuvHH7wfrJYQ70eqCzGA=='}}} Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 18:08:56.456790 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cfc4fa9-51fc-4bbb-900b-9b6eada0556f tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:56.461315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0cfc4fa9-51fc-4bbb-900b-9b6eada0556f tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.304136 Oct 04 18:08:56.474043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f900d8671f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1123850509", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.475428 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 576/1226] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:56 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:56.530395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:56.540564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for user cdcb742d294344d8a9969fc4bc13e55d and project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:56.599274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 2167 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1123850509", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:56.614954 n-d-833090-21 devstack@n-api.service[123887]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1123850509', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:56.617340 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bae67886-78c4-4bd5-a634-83e1cf1f6320 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.150879 Oct 04 18:08:56.623317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 651/1227] 10.222.0.40 () {60 vars in 1160 bytes} [Tue Oct 4 18:08:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:08:56.635665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59db09d9-76b9-42e2-a525-d535e122cfb5 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f9009892f70>, body: {"keypair": {"name": "tempest-keypair-1199506896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHxinwvNA49Gr96KPJifFfkDMmXtvorb9jlfQF4YnLspoZEGx/87s0xQZgBUmzTaOBYuBoGrsbOVyWgteJIapPY9dwe+Y5hvtkokYnxPMt0DC20NiGYMUzC+yPCjAhJBg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.697448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-59db09d9-76b9-42e2-a525-d535e122cfb5 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:56.714178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-59db09d9-76b9-42e2-a525-d535e122cfb5 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for user cdcb742d294344d8a9969fc4bc13e55d and project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:56.886146 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59db09d9-76b9-42e2-a525-d535e122cfb5 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.254316 Oct 04 18:08:56.896039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 577/1228] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:08:56.900855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f900d800700>, body: {"keypair": {"name": "tempest-keypair-1199506896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD0HWHqo+RJD5EdKZ+2yF51ZdOsbgzaJZLSiwa1W2533I9ERr4zwB/Nc44ozgSjQ/k3kAzsGLAlsWbL8mOHF48kzdTyOptk569NjNGUtOVAMlc7ZgZqbBri5lzSTVfiw=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.975331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:56.994033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for user cdcb742d294344d8a9969fc4bc13e55d and project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:57.052641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.054156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] [instance: 16e99ef1-b807-47c8-940c-5c644b738ed0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.070500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.071050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.071925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.072759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.073229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.074644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.110711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] HTTP exception thrown: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Request method failure captured: Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 HTTP/1.1 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXt6lQg-DZkHebSxB-BHuB7uHUgmvrYuL519I9lDgUbWaIo54LAFm3W4R4nhbQfVUm_tTR227yubOKK93Rsj3YrrThQw6LB_L-RgLloWexOoKPgMCm48lGnjq9NS7RD9kfDX8WqrVhkjC8-ZkRGzGAbHs-sdWB4c9OdDiKHH_BikPI Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 47776374afe649ab82ddac010a0768b7 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-35110553 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_47776374afe649ab82ddac010a0768b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47776374afe649ab82ddac010a0768b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/47776374afe649ab82ddac010a0768b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/47776374afe649ab82ddac010a0768b7"}]}] Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-35110553 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 47776374afe649ab82ddac010a0768b7 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-35110553 Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-UnshelveToHostMultiNodesTest-35110553-project Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 49f096d1beaf470586d93b5d02e3626c Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-35110553-project Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '16e99ef1-b807-47c8-940c-5c644b738ed0'} Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.113218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] Returning 404 to user: Instance 16e99ef1-b807-47c8-940c-5c644b738ed0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:57.118401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b69badf-0285-413e-ba07-78f33387a539 tempest-UnshelveToHostMultiNodesTest-35110553 tempest-UnshelveToHostMultiNodesTest-35110553-project] 10.222.0.40 "GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0" status: 404 len: 111 microversion: 2.91 time: 0.092798 Oct 04 18:08:57.120545 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 578/1229] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/16e99ef1-b807-47c8-940c-5c644b738ed0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:57.132071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.133012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.141076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.142346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.143620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.144584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.145835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.146488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.161969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] HTTP exception thrown: Key pair 'tempest-keypair-1199506896' already exists. Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 273 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: {"keypair": {"name": "tempest-keypair-1199506896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD0HWHqo+RJD5EdKZ+2yF51ZdOsbgzaJZLSiwa1W2533I9ERr4zwB/Nc44ozgSjQ/k3kAzsGLAlsWbL8mOHF48kzdTyOptk569NjNGUtOVAMlc7ZgZqbBri5lzSTVfiw=="}} Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: exception: Key pair 'tempest-keypair-1199506896' already exists. Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1199506896', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD0HWHqo+RJD5EdKZ+2yF51ZdOsbgzaJZLSiwa1W2533I9ERr4zwB/Nc44ozgSjQ/k3kAzsGLAlsWbL8mOHF48kzdTyOptk569NjNGUtOVAMlc7ZgZqbBri5lzSTVfiw=='}}} Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cdcb742d294344d8a9969fc4bc13e55d-tempest-keypair-1199506896' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:08:57.164306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:08:57.168920 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cdcb742d294344d8a9969fc4bc13e55d-tempest-keypair-1199506896' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 8, 57, 100332), 'updated_at': None, 'name': 'tempest-keypair-1199506896', 'user_id': 'cdcb742d294344d8a9969fc4bc13e55d', 'fingerprint': '7b:d8:54:b9:3f:bc:94:bb:9c:33:8b:c6:09:6f:ed:a8', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD0HWHqo+RJD5EdKZ+2yF51ZdOsbgzaJZLSiwa1W2533I9ERr4zwB/Nc44ozgSjQ/k3kAzsGLAlsWbL8mOHF48kzdTyOptk569NjNGUtOVAMlc7ZgZqbBri5lzSTVfiw==', 'type': 'ssh'}] Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._create() Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1199506896' already exists. Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 18:08:57.176623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1199506896' already exists. Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1199506896' already exists. Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 409 to user: Key pair 'tempest-keypair-1199506896' already exists. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1259aac-9c64-441e-8ef5-1c495f8aaa55 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.269046 Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 652/1230] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:56 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 270 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:08:57.185829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-deleted", "tag": "3a45b9b9-8705-4c2c-9236-5d9b253c57d3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.206362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.206856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.207427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.233457 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] Creating event network-vif-deleted:3a45b9b9-8705-4c2c-9236-5d9b253c57d3 for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:57.248065 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-16f84d80-b502-423e-b434-651e89727321 req-4a3366f3-4829-4c9e-8853-535ac77f1edf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080363 Oct 04 18:08:57.249616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 653/1231] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:57.263695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-748e6a9c-48c3-4da9-bc29-f411c60bb80a tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Calling method '.version_select at 0x7f900967c670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.370814 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-748e6a9c-48c3-4da9-bc29-f411c60bb80a tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199506896" status: 202 len: 0 microversion: 2.1 time: 0.119640 Oct 04 18:08:57.371873 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 654/1232] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199506896 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:57.379081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.380308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.389196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.389757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.390473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.391431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.392217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.392909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.755979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.768947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b77599ca-6be0-4aea-acab-3c0b065e0f1e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1653 microversion: 2.1 time: 0.643896 Oct 04 18:08:57.769577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 579/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1653 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.797375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0543ab51-3cd0-4553-a744-bb7d3f763179 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f9009892040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG35sYmMtx9+7a6jjO5NT1m1gvpuNy9vMPGxnJzBNAb8V7HjjrCCpdWz9vfZtU+j2BD7c7j9sTCLgKKkYYMkfRcAfkEpFMcz+kM3gCu4XuOMTmMARtIS7KqKhKelPaMewg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0543ab51-3cd0-4553-a744-bb7d3f763179 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 247 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG35sYmMtx9+7a6jjO5NT1m1gvpuNy9vMPGxnJzBNAb8V7HjjrCCpdWz9vfZtU+j2BD7c7j9sTCLgKKkYYMkfRcAfkEpFMcz+kM3gCu4XuOMTmMARtIS7KqKhKelPaMewg=="}} Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG35sYmMtx9+7a6jjO5NT1m1gvpuNy9vMPGxnJzBNAb8V7HjjrCCpdWz9vfZtU+j2BD7c7j9sTCLgKKkYYMkfRcAfkEpFMcz+kM3gCu4XuOMTmMARtIS7KqKhKelPaMewg=='}}} Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '' Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:08:57.812433 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.818021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0543ab51-3cd0-4553-a744-bb7d3f763179 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:57.821047 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0543ab51-3cd0-4553-a744-bb7d3f763179 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030016 Oct 04 18:08:57.821810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 580/1234] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:57.837345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f90097e51f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1982419450", "public_key": " "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.858129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:RELEASE=2,nova_api:SELECT=94,nova_api:SAVEPOINT=1,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:57.895969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:57.902799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for user cdcb742d294344d8a9969fc4bc13e55d and project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:57.952667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 95 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1982419450", "public_key": " "}} Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1982419450', 'public_key': ' '}}} Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.955942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:57.960417 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1bfd22a-3705-4f39-a0c7-0f6f7d609c07 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129142 Oct 04 18:08:57.966716 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 581/1235] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:08:57.981428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57d939ae-9deb-40f9-b193-be31d89beebd tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f90098923a0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLw+/W/xydHm7jb8sNyN8fhx4F98JtKmK0ShPbZNg9hkMd8D6UFGE639t3wFVRMT+/foRf8Ei6gHVtqgBinqeEAm/l8y21J7bTXvoCqTM0dWCpS7rT5zVm74FouBPEvRQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57d939ae-9deb-40f9-b193-be31d89beebd tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 507 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLw+/W/xydHm7jb8sNyN8fhx4F98JtKmK0ShPbZNg9hkMd8D6UFGE639t3wFVRMT+/foRf8Ei6gHVtqgBinqeEAm/l8y21J7bTXvoCqTM0dWCpS7rT5zVm74FouBPEvRQ=="}} Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLw+/W/xydHm7jb8sNyN8fhx4F98JtKmK0ShPbZNg9hkMd8D6UFGE639t3wFVRMT+/foRf8Ei6gHVtqgBinqeEAm/l8y21J7bTXvoCqTM0dWCpS7rT5zVm74FouBPEvRQ=='}}} Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:08:57.987358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57d939ae-9deb-40f9-b193-be31d89beebd tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:57.991690 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57d939ae-9deb-40f9-b193-be31d89beebd tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018963 Oct 04 18:08:58.002812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 582/1236] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:57 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:58.008476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Action: 'create', calling method: .version_select at 0x7f90098083a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1322821313", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:58.054854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:08:58.074799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Getting quotas for user cdcb742d294344d8a9969fc4bc13e55d and project abcea7d636dd4879bd2de0e753447545. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 118 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1322821313", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1322821313', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:08:58.103938 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c65861f-6eb9-475e-af73-f37ad81acf97 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.097731 Oct 04 18:08:58.109935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 583/1237] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:08:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:08:58.125002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd5ca60c-0149-4a86-bbca-7f182347d960 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Calling method '.version_select at 0x7f9009808940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.126153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.128900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd6d945a-954c-4286-8232-f29801bdd271 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.755693 Oct 04 18:08:58.136658 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 655/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:58.150016 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-cd5ca60c-0149-4a86-bbca-7f182347d960 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd5ca60c-0149-4a86-bbca-7f182347d960 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Request method failure captured: Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-59277000 HTTP/1.1 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa3wHeiOUNok-9iFRwHduoYmDi2tzmyoZaPLnwlTBfReHWjOfwMnNJfF5RehG4suHdR6y9EkHz-NPgwYH_kTYm71zn6xoSzDZAVngQ5BvIcE2XKVXh4BLmBCd_YQf7nga_RSxBNuzWbXxEMWRLvbHVpTwmyfq65t6yxZxjNPjFOWXE Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abcea7d636dd4879bd2de0e753447545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abcea7d636dd4879bd2de0e753447545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abcea7d636dd4879bd2de0e753447545"}]}] Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: abcea7d636dd4879bd2de0e753447545 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1867221533 Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1867221533-project Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: exception: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'tempest-keypair-non-existent-59277000'} Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.154678 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd5ca60c-0149-4a86-bbca-7f182347d960 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] Returning 404 to user: Keypair tempest-keypair-non-existent-59277000 not found for user cdcb742d294344d8a9969fc4bc13e55d {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:58.159845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd5ca60c-0149-4a86-bbca-7f182347d960 tempest-KeyPairsNegativeTestJSON-1867221533 tempest-KeyPairsNegativeTestJSON-1867221533-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-59277000" status: 404 len: 143 microversion: 2.1 time: 0.042020 Oct 04 18:08:58.162044 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 584/1239] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 18:08:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-59277000 => generated 143 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:58.794805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.795436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:58.810421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.810931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.813411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.821043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.823537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.825647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.906358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:59.028051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.053036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-385dbd96-b50a-4d09-8666-efdfb18c6b2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1298 microversion: 2.1 time: 0.262327 Oct 04 18:08:59.064138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 656/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.156054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.156682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.173628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.186018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.186485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.187253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.193860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.194392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.285503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80810108-44a4-41a0-9334-d1a80050c4a2", "name": "network-vif-deleted", "tag": "55b72c93-84bf-4a5b-958d-5e52f758298e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:59.329871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.332072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.332222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.378610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] Creating event network-vif-deleted:55b72c93-84bf-4a5b-958d-5e52f758298e for instance 80810108-44a4-41a0-9334-d1a80050c4a2 on n-h1-833090-21 Oct 04 18:08:59.428902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bb07d685-ca7b-4b81-80d9-b8b938d24914 req-96794766-8019-4550-9d05-9b49ed3ea849 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145192 Oct 04 18:08:59.429591 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 657/1241] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:00.091882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.092633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.108372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.108916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.113003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.113893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.115699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.116336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.131618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.144560 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c0a3d05e-79df-40bb-b8a6-57053ce6848a tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.992141 Oct 04 18:09:00.145321 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 585/1242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.195948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.196489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.199623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.200194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lazy-loading 'fault' on Instance uuid 80810108-44a4-41a0-9334-d1a80050c4a2 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:00.375707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.401726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a8313f4f-9124-46bd-8780-8e4d29686206 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 200 len: 1303 microversion: 2.1 time: 0.315373 Oct 04 18:09:00.412728 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 658/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.765394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61b4403a-3b90-4e86-9f22-4f3edc68517f tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f9009890e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2015685475", "description": "tempest-description-1116327842"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:01.170958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.171685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.179528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.188320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.188850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.190239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.190758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.191225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.435807 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61b4403a-3b90-4e86-9f22-4f3edc68517f tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.942723 Oct 04 18:09:01.447909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 586/1244] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:00 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:01.455849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.458354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.471841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.486719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.487281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.491833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.492572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.493114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.539751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 HTTP/1.1 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '80810108-44a4-41a0-9334-d1a80050c4a2'} Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:01.541427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e997d49-be90-4716-94c9-a3d6c8c8d425 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 404 len: 111 microversion: 2.1 time: 0.093834 Oct 04 18:09:01.546337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 587/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:01.557866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-631a90fb-78b1-4f1f-99dd-c997ad87f60d tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f9009bc80d0>, body: {"security_group_rule": {"parent_group_id": "1a8f0f9e-728b-45ce-8016-254dbac7308c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:01.742454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.765064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74e7d83c-96ef-4c59-a6f3-862a445c9e96 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.598588 Oct 04 18:09:01.765674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 659/1246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:02.191497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.192136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.202923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.203426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.203891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.204608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.205615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.206045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.772194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:02.841333 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29c8cad7-315f-440c-a57b-c9b3d518b4d5 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 2345 microversion: 2.25 time: 0.655298 Oct 04 18:09:02.842669 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 660/1247] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 2345 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:02.846908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-631a90fb-78b1-4f1f-99dd-c997ad87f60d tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.301481 Oct 04 18:09:02.856185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 588/1248] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:02.860600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.862037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.862570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26c60272-ac8b-4f30-b0bc-e3f034b0d4fd tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f90098089d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-496848240", "description": "tempest-description-777924170"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:02.877662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.878163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.885064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.885064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.885064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.885064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.332847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.344101 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eeed48af-8c67-46d6-9585-b87b1225d455 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.500089 Oct 04 18:09:03.344920 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 661/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:03.372311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.386450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.387166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.387640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.388381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.388837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.389320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.443807 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e7ad852-a596-4516-bca6-c83206a2a34f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.082654 Oct 04 18:09:03.446213 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 662/1250] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:09:03.864721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.866801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.867671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.869204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.873680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.874507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.875436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.907153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:03.916111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff7eafd6-6e18-4e2f-959c-05e60e47b748 tempest-AZV2TestJSON-317750656 tempest-AZV2TestJSON-317750656-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.468616 Oct 04 18:09:03.917335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 663/1251] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:09:03.970574 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26c60272-ac8b-4f30-b0bc-e3f034b0d4fd tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.113055 Oct 04 18:09:03.971816 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 589/1252] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:02 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:03.987332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-953dd965-a85f-43df-83e2-48052cef2637 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f900d820af0>, body: {"security_group_rule": {"parent_group_id": "0dd6e76a-8383-4fff-9f2d-297500ecaddb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:04.371942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.377977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.383755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.384200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.384641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.385361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.391819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.394890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.972619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:04.982885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ec1e9c2-b609-4853-a992-2fad3dc895ee tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.614795 Oct 04 18:09:05.000712 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 590/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:05.063134 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-953dd965-a85f-43df-83e2-48052cef2637 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.081761 Oct 04 18:09:05.064706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 664/1254] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:03 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:05.082691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc1ea87-6a01-415d-b3d7-c43c3e779317 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f90097e5700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1540585522", "description": "tempest-description-847472851"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:05.827503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04aaefb8-9322-4662-8a98-25fa406c2beb", "name": "network-vif-plugged", "status": "completed", "tag": "89ca96fe-d90c-48af-b678-80f2e514b564"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:05.876134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.878096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.879140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.911611 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] Creating event network-vif-plugged:89ca96fe-d90c-48af-b678-80f2e514b564 for instance 04aaefb8-9322-4662-8a98-25fa406c2beb on n-h2-833090-21 Oct 04 18:09:05.921410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2ef9c7e5-3768-468b-8530-1ace351a19b1 req-5ccfa760-9271-4e35-9319-8ceac77cfbc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103156 Oct 04 18:09:05.923757 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 665/1255] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:05.973562 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cc1ea87-6a01-415d-b3d7-c43c3e779317 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.895337 Oct 04 18:09:05.974157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 591/1256] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:05.990514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf949b90-bd83-4cb1-9a18-ca7363fba490 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f900d867670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-230431986", "description": "tempest-description-1997399012"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:06.008265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.009171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.017013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.020153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.021680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.022653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.025927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.028043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.557101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.570004 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb0ba110-5a6a-43ca-a235-b7c1d75adc94 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.565692 Oct 04 18:09:06.572082 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 592/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:07.071138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:07.351340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf949b90-bd83-4cb1-9a18-ca7363fba490 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.366358 Oct 04 18:09:07.351340 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 666/1258] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:07.367604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07c3ec26-2903-4e2f-8aab-4863a94f4c2a tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f9009808550>, body: {"security_group_rule": {"parent_group_id": "684e54d3-7d36-4213-a667-80ae5e58d1b2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "65df99b6-a38b-4d13-9f25-4d0f078717d5"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:07.594173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.599670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.602897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.603396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.603863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.604604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.605060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.605485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.084231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:08.092619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:08.106170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20902f4c-a79d-401e-9655-bee1a3517f9b tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1313 microversion: 2.1 time: 0.516084 Oct 04 18:09:08.125811 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 667/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:08.444741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9318020-3b37-438d-8fd9-23cb2a1ba265", "device": "/dev/xvdb"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:08.449210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.468217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.469202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.474568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.475654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.477187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.477927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.000394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07c3ec26-2903-4e2f-8aab-4863a94f4c2a tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.639659 Oct 04 18:09:09.010927 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 593/1260] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:07 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:09.016145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-573c1eef-cbee-42b4-a803-d87151274378 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f90097e5160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1515477329", "description": "tempest-description-1441702254"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:09.706971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59767ec7-149c-4c8b-9350-eebc9557a965 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.266301 Oct 04 18:09:09.708801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 668/1261] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 4 18:09:08 2022] POST /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 194 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:09:09.735811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.736883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.746810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.749859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.750769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.752725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.753434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.754070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.886278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-573c1eef-cbee-42b4-a803-d87151274378 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.873961 Oct 04 18:09:09.886940 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 594/1262] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:09.904655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b058da4b-b23f-4136-8f6e-3f6dff5458a0 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f9009808700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-306166687", "description": "tempest-description-1449017594"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:10.017731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.051230 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e43bebc3-fa9d-4882-84a8-208ae55161b4 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1463 microversion: 2.1 time: 0.339449 Oct 04 18:09:10.053841 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 669/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1463 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.467220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Calling method '.version_select at 0x7f900d800ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.479430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.486452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.486452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.515017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.515557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.516129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.554048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bccc1221-858b-4c6e-b038-0d10a0432b5c tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/1180e10561f24006b6e2bdaeaae0d003?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982" status: 200 len: 694 microversion: 2.1 time: 0.480844 Oct 04 18:09:10.557879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 670/1264] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/os-simple-tenant-usage/1180e10561f24006b6e2bdaeaae0d003?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982 => generated 694 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.573726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '.version_select at 0x7f900d800dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.587436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.589234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.594605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.613526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.617607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.625136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.648604 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59a2de9a-fd16-442c-9fac-3b6c3b2b54f9 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/1180e10561f24006b6e2bdaeaae0d003?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982" status: 200 len: 690 microversion: 2.1 time: 0.081661 Oct 04 18:09:10.649785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 671/1265] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/os-simple-tenant-usage/1180e10561f24006b6e2bdaeaae0d003?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982 => generated 690 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.685736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b058da4b-b23f-4136-8f6e-3f6dff5458a0 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.785961 Oct 04 18:09:10.688188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 595/1266] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:10.699246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Calling method '.version_select at 0x7f900d7fbca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.701220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-635bc8e9-74d8-43fd-b516-e38f14733bcf tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f90097da790>, body: {"security_group_rule": {"parent_group_id": "2100118a-e1a7-4281-90ce-59e26dadb151", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9f493d36-a805-4a45-9525-2f5a038f2c92"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:10.723930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.725714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.727584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.762604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.763308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.764211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.926173 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-528d0795-b4c6-47d4-8639-aeedefa4d44a tempest-TenantUsagesTestJSON-786096910 tempest-TenantUsagesTestJSON-786096910-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982&detailed=1" status: 200 len: 12857 microversion: 2.1 time: 0.258766 Oct 04 18:09:10.927431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 672/1267] 10.222.0.40 () {58 vars in 1335 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A09%3A10.068982&end=2022-10-05T18%3A09%3A10.068982&detailed=1 => generated 12857 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:09:10.976138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.977078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.031209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.042393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.045599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.053035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.055037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.055871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.172766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:11.592211 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29608331-cb78-4775-b782-f88ba634cc71 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "DELETE /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 204 len: 0 microversion: 2.1 time: 0.633085 Oct 04 18:09:11.593074 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 673/1268] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:10 2022] DELETE /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:11.600245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.602378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.620910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.623056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.623721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.626152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.631454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.632066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.898346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-635bc8e9-74d8-43fd-b516-e38f14733bcf tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.198898 Oct 04 18:09:11.898346 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 596/1269] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:11.902729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.903677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.920856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.926332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.926332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.926332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.926332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.926332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:12.165215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8fd7d90-ae3b-42bb-924f-a990cb929d7f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1860 microversion: 2.1 time: 0.570822 Oct 04 18:09:12.169276 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 674/1270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1860 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.182069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9da91127-15ee-4d58-86d6-5f17b87bce82 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f900d7ee700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:13.441112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:13.454911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9da91127-15ee-4d58-86d6-5f17b87bce82 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9f493d36-a805-4a45-9525-2f5a038f2c92" status: 202 len: 0 microversion: 2.1 time: 1.282818 Oct 04 18:09:13.456990 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 675/1271] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:12 2022] DELETE /compute/v2.1/os-security-groups/9f493d36-a805-4a45-9525-2f5a038f2c92 => generated 0 bytes in 1287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:13.459511 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5ad3347-58a7-4052-a997-e80b4d462718 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1469 microversion: 2.1 time: 1.551273 Oct 04 18:09:13.463897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 597/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1469 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:13.464901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-21", "block_migration": true, "disk_over_commit": false}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:13.482563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:13.485344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c95b5736-fea6-4596-b651-038e29e25f65 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f90097fd310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:13.513293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.521393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.521393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.521393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:13.521393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:13.521393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:13.584717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lazy-loading 'flavor' on Instance uuid 95dbe4c3-43e0-45c5-b137-9ee2989353f8 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:13.594279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:13.632420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Going to try to live migrate instance to n-h2-833090-21 {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:09:13.878116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c95b5736-fea6-4596-b651-038e29e25f65 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/2100118a-e1a7-4281-90ce-59e26dadb151" status: 200 len: 248 microversion: 2.1 time: 0.411201 Oct 04 18:09:13.888113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 598/1273] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:09:13 2022] GET /compute/v2.1/os-security-groups/2100118a-e1a7-4281-90ce-59e26dadb151 => generated 248 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:13.894342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db58f5ad-71f1-43a8-a376-a7ff8832fcb3 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f9009798f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1984268565", "description": "tempest-description-899055495"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:14.679270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db58f5ad-71f1-43a8-a376-a7ff8832fcb3 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.787733 Oct 04 18:09:14.679270 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 599/1274] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:09:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:14.693073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-191177629", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "c0abd138-3fea-468c-87a0-29cba93ebe24"}, {"uuid": "a6107b54-2b64-4e9b-9194-1127b5809902"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:14.808785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] validate_networks() for [('c0abd138-3fea-468c-87a0-29cba93ebe24', None, None, None, None, None), ('a6107b54-2b64-4e9b-9194-1127b5809902', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:16.272405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:16.273630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:16.274877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:16.275589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:16.276239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:16.287987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.290031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.290031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.290840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.291639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.292399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.321759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Getting quotas for project db7e35a897f64e069255d3946bbb22f5. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:16.328540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Getting quotas for user 7a0a0453d12e41ff87520a0a6735ce20 and project db7e35a897f64e069255d3946bbb22f5. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:16.345670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:16.348798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:16.573888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5da91668-1a95-45eb-915a-1b28edf0d243 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877697 Oct 04 18:09:16.575643 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 600/1275] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:16.580820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.589857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.629083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.629877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.630669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.631732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.632408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.633080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.787804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.814444 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab0aae60-2d17-4f17-aa41-d996389bb16e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1427 microversion: 2.1 time: 0.237086 Oct 04 18:09:16.818375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 601/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1427 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:16.847427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8b58b30-c1cd-47a3-aa16-0d2939973543 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f900981b550>, body: {"security_group_rule": {"parent_group_id": "31bf7d14-1dd9-417f-aa11-58addcb3be9c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:17.238329 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0e61076-eca7-431d-bbd5-0210d489fd05 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/action" status: 202 len: 0 microversion: 2.1 time: 3.779276 Oct 04 18:09:17.239252 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 676/1277] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:09:13 2022] POST /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/action => generated 0 bytes in 3781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:17.245622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33404759-1fb4-4489-9570-82a30e083d73 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.246348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33404759-1fb4-4489-9570-82a30e083d73 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.497883 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8b58b30-c1cd-47a3-aa16-0d2939973543 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.677464 Oct 04 18:09:17.499644 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 602/1278] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:17.504646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33404759-1fb4-4489-9570-82a30e083d73 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:17.505183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.506426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.520184 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33404759-1fb4-4489-9570-82a30e083d73 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1212 microversion: 2.1 time: 0.279939 Oct 04 18:09:17.524173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.524173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.524173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.524173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.527814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 677/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1212 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.530160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.531264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.548516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03a06d70-25d1-41cd-a90a-423a789d0aad tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Action: 'create', calling method: .version_select at 0x7f900d709310>, body: {"security_group_rule": {"parent_group_id": "31bf7d14-1dd9-417f-aa11-58addcb3be9c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:17.599260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:17.867357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:17.880537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6ffe7b1-a475-4fbd-9047-377b95f42b1e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.379437 Oct 04 18:09:17.892768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 603/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.897131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04aaefb8-9322-4662-8a98-25fa406c2beb", "name": "network-vif-deleted", "tag": "89ca96fe-d90c-48af-b678-80f2e514b564"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:17.949143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.951132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.951685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.985631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] Creating event network-vif-deleted:89ca96fe-d90c-48af-b678-80f2e514b564 for instance 04aaefb8-9322-4662-8a98-25fa406c2beb on n-h2-833090-21 Oct 04 18:09:17.997529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cd93eb56-8602-4690-b9a4-24ec8aa426e8 req-f0b0cb7f-3575-4c32-a251-d99e3d0f0267 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113312 Oct 04 18:09:18.000100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 604/1281] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:18.008183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.009468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.040644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.041444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.043906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.043906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.044372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.045129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.248826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.313025 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec8d9d47-74cc-411f-b1eb-51e859b6e852 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1298 microversion: 2.1 time: 0.310704 Oct 04 18:09:18.340944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 605/1282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1298 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.556184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.556905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.577823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.578665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.583078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.585993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.586672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.587415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.724577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.740286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36aca6ba-51c8-4fa6-ae79-5d74dce0c252 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1216 microversion: 2.1 time: 0.191056 Oct 04 18:09:18.760429 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 606/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1216 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.912757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.914703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.923179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.924246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.924884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.925865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.926552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.927177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.248957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.259923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-768d0503-561b-4727-982f-cf0b10b56286 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.351057 Oct 04 18:09:19.263379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 607/1284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.350000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.351847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.365523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.374264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.379058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.384253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.384771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.385214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.493886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.495057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.496435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.500350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lazy-loading 'fault' on Instance uuid 04aaefb8-9322-4662-8a98-25fa406c2beb {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:19.590273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59f54f1d9a44769a17eebf2e5a58e24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1180e10561f24006b6e2bdaeaae0d003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.604763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c33ec952-9a28-402d-ab47-93b28e1ffc93 tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 200 len: 1303 microversion: 2.1 time: 0.256458 Oct 04 18:09:19.606976 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 608/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.768730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.769935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.778984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.779787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.781326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.782351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.782978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.783629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.870025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.883007 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2202165-76f6-4ec8-a21e-02c89e08860d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1264 microversion: 2.1 time: 0.119537 Oct 04 18:09:19.884322 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 609/1286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1264 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:20.286847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.288487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:20.305810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.307208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.308908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.310808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.311756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.313187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.425102 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03a06d70-25d1-41cd-a90a-423a789d0aad tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 2.895725 Oct 04 18:09:20.439229 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 678/1287] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:09:17 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 2910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:20.449985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67524960-65ff-4c63-b25b-032cabf09494 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f900d709a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.761449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:20.905175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.917965 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15c92fd3-3d7a-42dc-8aab-4dd198357af9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.635389 Oct 04 18:09:20.919052 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 610/1288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:20.940422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.945742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] [instance: 04aaefb8-9322-4662-8a98-25fa406c2beb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:20.965009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.965009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.965009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.966150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.970960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.972559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.995294 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] HTTP exception thrown: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Request method failure captured: Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb HTTP/1.1 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHafVcQh4gauwNbT08lzHpES6d-OzsUthQSRNw3OGiCkSR46HvdaVcUpZ-zo-YnNROj5rJF7OOZKad4GfFoWM98sWsheXpKqjQtl1hP6va8Qkcc1Eq4siJiaketTdVw7TqsoB9AgUwf7lkVmB9__pGwsApgQDVwJptWzLyTH6nHu9Ts Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1180e10561f24006b6e2bdaeaae0d003 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TenantUsagesTestJSON-11868685 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1180e10561f24006b6e2bdaeaae0d003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1180e10561f24006b6e2bdaeaae0d003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1180e10561f24006b6e2bdaeaae0d003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1180e10561f24006b6e2bdaeaae0d003"}]}] Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TenantUsagesTestJSON-11868685 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1180e10561f24006b6e2bdaeaae0d003 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TenantUsagesTestJSON-11868685 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TenantUsagesTestJSON-11868685-project Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d59f54f1d9a44769a17eebf2e5a58e24 Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TenantUsagesTestJSON-11868685-project Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '04aaefb8-9322-4662-8a98-25fa406c2beb'} Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:20.997689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] Returning 404 to user: Instance 04aaefb8-9322-4662-8a98-25fa406c2beb could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a69e6ea-9630-4172-91c3-4c69cfad011e tempest-TenantUsagesTestJSON-11868685 tempest-TenantUsagesTestJSON-11868685-project] 10.222.0.40 "GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb" status: 404 len: 111 microversion: 2.1 time: 0.066843 Oct 04 18:09:21.004530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 611/1289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/servers/04aaefb8-9322-4662-8a98-25fa406c2beb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:21.007548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.008550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.015549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.016389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.016847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.017699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.018173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.018615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.115867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:21.129190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9884d86-b8ac-4379-892a-7fe663d1dc8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1270 microversion: 2.1 time: 0.126611 Oct 04 18:09:21.130072 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 612/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:21.472311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67524960-65ff-4c63-b25b-032cabf09494 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/31bf7d14-1dd9-417f-aa11-58addcb3be9c" status: 200 len: 664 microversion: 2.1 time: 1.030722 Oct 04 18:09:21.473456 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 679/1291] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/os-security-groups/31bf7d14-1dd9-417f-aa11-58addcb3be9c => generated 664 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:21.487574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dae9cd0-848b-421e-ae09-c3305fd271b0 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f90097a71f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.945596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.946192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.961760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.968450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.970027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.975954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.976852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.976954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.245754 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dae9cd0-848b-421e-ae09-c3305fd271b0 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/6105a8ad-f34d-4a10-9de5-2fee5e168791" status: 202 len: 0 microversion: 2.1 time: 0.762103 Oct 04 18:09:22.251448 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 613/1292] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 4 18:09:21 2022] DELETE /compute/v2.1/os-security-group-rules/6105a8ad-f34d-4a10-9de5-2fee5e168791 => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:22.256768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.259785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.284548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.285048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.288880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.288880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.288880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.288880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.429777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.442737 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8e42591-1799-45a9-9453-5a96e3f0d182 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1270 microversion: 2.1 time: 0.189699 Oct 04 18:09:22.459184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 614/1293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:22.474064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46750aa2-4347-4083-8a48-57f52ea6be21 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f9009892f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.125998 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46750aa2-4347-4083-8a48-57f52ea6be21 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/31bf7d14-1dd9-417f-aa11-58addcb3be9c" status: 202 len: 0 microversion: 2.1 time: 0.674550 Oct 04 18:09:23.127378 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 615/1294] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:22 2022] DELETE /compute/v2.1/os-security-groups/31bf7d14-1dd9-417f-aa11-58addcb3be9c => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:23.136977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f9009808a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.242358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:09:23.245296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Neutron security group 9f493d36-a805-4a45-9525-2f5a038f2c92 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:09:23.245915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] HTTP exception thrown: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.245915 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Request method failure captured: Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/9f493d36-a805-4a45-9525-2f5a038f2c92 HTTP/1.1 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHa8cEOL-V3B4jLwTwTSeCwj7SwOgXHCjM9Qr3jVYZf4Pk4YdB-8kf4mCswOrHZ4kutmhGLTug91K32DPDyj3aJftA2_P6_iGNkW45uEtsajrOQgGhzVO8u_DevOjDSTiwQfDTXsYKHrUlg9d_hEoSw11yxzPmlsW2HR9MqAY0QvpMc Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 009f309cdc42467db3a617a1455b4ee4 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2016893536 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_009f309cdc42467db3a617a1455b4ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/009f309cdc42467db3a617a1455b4ee4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/009f309cdc42467db3a617a1455b4ee4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/009f309cdc42467db3a617a1455b4ee4"}]}] Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2016893536 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 009f309cdc42467db3a617a1455b4ee4 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2016893536 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupRulesTestJSON-2016893536-project Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 52c86e343003415e955c5649388d729e Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2016893536-project Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9f493d36-a805-4a45-9525-2f5a038f2c92'} Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:09:23.249321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Returning 404 to user: Security group 9f493d36-a805-4a45-9525-2f5a038f2c92 does not exist Oct 04 18:09:23.259204 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-04849287-9c65-4ca5-b028-2f9c251c8869'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:23.262404 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-893004b5-2df5-4430-95d2-5fca331f7cef tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9f493d36-a805-4a45-9525-2f5a038f2c92" status: 404 len: 194 microversion: 2.1 time: 0.126830 Oct 04 18:09:23.267538 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 616/1295] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:23 2022] DELETE /compute/v2.1/os-security-groups/9f493d36-a805-4a45-9525-2f5a038f2c92 => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:23.298435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:23.300401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46a38d77-4e31-4a68-9a44-214a25df3143 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f90097fd550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.319380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-451250e3-3c5e-465e-b017-d44393564df6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 1.377952 Oct 04 18:09:23.344206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 680/1296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:23.474412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.475343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.491681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.491681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.497584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.498400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.502995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.505452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.926584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46a38d77-4e31-4a68-9a44-214a25df3143 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2100118a-e1a7-4281-90ce-59e26dadb151" status: 202 len: 0 microversion: 2.1 time: 0.643433 Oct 04 18:09:23.927593 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 617/1297] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:23 2022] DELETE /compute/v2.1/os-security-groups/2100118a-e1a7-4281-90ce-59e26dadb151 => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:23.935648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ffae416-7381-42e9-a4a1-146a0fb5039d tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f900981bd30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.377906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.392931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88810b99-d6f2-4189-82cc-ec640b748b7a tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1312 microversion: 2.1 time: 0.922697 Oct 04 18:09:24.396546 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 681/1298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:23 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1312 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:24.415759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.417947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.436836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.439964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.440554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.441306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.441783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.446021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.610035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ffae416-7381-42e9-a4a1-146a0fb5039d tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/65df99b6-a38b-4d13-9f25-4d0f078717d5" status: 202 len: 0 microversion: 2.1 time: 0.677993 Oct 04 18:09:24.611375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 618/1299] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:23 2022] DELETE /compute/v2.1/os-security-groups/65df99b6-a38b-4d13-9f25-4d0f078717d5 => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:24.619179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4371428a-23c5-49c0-8bb7-12e72140a148 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f90097da820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.908515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.945912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-237e5302-3b1e-4fc9-8d83-a16e3809f136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.543622 Oct 04 18:09:24.953099 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 682/1300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:25.141847 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4371428a-23c5-49c0-8bb7-12e72140a148 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/684e54d3-7d36-4213-a667-80ae5e58d1b2" status: 202 len: 0 microversion: 2.1 time: 0.525588 Oct 04 18:09:25.142446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 619/1301] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:24 2022] DELETE /compute/v2.1/os-security-groups/684e54d3-7d36-4213-a667-80ae5e58d1b2 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:25.151222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b46b30fc-d82a-4d17-b850-bb9a5f7480a3 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f900d738c10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.424171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.425101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.440308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.442674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.443542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.444492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.445212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.445800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.791985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.802216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e57428d-e5a1-471c-82e2-e53ba9ec4336 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.383834 Oct 04 18:09:25.804437 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 620/1302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:25.978184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.978800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.990389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.990953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.991612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.993987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.996138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.997034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.306608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:26.339768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:26.447922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.461872 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b010fa5-ec88-4b3c-b9ca-5dc2d16aa2f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.484674 Oct 04 18:09:26.462317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 621/1303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:26.826444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.829283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.867693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.870002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.872669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.873426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.873904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.879131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.945928 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b46b30fc-d82a-4d17-b850-bb9a5f7480a3 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/0dd6e76a-8383-4fff-9f2d-297500ecaddb" status: 202 len: 0 microversion: 2.1 time: 1.799070 Oct 04 18:09:26.946410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 683/1304] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:25 2022] DELETE /compute/v2.1/os-security-groups/0dd6e76a-8383-4fff-9f2d-297500ecaddb => generated 0 bytes in 1800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:26.958577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff6d8c3a-98ec-45c8-972d-54e375f5f975 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] Calling method '.version_select at 0x7f900d7388b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.518549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:27.520839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.537046 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdd21641-20e2-45da-9514-a5968dd75325 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.709325 Oct 04 18:09:27.541624 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 622/1305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:27.565807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.565807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.590074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.590582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.592438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.599209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.602488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.603039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.957444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:27.970885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b288598d-ef9b-4deb-9023-626cdb06cb25 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.425609 Oct 04 18:09:27.976530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 623/1306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:27 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:28.593620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "tag": "fe38893a-6465-4cd0-8da5-e5c896f4d3c0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:28.613013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.614269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.616968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.641840 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] Creating event network-changed:fe38893a-6465-4cd0-8da5-e5c896f4d3c0 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:09:28.672304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-249aeeda-4817-49bb-b491-bd5f1ad77e72 req-095f416b-23f3-4c76-882e-9f9b0707f08d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.486931 Oct 04 18:09:28.673502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 624/1307] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:28.689181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:28.690489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:28.715071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.716164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.718060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.719930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.720572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.724913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.406612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff6d8c3a-98ec-45c8-972d-54e375f5f975 tempest-SecurityGroupRulesTestJSON-2016893536 tempest-SecurityGroupRulesTestJSON-2016893536-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1a8f0f9e-728b-45ce-8016-254dbac7308c" status: 202 len: 0 microversion: 2.1 time: 2.453184 Oct 04 18:09:29.412490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 684/1308] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:09:26 2022] DELETE /compute/v2.1/os-security-groups/1a8f0f9e-728b-45ce-8016-254dbac7308c => generated 0 bytes in 2460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:09:29.418533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:29.419179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:29.446723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.447235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.448419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.449352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.450385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.451206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.873993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:29.896539 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f7d1cc7-5b12-4508-9d43-ab16bb6c8f37 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 1.215142 Oct 04 18:09:29.898242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 625/1309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:28 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:29.990173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-632410449", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "8192a865-5cfc-4984-87fa-750232fba9c2"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:30.069737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] validate_networks() for [('8192a865-5cfc-4984-87fa-750232fba9c2', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:30.169505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:30.185345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19784603-919b-4462-8dc9-f4467fb074dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.771700 Oct 04 18:09:30.190190 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 685/1310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:29 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:30.205375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:30.206796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:30.222165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.223008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.227799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.229493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.231230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.232019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.782815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:30.783275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:30.783820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:30.784459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:30.785056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:30.805917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.806601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.807236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.808176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:30.808891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:30.816272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:30.867580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Getting quotas for project 839a7592f75b4a30970febf691188adf. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:30.883240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Getting quotas for user fcc0dee8f8cc471d919df6b41af0d4e7 and project 839a7592f75b4a30970febf691188adf. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:30.906602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:30.912668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:30.978518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:31.124620 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-905c34d0-02bf-4f08-a1f6-38c4116dfbb0 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224626 Oct 04 18:09:31.131920 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 626/1311] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:31.135914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.136606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.151578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.152149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.152520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.165110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.165960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.166091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.441834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:31.474026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e95ed2e-86c8-4cfd-9834-c3d3d60ac998 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 2423 microversion: 2.25 time: 1.278449 Oct 04 18:09:31.492218 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 686/1312] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:30 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 2423 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:31.500771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "tag": "eba87f75-fe5f-4235-8e78-9856bc866230"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:31.520285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.520782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.521218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.536437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] Creating event network-changed:eba87f75-fe5f-4235-8e78-9856bc866230 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:09:31.543004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:31.555023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0d8aa94c-e998-47c1-acbc-3ff17672c406 req-b1195a49-8c2e-46ed-857f-288498b2bf2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061391 Oct 04 18:09:31.556993 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 687/1313] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:31.557471 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52950790-8f9b-40e0-877e-5434841eec76 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.429751 Oct 04 18:09:31.558769 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 627/1314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:31.570306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ddb07366-7ea7-417b-bee8-69212dad29d7 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.571296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ddb07366-7ea7-417b-bee8-69212dad29d7 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.571409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:31.572052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.578841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.579330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.579803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.580511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.580974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.581415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.625228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:31.813912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ddb07366-7ea7-417b-bee8-69212dad29d7 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:31.825857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ddb07366-7ea7-417b-bee8-69212dad29d7 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1223 microversion: 2.1 time: 0.265654 Oct 04 18:09:31.826760 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 688/1315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1223 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:31.840598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": "auto"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:31.847314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:31.862697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.866975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.868137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.869046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:31.869663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:31.870451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:31.917940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'flavor' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:31.927906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Going to try to live migrate instance to n-h1-833090-21 {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:09:32.005647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:32.017291 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc78fb22-3bf3-4e43-ad08-66e1c0efcbae tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.457265 Oct 04 18:09:32.031514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 628/1316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:31 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:32.605160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:32.607005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:32.630001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.630508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.630954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:32.631705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:32.632170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:32.644865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.056969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.068032 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6802aeda-e295-4fda-8116-edc014aa6ae8 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 1.481460 Oct 04 18:09:34.069093 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 629/1317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:32 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.091535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.095348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.117715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.118215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.118658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.119379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.119864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.120297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.355974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.373304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf1c3294-6c86-4aba-9247-29cb9647fd63 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1219 microversion: 2.1 time: 0.286323 Oct 04 18:09:34.375802 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 630/1318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1219 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.383751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:34.384740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:34.398458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.400381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.401646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.403122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:34.404087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:34.404866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:34.724934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:34.746500 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-134df75e-d490-45f9-9fc5-5586b00c152b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.367091 Oct 04 18:09:34.749033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 631/1319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:34 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:34.864176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2059298257", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a8f1d04b-8462-4d1d-b083-ed51ae7b9077"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:34.929873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] validate_networks() for [('a8f1d04b-8462-4d1d-b083-ed51ae7b9077', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:35.929576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:35.930985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:35.931681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:35.933426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:35.934077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:35.953179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.966792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.966792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.966792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:35.966792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:35.966792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:35.988502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Getting quotas for project 445e6f1d18a24f1ba281e72bd184e991. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:35.996391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Getting quotas for user ce10b5a94f984c29aa143d80f46c9aab and project 445e6f1d18a24f1ba281e72bd184e991. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:36.019441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Going to run 3 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:36.024067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:36.171094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:36.311043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=284fdf5e-da3b-4dce-87b9-c3534b88e196,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:36.509658 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb4b8d91-de2e-4831-8497-21f29928d3a2 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759110 Oct 04 18:09:36.516634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 632/1320] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:09:36.521645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:36.523850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:36.537601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.538299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.538906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.544112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.544860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.545468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.888776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:36.899833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b27bd1b-f068-4b5f-ae96-919b61ac6433 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.381932 Oct 04 18:09:36.900672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 633/1321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:36 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:36.910315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:36.916106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:36.926750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.928958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.929810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:36.931205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:36.932459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:36.933429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.048229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.057392 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea18cfbe-9043-4922-8799-9a2e93eb8637 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1281 microversion: 2.1 time: 0.155104 Oct 04 18:09:37.060446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 634/1322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:36 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.069378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.072968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.081649 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4aea2288-dcf7-4191-9a3c-519952448392 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/action" status: 202 len: 0 microversion: 2.25 time: 5.253487 Oct 04 18:09:37.083658 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 689/1323] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:09:31 2022] POST /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/action => generated 0 bytes in 5256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:37.089765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.105675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.108851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:09:37.109362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.117648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.117648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.117648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.117648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.120895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.186198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.187262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.187906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.188796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.189434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.190974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.430531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f306a534-9ec2-43a9-bf51-969b9da4660c tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.345161 Oct 04 18:09:37.432199 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 690/1324] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers => generated 1018 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.438821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.439901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.447672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.459921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.460987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.463538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.465506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.467105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.565880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.574395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0bca540-00fa-46fc-aa65-5801e7548dac tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.512308 Oct 04 18:09:37.591084 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 635/1325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.595639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8358488f-9910-4f60-b45e-112cb2969dbd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.596335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8358488f-9910-4f60-b45e-112cb2969dbd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.729540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8358488f-9910-4f60-b45e-112cb2969dbd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:37.746273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8358488f-9910-4f60-b45e-112cb2969dbd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1223 microversion: 2.1 time: 0.154125 Oct 04 18:09:37.751858 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 636/1326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:37.926820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:37.927437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:37.938540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.939797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.949761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:37.950541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:37.951966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:37.955412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.197392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.212805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.214324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.215577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e90b160-bf21-422a-a50e-ad1b11e38c0e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.782115 Oct 04 18:09:38.231013 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 691/1327] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:38.231013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.231013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.233073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:38.245275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.246378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.246378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.247041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.255585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.256261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.391783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.398656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.416943 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3abf940-b94a-46de-8554-467fa4b0511a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1281 microversion: 2.1 time: 0.192907 Oct 04 18:09:38.417657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1d07aea-5e13-40b7-af7a-74e67a1b067e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.496007 Oct 04 18:09:38.418936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 692/1328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:38 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:38.428692 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 637/1329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:37 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:38.597936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.599641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.623516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.627323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.629244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.629244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:38.630912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:38.631679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:38.775429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cbb0fd60-2b34-423e-b853-25295bd5fa5a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:38.777252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cbb0fd60-2b34-423e-b853-25295bd5fa5a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:38.837324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cbb0fd60-2b34-423e-b853-25295bd5fa5a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:38.845179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cbb0fd60-2b34-423e-b853-25295bd5fa5a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1223 microversion: 2.1 time: 0.073566 Oct 04 18:09:38.846530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 638/1330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:38 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:39.247947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.249309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.260715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.262352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.263060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.264258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.265546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.266171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.510398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.525770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.525770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.526255 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b19f00c0-f5e1-4bb2-8c62-bb2852cd8280 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.281956 Oct 04 18:09:39.527617 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 639/1331] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:39.533110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.533968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.557196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.558119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.558779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.559902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.560550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.562167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.616566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.630935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8cdf4691-9197-4514-8915-3a6320bc1f60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 1.034631 Oct 04 18:09:39.632246 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 693/1332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:38 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:39.649719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.651252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.674067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.674847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.675308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.675966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.676866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:39.677879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:39.678494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:39.684319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0cc9d010-10f1-4149-bb97-b1b7819c378d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1281 microversion: 2.1 time: 0.155296 Oct 04 18:09:39.685809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 640/1333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:39.870675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5892554-5577-44c4-9c32-e80f17fd5a8e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:39.874767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5892554-5577-44c4-9c32-e80f17fd5a8e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:39.934795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f5892554-5577-44c4-9c32-e80f17fd5a8e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:39.947184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5892554-5577-44c4-9c32-e80f17fd5a8e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1223 microversion: 2.1 time: 0.076733 Oct 04 18:09:39.947184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 641/1334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:40.292891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.307617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6eacf552-da9d-4d0f-8cfe-cefef16a84d6 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.672370 Oct 04 18:09:40.311999 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 694/1335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:39 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:40.555329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.556839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.572056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.572553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.572997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.594286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.594286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.594286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.660808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.662440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.675662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.677063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.678168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.679392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.681413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.681413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.975552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.995037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.997075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.998602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae7d6556-c572-4f91-90ad-5bd5b19ab4dc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.449252 Oct 04 18:09:41.009189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 642/1336] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:41.025127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.027990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.036271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.036761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.037769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.038554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.039021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.039614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.278676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.289555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8a51c3d-0614-46e4-8829-3b8882080421 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.278425 Oct 04 18:09:41.290296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 643/1337] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:41.295775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.297078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.304617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.305545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.306198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.307101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.307798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.308291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.378645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.386903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30ed47f7-a042-42ec-a474-aece3fe54c3a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1219 microversion: 2.1 time: 0.095360 Oct 04 18:09:41.388048 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 644/1338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:41.393412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.394311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:41.401657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.402414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.403151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.404158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:41.404793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:41.406127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:41.437677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.451831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80b35bef-b08b-4ea2-9359-4cce90bcd53d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.796000 Oct 04 18:09:41.453675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 695/1339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:41.688424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:41.707637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1d00fba-1f69-4c34-b5e5-1f6c374b2cf0 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.317442 Oct 04 18:09:41.723412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 645/1340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:42.070626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:42.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:42.113309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:42.118008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.121614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.124822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.127417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.128103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.129598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.185817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:42.316181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:42.317092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:42.352886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.354630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.356424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.357385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.360784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.363744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.019341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.048457 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-243c4c4b-c40f-4277-9041-b4d87ad9eb0f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.737818 Oct 04 18:09:43.052648 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 646/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:42 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:43.065027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.066015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.078812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.084546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.088593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.089863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.090516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.095651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.258087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.270932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddd73ef8-cb02-407f-8960-11fa3560c1d3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1293 microversion: 2.1 time: 0.216491 Oct 04 18:09:43.271562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 647/1342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:43.282436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.283067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.301320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.302095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.302726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.303644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.308059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.308779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.735100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.782359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.787822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:43.787822 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5e48d12-872c-4a5c-a1bb-d6995b1fbcc6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 1.760563 Oct 04 18:09:43.787822 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 696/1343] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:42 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:43.795566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.803194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.812598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.813465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.817373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.818340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.818978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.819612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.611038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.618716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:44.626870 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-016df120-533b-4ffb-b22e-f0352cb79d3f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 1.354009 Oct 04 18:09:44.629714 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 648/1344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:44.716376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.716376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d3958e2-0159-4858-a799-f55d117749fc tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.914512 Oct 04 18:09:44.716376 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 697/1345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:44.716376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.716376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.731363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.741000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.741940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.765342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.765342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.765342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.778921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "name": "network-vif-plugged", "status": "completed", "tag": "eba87f75-fe5f-4235-8e78-9856bc866230"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:44.800628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.801418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.804207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.832388 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] Creating event network-vif-plugged:eba87f75-fe5f-4235-8e78-9856bc866230 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:09:44.845700 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-66e0c5e7-86a5-4091-aebc-d2981a4f0d3e req-89b65977-b01e-496d-b1ad-4cb913b42dd1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214058 Oct 04 18:09:44.849573 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 649/1346] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:44.862020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:44.865388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:44.884653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.884653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.884653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.886925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:44.890766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:44.893021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.348224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:45.365077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa72d4d2-ea6e-431d-89cd-31fc36aef816 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1281 microversion: 2.1 time: 0.510520 Oct 04 18:09:45.367232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 650/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:45.376838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "name": "network-vif-unplugged", "status": "completed", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:45.410552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.410552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.410552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.440072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] Creating event network-vif-unplugged:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h1-833090-21 Oct 04 18:09:45.452658 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-35b1fd33-2133-4fe7-b449-4e0438749853 req-6fa70c81-59fe-4440-a7de-b0d191b5a3d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082240 Oct 04 18:09:45.458213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 651/1348] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:45.476129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:45.478699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:45.509210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.509735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.510196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.513863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.516873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.517409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.540658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:45.560071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2a863bd-834d-4ac2-82fd-9f1149466661 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.851506 Oct 04 18:09:45.562400 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 698/1349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:44 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:45.658188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:45.659156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.680321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.975745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:46.049542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.068255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02d57392-4a72-4ace-b26c-a01b35a62440 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.413849 Oct 04 18:09:46.071801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 699/1350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:45 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:46.082693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.083336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.094085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.099664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.100517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.101422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.103567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.104204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.399086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.409163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.425600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.426924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4197b933-3ea2-4957-a921-931a95a8eb15 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.967417 Oct 04 18:09:46.427573 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 652/1351] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:45 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:46.468984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.477295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.487789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.488469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.489069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.495144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.496237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.496847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.616403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.629910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fcddb0f2-53cd-41ed-8fcf-fb46e6c850c0 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1281 microversion: 2.1 time: 0.188973 Oct 04 18:09:46.630773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 653/1352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:46.643745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:46.644967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:46.663058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.672648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.673429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.674387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:46.675044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:46.686553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.312178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:47.392544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:47.429610 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7106983a-a35c-454f-a1d1-e89852445097 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.795172 Oct 04 18:09:47.443498 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 654/1353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:47.464895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "name": "network-vif-plugged", "status": "completed", "tag": "fe38893a-6465-4cd0-8da5-e5c896f4d3c0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:47.497583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.498847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.500713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.526562 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] Creating event network-vif-plugged:fe38893a-6465-4cd0-8da5-e5c896f4d3c0 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:09:47.533558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-081d033d-700a-4608-9bac-95fb0c790738 req-b65df04b-cdaf-4c8c-a2d6-a790db061751 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097033 Oct 04 18:09:47.562272 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 655/1354] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:47.564139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:47.578292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.579013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.583089 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6019c437-aa54-4f75-b681-e97985ffc271 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 1.509697 Oct 04 18:09:47.583987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 700/1355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:46 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:47.589461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.590156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.590753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.591686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.594627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.595282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.599009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.600104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.611383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.612535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.613176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.614095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.614770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.616380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.866036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:47.876796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b7e983e-e6c9-4a9a-8af0-6a11c6919ddd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.312702 Oct 04 18:09:47.877384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 656/1356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:47.883278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:47.903033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.903822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.904441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.917451 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] Creating event network-changed:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:09:47.923740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-af97638f-29e3-4345-9b69-9273a884903c req-f85b5db8-67d8-4029-8c92-6aa06a5344a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044222 Oct 04 18:09:47.924647 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 657/1357] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:47.930981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.931716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.940721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.941595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.942214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.943120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.943769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.944389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.046096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.071932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93c4bfbe-5414-4408-a3dd-97884dd5ae9e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1281 microversion: 2.1 time: 0.130902 Oct 04 18:09:48.071932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 658/1358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:48.321519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.335030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.338583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.340979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c8398c9-b1d2-41ea-a5d4-b2042ebbb677 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.745830 Oct 04 18:09:48.341400 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 701/1359] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:48.462608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.463502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.472341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.473093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.473483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.474339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.474698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.475304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.607478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:48.609763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:48.623020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.627233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.628227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.629218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:48.629898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:48.630605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:48.957346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.972981 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9780a751-4988-4e3b-afce-9f921ceeaf2e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1333 microversion: 2.1 time: 0.364663 Oct 04 18:09:48.984537 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 702/1360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.007687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.008790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.025195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.028601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.029692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.032218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.035039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.035805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.334277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.353712 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5057748-cffe-4313-9fe3-aff47b2e1e93 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.900478 Oct 04 18:09:49.359619 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 659/1361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.364635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.365253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.384690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.385528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.386138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.387028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.387696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.388283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.464476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.482769 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c28282c4-6a95-4f72-8bfb-7879c1448ade tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.488724 Oct 04 18:09:49.491318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 703/1362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:49.496893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.497515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.512492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.513503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.515722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.522635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.522635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.522635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.779280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.806019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.812801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.815803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-682dd44f-08d7-4630-91e8-c9fcba57f299 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.326706 Oct 04 18:09:49.819182 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 704/1363] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:49.820153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:49.829988 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c7d5165-812e-43fd-86d7-664fc12c3e9d tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.469003 Oct 04 18:09:49.830727 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 660/1364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.007803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.008435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.025266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.028682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.030498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.031305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.032563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.033954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.100130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:50.127551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=18 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:50.138093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.141255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.142844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.168271 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] Creating event network-changed:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h1-833090-21 Oct 04 18:09:50.177969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cb6eda9f-f4bd-4844-b9ad-4c544004334b req-14f075fe-65a6-45df-9b98-9d4bd57ff353 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084275 Oct 04 18:09:50.182229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 661/1365] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:50.378501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.379340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.413994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:50.421199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.421749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.425052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.430037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.431202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.436070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.748868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:50.761029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae6cb5c3-5bb7-4b33-84fc-e7e0dc8ff286 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1668 microversion: 2.1 time: 0.758502 Oct 04 18:09:50.763736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 705/1366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1668 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:50.774891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.775547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.801933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.805163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.807683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.809516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.812640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.813320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.255970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.268139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7dc783c0-7405-4e6a-b0e1-b71660ec7da9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.499129 Oct 04 18:09:51.272658 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 706/1367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:51.287538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.288050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.296220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.301333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.301882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.313630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.314385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.315015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.358805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a451c52-6b5b-4e5b-afc0-206edee3f6eb tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da/ips" status: 200 len: 179 microversion: 2.1 time: 0.084650 Oct 04 18:09:51.360058 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 707/1368] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da/ips => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:51.375607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.376480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.383445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.392858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.392858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.396947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.397709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.398158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.618799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.632401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8874c613-50ca-4a14-b342-7d831824bb88 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 1.259278 Oct 04 18:09:51.634166 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 662/1369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:51.642427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.643934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.659417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.660968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.663202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.664747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.667044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.668851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.140506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.167346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.170653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.173813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b2124ab5-6563-4dae-af77-e42d62d95880 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.810852 Oct 04 18:09:52.173813 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 708/1370] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:52.180102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.180967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.202800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.249162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:52.323556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.341603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16d4bec6-73fc-46cc-a0cf-cf823da11ea5 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.705941 Oct 04 18:09:52.343220 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 663/1371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:52.360414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6", "tag": "c66e62b1-3a5d-4d79-aedb-df861969615a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:52.416857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.418403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.420989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.435330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] Creating event network-changed:c66e62b1-3a5d-4d79-aedb-df861969615a for instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 on n-h1-833090-21 Oct 04 18:09:52.440681 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-08f0ee44-7cf6-4cd8-8322-a9528a1f76dc req-309f75b5-0c15-42db-af60-0bed1497c183 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095420 Oct 04 18:09:52.441457 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 664/1372] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:52.447112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.448180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.461670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.462632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.463331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.464984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.465952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.467525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.652058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afaed375-1752-424d-986f-40b12c886893 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 204 len: 0 microversion: 2.1 time: 0.476403 Oct 04 18:09:52.652849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 709/1373] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:52 2022] DELETE /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:52.668648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.669379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.679012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.679539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.684864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:52.690565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:52.690565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:52.690565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.053581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.077351 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9c3fb4d-11dd-4328-a94d-4c82ba4b907d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.634629 Oct 04 18:09:53.077973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 665/1374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.085563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.086465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.097867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.108130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.110323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.112445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.117734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.132867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.405390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.414242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-153d00a2-e7ff-4dda-aaa6-b29d5fe8fcc5 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1674 microversion: 2.1 time: 0.333419 Oct 04 18:09:53.417712 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 666/1375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.430203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "name": "network-vif-plugged", "status": "completed", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:53.465322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.465819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.466449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.468006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.484759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ceec9923-4e61-45ea-b7dc-5479cec8c399 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.820920 Oct 04 18:09:53.489670 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 710/1376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:53.498759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.499378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.501435 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] Creating event network-vif-plugged:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:09:53.507933 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-76118939-70a4-4ffe-9e6e-40303ecdebb3 req-e3b1100d-b367-460d-8c9a-c73ada8d4e6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080520 Oct 04 18:09:53.513350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 667/1377] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:53.513465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.514093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.514537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.515451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.516184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.517048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.519603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.520319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.530512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.531016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.531688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.532469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.532935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.533363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.950075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.954357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:53.960705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.962171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.963414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7358062a-89ec-4cde-9a76-407cd990d1bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.471175 Oct 04 18:09:53.964166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 711/1378] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:53.969242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79069af2-191c-4bea-ae18-5d013c91f16b", "tag": "28779060-99cd-4d65-afa6-29e83efb8159"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:53.980674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.981450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.982071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.995375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] Creating event network-changed:28779060-99cd-4d65-afa6-29e83efb8159 for instance 79069af2-191c-4bea-ae18-5d013c91f16b on n-h1-833090-21 Oct 04 18:09:54.003208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-41ee290c-80b2-4a52-bdf1-f285e2397200 req-6475916e-90fe-4768-9c10-721f99b86a13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037584 Oct 04 18:09:54.005020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 712/1379] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:54.111622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.112661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.127082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.128593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.131108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.132610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.134467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.135739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.369919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.371839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.380793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a1596b7-6c49-4bfc-be12-53317bf19437 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.275473 Oct 04 18:09:54.381970 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 713/1380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.383735 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14762129-d9e3-4321-aa5b-87eabc59a2a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.870560 Oct 04 18:09:54.384569 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 668/1381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.442042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.442959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.451048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.451582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.452022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.452727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.453187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.453609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.485151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284fdf5e-da3b-4dce-87b9-c3534b88e196", "tag": "c81684fe-b7f8-4381-9b3c-f435d4e447cc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:54.496485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.497241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.498110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.510664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] Creating event network-changed:c81684fe-b7f8-4381-9b3c-f435d4e447cc for instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 on n-h2-833090-21 Oct 04 18:09:54.516556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1869890a-47f9-4ace-a89b-3c7132e25c54 req-eeae1371-cc88-4f9f-8069-04c522f861a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035582 Oct 04 18:09:54.517522 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 669/1382] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:54.526801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.527837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.535235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.536281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.536926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.538040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.538691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.539311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.659400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.670771 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a41bfa3-4264-4511-ad87-5867a7c31d2d tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1674 microversion: 2.1 time: 0.231917 Oct 04 18:09:54.688320 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 714/1383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.835551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.839450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:54.855656 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-943a47cb-2a38-414c-b13b-e31062df677c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 0.332801 Oct 04 18:09:54.862737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 670/1384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:54.990891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.991893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.000940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.004474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.004474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.004474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.004474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.004474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.330596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.340197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.342508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.343982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e87bd5d5-1b64-439f-acb9-587bc44febbe tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.357517 Oct 04 18:09:55.356225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 715/1385] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:55.406652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.408244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.419402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.421650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.429071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.430910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.431850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.432512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.443290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.443290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.443290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.443672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.443672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.443672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.443672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.443672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.685685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.709828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1803c38-3ea8-43aa-a973-8ea86be9badf tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.307406 Oct 04 18:09:55.711866 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 671/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:55.719641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.733717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.748448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.749348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.751460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.752858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.754817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.760983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.937233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:55.947736 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-225a4c9c-d8a1-4a7f-a6cf-ac97a83083f6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.531842 Oct 04 18:09:55.950424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 716/1387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:55.961877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.963426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.970864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.971680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.973848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.976633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.977421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.978224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.124730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.133064 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-accf927c-c4a3-46ab-a7d8-121ff2d75b44 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1674 microversion: 2.1 time: 0.419863 Oct 04 18:09:56.135502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 672/1388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1674 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:56.370704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.371311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.381707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.384216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.384216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.391036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.392285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.393207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.766217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.777392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.789458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.791778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3918e0d-f9ac-4a4d-8128-a7328f0ca28f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.425225 Oct 04 18:09:56.804318 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 673/1389] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:56.834931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.835736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.848221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.849065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.849674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.851171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.852038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.852652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.040224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.077389 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-186e2058-703b-4fa5-b41f-3cdf9afcb6c1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1323 microversion: 2.1 time: 1.125058 Oct 04 18:09:57.078540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 717/1390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1323 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:57.097244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.097244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.106644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.110648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.113006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.114048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.114721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.115827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.238962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.255290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8fb7660-99de-4a99-a2a2-00b53c0edbf9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.449482 Oct 04 18:09:57.255913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 674/1391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:57.267933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.268903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.277056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.295401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.295401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.295401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.295401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.295401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.306592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.319149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98c1fa6b-ef03-4e13-8334-0fd6b74b83ec tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1653 microversion: 2.1 time: 1.058146 Oct 04 18:09:58.329009 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 675/1392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1653 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.413468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.425384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba754656-5c84-4955-8be7-c8d5ebfd24ef tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 1.345368 Oct 04 18:09:58.431881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 718/1393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:58.443720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.449416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.494069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.500351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.501241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.506450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.510458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.511891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.752794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "name": "network-vif-unplugged", "status": "completed", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:58.773027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.774369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.775127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.798642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] Creating event network-vif-unplugged:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h2-833090-21 Oct 04 18:09:58.814055 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2697a387-ce4e-422f-b3ef-db6a89f3825f req-331ff977-0607-49a4-96de-fd300d89c2be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.483114 Oct 04 18:09:58.814700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 676/1394] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:58.825586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "name": "network-vif-deleted", "tag": "eba87f75-fe5f-4235-8e78-9856bc866230"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:58.837421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.848298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.851341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.852072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.852626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.853096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.860245 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87bf8b72-36b7-4bd0-a469-f9595b1eb0df tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.426954 Oct 04 18:09:58.864542 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 719/1395] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:58.874210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.874823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.891442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] Creating event network-vif-deleted:eba87f75-fe5f-4235-8e78-9856bc866230 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:09:58.894676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.895405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.896706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.897485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.897881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.898309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.901671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-12e58787-7dcf-4dd4-b9ba-81bd0ca272a5 req-45863611-badf-46b9-b7ca-fb57611ac3d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085370 Oct 04 18:09:58.908319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 677/1396] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:58.920796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.921889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.933497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.939499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.940235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.941225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.943720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.944447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.702322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.717145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55edfa86-d2c8-4548-a0ef-35d327767d8d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.807361 Oct 04 18:09:59.733837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 678/1397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.742130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.750539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.766910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.779004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.779550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.781901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eadacfd6-b823-488c-9fe1-5627583f6840 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1520 microversion: 2.1 time: 0.916248 Oct 04 18:09:59.782533 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 720/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1520 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:59.782877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.788000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.788000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.792081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.800893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.801537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:59.815976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.816720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.817346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.818701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:59.819530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:59.820189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.985068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0a0453d12e41ff87520a0a6735ce20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7e35a897f64e069255d3946bbb22f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.996797 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ae781e1-6384-4950-b37b-a8036852fe8e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 200 len: 1453 microversion: 2.1 time: 0.261751 Oct 04 18:10:00.001812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 679/1399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 1453 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:00.034222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c0c7a92-f7d9-4bb4-9632-9fa0f6312bc1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'create', calling method: .version_select at 0x7f90097fd4c0>, body: {"pool": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:01.015869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.031079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dddc3c2c-cc47-45a9-a791-4128cd01fd6a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 1.242557 Oct 04 18:10:01.031955 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 721/1400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:01.044694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.045541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.063196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.063751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.072027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.072027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.072027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.072027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.684625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.701573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.703412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.708766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf448f46-7774-487c-bcbc-79fc7b617f87 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.665295 Oct 04 18:10:01.709660 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 722/1401] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:01.725483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.726622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.742469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.743933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.746561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.749845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.750603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.751276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.280414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.303959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35dd717e-3f50-4d31-93f0-92b724214146 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.586524 Oct 04 18:10:02.304888 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 723/1402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.534472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1691501006", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:02.549478 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c0c7a92-f7d9-4bb4-9632-9fa0f6312bc1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.529881 Oct 04 18:10:02.552240 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 680/1403] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:10:00 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:02.557322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.558124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.581109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.581874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.583561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.584504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.589920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.590601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.607951 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da HTTP/1.1 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a004dad6-71ed-4bbe-b590-ba9f1a79a4da'} Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:02.609952 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:02.615528 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:02.617014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:02.618416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-594169e0-d18f-4ffe-97fd-6bf7e538c423 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 404 len: 111 microversion: 2.1 time: 0.064939 Oct 04 18:10:02.619229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:02.619919 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 681/1404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:02.625275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a004dad6-71ed-4bbe-b590-ba9f1a79a4da", "name": "network-vif-deleted", "tag": "fe38893a-6465-4cd0-8da5-e5c896f4d3c0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:02.638645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.639424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.640071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.653721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] Creating event network-vif-deleted:fe38893a-6465-4cd0-8da5-e5c896f4d3c0 for instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da on n-h1-833090-21 Oct 04 18:10:02.659712 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dc19d02e-535c-44e0-8d63-470408186bb4 req-1b987774-cc5e-4adb-b776-47cda69dcfd6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038182 Oct 04 18:10:02.660605 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 682/1405] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:02.666009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:02.677201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.678048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.678794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.695061 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] Creating event network-changed:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h2-833090-21 Oct 04 18:10:02.701963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6d900d1c-ddd5-4ae9-a515-42c9a6414053 req-0c75283d-0ac1-4006-a8a8-3be6f1862d22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039873 Oct 04 18:10:02.702783 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 683/1406] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:02.709793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.710798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.718677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.719635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.720270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.721168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.721997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.722589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.110571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.129054 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f331bc26-56e7-4c0d-90eb-b6d306fc6b44 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.424706 Oct 04 18:10:03.133706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 684/1407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:03.149835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.155628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.175321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.177617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.178363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.179317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.180119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.180798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.200039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:03.200495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:03.201108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:03.201708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:03.202272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:03.222569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.223937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.234214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.235377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.236109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.236712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.277897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:03.289790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:03.325606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:03.328462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:03.552097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f3f1180-0d66-4a11-9975-1a6a33952b61 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229342 Oct 04 18:10:03.552874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 724/1408] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:03.591018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-936367446", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "8192a865-5cfc-4984-87fa-750232fba9c2"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:03.693074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] validate_networks() for [('8192a865-5cfc-4984-87fa-750232fba9c2', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:03.974610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.985043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.991174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.996659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8bd7c3be-8069-438e-8ef5-ca2724567423 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.861758 Oct 04 18:10:03.998937 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 685/1409] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:04.010847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.014940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.027087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.028019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.031121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.032224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.034669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.035377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.296761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.313300 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee601f1f-094d-4cd7-8b3e-c9dbfb4808ca tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.312290 Oct 04 18:10:04.313893 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 686/1410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.332111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f3439dd-af8c-4ab4-aab3-2001a273706b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.332722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f3439dd-af8c-4ab4-aab3-2001a273706b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.428466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0f3439dd-af8c-4ab4-aab3-2001a273706b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.449522 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f3439dd-af8c-4ab4-aab3-2001a273706b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1213 microversion: 2.1 time: 0.133970 Oct 04 18:10:04.451495 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 687/1411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.484139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6", "name": "network-vif-plugged", "status": "completed", "tag": "c66e62b1-3a5d-4d79-aedb-df861969615a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:04.505202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.505941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.506741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.530365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] Creating event network-vif-plugged:c66e62b1-3a5d-4d79-aedb-df861969615a for instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 on n-h1-833090-21 Oct 04 18:10:04.539127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5b7803b1-d018-47eb-906f-dfd04ccc2c6d req-204df12e-d04c-41e5-aa09-0882c2f657cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070863 Oct 04 18:10:04.539869 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 688/1412] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:04.546138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.546995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.559854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.561073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.569718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.569718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.569718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.569718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.820189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.829073 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ed1cc07-4d62-4785-94d4-39bd42104ea6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.287766 Oct 04 18:10:04.832465 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 689/1413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.043517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.047713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.072356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.073087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.075188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.081669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.082087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.082860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.483540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.504951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.509387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b6024c2-8212-4cc6-b54e-29a5c7dff21f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.484205 Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 690/1414] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.530148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.530847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.530972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.531428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.531930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.814713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.825327 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7afc331-97b6-4294-9442-b4fc9769b3dd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.309789 Oct 04 18:10:05.835809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 691/1415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.845438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.846301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.867753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.868736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.871459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.873016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.879718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.879718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.969116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.978670 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-37f90c3f-5cae-49bc-b75f-1e0a71442293 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1217 microversion: 2.1 time: 0.141155 Oct 04 18:10:05.980050 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 692/1416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:05.985649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.986192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.992747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.993401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.993850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.994961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.995419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.996140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.021592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:06.177051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.192688 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07adf575-d9a3-49db-bc77-190af1d690e3 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.210139 Oct 04 18:10:06.193562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 693/1417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.529526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:06.530040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:06.530416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:06.530818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:06.531227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:06.538803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.539411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.542086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.542869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.544485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.545524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.545662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.546008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.546147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.546445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.546796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.547140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.547620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.548051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.569515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Getting quotas for project 839a7592f75b4a30970febf691188adf. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:06.576735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Getting quotas for user fcc0dee8f8cc471d919df6b41af0d4e7 and project 839a7592f75b4a30970febf691188adf. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:06.600379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:06.603051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:06.625088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:06.713710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.726815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.728560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.730234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88474536-f8cd-4191-921b-ad9c9d192288 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.196462 Oct 04 18:10:06.748480 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 694/1418] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:06.748480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284fdf5e-da3b-4dce-87b9-c3534b88e196", "name": "network-vif-plugged", "status": "completed", "tag": "c81684fe-b7f8-4381-9b3c-f435d4e447cc"}, {"server_uuid": "79069af2-191c-4bea-ae18-5d013c91f16b", "name": "network-vif-plugged", "status": "completed", "tag": "28779060-99cd-4d65-afa6-29e83efb8159"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:06.752260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.752899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.753435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.768081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Creating event network-vif-plugged:c81684fe-b7f8-4381-9b3c-f435d4e447cc for instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 on n-h2-833090-21 Oct 04 18:10:06.768704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] Creating event network-vif-plugged:28779060-99cd-4d65-afa6-29e83efb8159 for instance 79069af2-191c-4bea-ae18-5d013c91f16b on n-h1-833090-21 Oct 04 18:10:06.778861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-25cd7b14-683f-44b2-a5f6-f3452e6898f1 req-7250891c-5a1a-4d13-b5ac-ccfb6c90d3ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046334 Oct 04 18:10:06.779492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 695/1419] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:06.863314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-953c7e4e-2aeb-45ac-a98b-b01983ab275a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.301906 Oct 04 18:10:06.870675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 725/1420] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:06.873839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.874748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.882591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c312f679-5446-4bf5-b270-e822e0437471 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.883279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c312f679-5446-4bf5-b270-e822e0437471 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.885585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.886924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.887742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.888924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.889649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.890382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.262176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.306812 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce33a43b-d147-44b2-a296-e7892598200f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.438157 Oct 04 18:10:07.309283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 696/1421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.322556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.323169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.330788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.331283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.331866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.332583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.333378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.333529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.426607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.432235 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fbf6e2ba-d31a-4087-ade0-f9b0b7ae7508 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1265 microversion: 2.1 time: 0.119835 Oct 04 18:10:07.433155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 697/1422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.438488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.439318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.447294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.448034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.448484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.449234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.449768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.451247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.633084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.645004 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc8e41ed-cfc7-4bb7-ac5e-bdf3318dcb39 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.210461 Oct 04 18:10:07.660439 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 698/1423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.663501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c312f679-5446-4bf5-b270-e822e0437471 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.683958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c312f679-5446-4bf5-b270-e822e0437471 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1223 microversion: 2.1 time: 0.811551 Oct 04 18:10:07.685108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 726/1424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1223 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:07.761435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.761868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.772592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.773106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.773613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.774331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.777611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.780579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.989399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.000395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.002126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.004149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8a126f2-24e9-4350-9bae-354f047ee78a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.248060 Oct 04 18:10:08.015970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 699/1425] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:08.333561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.334366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.342688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.343647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.344305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.345094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.345612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.346246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.462291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.463505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.484710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.485543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.486259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.487179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.487903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.488600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.694950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.737517 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e78c832e-887a-4660-826f-05cde7a24c29 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1273 microversion: 2.1 time: 0.279734 Oct 04 18:10:08.747581 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 700/1426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.748695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.749453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.758787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.759385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.759935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.761580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.762257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.763481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.910479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.925543 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0e7a229-9027-4297-a5d7-4af1bf64aed9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 0.595465 Oct 04 18:10:08.926964 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 727/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.933023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.933935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.949409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.950827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.951640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.952628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.953417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.954103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.150164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.185067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e3fe865-57cc-4bdf-ad2e-24f11ca3854c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1219 microversion: 2.1 time: 0.256278 Oct 04 18:10:09.204371 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 728/1428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1219 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.229307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.230247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.256515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.259227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.264452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.267576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.268220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.271257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.420957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.432613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5683a910-0682-4bd0-9778-07cf3719d77f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1323 microversion: 2.1 time: 0.690458 Oct 04 18:10:09.433211 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 701/1429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1323 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.768835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.769491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.796668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.797433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.798072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.806793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.807295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.807653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.807802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.828710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.834590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.842615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61597621-5db0-40f3-bcc5-1355c926b272 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.649860 Oct 04 18:10:09.845581 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 729/1430] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:09.955325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.955983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.972197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.973548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.974011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.974890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.977817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.978264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.018906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.039124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6a5b442-4a13-4dc0-9a88-e78c16932314 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1271 microversion: 2.1 time: 0.274883 Oct 04 18:10:10.043117 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 702/1431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:10.208631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41498e2b-cefa-48cc-84cb-6c71f6f17ba0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Action: 'create', calling method: .version_select at 0x7f90097865e0>, body: {"keypair": {"name": "tempest-keypair-444193698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdynUoYJL00MeTtNxkM3K7t0KxrOGAgcy00mNdiFfHNQNpS5+BakwqsF1yX5wlLVlpkDOhGqM7So6VqAROARyKf6t5QKkOYvM6OcOeeaRC1wf/Jpj2uhNDqxCIsltA4iw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:10.240107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-41498e2b-cefa-48cc-84cb-6c71f6f17ba0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for project 1de1f2554b8445028077ef14793c77a3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:10.246428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-41498e2b-cefa-48cc-84cb-6c71f6f17ba0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for user 86bc8800e6b14a1ab4810be9e05f55e2 and project 1de1f2554b8445028077ef14793c77a3. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:10.357134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41498e2b-cefa-48cc-84cb-6c71f6f17ba0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.311045 Oct 04 18:10:10.359242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 703/1432] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:10:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:10.366896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.370848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.392763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.396953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.397699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.398597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.399199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.400791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.556405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.569739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46c56448-74b8-4c06-a986-c6a671cef24c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1275 microversion: 2.1 time: 0.206852 Oct 04 18:10:10.570805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 704/1433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:10.581540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.582168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.594812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.600526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.605869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.605869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.605869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.605869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.081711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.105310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a48874a9-71e6-4c0c-90b6-13da98b6b747 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1717 microversion: 2.1 time: 1.154021 Oct 04 18:10:11.107002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 730/1434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1717 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.115160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.120602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.141340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.141996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.142779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.145037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.145718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.150568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.197963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:11.248024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.261679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9d07f44-aac8-4312-a208-36868b58e479 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 200 len: 1516 microversion: 2.1 time: 0.688035 Oct 04 18:10:11.275848 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 705/1435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 1516 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.291027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.293562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.315289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.316088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.316898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.317986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.318639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.319242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.756205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.765142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4225ddc3-8adc-40bf-acad-e7bfbf2a0545 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.487118 Oct 04 18:10:11.766061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 706/1436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.786486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.787534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.789929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:11.796060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.796842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.797477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.805407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.805407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.805407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.277491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.299044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.302266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.303779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cae09aec-0006-4401-a083-3dfc55dde03a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 1.194307 Oct 04 18:10:12.304656 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 731/1437] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:12.310660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.328533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.391405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.405583 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31cf59d4-91e7-4839-a5ae-41a989b68f1a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1516 microversion: 2.1 time: 0.623094 Oct 04 18:10:12.409531 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 707/1438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1516 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.416486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.417671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.428822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.430432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.431400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.433016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.433709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.434874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.569696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.586291 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40a3b356-a46c-409c-9afc-5d0f1c36ca57 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1281 microversion: 2.1 time: 0.279607 Oct 04 18:10:12.587598 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 732/1439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.603484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.609518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.619868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.621034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.623819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.625521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.632252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.636856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.783737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:12.802452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ea4b29c-5986-463b-ae1c-879a49c5a5fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1707 microversion: 2.1 time: 0.389219 Oct 04 18:10:12.803547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 708/1440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1707 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:12.815347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.816273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.862382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.868644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.870643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.872865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.876775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.877603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.377350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.385469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85405ccf-a091-4c66-9142-81ca31204429 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.580513 Oct 04 18:10:13.386058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 709/1441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.428005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5592875b-b710-4c31-8231-ba9b5a1c9a01 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '.version_select at 0x7f90097864c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.432732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5592875b-b710-4c31-8231-ba9b5a1c9a01 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.438289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5592875b-b710-4c31-8231-ba9b5a1c9a01 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.438289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5592875b-b710-4c31-8231-ba9b5a1c9a01 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.450253 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5592875b-b710-4c31-8231-ba9b5a1c9a01 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2340 microversion: 2.1 time: 0.057923 Oct 04 18:10:13.467160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 710/1442] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/os-migrations => generated 2340 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.475703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.476397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.484739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.491023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.491788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.492724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.494131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.494787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.515996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da HTTP/1.1 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a004dad6-71ed-4bbe-b590-ba9f1a79a4da'} Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:13.518427 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aad10ec0-d9b0-44a1-b82e-d007c1f103f9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 404 len: 111 microversion: 2.1 time: 0.051624 Oct 04 18:10:13.524895 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 711/1443] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:13 2022] DELETE /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:13.545949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.546582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.561980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.562483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.562930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.563696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.572005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.572512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.712889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.722278 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5f7289a-beb6-4e65-be11-76883ad82321 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 200 len: 1517 microversion: 2.1 time: 1.125740 Oct 04 18:10:13.727822 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 733/1444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 1517 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.740472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.741248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.758803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.759303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.759787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.760538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.761002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.761429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.938180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.949372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.953287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.957034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c251b690-cfbc-4ca4-8166-f2a4eb5a829d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.422469 Oct 04 18:10:13.958060 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 712/1445] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:13.963001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.963757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: a004dad6-71ed-4bbe-b590-ba9f1a79a4da] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.971092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.971761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.972330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.973117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.973678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.974179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.995541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:13.997769 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da HTTP/1.1 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a004dad6-71ed-4bbe-b590-ba9f1a79a4da'} Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:13.999825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. Oct 04 18:10:14.005032 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.006509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance a004dad6-71ed-4bbe-b590-ba9f1a79a4da could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:14.007675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5eb60796-7f91-4561-b001-17bde054c2ce tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da" status: 404 len: 111 microversion: 2.1 time: 0.048543 Oct 04 18:10:14.008591 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 713/1446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/a004dad6-71ed-4bbe-b590-ba9f1a79a4da => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:14.026200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.031957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.039387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.040885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.041594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.042826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.043753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.044468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.210331 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-135c16c7-3877-4565-ae70-319c21133feb tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1860 microversion: 2.1 time: 0.481092 Oct 04 18:10:14.235653 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 734/1447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1860 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:14.289308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.290443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.317179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.319964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.319964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.321027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.323364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.324410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.408404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:14.458128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:14.466733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9274b7ae-b084-4ba7-8ab1-282a51f05336 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.457046 Oct 04 18:10:14.467320 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 714/1448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:14.483583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.500727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.518007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.521597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.521597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.521597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.521597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.522552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.542728 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 HTTP/1.1 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '80810108-44a4-41a0-9334-d1a80050c4a2'} Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:14.545616 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78ec0270-f58c-457b-a8f4-742ba99af90e tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 404 len: 111 microversion: 2.1 time: 0.075388 Oct 04 18:10:14.551317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 715/1449] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:14 2022] DELETE /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:14.558030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.558957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.566760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.567333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.567805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.569203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.569848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.570543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.800451 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f96f785-7eae-425e-ad38-52eeeb1160ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 204 len: 0 microversion: 2.1 time: 0.562467 Oct 04 18:10:14.804179 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 735/1450] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:14 2022] DELETE /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:14.809719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.810432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.857849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.858361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.858808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.859556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.860009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.865954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.008778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8152ed75-c56f-4be3-8e34-9f8ff512bc7b tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1860 microversion: 2.1 time: 0.456637 Oct 04 18:10:15.011805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 716/1451] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1860 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.028871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.028871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] [instance: 80810108-44a4-41a0-9334-d1a80050c4a2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.041182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.046866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.047431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.048233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.048874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.049511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.097236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] HTTP exception thrown: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Request method failure captured: Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 HTTP/1.1 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHaHoQXBpOFwSOfEqwluyheAZk7sZ-E9bHajAswsEBU5u9DrpFPkfTQ1lSkjm7gaDn2PBQrcVNhdaWYB2SiMiV4H8bf81AULcvMSeYcyj_JKgumEvd90cBkxKgoAivoM5lrYSKN_CRETFeF3Edlq0ui4kfSkfJeKHgT18vvP86sSwdU Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/db7e35a897f64e069255d3946bbb22f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/db7e35a897f64e069255d3946bbb22f5"}]}] Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: db7e35a897f64e069255d3946bbb22f5 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestMultiNic-2094890366 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7a0a0453d12e41ff87520a0a6735ce20 Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestMultiNic-2094890366-project Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '80810108-44a4-41a0-9334-d1a80050c4a2'} Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:15.102330 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] Returning 404 to user: Instance 80810108-44a4-41a0-9334-d1a80050c4a2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:15.108051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6628c0e1-a863-49cb-9608-b807ee45ccf9 tempest-ServersTestMultiNic-2094890366 tempest-ServersTestMultiNic-2094890366-project] 10.222.0.40 "GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2" status: 404 len: 111 microversion: 2.1 time: 0.090386 Oct 04 18:10:15.114576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 717/1452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/80810108-44a4-41a0-9334-d1a80050c4a2 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:15.126042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.126718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.150632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.151449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.155865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.156730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.157224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.157673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.557456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.573154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ce67186-df59-4ca1-9c26-7e75e5535d8f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 200 len: 1523 microversion: 2.1 time: 0.457385 Oct 04 18:10:15.580181 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 718/1453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.585224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.595356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.632671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.635168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.635927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.641286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.642276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.642926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.689283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.705350 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00418fe9-de54-4466-8242-f9265e1dfed4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.899637 Oct 04 18:10:15.719496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 736/1454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.719496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.719496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.741491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.752266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.753037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.753948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.754570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.755227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.985618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lazy-loading 'services' on Instance uuid 95dbe4c3-43e0-45c5-b137-9ee2989353f8 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:16.349989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.369593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.372091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.379718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a549413-3892-48bb-be31-e2afcdadb0b5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.797198 Oct 04 18:10:16.385853 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 719/1455] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:16.392702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.393975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.404657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.405809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.406490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.407623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.409039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.409760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.433667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d5da116-3ac4-4267-aac5-4f6c10923d08 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments/9377b64e-4653-4e77-9cff-90b1cb6e2aaf" status: 202 len: 0 microversion: 2.1 time: 0.724618 Oct 04 18:10:16.437388 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 737/1456] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:10:15 2022] DELETE /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments/9377b64e-4653-4e77-9cff-90b1cb6e2aaf => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:16.459296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:16.511041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.511586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.512061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.568375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] Creating event network-changed:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h1-833090-21 Oct 04 18:10:16.584467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-05d48e53-d04c-4b4c-81c2-a03b86c62371 req-0a0b2586-7218-40ad-aaa9-d4c18a225a3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148652 Oct 04 18:10:16.585143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 738/1457] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:16.613377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.622146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.624191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:16.660028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.661220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.661922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.663388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.664109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.665565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.759274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3707ce8f-c42f-4462-9151-f6ae20865eea tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156076 Oct 04 18:10:16.773086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 739/1458] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:16.795219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.806655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.817778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.821712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.822542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.823576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.824241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.839448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.876190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.890992 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8a58d7d-04c4-4c29-8cf6-9b5328380af2 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.508340 Oct 04 18:10:16.892508 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 720/1459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:16.905431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.910203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.914469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.929664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.930533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.931570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.932276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.932955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.267047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.278200 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9479e9c9-3468-4179-b6ad-04d2389788d5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.384317 Oct 04 18:10:17.279143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 721/1460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.300852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb846ca-3290-4d54-9114-0298e8a26e71", "tag": "ca216d18-f3b5-4168-a856-5ab624c331a1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:17.314032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.318931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.318931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.382498 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] Creating event network-changed:ca216d18-f3b5-4168-a856-5ab624c331a1 for instance adb846ca-3290-4d54-9114-0298e8a26e71 on n-h2-833090-21 Oct 04 18:10:17.401365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-34849a0f-5cfe-4d70-91b0-8eefa36d5cd0 req-286abb0d-b899-4d90-b52f-b70b54e57144 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109652 Oct 04 18:10:17.403305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 722/1461] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:17.428837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.431049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.450555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.451085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.452759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.454496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.455158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.473913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.676054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:17.716164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.726599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.733155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.736958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90cb0afa-24b6-4487-b01d-f7ab67f84578 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.326706 Oct 04 18:10:17.752113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 723/1462] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:17.778463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.792348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.825812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.826873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.828367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.829797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.830719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.831419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.867523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.887844 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92a6e1fc-555a-4ea4-a1a9-8f7b825a3972 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 200 len: 1523 microversion: 2.1 time: 1.105878 Oct 04 18:10:17.899376 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 740/1463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 1523 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.906088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b142191-4403-4303-ae72-f15bcd2b22e4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131796 Oct 04 18:10:17.914566 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 724/1464] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:17.923540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.924331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.944062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.944526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.959685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.969631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.970249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.970702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.306336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.308066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.318991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.320371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.322189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.323623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.325420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.326941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.650468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.670222 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-788527a5-6d9b-4280-bcbd-14f772a290c9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.754797 Oct 04 18:10:18.675574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 741/1465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.774510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.775911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.789756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.794151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.796168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.797206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.803063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.809327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.812065 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5fac9add-8508-49e4-8bc8-3605a10b8078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.511422 Oct 04 18:10:18.812626 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 725/1466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.813731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.913390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.914486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.923861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.926816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.926816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.926816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.926816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.927350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.251245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.261082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c3c9703-9fa8-463a-a215-2fe9600e0058 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 200 len: 1523 microversion: 2.1 time: 0.351429 Oct 04 18:10:19.276511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 726/1467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.317939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.328544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.356015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.356518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.356954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.357692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.362720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.363223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.533253 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfa3df89-b3ce-435e-9e1e-70f74b22c32f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.255177 Oct 04 18:10:19.534451 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 727/1468] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:19.694524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.695789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.714831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.714831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.714831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.715760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.716190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.716894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.862130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.903540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.917315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.925709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6966a324-b463-43e6-bf7e-63f182ed512a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 1.155004 Oct 04 18:10:19.926325 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 742/1469] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:19.948552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6", "name": "network-vif-deleted", "tag": "c66e62b1-3a5d-4d79-aedb-df861969615a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:20.008290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.008876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.009212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.076195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] Creating event network-vif-deleted:c66e62b1-3a5d-4d79-aedb-df861969615a for instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 on n-h1-833090-21 Oct 04 18:10:20.088972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8c633a43-5133-4e49-b869-1178a0b766f3 req-7b1b23fd-070e-4e2a-9f32-ed48a7ca844a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159712 Oct 04 18:10:20.091791 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 743/1470] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:20.101950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.104611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.123273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.128256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.134022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.134022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.134022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.134022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.199695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.210059 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00bd9e2b-2bc5-4ea5-997a-caf207a6d745 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.518363 Oct 04 18:10:20.212624 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 728/1471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.294874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.296634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.298947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:20.309152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.318049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.322943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.323875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.325957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.328203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.557187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.566804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b773fc86-ed8f-47b9-a200-0f543b31940c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.473517 Oct 04 18:10:20.573043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:20.582963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a64b1dc0-c20f-4c9c-9063-8daa988a9dc8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 200 len: 1308 microversion: 2.1 time: 0.292786 Oct 04 18:10:20.585098 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 744/1472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.596999 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 729/1473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:20.608085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.610330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.696316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.696814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.700681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.700681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.700681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.700681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.796739 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75ba9bb2-57d5-4cac-b840-c3959004b864 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210351 Oct 04 18:10:20.797871 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 745/1474] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:20.955789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.956698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.966488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.970658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.974660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.975425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.980350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.982322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.249480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.250092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.283897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.285143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.285762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.287900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.288710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.290097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.410928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.429447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.442971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.444924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25452f39-857f-46ae-a6af-eb0235bcc4e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1812 microversion: 2.25 time: 0.492978 Oct 04 18:10:21.464935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 730/1475] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1812 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:21.598422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.599382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.616779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.622178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.626700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.628155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.631303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.632066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.725846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.737162 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9175157-f256-4525-9ca2-fc3d87796caf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 1.143335 Oct 04 18:10:22.751883 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 731/1476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:22.778399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.781471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.801716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.807190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.807942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.818287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.819052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.819731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.888196 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] HTTP exception thrown: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 HTTP/1.1 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6'} Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:22.896590 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 404 to user: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:22.903544 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec58cb07-0a27-409a-b12d-23dadfeec2b8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 404 len: 111 microversion: 2.1 time: 0.144597 Oct 04 18:10:22.910090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 732/1477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:22.939858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.948328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.984963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.985542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.985999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.986746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.987212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.012940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.034824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:23.137000 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdf01080-1ea4-4dd0-8c3b-16d238b60425 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225632 Oct 04 18:10:23.139990 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 733/1478] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:23.162903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.163843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:23.184659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.193467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.194217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.195145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.199314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.200063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.807320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.821862 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbeddc3c-b070-463d-9c6d-3d146d46fcff tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 2.583942 Oct 04 18:10:23.851758 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 746/1479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:23.863731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.880437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.882259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:23.895547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.896265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.897628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.900445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.901124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.904119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.073441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:24.169368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3045d74-0628-45bd-b0e8-319038edf5fa tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.313697 Oct 04 18:10:24.182033 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 747/1480] 10.222.0.40 () {58 vars in 1230 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:24.195695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.196668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.212881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.213665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.214289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.216323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.221578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.222451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.429146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.454970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.458991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.464527 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e64d6a79-8d49-4e65-b91f-769812126b88 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1802 microversion: 2.25 time: 1.323297 Oct 04 18:10:24.472502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 734/1481] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1802 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:24.477510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.495356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.521584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.522294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.522744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.523523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.523949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.526865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.665250 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90ac2f01-5224-49c5-975b-90c5b2abd89c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191549 Oct 04 18:10:24.666341 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 735/1482] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:24.677810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b4d9bb9-0bc9-4c7a-989b-3effa14a46ad tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b4d9bb9-0bc9-4c7a-989b-3effa14a46ad tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: action_args: {} Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:24.688014 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b4d9bb9-0bc9-4c7a-989b-3effa14a46ad tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:24.705034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b4d9bb9-0bc9-4c7a-989b-3effa14a46ad tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.030415 Oct 04 18:10:24.707199 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 736/1483] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:24.711584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6dd262d2-840e-4d49-9b47-ef925d215b9e tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '.version_select at 0x7f9009750a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.739797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6dd262d2-840e-4d49-9b47-ef925d215b9e tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.744450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6dd262d2-840e-4d49-9b47-ef925d215b9e tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.746472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6dd262d2-840e-4d49-9b47-ef925d215b9e tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.775827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6dd262d2-840e-4d49-9b47-ef925d215b9e tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2804 microversion: 2.25 time: 0.067840 Oct 04 18:10:24.781041 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 737/1484] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/os-migrations => generated 2804 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:24.782246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.791674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.792718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:24.817968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.820460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.822025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.827929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.831789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.832583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.111341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:25.629095 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71f10a25-8b1e-472f-9d8d-9f3d1dfabddd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.850827 Oct 04 18:10:25.650415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 738/1485] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers => generated 683 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:25.662884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:25.663524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:25.722415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.723031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.723503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.724261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.724723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.725158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.129178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.154147 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36c604a0-5330-4d21-9382-1df5420c42e8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 1.968181 Oct 04 18:10:26.159988 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 748/1486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:26.174349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.176004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.217454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.217957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.218399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.219112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.226306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.226920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.841084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.849116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-044affef-2f38-4a87-83d4-0a9b3cb5d219 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.687732 Oct 04 18:10:26.858504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 749/1487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:26.889796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.895963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.896704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.compute.servers [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Removing options 'limit' from query {{(pid=123887) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:10:26.897646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:26.905087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.905868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.906530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.907855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.915146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.915146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.962846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:27.131089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:27.188856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c99d0b90-3c42-4b09-80d2-c1ac826bdbad tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 2423 microversion: 2.25 time: 1.537255 Oct 04 18:10:27.199788 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 739/1488] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:25 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 2423 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:27.221545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.224022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.272169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.274437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66f79121-fec1-4a02-956a-0e78965370ab tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.419392 Oct 04 18:10:27.276119 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 750/1489] 10.222.0.40 () {58 vars in 1144 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.284293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.285298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.285441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.286825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.290522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.290983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.296088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.307550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.310977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.311814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.313081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.339111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.346736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.380348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-071b6482-3b1a-4366-9c80-05210fef4d2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178927 Oct 04 18:10:27.400924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 740/1490] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:27.414028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.414927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.436666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.438111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.438808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.441459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.442769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.448545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.839994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.856301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c83d0f1f-68f9-4712-82f2-e8ab994e376b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.578610 Oct 04 18:10:27.859848 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 751/1491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.871439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20b6a4d9-1a03-43fd-b062-b73c46cd10e8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20b6a4d9-1a03-43fd-b062-b73c46cd10e8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '-1' Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:27.897872 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20b6a4d9-1a03-43fd-b062-b73c46cd10e8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20b6a4d9-1a03-43fd-b062-b73c46cd10e8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.035036 Oct 04 18:10:27.903823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 752/1492] 10.222.0.40 () {58 vars in 1142 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:27.916584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "name": "network-vif-plugged", "status": "completed", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:28.116544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:28.184503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8482f809-31c2-4881-a1c3-c904714e1e81 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 2423 microversion: 2.25 time: 0.782097 Oct 04 18:10:28.188215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 741/1493] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 2423 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:28.202962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.203717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.252614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.253110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.253548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.254264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.264375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.275816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.731838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.733534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.734272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.808832 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] Creating event network-vif-plugged:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h1-833090-21 Oct 04 18:10:28.841604 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6ee9a916-2afd-40bc-98eb-6583654cbe43 req-e7421dff-87c9-4ac4-afb6-874905290a6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.943529 Oct 04 18:10:28.842806 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 753/1494] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:28.857500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d2ae51a-ecf9-4eef-a563-e0c78e8719f4 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d2ae51a-ecf9-4eef-a563-e0c78e8719f4 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: action_args: {} Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 18:10:28.879038 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 18:10:28.887118 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:28.894741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d2ae51a-ecf9-4eef-a563-e0c78e8719f4 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:28.896098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d2ae51a-ecf9-4eef-a563-e0c78e8719f4 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.051855 Oct 04 18:10:28.905979 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 754/1495] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:28.914101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.916822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.955678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.959081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.959901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.963633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.965660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.966378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.005089 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a39f6dd2-6aa8-4b8b-b996-949a7065911b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097471 Oct 04 18:10:29.006096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 755/1496] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:29.012190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.022641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.033208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.035591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.036435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.037147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.041178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.044270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.044995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.051198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a2818bf-b9aa-4cee-af59-5959d680dffb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.859980 Oct 04 18:10:29.063886 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 742/1497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.084507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8682b5d-b943-4365-a119-3925c38ef94f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.098379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8682b5d-b943-4365-a119-3925c38ef94f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.100620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8682b5d-b943-4365-a119-3925c38ef94f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:29.109977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.servers [None req-e8682b5d-b943-4365-a119-3925c38ef94f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Flavor 'non_existing_flavor' could not be found {{(pid=123886) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 18:10:29.111336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8682b5d-b943-4365-a119-3925c38ef94f tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.054790 Oct 04 18:10:29.112459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 743/1498] 10.222.0.40 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:29.130894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.139294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.139294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:29.149856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.151588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.152793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.153990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.154621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.155222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.325631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f68d7a25-e9f8-4806-b182-604706ccb235 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.199139 Oct 04 18:10:29.341694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 744/1499] 10.222.0.40 () {58 vars in 1174 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:10:29.363152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.369478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.380174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.389105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.389806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.390859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.391928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.392527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.803766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.813006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-395ae77f-d8b1-4dc5-b12b-60da5366f106 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.805477 Oct 04 18:10:29.822859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lazy-loading 'services' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:29.829793 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 756/1500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.846542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.858371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.859556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:29.867773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.868992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.869714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.870847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.872645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.873348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.308600 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-597391c6-b78f-4c36-9de6-38f241b371a6 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.471004 Oct 04 18:10:30.309711 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 757/1501] 10.222.0.40 () {58 vars in 1184 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:30.347283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.347283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.352034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.352034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.352034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.353097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.353668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.354499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.442217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5a13fe9-caa5-4b08-ada3-b6c2f3debc1d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131140 Oct 04 18:10:30.443777 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 758/1502] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:30.456576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.457610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.473680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.475943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.475943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.475943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.478861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.481241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.609979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06588a3e-98aa-4f33-95a3-4a9e2ec905d1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments/c9318020-3b37-438d-8fd9-23cb2a1ba265" status: 202 len: 0 microversion: 2.25 time: 1.256304 Oct 04 18:10:30.609979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 745/1503] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 4 18:10:29 2022] DELETE /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments/c9318020-3b37-438d-8fd9-23cb2a1ba265 => generated 0 bytes in 1258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:30.609979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.624255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.625138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:30.641560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.646964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.647460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.655876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.659350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.660544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.738254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.753419 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d2a81a1-a471-4b3a-8742-8cd67116025d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.308244 Oct 04 18:10:30.770225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 759/1504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:30.775358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.780515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.788596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.789355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.789987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.790708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.791159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.791777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.829334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1a65c85f-754c-4c65-9396-7481bb7ef7ac tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057894 Oct 04 18:10:30.830268 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 760/1505] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:30.845180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:30.857039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.858654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.874719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.875547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.876364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.877964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.878738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.879397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.936036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:30.944571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.945066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.946749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.126080 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-009c0675-b74d-435a-a127-7232bd9ef914 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.524674 Oct 04 18:10:31.127114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 746/1506] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.136065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.143341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb846ca-3290-4d54-9114-0298e8a26e71", "name": "network-vif-plugged", "status": "completed", "tag": "ca216d18-f3b5-4168-a856-5ab624c331a1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:31.147725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5282f0e-2121-4da3-8fa6-165863f9138e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1313 microversion: 2.1 time: 0.301438 Oct 04 18:10:31.148417 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 761/1507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:31.156084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22e8137a-9e14-4346-92d0-c3f32b284ce8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.156661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.157545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.158229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.164603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22e8137a-9e14-4346-92d0-c3f32b284ce8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.165764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22e8137a-9e14-4346-92d0-c3f32b284ce8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016400 Oct 04 18:10:31.166502 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 762/1508] 10.222.0.40 () {58 vars in 1178 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:10:31.182111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.183428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] Creating event network-vif-plugged:ca216d18-f3b5-4168-a856-5ab624c331a1 for instance adb846ca-3290-4d54-9114-0298e8a26e71 on n-h2-833090-21 Oct 04 18:10:31.187450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.188158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Searching by: {'deleted': False, 'project_id': '445e6f1d18a24f1ba281e72bd184e991'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:10:31.193739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-8421dc00-10e5-46d9-9ea0-c8a97403ead3 req-5b9fd6f3-b8a5-465d-96d3-6458e2ec54f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053780 Oct 04 18:10:31.195083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.195643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.196339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.197751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.199382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.200122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.203221 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 747/1509] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:31.241145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:10:31.295499 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbcbb98a-d818-4b66-8a71-91a0a110eed7 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.118849 Oct 04 18:10:31.307202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 763/1510] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers => generated 683 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:31.314181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.316437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.329479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.333367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.333830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.334608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.335066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.335525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.353977 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] HTTP exception thrown: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 HTTP/1.1 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6'} Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:31.356480 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 404 to user: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2688b53-be8f-472a-840f-c9c80cc6719a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 404 len: 111 microversion: 2.1 time: 0.049130 Oct 04 18:10:31.363022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 748/1511] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:31 2022] DELETE /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:31.371519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.372607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.379202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.391485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.396927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.396927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.396927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.396927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.430009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:31.785976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.787403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.801103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.801692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.804325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.807100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.807644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.808124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.823023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e78b1e0-ce91-437d-ae5f-734005294ebd tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "DELETE /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 204 len: 0 microversion: 2.1 time: 0.455756 Oct 04 18:10:31.825985 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 764/1512] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:31 2022] DELETE /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:31.834458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.835926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.851724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.852436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.853081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.854069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.854686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.855304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.887668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:31.955400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:32.225122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.251414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ee2bf83-84aa-44f6-8ced-3a10b58542bb tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.463974 Oct 04 18:10:32.267505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 749/1513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:32.267505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.276747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.296985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.300719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.301854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.303166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.304120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.305337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.328926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dabc00ea-668b-44c3-95de-c92d8b4b7804 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 204 len: 0 microversion: 2.1 time: 0.494404 Oct 04 18:10:32.328926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 765/1514] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:31 2022] DELETE /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:10:32.334250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.334973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.357380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.357877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.358316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.359055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.361786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.361786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.362082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32978922-de67-4c1a-be8c-eabc3691d7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104363 Oct 04 18:10:32.366540 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 750/1515] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:32.379618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.381182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.392349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.409766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] HTTP exception thrown: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 HTTP/1.1 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6'} Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.413156 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:10:32.420707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 404 to user: Instance 7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:32.422101 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a57068b8-78e4-4d52-accc-fb6ef989675e tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6" status: 404 len: 111 microversion: 2.1 time: 0.049326 Oct 04 18:10:32.423347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 751/1516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/7c3de7ce-7dc9-4c0b-b2dc-3b58b564b7b6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:32.431579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.443896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.457608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.461354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.462349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.463801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.465851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.466636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.603501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.629190 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4a16d87-1c07-4c26-bd83-23847c5fd69f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1463 microversion: 2.1 time: 0.299140 Oct 04 18:10:32.649728 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 766/1517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1463 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.755600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.763586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:32.772047 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c7e2607-298e-4660-9f8c-9809e36324da tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1522 microversion: 2.1 time: 0.342528 Oct 04 18:10:32.773162 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 752/1518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:33.080282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.080905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.089861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.098677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.099482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.100468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.101129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.102018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.299988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.301270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.314471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.318489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.319729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.320778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.321537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.322291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.546894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-531a8b3b-02ee-46c9-ade2-0ad9d5f7f7b0 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1616 microversion: 2.1 time: 0.889208 Oct 04 18:10:33.560578 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 767/1519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1616 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:33.578103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.585070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.613047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:33.619636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.625514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.643441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.645178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.650808 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41e90566-a654-479e-b24b-3a280e07653c tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1323 microversion: 2.1 time: 0.355709 Oct 04 18:10:33.655146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.658145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.660244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.661067 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 753/1520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:33.679898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:33.688807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.714498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.716852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.718548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.720360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.722504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.726368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.781877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '22a8cf242b2344018e985471b23b2733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76713f7d5e64051957c737fd8532514', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.783159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] flavor_id is None. Assuming migration. {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:10:33.783749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:10:33.810367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57acc9b2-6016-4af2-8c1d-bb43178406f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.248114 Oct 04 18:10:33.812701 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 768/1521] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:33.829398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.830372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.846560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.847076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.848001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.848788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.850199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.850664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.582240 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1862962d-7c01-490d-83d9-304d8ba4890b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89/action" status: 202 len: 0 microversion: 2.1 time: 0.917344 Oct 04 18:10:34.588801 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 754/1522] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:33 2022] POST /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89/action => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:10:34.597456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.602502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.607580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.608224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.609196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.610100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.610841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.611206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.712600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.724990 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a6d78bd-88db-4120-bf06-e770e3bce085 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1522 microversion: 2.1 time: 0.903741 Oct 04 18:10:34.728483 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 769/1523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1522 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:34.737752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.739576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.747907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.748722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.749396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.750337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.751050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.751826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.229344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.240295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f64f02d5-0a9f-4b8b-8608-f63c2e58b0bf tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 200 len: 1520 microversion: 2.1 time: 0.510413 Oct 04 18:10:35.250424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 770/1524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 1520 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.275625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.293244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.342480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.343547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.350787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.366260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.371892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.378910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.458397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3326a92e-2a0e-451b-866d-810d2d739b08 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.205965 Oct 04 18:10:35.463282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 771/1525] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:35.470558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.4"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:35.473761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.482144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.483319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.483989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.484958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.485644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.486478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.544982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:10:35.549111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquired lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:10:35.912351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.943106 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c7e8c4a-0dba-46f3-8543-c18882458f28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1472 microversion: 2.1 time: 1.346266 Oct 04 18:10:35.943825 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 755/1526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1472 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.962608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79069af2-191c-4bea-ae18-5d013c91f16b", "name": "network-vif-deleted", "tag": "28779060-99cd-4d65-afa6-29e83efb8159"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:36.039648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.040139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.052636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.110820 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] Creating event network-vif-deleted:28779060-99cd-4d65-afa6-29e83efb8159 for instance 79069af2-191c-4bea-ae18-5d013c91f16b on n-h1-833090-21 Oct 04 18:10:36.133947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6fbec626-3c94-4ccc-91eb-fef7ea4e16d7 req-6481d554-8dcc-48b0-acaa-6b9ab92e8b03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188744 Oct 04 18:10:36.140151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 756/1527] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:36.169203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.171797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.224339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.226516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.230486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.234656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.235384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.236907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.669883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.691103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6f83014-38ff-43ef-ac8a-01af3669f17a tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1480 microversion: 2.1 time: 0.549279 Oct 04 18:10:36.691758 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 757/1528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1480 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:36.702337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284fdf5e-da3b-4dce-87b9-c3534b88e196", "name": "network-vif-deleted", "tag": "c81684fe-b7f8-4381-9b3c-f435d4e447cc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:36.721705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:36.748235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.748235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.748235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.780682 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] Creating event network-vif-deleted:c81684fe-b7f8-4381-9b3c-f435d4e447cc for instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 on n-h2-833090-21 Oct 04 18:10:36.804593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-35beefed-b963-447e-99d8-8f360ae7e8ed req-924619de-578d-438f-a5b9-e06a50c23341 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108574 Oct 04 18:10:36.806516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 758/1529] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:36.828629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.842675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.851397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.852265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.853160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.854078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.855305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.855918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.936816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b613dea4-6799-4096-8d99-754b2a72540d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124775 Oct 04 18:10:36.939118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 759/1530] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:36.970917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.974715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.015287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.017642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.018994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.020413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.021346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.024927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.470445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.481003 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c64016a-06cd-4011-9bc8-aa1849ceae31 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1472 microversion: 2.1 time: 0.516366 Oct 04 18:10:37.484811 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 760/1531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1472 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.718708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.719244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.739144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.740690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.740690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.741122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.741584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.742018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.818764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.819582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.820177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.820807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lazy-loading 'fault' on Instance uuid 284fdf5e-da3b-4dce-87b9-c3534b88e196 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:37.945685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.973686 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cba5a05b-ef1a-4263-8166-efa09a2ed110 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1313 microversion: 2.1 time: 0.259206 Oct 04 18:10:37.975670 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 761/1532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.984194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.987113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.000234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.010501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.010501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.010501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.010501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.010501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.079321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-259e3594-3740-418d-ae5b-f0b48fe5d127 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101023 Oct 04 18:10:38.095525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 762/1533] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:38.508355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.509122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.536129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.563659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.563659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.563659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.563659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.563659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.693906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Building network info cache for instance {{(pid=123887) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:10:38.922145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.930462 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc6f22f9-8f6d-4536-8dda-a20a4cd917e9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1472 microversion: 2.1 time: 0.427968 Oct 04 18:10:38.931103 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 763/1534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:38.946379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:38.953138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.954018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.954750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.980852 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] Creating event network-changed:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:10:38.989487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bce7ae51-c32a-4619-9e56-f31109f90952 req-dfbd526b-4a7b-444d-9cc2-b81ec623b3fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055290 Oct 04 18:10:38.994901 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 764/1535] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:39.003574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.005117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.013285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.014164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.015137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.016158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.016874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.018433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.116208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.117031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.117904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.118371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lazy-loading 'fault' on Instance uuid 284fdf5e-da3b-4dce-87b9-c3534b88e196 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:10:39.297360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce10b5a94f984c29aa143d80f46c9aab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445e6f1d18a24f1ba281e72bd184e991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.312032 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07f78f8c-de95-48bb-a3f5-fdbbcdbf31a8 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 200 len: 1313 microversion: 2.1 time: 0.314352 Oct 04 18:10:39.313021 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 765/1536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:39.327381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.377937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.418291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.419316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.421720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.422689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.423809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.425793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.562289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6df3ede1-884c-4af3-b03a-2a1c805df431 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.241806 Oct 04 18:10:39.562289 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 766/1537] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:40.003446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.020964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:40.076117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.077224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.086425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.091274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.097388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.111064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.752986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:40.896236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Updating instance_info_cache with network_info: [{"id": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048", "address": "fa:16:3e:01:22:a0", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7c1a3fe-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123887) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:10:40.934438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:41.039863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Releasing lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:10:41.042660 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c470b0f7-9cfd-4307-8b77-8410f0d5526f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action" status: 202 len: 0 microversion: 2.1 time: 5.577029 Oct 04 18:10:41.045318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 772/1538] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:35 2022] POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action => generated 0 bytes in 5581 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:10:41.054432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.062610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 284fdf5e-da3b-4dce-87b9-c3534b88e196] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.085437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.086255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.086984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.087804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.089342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.095513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.128735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.131833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] HTTP exception thrown: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 HTTP/1.1 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '284fdf5e-da3b-4dce-87b9-c3534b88e196'} Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.133765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. Oct 04 18:10:41.138807 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.143332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 404 to user: Instance 284fdf5e-da3b-4dce-87b9-c3534b88e196 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:41.145009 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-99924fcb-7335-4a93-a2a1-ea9682906a41 tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196" status: 404 len: 111 microversion: 2.1 time: 0.098595 Oct 04 18:10:41.146172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 773/1539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/284fdf5e-da3b-4dce-87b9-c3534b88e196 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:41.153435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.157681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.162420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f54360b7-0b75-4093-9e5e-3f9c5979b0cd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1472 microversion: 2.1 time: 1.199281 Oct 04 18:10:41.163569 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 767/1540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1472 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.172062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.173148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.174497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.175756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.176423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.177047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.186792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.4"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:41.194649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.207012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:41.216292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.220263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.221043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.222302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.223102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.227174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f1c0847-ca04-47d7-9e17-5d364a32faa3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.077739 Oct 04 18:10:41.228097 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 774/1541] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.239040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.243712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.249821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] [instance: 79069af2-191c-4bea-ae18-5d013c91f16b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.260015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.261333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.261990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.262934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.263625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.264227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.284335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] HTTP exception thrown: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Request method failure captured: Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b HTTP/1.1 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbd1jVEx7EM59up_neYfO8Iy_iq3YVqE_BdoSmmmSSheJJcRDv1u8ph116U1CPiQCKZN6048O1E72tlNzC59nVxuIwOEMLWCOeLPuA1N1NanWFU1o17Noa8m8WJ6thX42pZGeG0Ju1zazsoNC2F1dlOZp8LPlLvcQAb4GRECvBQPpA Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/445e6f1d18a24f1ba281e72bd184e991"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/445e6f1d18a24f1ba281e72bd184e991"}]}] Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 445e6f1d18a24f1ba281e72bd184e991 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-581709225 Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ce10b5a94f984c29aa143d80f46c9aab Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListServersNegativeTestJSON-581709225-project Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '79069af2-191c-4bea-ae18-5d013c91f16b'} Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.288181 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. Oct 04 18:10:41.294102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:41.297567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] Returning 404 to user: Instance 79069af2-191c-4bea-ae18-5d013c91f16b could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:41.300407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8c3e47e-fe6e-4fd1-8f01-fcbf22808b9b tempest-ListServersNegativeTestJSON-581709225 tempest-ListServersNegativeTestJSON-581709225-project] 10.222.0.40 "GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b" status: 404 len: 111 microversion: 2.1 time: 0.060926 Oct 04 18:10:41.301738 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 775/1542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/79069af2-191c-4bea-ae18-5d013c91f16b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:41.367927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:10:41.368682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquired lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:10:42.188903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.189519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.202441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.202711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.202939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.217468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.218009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.218483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.667261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.683764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26280a5b-de09-46f0-8d25-944b944c6b15 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1472 microversion: 2.1 time: 0.498643 Oct 04 18:10:42.688594 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 776/1543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:43.717699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:43.718573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:43.738006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.740374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.740937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.741939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.742812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.743426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.157834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:44.171056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c0fcb04-7dc7-456b-beb7-8e541854b6ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.454198 Oct 04 18:10:44.173206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 777/1544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:43 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:45.200099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:45.201472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:45.215093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.215947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.218516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.219592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:45.222317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:45.224444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.802998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.827614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3f91436-64f9-4989-bc2c-0fc8b7220e01 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.625102 Oct 04 18:10:45.829415 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 778/1545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:45 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:46.860501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.861636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.920930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.931840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.936416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.942344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.948782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.953711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.484621 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.neutron [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] re-assign floating IP 172.25.3.4 from instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 Oct 04 18:10:47.565345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:10:47.571196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:48.524789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.581108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7cbfc33-47db-4605-b529-988799e18805 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 1.722633 Oct 04 18:10:48.588119 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 779/1546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:48.640734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:48.726449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.727293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.729927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.780783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] Creating event network-changed:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:10:48.807686 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d2d07eba-145e-409d-89b7-68dc4e275b6c req-b38a1098-e9c9-4066-b138-bbd6b8f30b55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204217 Oct 04 18:10:48.808955 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 780/1547] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:49.636133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:49.642441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:49.693715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.713023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.719125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.731242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.732876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.741712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.382653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Updating instance_info_cache with network_info: [{"id": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048", "address": "fa:16:3e:01:22:a0", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7c1a3fe-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:10:50.498306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.502875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:10:50.508148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e63a9da5-6180-48be-9e27-ea9847711c13 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.897827 Oct 04 18:10:50.517135 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 781/1548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:49 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:50.938263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb846ca-3290-4d54-9114-0298e8a26e71", "tag": "ca216d18-f3b5-4168-a856-5ab624c331a1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:50.992620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.996188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.005043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.065931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] Creating event network-changed:ca216d18-f3b5-4168-a856-5ab624c331a1 for instance adb846ca-3290-4d54-9114-0298e8a26e71 on n-h2-833090-21 Oct 04 18:10:51.115640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2af20f55-92b5-49c0-9857-6bc226ede97e req-39085d5b-025d-4c40-81ee-95aa4133f2af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180751 Oct 04 18:10:51.135731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 782/1549] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:51.200747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=25 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:51.544002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.545621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:51.578795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.598315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.600309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.608619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.612767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.614744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.758953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:53.099361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:53.195634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7da506eb-4190-4a66-9c50-c84e518b95fe tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 1.649845 Oct 04 18:10:53.221745 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 783/1550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:54.025972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Updating instance_info_cache with network_info: [{"id": "ca216d18-f3b5-4168-a856-5ab624c331a1", "address": "fa:16:3e:8f:4f:f3", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca216d18-f3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:10:54.160860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Releasing lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:10:54.162981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d3d463f-d532-4009-90ec-effe56ca3ea1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71/action" status: 202 len: 0 microversion: 2.1 time: 12.997662 Oct 04 18:10:54.164355 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 768/1551] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:41 2022] POST /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71/action => generated 0 bytes in 13000 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:10:54.176162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.4"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:54.227413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:54.228943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:54.234722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.235627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.236262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.237149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.238069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.238672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.543140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.553717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43f3524a-ad2c-46d6-9f22-02ecb27041f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.331446 Oct 04 18:10:54.578431 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 769/1552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:54 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.608529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:54.648788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.651670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.652102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.652862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:54.653338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:54.653772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.078442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] HTTP exception thrown: Floating IP 172.25.3.4 is not associated with instance 402741d1-99a3-4992-b80a-b8003bc7b6c4. Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Request method failure captured: Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action HTTP/1.1 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 47 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbY1wiB8v0eURlRq_rFHl2u6t3NsucKX4oWhkdUmbXWAP-TXe49u8sb_dREcpixxHkAHv3vKdSUITJSvmaQ1Rt2X8TB1iaKlybzbpIUaLC4D0GFey5Z3-PUmq0DcXi0nVUIZsI5SYF6Hk5w0dciFxS0nbVhs-F-xEG1AwDPX33M8LA Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_839a7592f75b4a30970febf691188adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/839a7592f75b4a30970febf691188adf"}]}] Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fcc0dee8f8cc471d919df6b41af0d4e7 Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: {"removeFloatingIp": {"address": "172.25.3.4"}} Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: exception: Floating IP 172.25.3.4 is not associated with instance 402741d1-99a3-4992-b80a-b8003bc7b6c4. Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '402741d1-99a3-4992-b80a-b8003bc7b6c4', 'body': {'removeFloatingIp': {'address': '172.25.3.4'}}} Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.4 is not associated with instance 402741d1-99a3-4992-b80a-b8003bc7b6c4. Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.4 is not associated with instance 402741d1-99a3-4992-b80a-b8003bc7b6c4. Oct 04 18:10:55.080429 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:55.085442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Returning 409 to user: Floating IP 172.25.3.4 is not associated with instance 402741d1-99a3-4992-b80a-b8003bc7b6c4. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:55.085442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf42729c-b94c-4178-bec2-ae335c9ac4db tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action" status: 409 len: 144 microversion: 2.1 time: 0.912492 Oct 04 18:10:55.085442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 784/1553] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:54 2022] POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action => generated 144 bytes in 915 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:10:55.092205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.4"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:55.388557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.396092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.396596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.397039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.397752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.398211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.398640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.599999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.601358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.625396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.626181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.633637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.633637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.633637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.633637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.977647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.993710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-48e3f4b2-754f-4dc8-b9d2-5c6bbe246290 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.401795 Oct 04 18:10:56.007721 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 785/1554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:56.060393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:10:56.062093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquired lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:10:57.022221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:57.023458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.056442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.305826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:10:57.345791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.354087 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf655794-c497-459a-b886-402d0e132d2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.337836 Oct 04 18:10:57.354665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 786/1555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:57 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:57.359165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb846ca-3290-4d54-9114-0298e8a26e71", "tag": "ca216d18-f3b5-4168-a856-5ab624c331a1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.382890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.383377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.386822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.402092 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] Creating event network-changed:ca216d18-f3b5-4168-a856-5ab624c331a1 for instance adb846ca-3290-4d54-9114-0298e8a26e71 on n-h2-833090-21 Oct 04 18:10:57.408417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d7f32d76-3d5d-49be-b3bb-3ed81c2d8dba req-4fb3673b-491e-4da5-ac2f-ca8533d47937 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051764 Oct 04 18:10:57.413925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 787/1556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:57.679018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50f988a5-2348-4d1b-be95-4535d4a1793e tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1666197425", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.683217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-50f988a5-2348-4d1b-be95-4535d4a1793e tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] HTTP exception thrown: min_count must be <= max_count Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50f988a5-2348-4d1b-be95-4535d4a1793e tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Request method failure captured: Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 184 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcx2hORlpddbGjY7Fr8O0Xs3yUcphWfGc3KHhRfTLpnvErt2NQhpfxTiwoQck0O-f3PdyfFGpQixZ3foHjolHbqCoeLcSREZW5QjyZfLO1NpfCEIyAxkGJNQL9fc1YzVQs9HQ5osJfTrwpDtGRGlMd2i9Adb6fHl0Q5hBYRgO0pKTI Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_86df1b8784b14888b8e184fd94632383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/86df1b8784b14888b8e184fd94632383"}]}] Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 84fe70e3bab04e939a08c62199bec361 Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1666197425", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: exception: min_count must be <= max_count Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1666197425', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 18:10:57.687417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.692911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50f988a5-2348-4d1b-be95-4535d4a1793e tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Returning 400 to user: min_count must be <= max_count {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:57.692911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50f988a5-2348-4d1b-be95-4535d4a1793e tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.281242 Oct 04 18:10:57.693482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 788/1557] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/servers => generated 74 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:10:57.870776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-478964d8-5a2a-4040-a547-446038b9020a tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-162786911", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "max_count": 0}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-478964d8-5a2a-4040-a547-446038b9020a tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Request method failure captured: Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 167 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcx2hORlpddbGjY7Fr8O0Xs3yUcphWfGc3KHhRfTLpnvErt2NQhpfxTiwoQck0O-f3PdyfFGpQixZ3foHjolHbqCoeLcSREZW5QjyZfLO1NpfCEIyAxkGJNQL9fc1YzVQs9HQ5osJfTrwpDtGRGlMd2i9Adb6fHl0Q5hBYRgO0pKTI Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_86df1b8784b14888b8e184fd94632383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/86df1b8784b14888b8e184fd94632383"}]}] Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 84fe70e3bab04e939a08c62199bec361 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-162786911", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "max_count": 0}} Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-162786911', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'max_count': 0}}} Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:57.875015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-478964d8-5a2a-4040-a547-446038b9020a tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-478964d8-5a2a-4040-a547-446038b9020a tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012805 Oct 04 18:10:57.881082 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 789/1558] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:57.976191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f296c1e6-39b5-4e2f-a862-e6a045ff6943 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1535642058", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "max_count": 2.5}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f296c1e6-39b5-4e2f-a862-e6a045ff6943 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Request method failure captured: Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 170 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcx2hORlpddbGjY7Fr8O0Xs3yUcphWfGc3KHhRfTLpnvErt2NQhpfxTiwoQck0O-f3PdyfFGpQixZ3foHjolHbqCoeLcSREZW5QjyZfLO1NpfCEIyAxkGJNQL9fc1YzVQs9HQ5osJfTrwpDtGRGlMd2i9Adb6fHl0Q5hBYRgO0pKTI Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_86df1b8784b14888b8e184fd94632383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/86df1b8784b14888b8e184fd94632383"}]}] Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 84fe70e3bab04e939a08c62199bec361 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1535642058", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "max_count": 2.5}} Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1535642058', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:57.981047 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f296c1e6-39b5-4e2f-a862-e6a045ff6943 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f296c1e6-39b5-4e2f-a862-e6a045ff6943 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011138 Oct 04 18:10:57.990075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 790/1559] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:10:58.070502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14a4f0f0-ea5d-4220-999a-ad566af58751 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1124196902", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 0}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14a4f0f0-ea5d-4220-999a-ad566af58751 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Request method failure captured: Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 168 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcx2hORlpddbGjY7Fr8O0Xs3yUcphWfGc3KHhRfTLpnvErt2NQhpfxTiwoQck0O-f3PdyfFGpQixZ3foHjolHbqCoeLcSREZW5QjyZfLO1NpfCEIyAxkGJNQL9fc1YzVQs9HQ5osJfTrwpDtGRGlMd2i9Adb6fHl0Q5hBYRgO0pKTI Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_86df1b8784b14888b8e184fd94632383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/86df1b8784b14888b8e184fd94632383"}]}] Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 84fe70e3bab04e939a08c62199bec361 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1124196902", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 0}} Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1124196902', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'min_count': 0}}} Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:58.075272 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14a4f0f0-ea5d-4220-999a-ad566af58751 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14a4f0f0-ea5d-4220-999a-ad566af58751 tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011177 Oct 04 18:10:58.080251 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 791/1560] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:10:58.177929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-408c9574-6939-48db-bb22-dc7d6359d21b tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1477198905", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 2.5}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-408c9574-6939-48db-bb22-dc7d6359d21b tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Request method failure captured: Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 170 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcx2hORlpddbGjY7Fr8O0Xs3yUcphWfGc3KHhRfTLpnvErt2NQhpfxTiwoQck0O-f3PdyfFGpQixZ3foHjolHbqCoeLcSREZW5QjyZfLO1NpfCEIyAxkGJNQL9fc1YzVQs9HQ5osJfTrwpDtGRGlMd2i9Adb6fHl0Q5hBYRgO0pKTI Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_86df1b8784b14888b8e184fd94632383"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/86df1b8784b14888b8e184fd94632383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/86df1b8784b14888b8e184fd94632383"}]}] Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 86df1b8784b14888b8e184fd94632383 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1867636704 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 84fe70e3bab04e939a08c62199bec361 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1867636704-project Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1477198905", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 2.5}} Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1477198905', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:10:58.184621 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:10:58.189138 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:10:58.200006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-408c9574-6939-48db-bb22-dc7d6359d21b tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:58.203861 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-408c9574-6939-48db-bb22-dc7d6359d21b tempest-MultipleCreateNegativeTestJSON-1867636704 tempest-MultipleCreateNegativeTestJSON-1867636704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030035 Oct 04 18:10:58.206351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 792/1561] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:10:58.374316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Updating instance_info_cache with network_info: [{"id": "ca216d18-f3b5-4168-a856-5ab624c331a1", "address": "fa:16:3e:8f:4f:f3", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapca216d18-f3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:10:58.385910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.387096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:58.406615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.407109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.407810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.408825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.409408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.409943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.455855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Releasing lock "refresh_cache-adb846ca-3290-4d54-9114-0298e8a26e71" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:10:58.456818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-987c6467-0a32-4ecd-be5e-642774e55073 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71/action" status: 202 len: 0 microversion: 2.1 time: 3.369103 Oct 04 18:10:58.458722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 770/1562] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:55 2022] POST /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71/action => generated 0 bytes in 3372 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:10:58.469793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.470317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:58.500708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.504905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.508099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.510573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.511839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.513239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.595280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:59.185065 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80ab7d23-c49d-45cf-9b0d-8d88b3ab886a tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 204 len: 0 microversion: 2.1 time: 0.722210 Oct 04 18:10:59.185793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 771/1563] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:58 2022] DELETE /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:10:59.196781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.4"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:59.211198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.222610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.223160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.223651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.224402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.224880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.225315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.285868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:10:59.289326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquired lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:10:59.492217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.508036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81192df3-f291-4003-8bc6-48dba1aef00c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 1.123498 Oct 04 18:10:59.510485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 793/1564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:58 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:00.408400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5c019b9-fcbf-4792-8e08-ce4d8708c914 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Action: 'create', calling method: .version_select at 0x7f900d7d8d30>, body: {"keypair": {"name": "tempest-keypair-1310457357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8dtOZFgMD4pjiuDIKgePDzueNStjfSG1JqVKRRlIYzcYiPQsOSPZEFfZSRjO1dUAFucgHRWO22ZO0ybQLXbpoHqh4dKddOqcXrvoSjoeNIGXukp7ozjARyV+cra844hA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:00.452205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f5c019b9-fcbf-4792-8e08-ce4d8708c914 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Getting quotas for project a4637af03b8846bf852621bf897c7d15. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:00.473880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f5c019b9-fcbf-4792-8e08-ce4d8708c914 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Getting quotas for user d4535696eb0e408198213695ddba2799 and project a4637af03b8846bf852621bf897c7d15. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:00.663205 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5c019b9-fcbf-4792-8e08-ce4d8708c914 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.764166 Oct 04 18:11:00.665528 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 794/1565] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:10:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:00.679235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.686954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:00.696942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.700480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.700480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.700480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.701114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.704322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.538458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.555834 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-960e20c1-6a53-4d6f-acf4-1707bc5888ac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.882197 Oct 04 18:11:01.557512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 795/1566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:02.592007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.592775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:02.605130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.609478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.623346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.623346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.623346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.623346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:03.592432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:03.611922 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19c86473-eed4-4c54-943d-436969c66d87 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 1.019186 Oct 04 18:11:03.612613 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 796/1567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:02 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:03.618528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb846ca-3290-4d54-9114-0298e8a26e71", "name": "network-vif-deleted", "tag": "ca216d18-f3b5-4168-a856-5ab624c331a1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:03.665596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:03.666599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:03.667039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:03.720627 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] Creating event network-vif-deleted:ca216d18-f3b5-4168-a856-5ab624c331a1 for instance adb846ca-3290-4d54-9114-0298e8a26e71 on n-h2-833090-21 Oct 04 18:11:03.733568 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-34bb2752-98c1-4f68-b31a-7f73514a6bc8 req-04184a72-cd02-4e8d-9e04-5701cc63dc91 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113986 Oct 04 18:11:03.734302 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 797/1568] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:04.339634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:04.383535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:04.394676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:04.407690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.409919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.409919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.428328 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] Creating event network-changed:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:11:04.438368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-18f57abc-6c2a-4142-b50f-e1dcbb8f744e req-5bbbabfc-5a2d-44f2-9c1a-ac224404bf8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058720 Oct 04 18:11:04.442725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 798/1569] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:04.655620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.659236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:04.676683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.686028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.688605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.690638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.695270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.696021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.468180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:05.487310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2dd342d0-ccf7-41f1-8904-4318b66ce984 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1477 microversion: 2.1 time: 0.850811 Oct 04 18:11:05.510496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 799/1570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:04 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1477 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:05.640515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Updating instance_info_cache with network_info: [{"id": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048", "address": "fa:16:3e:01:22:a0", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7c1a3fe-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:05.779448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Releasing lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:05.785280 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94f6552b-59b2-42a2-889f-534eca5b61e9 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action" status: 202 len: 0 microversion: 2.1 time: 6.588469 Oct 04 18:11:05.785280 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 772/1571] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:10:59 2022] POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action => generated 0 bytes in 6592 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 18:11:05.802120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6e4c0a2-7d2d-4620-bae3-ecf4ed0a2633 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '.version_select at 0x7f900d7fb3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.517028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.517832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:06.527727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.533255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.536224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.543064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.545085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.545689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.828733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6e4c0a2-7d2d-4620-bae3-ecf4ed0a2633 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/bbbf45d5-e7a2-45e5-9b8d-c3b6fcb4d3db" status: 200 len: 183 microversion: 2.1 time: 1.039842 Oct 04 18:11:06.829662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 800/1572] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/os-floating-ips/bbbf45d5-e7a2-45e5-9b8d-c3b6fcb4d3db => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:06.844065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.4"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:06.980570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.990783 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7045f471-49ea-4e05-b1cf-d69c5031927e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1476 microversion: 2.1 time: 0.480948 Oct 04 18:11:07.004235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 773/1573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:06 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:07.272985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "name": "network-vif-unplugged", "status": "completed", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:07.294934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.300830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.301473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.317721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Creating event network-vif-unplugged:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h2-833090-21 Oct 04 18:11:07.327618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] Instance 94708d16-1b4a-4541-b15d-d186088d9a89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:11:07.343524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4fbf420b-11bb-455f-bbf4-83bbc5124e78 req-be64b925-6c9f-4f72-9fdc-c957ba4b1ae0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075148 Oct 04 18:11:07.345031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 774/1574] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:07.818841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:07.834507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.835816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.838779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.839883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.842153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.846827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.018992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:08.019977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:08.045386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.048761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.052191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.054624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.055753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.058595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.529653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.556498 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-945355bf-3cda-4683-bc98-e0e2886dd31f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1476 microversion: 2.1 time: 0.540591 Oct 04 18:11:08.559216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 775/1575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:08 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:08.595034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:11:08.596656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquired lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:11:09.511405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:09.529749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.530320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.530762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.560069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Creating event network-changed:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h2-833090-21 Oct 04 18:11:09.588158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] Instance 94708d16-1b4a-4541-b15d-d186088d9a89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:11:09.624733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c5594098-7d9a-437e-bd2b-8520a824fe1c req-f49ebe02-166e-403f-a971-80982d185967 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115047 Oct 04 18:11:09.628337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 776/1576] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:09.648229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:09.650282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:09.663612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.665364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.681591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.681591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.681591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.681591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.520080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:10.535020 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b6f63a0-0845-4e79-9f4f-4bccf10b0656 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1476 microversion: 2.1 time: 0.900870 Oct 04 18:11:10.536321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:10.537889 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 777/1577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:09 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:10.557672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-849624202", "imageRef": "473d5576-00e5-45ea-aafc-f37f5dda90cd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a2b0589b-af5a-4a3b-929a-debd4487fe15"}], "security_groups": [{"name": "tempest-securitygroup--2007968081"}], "key_name": "tempest-keypair-1310457357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:11.553426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Building network info cache for instance {{(pid=123887) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:11:12.885294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Updating instance_info_cache with network_info: [{"id": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048", "address": "fa:16:3e:01:22:a0", "network": {"id": "8192a865-5cfc-4984-87fa-750232fba9c2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1307308253-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "839a7592f75b4a30970febf691188adf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape7c1a3fe-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123887) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:11:13.023838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Releasing lock "refresh_cache-402741d1-99a3-4992-b80a-b8003bc7b6c4" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:11:13.024702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41b2f7c2-ccf7-4737-bf31-d275012fd1e1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action" status: 202 len: 0 microversion: 2.1 time: 6.185827 Oct 04 18:11:13.032668 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 801/1578] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:06 2022] POST /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4/action => generated 0 bytes in 6195 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:11:13.044659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.045597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.071242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.071242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.073120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.076072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.081745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.082502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.673725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:13.690456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9d297b0-0ff8-4c19-91b2-d573c568496d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1474 microversion: 2.1 time: 0.654760 Oct 04 18:11:13.693502 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 802/1579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:13 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1474 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:13.708822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:13.735518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.739218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.740039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.791810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] Creating event network-changed:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:11:13.791810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-739c59a0-a6d4-41ec-ad4a-67480f59bf20 req-b34cf8a7-c776-4494-ab7c-23229eb30479 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092127 Oct 04 18:11:13.791810 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 803/1580] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:13.799424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.800575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.811501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.812481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.813275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.814280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.815131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.815793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.834406 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] HTTP exception thrown: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Request method failure captured: Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 HTTP/1.1 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbY1wiB8v0eURlRq_rFHl2u6t3NsucKX4oWhkdUmbXWAP-TXe49u8sb_dREcpixxHkAHv3vKdSUITJSvmaQ1Rt2X8TB1iaKlybzbpIUaLC4D0GFey5Z3-PUmq0DcXi0nVUIZsI5SYF6Hk5w0dciFxS0nbVhs-F-xEG1AwDPX33M8LA Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_839a7592f75b4a30970febf691188adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/839a7592f75b4a30970febf691188adf"}]}] Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fcc0dee8f8cc471d919df6b41af0d4e7 Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'adb846ca-3290-4d54-9114-0298e8a26e71'} Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:13.838932 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.844417 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.849829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Returning 404 to user: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:13.851213 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c2c1501-fa99-4385-816a-70df8a24c88f tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 404 len: 111 microversion: 2.1 time: 0.058187 Oct 04 18:11:13.852508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 804/1581] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:13 2022] DELETE /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:13.863094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.864561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: adb846ca-3290-4d54-9114-0298e8a26e71] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.875746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.876976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.878243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.880074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.880802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.881490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.903711 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] HTTP exception thrown: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Request method failure captured: Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 HTTP/1.1 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbY1wiB8v0eURlRq_rFHl2u6t3NsucKX4oWhkdUmbXWAP-TXe49u8sb_dREcpixxHkAHv3vKdSUITJSvmaQ1Rt2X8TB1iaKlybzbpIUaLC4D0GFey5Z3-PUmq0DcXi0nVUIZsI5SYF6Hk5w0dciFxS0nbVhs-F-xEG1AwDPX33M8LA Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_839a7592f75b4a30970febf691188adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/839a7592f75b4a30970febf691188adf"}]}] Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fcc0dee8f8cc471d919df6b41af0d4e7 Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'adb846ca-3290-4d54-9114-0298e8a26e71'} Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.907553 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. Oct 04 18:11:13.914223 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:13.916702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Returning 404 to user: Instance adb846ca-3290-4d54-9114-0298e8a26e71 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:13.918236 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6fd11278-d1f2-4ffa-bda6-0063ede295b1 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71" status: 404 len: 111 microversion: 2.1 time: 0.061510 Oct 04 18:11:13.925873 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 805/1582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:13 2022] GET /compute/v2.1/servers/adb846ca-3290-4d54-9114-0298e8a26e71 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:13.934292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cf90710-4694-42cc-8087-23c0b824b624 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '.version_select at 0x7f900d8001f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.199064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cf90710-4694-42cc-8087-23c0b824b624 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/bbbf45d5-e7a2-45e5-9b8d-c3b6fcb4d3db" status: 202 len: 0 microversion: 2.1 time: 3.275563 Oct 04 18:11:17.201901 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 806/1583] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:13 2022] DELETE /compute/v2.1/os-floating-ips/bbbf45d5-e7a2-45e5-9b8d-c3b6fcb4d3db => generated 0 bytes in 3279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:11:17.228024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.235314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.256948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.259482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.270044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.271045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.274048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.275151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.650084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.690141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-247cace5-9249-4b37-a7d4-c41a126c1651 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1471 microversion: 2.1 time: 0.486422 Oct 04 18:11:17.690802 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 807/1584] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:17 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:17.721177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.721721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.746066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.747040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.747712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.748667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.750849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.751530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.822727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:18.592792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34d0d4cf-0fb7-427d-8e3d-4e23658ec4c5 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "DELETE /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 204 len: 0 microversion: 2.1 time: 0.899744 Oct 04 18:11:18.600227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 808/1585] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:17 2022] DELETE /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:18.601235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:18.602372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.611027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.612011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.612457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.613043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] validate_networks() for [('a2b0589b-af5a-4a3b-929a-debd4487fe15', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:18.613562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.613674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.614034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.655934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:18.952242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-022dc713-24f8-485d-8abe-ac03202ba1b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89/action" status: 204 len: 0 microversion: 2.1 time: 0.356580 Oct 04 18:11:18.953070 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 809/1586] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:11:18 2022] POST /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89/action => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:19.345937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-340433112", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ad013a13-c22a-45d1-afee-287c57adcf74"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:19.536138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] validate_networks() for [('ad013a13-c22a-45d1-afee-287c57adcf74', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:19.575973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:19.576661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:19.577737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:19.578261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:19.578805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:19.591300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.591785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.592534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.594016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.595373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.596100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.609163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=69,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:19.623746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Getting quotas for project a4637af03b8846bf852621bf897c7d15. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:19.644028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Getting quotas for user d4535696eb0e408198213695ddba2799 and project a4637af03b8846bf852621bf897c7d15. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:19.682940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:19.693070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='473d5576-00e5-45ea-aafc-f37f5dda90cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:20.148331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dbf2e26-aaff-4841-abc6-d12270d45e30 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 9.606457 Oct 04 18:11:20.154155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 778/1587] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 9616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:20.162123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:20.164979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.181859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.185614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.185614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.198009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.200462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.202984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.615455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.629296 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f3b9060-1ba6-4823-abce-d74b9d3c9d90 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1526 microversion: 2.1 time: 0.470397 Oct 04 18:11:20.633230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 779/1588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:20 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1526 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:20.638473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:20.643057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.672114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.674085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.674085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.678397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.679297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.680032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.991786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.002227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1aa96cf-4d0a-4da7-9715-181336ef2c16 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1471 microversion: 2.1 time: 0.366521 Oct 04 18:11:21.007316 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 780/1589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:20 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:21.009837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "name": "network-vif-plugged", "status": "completed", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:21.021423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.022603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.023282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.037722 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Creating event network-vif-plugged:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h2-833090-21 Oct 04 18:11:21.045494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] Instance 94708d16-1b4a-4541-b15d-d186088d9a89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:11:21.063633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cce81152-74f6-49be-a531-5ba4aa865602 req-0d3f407b-439d-4490-906c-e304733cfc50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056916 Oct 04 18:11:21.064842 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 781/1590] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:21.073020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:21.074108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:21.075025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:21.075726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:21.078196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:21.085710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04220680-950d-4530-9679-65468e808024 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.089598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04220680-950d-4530-9679-65468e808024 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.097232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.098172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.098932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.100330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.101284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.101973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.128627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Getting quotas for project b6855d9e36654de396dbffe604b86cdb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:21.135884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Getting quotas for user 6f53841f02aa4e3bbbecd8fd4968b089 and project b6855d9e36654de396dbffe604b86cdb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:21.270218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:21.271844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:21.317443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04220680-950d-4530-9679-65468e808024 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.325224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04220680-950d-4530-9679-65468e808024 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1245 microversion: 2.1 time: 0.258878 Oct 04 18:11:21.326135 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 782/1591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1245 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:21.681472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.682511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.689672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:21.691647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.694588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.695038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.695834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.696314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.696730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.941584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd5df0ce-454b-4e43-b5f3-d0c5e39acb47 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.979460 Oct 04 18:11:21.941584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 810/1592] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:21.955716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b8c5963-d2fb-484e-b2d9-d19e0b829818 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.957987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7b8c5963-d2fb-484e-b2d9-d19e0b829818 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:22.198313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7b8c5963-d2fb-484e-b2d9-d19e0b829818 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:22.226232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b8c5963-d2fb-484e-b2d9-d19e0b829818 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1216 microversion: 2.1 time: 0.280278 Oct 04 18:11:22.233126 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 811/1593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:22.268271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.268903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:22.330432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.330432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.330432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.336439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.337293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.340422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.547659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:22.565253 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f826a39-555a-44af-9f25-9dae7b8e124d tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1526 microversion: 2.1 time: 0.907820 Oct 04 18:11:22.585616 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 783/1594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1526 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:22.614056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1032990035", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "60ffc66e-4103-4031-9c11-ac6c53e2f84b"}], "security_groups": [{"name": "tempest-securitygroup--690953749"}], "key_name": "tempest-keypair-444193698", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e7cd5f34-e336-4f0d-8a10-97f75262e363", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:23.013498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.027791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e65c19a-2379-4887-8cce-2b57bab794f8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1471 microversion: 2.1 time: 0.789602 Oct 04 18:11:23.028640 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 812/1595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:22 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1471 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:23.046728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e3b4f7a-5f09-44bb-b2ec-065f03bcdc0d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:23.051193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e3b4f7a-5f09-44bb-b2ec-065f03bcdc0d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:23.134783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] validate_networks() for [('60ffc66e-4103-4031-9c11-ac6c53e2f84b', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:23.271158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e3b4f7a-5f09-44bb-b2ec-065f03bcdc0d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.281567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e3b4f7a-5f09-44bb-b2ec-065f03bcdc0d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1245 microversion: 2.1 time: 0.251634 Oct 04 18:11:23.282155 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 813/1596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:23 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1245 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:23.299385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e6c3037-01f6-4d14-8f45-abc0c2d5860e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:23.301286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e6c3037-01f6-4d14-8f45-abc0c2d5860e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:23.409041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e6c3037-01f6-4d14-8f45-abc0c2d5860e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.415293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e6c3037-01f6-4d14-8f45-abc0c2d5860e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1216 microversion: 2.1 time: 0.130330 Oct 04 18:11:23.419789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 814/1597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:23 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:23.445029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402741d1-99a3-4992-b80a-b8003bc7b6c4", "name": "network-vif-deleted", "tag": "e7c1a3fe-5136-43d8-8dec-27ab59dc0048"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:23.456745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.457476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.458426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.482272 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] Creating event network-vif-deleted:e7c1a3fe-5136-43d8-8dec-27ab59dc0048 for instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 on n-h2-833090-21 Oct 04 18:11:23.499317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-00ec4012-07da-4dc5-a78f-77e9d48b3baf req-e100f905-36eb-4413-806d-4b059b6722de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078207 Oct 04 18:11:23.504186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 815/1598] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:23.600459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:23.601634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:23.631673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.632184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.632629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.633897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.634571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.635001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.901148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.922420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d5b9821-079f-46a0-ae74-dc6e069f6c46 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1308 microversion: 2.1 time: 0.325440 Oct 04 18:11:23.935167 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 816/1599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:23 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:24.058420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.061530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.089432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.101358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.109150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.115694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.115694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.115694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.573174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:24.585380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-522a8b5e-2728-4695-bd77-5330843ea10a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1471 microversion: 2.1 time: 0.535087 Oct 04 18:11:24.587742 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 817/1600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:24.592384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.593543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.601651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.603346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.603972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.605040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.606056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.606714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.715977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for project 1de1f2554b8445028077ef14793c77a3. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:24.747433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for user 86bc8800e6b14a1ab4810be9e05f55e2 and project 1de1f2554b8445028077ef14793c77a3. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:24.775235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:24.784099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:24.787148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:24.787988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:24.788651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:24.792265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:24.793912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d6c7d8-aa22-4203-afd3-ed3a5503c236 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1297 microversion: 2.1 time: 0.205260 Oct 04 18:11:24.797932 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 818/1601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1297 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:24.815694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.816536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.817262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.818890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.825098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.826277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.829370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.831231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.846414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.849574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.853092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.855977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.857185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.858480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.895453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for project 1de1f2554b8445028077ef14793c77a3. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:24.914919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Getting quotas for user 86bc8800e6b14a1ab4810be9e05f55e2 and project 1de1f2554b8445028077ef14793c77a3. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:25.019454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.052677 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca6da908-50e0-4ad4-b433-9a84bddc2dfd tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1212 microversion: 2.1 time: 0.234978 Oct 04 18:11:25.053431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 819/1602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1212 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:25.060347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.061882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.070468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.077948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.077948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.077948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.077948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.077948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.144635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:25.145750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.146782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.147428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7cd5f34-e336-4f0d-8a10-97f75262e363',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:25.147644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.148021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lazy-loading 'fault' on Instance uuid 402741d1-99a3-4992-b80a-b8003bc7b6c4 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:25.217276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.228656 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8389cb33-0aa2-458b-af60-61c39cd8661e tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1313 microversion: 2.1 time: 0.173182 Oct 04 18:11:25.246071 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 820/1603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:25.625388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.627172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.647632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.648497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.648985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.649776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.650245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.650676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.740234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7fbcaae-59ab-43e7-a8a4-a4bea5e2ea7d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.153391 Oct 04 18:11:25.741643 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 784/1604] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 3155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:25.759002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d3383a4f-3040-474d-b782-9ef56de1556d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.759712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d3383a4f-3040-474d-b782-9ef56de1556d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.831104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d3383a4f-3040-474d-b782-9ef56de1556d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.838435 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d3383a4f-3040-474d-b782-9ef56de1556d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1121 microversion: 2.1 time: 0.087659 Oct 04 18:11:25.847303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.855135 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 785/1605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1121 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:25.856566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3334aab-c602-4e91-9abc-edacca363607 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1463 microversion: 2.1 time: 0.242254 Oct 04 18:11:25.871853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 821/1606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1463 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.872426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.873014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.873261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.886603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.887323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.894710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.895690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.896209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.897121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.897654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.898149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.955738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.966190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7411c706-7fbe-4060-9b1e-f36857fcefe0 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1305 microversion: 2.1 time: 0.109439 Oct 04 18:11:25.973348 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 786/1607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:26.090135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.090766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:26.101592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.106366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.106946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.108625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.109566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.111283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.246197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1faef3a-7fa6-491a-a89f-2b6cb0011a73 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1616 microversion: 2.1 time: 0.364409 Oct 04 18:11:26.248472 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 822/1608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1616 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:26.259110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.259968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:26.280059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.280705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.283311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.286948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.288698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.290672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.307493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.317331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-864e5962-dbab-4a07-8a14-df5702715e6e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1212 microversion: 2.1 time: 0.232870 Oct 04 18:11:26.319203 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 787/1609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1212 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:26.326838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fbc2558-b960-416f-8853-4ad1a66baede tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '.version_select at 0x7f9009890a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.335041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbc2558-b960-416f-8853-4ad1a66baede tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.335908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbc2558-b960-416f-8853-4ad1a66baede tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.336384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbc2558-b960-416f-8853-4ad1a66baede tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.336555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.337057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.337604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.338299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lazy-loading 'fault' on Instance uuid 402741d1-99a3-4992-b80a-b8003bc7b6c4 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:26.348401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fbc2558-b960-416f-8853-4ad1a66baede tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2741 microversion: 2.1 time: 0.025074 Oct 04 18:11:26.364244 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 788/1610] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/os-migrations => generated 2741 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:26.398303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0dee8f8cc471d919df6b41af0d4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a7592f75b4a30970febf691188adf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.408847 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58477349-9ead-44af-83b8-dbe2d1f2b212 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 200 len: 1313 microversion: 2.1 time: 0.155562 Oct 04 18:11:26.434515 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 823/1611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:26.523007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1180799636", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:26.861674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ada4035c-0246-445c-bb24-115329658645 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.862542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ada4035c-0246-445c-bb24-115329658645 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:26.925936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ada4035c-0246-445c-bb24-115329658645 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.933483 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ada4035c-0246-445c-bb24-115329658645 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1121 microversion: 2.1 time: 0.075874 Oct 04 18:11:26.934068 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 824/1612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1121 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:26.998831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.999442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.007688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.008709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.009387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.010179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.010641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.011071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.300166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:27.316139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0729ba33-08fa-43c1-964d-f0104b937265 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.321102 Oct 04 18:11:27.317319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 825/1613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:27.350342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.352070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.389602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.389602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.389602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.394961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.397029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.398048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.543031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:27.552166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb55fc56-a964-46bf-9317-15826b1cf192 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1276 microversion: 2.1 time: 0.209260 Oct 04 18:11:27.564573 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 826/1614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:27.571090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.572187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] [instance: 402741d1-99a3-4992-b80a-b8003bc7b6c4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.584042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.585840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.586621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.587748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.588472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.588842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.612321 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] HTTP exception thrown: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Request method failure captured: Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 HTTP/1.1 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbY1wiB8v0eURlRq_rFHl2u6t3NsucKX4oWhkdUmbXWAP-TXe49u8sb_dREcpixxHkAHv3vKdSUITJSvmaQ1Rt2X8TB1iaKlybzbpIUaLC4D0GFey5Z3-PUmq0DcXi0nVUIZsI5SYF6Hk5w0dciFxS0nbVhs-F-xEG1AwDPX33M8LA Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_839a7592f75b4a30970febf691188adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/839a7592f75b4a30970febf691188adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/839a7592f75b4a30970febf691188adf"}]}] Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 839a7592f75b4a30970febf691188adf Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1797861689 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fcc0dee8f8cc471d919df6b41af0d4e7 Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1797861689-project Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '402741d1-99a3-4992-b80a-b8003bc7b6c4'} Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:27.614420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] Returning 404 to user: Instance 402741d1-99a3-4992-b80a-b8003bc7b6c4 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfff2baf-ff07-49f8-8578-3bb31aa99928 tempest-FloatingIPsAssociationTestJSON-1797861689 tempest-FloatingIPsAssociationTestJSON-1797861689-project] 10.222.0.40 "GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4" status: 404 len: 111 microversion: 2.1 time: 0.050374 Oct 04 18:11:27.628589 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 827/1615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/402741d1-99a3-4992-b80a-b8003bc7b6c4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:27.956870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.958223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.967077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.967858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.968480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.969406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.970088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.970732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.097017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.107239 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef007c08-ef5a-44df-a999-6a3b4ef47676 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1163 microversion: 2.1 time: 0.154184 Oct 04 18:11:28.111241 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 828/1616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1163 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:28.349134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.349897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:28.366254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.367924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.368727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.369733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.370439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.371076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.601788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.610583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6071cb01-e8e3-4c2f-9586-cfb397e5c95d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.268009 Oct 04 18:11:28.611482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 829/1617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:28 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:28.616777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.617712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:28.625652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.626593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.627709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.632264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.633403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.633861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.332483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.337550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:29.345868 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a780469-8b93-4841-bd49-74a39c11d869 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.733080 Oct 04 18:11:29.350887 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 830/1618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:28 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:29.358093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.358951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.379456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.380049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.380503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.381242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.381701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.389123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.561884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.577037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-317a8203-8507-4709-81df-ea98522405cb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1227 microversion: 2.1 time: 0.224707 Oct 04 18:11:29.579184 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 831/1619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1227 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:29.592469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7", "tag": "ccc3295b-19a0-429e-b4f1-98b36f089b42"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:29.612987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.613498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.614623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.641504 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] Creating event network-changed:ccc3295b-19a0-429e-b4f1-98b36f089b42 for instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 on n-h2-833090-21 Oct 04 18:11:29.655452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c8957fc6-95c5-4473-9466-4504fbb48fa8 req-8c6b4c08-3113-49aa-9fbf-1c5940ebd5f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072017 Oct 04 18:11:29.656421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 832/1620] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:29.665436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.667380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.679365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.680713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.681612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.684670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.685128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.688431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.213020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.235208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e67a1df0-7ba2-4998-a299-b650cb0f224d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.577011 Oct 04 18:11:30.236579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 833/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:30.372841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:30.373708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:30.377371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:30.389397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.389933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.391595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.391595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.392327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.392763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.920399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.938615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d91ef11-2f38-44e4-aec7-a4e5ed0ce93b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.570451 Oct 04 18:11:30.943248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 834/1622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:30 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:30.958121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:30.960469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:30.997471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.000524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.007522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.012049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.039082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.042186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.115064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:31.231501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:31.240482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84d6a594-3a5f-4dc1-9dfd-4397f209fd76 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1237 microversion: 2.1 time: 0.295265 Oct 04 18:11:31.241084 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 835/1623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:30 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1237 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.263205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.263854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.274256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.275031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.275501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.276217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.276672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.277103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.526986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:31.538419 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55e0e989-04a6-4bdf-b3cd-e2a35367c5f4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.279385 Oct 04 18:11:31.543969 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 836/1624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.610322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659acde5-4e72-4fc0-bd52-25976b07975d", "tag": "8a4754f5-1c9f-4457-892a-5b34db32d0bc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:31.635949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.640503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.641360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.687104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] Creating event network-changed:8a4754f5-1c9f-4457-892a-5b34db32d0bc for instance 659acde5-4e72-4fc0-bd52-25976b07975d on n-h2-833090-21 Oct 04 18:11:31.700711 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-dbd3f3e3-3a56-4db7-b9ca-ffeee8016c0d req-f3476db8-e76c-4817-9bb8-20e3b58c9aa9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101134 Oct 04 18:11:31.707535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 837/1625] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:31.970744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.971712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.986940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.987623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.988322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.989227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.989784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.991045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.417467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.433546 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cc0d1c0a-6a43-4661-9fdd-1d72f881c150 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.468213 Oct 04 18:11:32.453302 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 838/1626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:32.469479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:32.471732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:32.501122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.501964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.504812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.506140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.506775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.508548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.836506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.857172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdda5c92-cab7-434b-ba22-4589d4f6fba1 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.397834 Oct 04 18:11:32.867944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 839/1627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:32 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:32.887535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:32.889613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:32.904688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.905180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.905615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.906323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.906776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.907197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.238579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.259289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4553706-7d90-4dbc-8fea-6121401a5b07 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.386216 Oct 04 18:11:33.271488 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 840/1628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:32 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:33.468010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:33.468647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:33.487567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.489142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.490438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.492744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.495918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.496628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.857892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.879573 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3cda354-b215-4d48-a04c-7beabb0c89fc tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.413998 Oct 04 18:11:33.879573 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 841/1629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:33 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:33.890905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfeee07-5b47-4659-a449-c512555a4a39", "tag": "429c30cf-db5b-4b66-92e9-53f9dcd4d8ad"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:33.909381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.910128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.910725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.942209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] Creating event network-changed:429c30cf-db5b-4b66-92e9-53f9dcd4d8ad for instance 3cfeee07-5b47-4659-a449-c512555a4a39 on n-h1-833090-21 Oct 04 18:11:33.958752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1c67f8ba-ccac-4273-874a-908894a752f7 req-46271415-501a-4f87-b278-620ce5669576 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079951 Oct 04 18:11:33.959382 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 842/1630] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:33.975012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:33.977566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:33.992509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.993015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.993459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.998494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.999369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.000079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.269525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.279733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a370722d-b54e-4138-bff5-d8bb585d28b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.314120 Oct 04 18:11:34.281025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 843/1631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:33 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:34.286263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:34.286876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:34.294870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.295482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.296018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.296810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.297341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.297904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.644837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.656138 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28527a3f-2fb5-4ca5-bdb6-a034ef69472b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.373433 Oct 04 18:11:34.657315 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 844/1632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:34 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:34.855170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:34.902427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:34.903167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:34.914725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.914725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.916960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.917794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.918655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.919279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.967947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:35.244146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.259248 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c935c2f5-aacc-4656-b649-6d5bd3c76486 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.361230 Oct 04 18:11:35.260906 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 845/1633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:34 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:35.303193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:35.304095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:35.313136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.316223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.317487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.320659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.322806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.324308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.586469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:35.586890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:35.587360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:35.587791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:35.588202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:35.614185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.614677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.615369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.616120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.616605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.617066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.656525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:35.662760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:35.693925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:35.704507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:35.734169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.752169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36f22710-24aa-4c77-9ec0-84e11ff83ffb tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.453019 Oct 04 18:11:35.753385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 846/1634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:35 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:35.765770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:35.766352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:35.792414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.792919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.793363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.794135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.794609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.795042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.072950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.072950 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54f85b15-e25d-436a-817f-1abd85660af7 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.258217 Oct 04 18:11:36.072950 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 847/1635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:35 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:36.282700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.283331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:36.296414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.296916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.297370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.298064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.298514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.299025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.549418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-115ed4c8-f910-4550-bfd9-8277f79cb370 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.008931 Oct 04 18:11:36.556089 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 789/1636] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 10038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:36.593244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b212f900-7f5a-42a7-aac9-2a3f230c7188 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.600176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b212f900-7f5a-42a7-aac9-2a3f230c7188 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:36.611070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.636759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8feb79ea-ff17-4de7-8bb2-7bcaa72f5570 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.357690 Oct 04 18:11:36.642550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 848/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:36.715663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b212f900-7f5a-42a7-aac9-2a3f230c7188 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.725884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b212f900-7f5a-42a7-aac9-2a3f230c7188 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1213 microversion: 2.1 time: 0.160213 Oct 04 18:11:36.732734 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 790/1638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:36.776967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.777826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:36.791360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.795639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.795639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.795639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.795639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.795639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.831394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:36.939182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:37.080800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.088184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.097785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.103045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.107962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.109021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.110845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.112551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.209876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:37.223645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8481f6ab-ccf3-407f-8d63-367c900ee045 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.451116 Oct 04 18:11:37.228386 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 849/1639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:37.532012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:37.540639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-958a2a1b-58df-4ddb-a9ac-7a4d81b7e02c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.463847 Oct 04 18:11:37.543702 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 791/1640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:37.672355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.684574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.725610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.727188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.729872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.733938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.735980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.741600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.758319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e5aecbd-b46a-4d6e-b097-7b6cf7e808f5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.760481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e5aecbd-b46a-4d6e-b097-7b6cf7e808f5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.894598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e5aecbd-b46a-4d6e-b097-7b6cf7e808f5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:37.902990 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e5aecbd-b46a-4d6e-b097-7b6cf7e808f5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1213 microversion: 2.1 time: 0.149795 Oct 04 18:11:37.905507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 792/1641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:38.255096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.256154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.266737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.272149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.272873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.277072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.277885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.278597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.292852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.315954 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d14d118-f620-4138-8d17-db27c4c6b161 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.639884 Oct 04 18:11:38.315954 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 850/1642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:38.568462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.569686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.584707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.587494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.633482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.644873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.645933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.649353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.676594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.686687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2311c83-9139-44d8-9d5b-8c93f252ac32 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.436388 Oct 04 18:11:38.688217 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 793/1643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:38.938003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.939333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.966277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.967428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.968190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.969451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.970179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.970958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.976501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.995986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f115e46f-9402-4195-801e-723d89bb712f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.432769 Oct 04 18:11:38.996854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 851/1644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:39.113041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.122973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7590541b-894d-4b0a-80f3-997aa88a200b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1217 microversion: 2.1 time: 0.189662 Oct 04 18:11:39.125925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 794/1645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:39.344106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.344718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.358839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.359335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.359844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.360501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.365257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.366524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.647819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.691885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe6bb7cd-1fba-4ae8-9c69-decfdf5d481d tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.331660 Oct 04 18:11:39.691885 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 852/1646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:39.723547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.723547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.726564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.727071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.732045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.733640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.734166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.734643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.019419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.029577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbd54a99-3fe5-4416-b20a-68520c79bfe0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.320121 Oct 04 18:11:40.044153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.044153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.045272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.045543 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 795/1647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:40.046269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.046774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.047819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.048498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.049146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.160755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.161916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.196006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.199964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.200829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.205124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.207331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.208054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.338634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.367250 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf3cee63-2b77-4b32-97bb-dfa0567e001d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1265 microversion: 2.1 time: 0.209998 Oct 04 18:11:40.367250 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 796/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:40.370646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.384749 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52848ea9-53c6-4872-b535-ed914bccad52 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.366973 Oct 04 18:11:40.386641 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 853/1649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:40.700667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.701318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.713636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.718936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.719528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.720316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.725644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.726349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.049924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.060906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.063011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.077437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.078176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cf06236-18ca-4560-b6bb-94feafa4cdb6 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.378991 Oct 04 18:11:41.078992 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 797/1650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:41.096891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.098940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.098940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.099180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.103822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.351795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.364958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84611941-9302-4d16-b250-247d9f320624 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1304 microversion: 2.1 time: 0.312175 Oct 04 18:11:41.376421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 854/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1304 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:41.408330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.429882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.430030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.430151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.446885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.447662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.448300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.449486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.450151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.450760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.456053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.458477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.461301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.463394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.464189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.466159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.572122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.581236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-adfc4ceb-7bbc-40cf-bfa3-8ffe2cabf139 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1265 microversion: 2.1 time: 0.199764 Oct 04 18:11:41.599014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 798/1652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:41.702061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.713339 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7b52c67-a37c-4e45-87f7-4ecdcbfe6089 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.302716 Oct 04 18:11:41.727496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 855/1653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:42.111830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.116307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.134454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.134964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.135411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.136167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.136918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.137693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.392193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.394443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.429823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.430699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.431670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.438680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.438680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.438680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.444554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.461199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6883d2d0-4925-4ae7-ad84-301ad02c1395 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.351443 Oct 04 18:11:42.462175 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 799/1654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:42.607301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.608028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.619523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.620069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.620665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.621452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.621918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.622413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.845788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.862640 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e23956ba-57b9-416f-862c-80685c6f7d59 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1273 microversion: 2.1 time: 0.258155 Oct 04 18:11:42.866015 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 800/1655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:42.881473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659acde5-4e72-4fc0-bd52-25976b07975d", "name": "network-vif-plugged", "status": "completed", "tag": "8a4754f5-1c9f-4457-892a-5b34db32d0bc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:42.907569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.917269 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e47bc3a-f41b-412d-aa8c-8e4945195fc0 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.530431 Oct 04 18:11:42.926987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.931755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.947812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.951846 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 856/1656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:42.963391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.964775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.973187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.974131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.974906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.976199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.976677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.977318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.977619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] Creating event network-vif-plugged:8a4754f5-1c9f-4457-892a-5b34db32d0bc for instance 659acde5-4e72-4fc0-bd52-25976b07975d on n-h2-833090-21 Oct 04 18:11:43.006261 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-aeaa4c37-9c11-4a65-a7d2-b916102c10b4 req-d3683a54-dbc4-406c-b73e-57b08d80706a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138581 Oct 04 18:11:43.006923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 801/1657] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:43.458581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.473251 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e67d0df9-23d9-4153-9337-365aabcc365d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.519700 Oct 04 18:11:43.480084 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 857/1658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:43.496796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.497971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.514072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.514570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.515014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.515765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.516415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.517032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.541089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:43.770811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.780423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d57336eb-145f-4e9a-bf4d-5cad4ded440e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.289069 Oct 04 18:11:43.786534 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 802/1659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:43.893721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.894336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.904084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.906557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.907217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.908748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.909208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.909642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.960890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.961559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.973203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.986576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.986576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.986576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.986576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.986576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.061713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.061713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f2cf480-4680-4f10-8f4a-f2f9186068ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1271 microversion: 2.1 time: 0.155391 Oct 04 18:11:44.061713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 858/1660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.297668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.305132 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4c54023-e125-41d0-add6-9629d909e8aa tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.349867 Oct 04 18:11:44.322131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 803/1661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.501227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.502538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.519738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.522358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.522358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.528297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.531012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.531497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.809613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.810349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.829617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.830828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.832312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.833894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.835258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.835757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.846669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.858345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-471ed3a5-ae46-45eb-9b1a-9f56c390db46 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.361222 Oct 04 18:11:44.861928 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 859/1662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:45.070047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.071001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.079165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.081657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.083695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.088295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.089884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.090521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.160642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.172088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd89ee64-ec94-48bf-a247-479fc9a4a5db tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1316 microversion: 2.1 time: 0.370856 Oct 04 18:11:45.187871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 804/1663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:45.332453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.332990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.339919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.340758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.341415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.342363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.343024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.343666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.631903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:45.850887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.862346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-523f64ae-dd77-46ea-8bbe-ec9bfcf1d251 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.533882 Oct 04 18:11:45.878115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 805/1664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:45.889761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:45.890658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.910452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.911056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.911553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.918457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.925147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.925841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.969642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.993937 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d97ff4af-e811-4b13-9cef-954a667ecc3b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.925360 Oct 04 18:11:45.994943 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 860/1665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:46.199185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.201030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.225642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.228973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.228973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.228973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.228973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.228973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.306067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.317173 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-936f2837-7e0f-4d28-90fb-c70106ca8f9c tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.432554 Oct 04 18:11:46.320353 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 806/1666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:46.519587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.535036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb1d381e-b763-4105-b7be-41af7ad9855f tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1504 microversion: 2.1 time: 0.341601 Oct 04 18:11:46.551886 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 861/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:46.563554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.564104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.586782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.587319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.587788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.588723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.589350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.589946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.649464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14204008-39a1-4693-94f9-098756a57e74 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips" status: 200 len: 108 microversion: 2.1 time: 0.087378 Oct 04 18:11:46.659344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 807/1668] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips => generated 108 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:46.666913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.667821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.685654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.698308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.719016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.719016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.719016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.719016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.872008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8bac5a2-b4fc-4b61-9bd9-c95d1b270a99 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips" status: 200 len: 108 microversion: 2.1 time: 0.207938 Oct 04 18:11:46.873703 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 862/1669] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips => generated 108 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:46.892092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.893634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.902695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.903326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.911105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.912015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.912015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.912015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.912015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.912015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.912513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.912513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.912513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.913462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.914198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.914858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.013000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-739115a1-6fb8-413b-aa92-529e9c7f7022 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips/tempest-ServerAddressesTestJSON-585750628-network" status: 200 len: 93 microversion: 2.1 time: 0.125929 Oct 04 18:11:47.025300 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 863/1670] 10.222.0.40 () {58 vars in 1398 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d/ips/tempest-ServerAddressesTestJSON-585750628-network => generated 93 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:47.043431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.043431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.048710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.049494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.050105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.051000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.051655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.052252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.360741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.370272 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3a3f025-3078-4ef3-87c0-5958c696d690 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.343745 Oct 04 18:11:47.382849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 864/1671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:47 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:47.382849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.382849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.389399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.487613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:47.557952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.583668 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dae65b43-bf41-44fe-841c-b57b589835dc tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.699354 Oct 04 18:11:47.586435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 808/1672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:47.592520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.599254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.600822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.610122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.610942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.611924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.612561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.613156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.632508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:47.902941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=30 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:47.983580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.014024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e456df29-6f1e-49d7-a90b-fc0ca7165509 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.418268 Oct 04 18:11:48.014024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 809/1673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:47 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:48.015093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:48.040948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.041848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.042566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.060289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] Creating event network-changed:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h1-833090-21 Oct 04 18:11:48.070649 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0f518aaa-a349-4954-ad7f-52bbc63c3103 req-3ca0a17c-72d6-40fe-96f0-3f3cba844075 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061410 Oct 04 18:11:48.078350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 810/1674] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:48.145504 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9cc5ec8c-dc8a-4390-a8d1-88fb76af047e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "DELETE /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 204 len: 0 microversion: 2.1 time: 0.772074 Oct 04 18:11:48.152367 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 865/1675] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:47 2022] DELETE /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 0 bytes in 780 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:48.161075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:48.163930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.180340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.181670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.182962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.185898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.188912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.189434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.398662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:48.399821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.417270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.418561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.419189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.422762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.423545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.424183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.761451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.774436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70bec239-8451-4b04-ada4-a11d18fabbbb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.380955 Oct 04 18:11:48.788993 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 866/1676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:48.797995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:48.820079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.834024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.835163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.835834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.836781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.837419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.838137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.000639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.011035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d318b078-d2ec-4c7a-aac0-4483185d5681 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1510 microversion: 2.1 time: 0.854246 Oct 04 18:11:49.012388 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 811/1677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1510 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.039701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.041217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.048107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:49.049536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.050019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.050915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.052420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.053059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.053483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.134447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.142724 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15f7b979-74a5-4bc8-86ff-3ec6c972c284 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.351510 Oct 04 18:11:49.155939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 867/1678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:48 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.244227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.253156 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f28aee0-5242-4898-b3a8-947137512120 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.220409 Oct 04 18:11:49.256633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 812/1679] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.800559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.801176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.819324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.820397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.820845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.825931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.832447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.850219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.037071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.038963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:50.060712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.061512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.062195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.063694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.070250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.072930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.262924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.287374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8af40013-839f-49c3-8890-a64cca9d40da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.491629 Oct 04 18:11:50.287999 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 868/1680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:50.309940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.313252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:50.337348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.338434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.339253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.340496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.376661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.376661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.486741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.500908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1be9d3ae-a892-41f9-af1d-88f493682578 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1510 microversion: 2.1 time: 0.470524 Oct 04 18:11:50.501660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 813/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:50.528351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.528971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:50.543381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.550167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.550699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.551443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.551940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.552363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.642198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.653497 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87a7a364-bd3f-4581-996c-a7e643877ff8 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.354797 Oct 04 18:11:50.654431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 869/1682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:50.911395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.926593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d70891ba-9292-415f-b512-4144ffe9b858 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.409247 Oct 04 18:11:50.927373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 814/1683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:51.321363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.328223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.342926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.345962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.348321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.350387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.351669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.353875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.530136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.534980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.545950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.548934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.549695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.552983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.553999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.554710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.583039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.595043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce7bd98c-b3ca-4d62-b8ae-a8b3b169c1dd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.280179 Oct 04 18:11:51.610907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 870/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:51.683611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.684525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.698748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.700024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.700483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.702472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.704195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.704685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.852161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.866977 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-507d6474-f695-421f-9ee9-f01d9c3c5d45 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1510 microversion: 2.1 time: 0.340366 Oct 04 18:11:51.880925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 815/1685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:51.953859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.955271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.970148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.971434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.972824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.975043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.975776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.978254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.023453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.037489 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f3f97d7-5f91-4281-809b-bdd7b0342351 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.356050 Oct 04 18:11:52.038931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 871/1686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:52.315873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.332650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea6b68e2-f236-4d08-8d5d-a010ccfa3333 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.381766 Oct 04 18:11:52.336131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 816/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:52.635448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.641307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.653448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.653957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.654418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.655771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.656245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.656678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.821246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.834247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19fd86c6-72db-4f51-893b-0a8f26981e28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.203557 Oct 04 18:11:52.836297 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 872/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:52.900208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.900834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.911003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.911798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.912447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.913919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.914578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.917633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.062072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.062706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.076460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.076969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.077417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.078153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.078612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.079060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.368376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.380208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.380915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce66e4dc-e47d-4711-b7e4-769c10e3b732 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1510 microversion: 2.1 time: 0.490414 Oct 04 18:11:53.381522 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 817/1689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1510 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:53.389046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.395046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.400982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f444b1f-ba1b-4486-941d-d6e4ad1c1bef tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.343983 Oct 04 18:11:53.403706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 873/1690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:53.427454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.431726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.436957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.439353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.441386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.446955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.859759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.860418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.875261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.875261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.875261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.876292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.876964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.877603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.996544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.009315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19cee467-27c6-4dfb-8987-55e7f1469322 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.626044 Oct 04 18:11:54.015948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 818/1691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.093184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.102453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc6c93d8-2da3-487d-8041-69571d5bf1a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.244395 Oct 04 18:11:54.115576 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 874/1692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:54.318993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659acde5-4e72-4fc0-bd52-25976b07975d", "name": "network-vif-deleted", "tag": "8a4754f5-1c9f-4457-892a-5b34db32d0bc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.361780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.362324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.370895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.406377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.407002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.419916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] Creating event network-vif-deleted:8a4754f5-1c9f-4457-892a-5b34db32d0bc for instance 659acde5-4e72-4fc0-bd52-25976b07975d on n-h2-833090-21 Oct 04 18:11:54.420095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.420626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.423303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.424798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.426652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.427547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.436971 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5a2442fc-8a5f-46e2-af8c-d54a7788cedb req-0dce3f58-c22c-43b1-81a9-5be8292df2e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121781 Oct 04 18:11:54.440432 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 819/1693] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:54.456658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.457940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.472199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.476831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.477531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.478464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.484016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.484741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.625421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.639548 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aae74467-f3ea-46df-9bc8-df821678d2b1 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1468 microversion: 2.1 time: 0.236337 Oct 04 18:11:54.645214 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 875/1694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.805271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.810052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:54.820145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27baa22f-3bf9-4e2a-9132-5d51eefb116a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.375919 Oct 04 18:11:54.821126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 820/1695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:54.843166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfeee07-5b47-4659-a449-c512555a4a39", "name": "network-vif-plugged", "status": "completed", "tag": "429c30cf-db5b-4b66-92e9-53f9dcd4d8ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:54.885915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.885915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.885915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.900658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbfe1e08-fd55-43c9-9ed5-e89169035a79 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Calling method '.version_select at 0x7f9009649040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.915902 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] Creating event network-vif-plugged:429c30cf-db5b-4b66-92e9-53f9dcd4d8ad for instance 3cfeee07-5b47-4659-a449-c512555a4a39 on n-h1-833090-21 Oct 04 18:11:54.923803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-be2a3ccd-0b8f-4794-8e87-90cd65c7f5cd req-485c0f37-dee3-47d8-ba63-bb1fed0cfc28 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101151 Oct 04 18:11:54.924971 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 821/1696] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:55.044714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.047012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.058548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.059235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.059825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.060757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.061236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.062697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.071774 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbfe1e08-fd55-43c9-9ed5-e89169035a79 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.424226 Oct 04 18:11:55.072710 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 876/1697] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:11:55.086583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e0496e9-66ed-42e7-88db-50ba51567eeb tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Action: 'create', calling method: .version_select at 0x7f900963e5e0>, body: {"pool": "non_exist_pool"} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:55.165546 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6e0496e9-66ed-42e7-88db-50ba51567eeb tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] HTTP exception thrown: Floating IP pool not found. Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e0496e9-66ed-42e7-88db-50ba51567eeb tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Request method failure captured: Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 26 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHdqAy5A3iC95YCbnmGl2T1Rgb8W7pEZQKG-tPLcKXvJEfylpvP-3NJUMYAoVHTe_GHdrRaD7R-IRUy1l4ax3vNHLPMYt4ESSN8MqJ8qA0qpHPrknLwxaCwfmZFHIWhTL-3WKe6MJP5akamVlPdwLMUYwVkEEVjp1xOjtVZyqCfpK_8 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f2b3ee6a44b24df684793e44e9872a51 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f2b3ee6a44b24df684793e44e9872a51"}]}] Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f2b3ee6a44b24df684793e44e9872a51 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FloatingIPsNegativeTestJSON-259153824-project Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c34bfecd61bb4d629ac31ea64dc80a4a Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-259153824-project Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: {"pool": "non_exist_pool"} Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: exception: Floating IP pool not found. Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:55.167230 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:55.174420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 18:11:55.174420 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.174420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e0496e9-66ed-42e7-88db-50ba51567eeb tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Returning 404 to user: Floating IP pool not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:55.174420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e0496e9-66ed-42e7-88db-50ba51567eeb tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.087003 Oct 04 18:11:55.174420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 877/1698] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:11:55 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:11:55.181200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.184553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.201859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.206106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.206879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.207851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.212195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.212866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.291084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.300821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-684c1ad0-8871-4c9b-a8a6-d1e46dc7f9c1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.260521 Oct 04 18:11:55.303582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 822/1699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:55.327766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Calling method '.version_select at 0x7f90098e70d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.430636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 82a2a69c-915f-4634-960d-1bc11a92ac8f could not be found", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:11:55.432101 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] HTTP exception thrown: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Request method failure captured: Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-floating-ips/82a2a69c-915f-4634-960d-1bc11a92ac8f HTTP/1.1 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHdqAy5A3iC95YCbnmGl2T1Rgb8W7pEZQKG-tPLcKXvJEfylpvP-3NJUMYAoVHTe_GHdrRaD7R-IRUy1l4ax3vNHLPMYt4ESSN8MqJ8qA0qpHPrknLwxaCwfmZFHIWhTL-3WKe6MJP5akamVlPdwLMUYwVkEEVjp1xOjtVZyqCfpK_8 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f2b3ee6a44b24df684793e44e9872a51 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f2b3ee6a44b24df684793e44e9872a51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f2b3ee6a44b24df684793e44e9872a51"}]}] Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f2b3ee6a44b24df684793e44e9872a51 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-259153824 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FloatingIPsNegativeTestJSON-259153824-project Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: c34bfecd61bb4d629ac31ea64dc80a4a Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-259153824-project Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: exception: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '82a2a69c-915f-4634-960d-1bc11a92ac8f'} Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 82a2a69c-915f-4634-960d-1bc11a92ac8f could not be found Oct 04 18:11:55.434585 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7581b449-e930-425d-b69b-61b0369d9cac'] Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f. Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] Returning 404 to user: Floating IP not found for ID 82a2a69c-915f-4634-960d-1bc11a92ac8f {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57f7b435-fc42-4859-b181-5e00ed85e1a1 tempest-FloatingIPsNegativeTestJSON-259153824 tempest-FloatingIPsNegativeTestJSON-259153824-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/82a2a69c-915f-4634-960d-1bc11a92ac8f" status: 404 len: 111 microversion: 2.1 time: 0.131367 Oct 04 18:11:55.444294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 823/1700] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:11:55 2022] DELETE /compute/v2.1/os-floating-ips/82a2a69c-915f-4634-960d-1bc11a92ac8f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:55.550188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.559822 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47346bf9-e90e-454d-90a6-5feb0a2e5aed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.388362 Oct 04 18:11:55.582420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 878/1701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:55.668881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.669705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.690444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.691247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.691963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.693171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.693806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.694672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.848579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.849217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.865658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.869798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.872798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.876207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.882346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.883349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.889333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.906836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-443d396b-bfd7-408a-9cf6-944bec9cbcb7 tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1468 microversion: 2.1 time: 0.238852 Oct 04 18:11:55.907859 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 824/1702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:56.160638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:56.174732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8e9264c-331d-4936-80fa-27f5564a7d47 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1292 microversion: 2.1 time: 0.330112 Oct 04 18:11:56.178671 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 879/1703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1292 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:56.331698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:56.332436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:56.356376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.369210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.372863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.373860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.374735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.377778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.606642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:56.613054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:56.620599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.621550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.622175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.623085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.623757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.624435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.021230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.036753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebfeec36-cc45-4d2e-90f2-c76cf96eb9e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.434265 Oct 04 18:11:57.047495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 880/1704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:56 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:57.057130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.057767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.066449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.066958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.067404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.073276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.073748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.078405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.237135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.237787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.238122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.242832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lazy-loading 'fault' on Instance uuid 659acde5-4e72-4fc0-bd52-25976b07975d {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:57.330543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f53841f02aa4e3bbbecd8fd4968b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6855d9e36654de396dbffe604b86cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.345896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29b76599-75fd-439e-bf84-9138b9b7bf8e tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 200 len: 1306 microversion: 2.1 time: 0.301679 Oct 04 18:11:57.345896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 881/1705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 1306 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:57.360588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.361505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.375347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:57.382474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.383357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.384375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.388007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.391765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.392516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.495718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.503977 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76d79edd-6e6c-443b-a02b-4965e01da108 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 1.176819 Oct 04 18:11:57.508913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 825/1706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:56 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:57.774012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:57.781688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d044011e-b2de-4953-add9-f506f74af70b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1482 microversion: 2.1 time: 0.431725 Oct 04 18:11:57.782331 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 882/1707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1482 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:57.805525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.806040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.817323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.817323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.817323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.817323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.817323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.817743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.037160 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6aeef75-bd5a-4728-b99c-3dd175563c38 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235746 Oct 04 18:11:58.038387 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 826/1708] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:58.043449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "name": "network-vif-plugged", "status": "completed", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:58.065821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.066379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.067094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.068647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.070084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.086579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.087270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.089189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.090026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.090799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.095868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.106160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] Creating event network-vif-plugged:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h1-833090-21 Oct 04 18:11:58.127302 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-627dad0b-8e9a-4937-bc22-9062466a361a req-e7f09af7-7e9f-4c6f-8b12-3494cf9c26e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087728 Oct 04 18:11:58.128253 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 883/1709] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:58.378714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.379372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] [instance: 659acde5-4e72-4fc0-bd52-25976b07975d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.395206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.395759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.396211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.399548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.401800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.403246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.414466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:58.449964 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] HTTP exception thrown: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Request method failure captured: Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d HTTP/1.1 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHdFSiJrTctPWvWjmcDzC2r7PC3CBXz6ksAZguRqkt7AbYz3Ct2Rq_seWlrfNr1GhgM0Jq161VzPpT7QmLeftSYNV3DOWfS3TCoSw9ISlSREuEglgpbCkbtA8Qsayx5c2xDSbjUKWoH0irM_aaSq8BUZ7h_JKVg-TXpq4YDaIavyYTY Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: b6855d9e36654de396dbffe604b86cdb Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerAddressesTestJSON-412932584 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6855d9e36654de396dbffe604b86cdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6855d9e36654de396dbffe604b86cdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6855d9e36654de396dbffe604b86cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6855d9e36654de396dbffe604b86cdb"}]}] Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerAddressesTestJSON-412932584 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: b6855d9e36654de396dbffe604b86cdb Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerAddressesTestJSON-412932584 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerAddressesTestJSON-412932584-project Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6f53841f02aa4e3bbbecd8fd4968b089 Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerAddressesTestJSON-412932584-project Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '659acde5-4e72-4fc0-bd52-25976b07975d'} Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:58.458692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. Oct 04 18:11:58.464934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:11:58.469429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] Returning 404 to user: Instance 659acde5-4e72-4fc0-bd52-25976b07975d could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:58.471011 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-829ca27d-3d7c-4283-85e5-2d7cc49cd07b tempest-ServerAddressesTestJSON-412932584 tempest-ServerAddressesTestJSON-412932584-project] 10.222.0.40 "GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d" status: 404 len: 111 microversion: 2.1 time: 0.102237 Oct 04 18:11:58.472266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 884/1710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/659acde5-4e72-4fc0-bd52-25976b07975d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:58.531999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.531999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.543030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.543555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.543999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.544806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.545264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.545693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.756362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:58.767395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32868fc3-67b3-46e0-a5d0-43fc849dc029 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.706677 Oct 04 18:11:58.768247 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 827/1711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:58.854817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-211934887", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bcca917f-d495-4d05-8cab-ccf60494bd86"}], "block_device_mapping_v2": [{"uuid": "fff650a6-0da7-47a9-9dd9-c6a62af28d55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:59.001838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] validate_networks() for [('bcca917f-d495-4d05-8cab-ccf60494bd86', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:59.079690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.088557 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f2b579e-fbf6-412f-8032-e5e5585daa3d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.561641 Oct 04 18:11:59.089431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 885/1712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:59.791029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.791884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.801025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.806477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.807021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.807897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.808566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.811498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.986009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:59.987968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:59.988677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:59.992411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:59.992989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:00.010310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.011164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.011875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.028680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.032405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.032405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.066169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:00.075391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Getting quotas for user 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 and project d7be3d0ba65a426f939fffd2ffbd16fe. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:00.153895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:00.156477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fff650a6-0da7-47a9-9dd9-c6a62af28d55',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:00.588736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.637843 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4fa0532-37dc-4d3b-bbd8-e583f29d6e86 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1313 microversion: 2.1 time: 0.848591 Oct 04 18:12:00.642790 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 886/1713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:00.658495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.663704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.676060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.676554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.676989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.677706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.684314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.684887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.939250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.950889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1e7aa01-a561-404a-b54a-67a3c4555674 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.304500 Oct 04 18:12:00.963494 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 887/1714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.963494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7", "name": "network-vif-plugged", "status": "completed", "tag": "ccc3295b-19a0-429e-b4f1-98b36f089b42"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:00.985407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.985893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.986576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.008995 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] Creating event network-vif-plugged:ccc3295b-19a0-429e-b4f1-98b36f089b42 for instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 on n-h2-833090-21 Oct 04 18:12:01.015934 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-627d0bd3-e411-4039-93ef-d6d758688770 req-df485cc4-cb1f-46f3-8aa4-6067fa339dbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062720 Oct 04 18:12:01.021565 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 888/1715] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:01.029215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.030344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.041156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.041156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.041156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.041156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.041931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.042468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.096426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-193657b2-5689-4bc7-86c1-40c5907cff63 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.245942 Oct 04 18:12:01.106912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 828/1716] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:11:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:12:01.120398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfeee07-5b47-4659-a449-c512555a4a39", "tag": "429c30cf-db5b-4b66-92e9-53f9dcd4d8ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:01.157998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.158492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.159751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.176741 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] Creating event network-changed:429c30cf-db5b-4b66-92e9-53f9dcd4d8ad for instance 3cfeee07-5b47-4659-a449-c512555a4a39 on n-h1-833090-21 Oct 04 18:12:01.183171 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6f1632af-f612-4218-999c-a3a6919b133f req-53655567-a773-4abf-b0e4-b9c4e708d15f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074396 Oct 04 18:12:01.184196 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 829/1717] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:01.190770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.204452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.360845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.378680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.392054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.397971 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8fe3aa1b-e3eb-4b89-95e1-1773ee05f27f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1103 microversion: 2.25 time: 0.211558 Oct 04 18:12:01.398843 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 830/1718] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1103 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:01.528673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.556225 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f6a11af-074b-4fae-a974-b520f0ebf651 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1482 microversion: 2.1 time: 0.531614 Oct 04 18:12:01.560302 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 889/1719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1482 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.674436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.680216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.696370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.700081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.700755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.701660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.702371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.703260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.979017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.980269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.996006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.998917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.999913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.010951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.010951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.010951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.077745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.092499 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f927e3a7-e0b9-4e02-842e-44fe754a04ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1461 microversion: 2.1 time: 0.426652 Oct 04 18:12:02.093144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 831/1720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1461 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:02.134922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:02.160053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.171511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.172080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.172583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.177005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.177831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.184431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.339741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.347711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:12:02.369679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:02.370109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:02.370618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:02.371008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:02.371433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:02.561045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.573170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e13f7c7a-e141-4759-813b-870b07d3c48f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1371 microversion: 2.1 time: 0.597908 Oct 04 18:12:02.591332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 890/1721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1371 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:02.607106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.608752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.716295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.727055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.729322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.730757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca0324b7-4c44-4e56-8f7d-8b3de3272a52 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1103 microversion: 2.25 time: 0.137889 Oct 04 18:12:02.747512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 891/1722] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1103 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:03.013749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1f82959-7d72-4a80-92ba-99183b350e4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568/action" status: 202 len: 0 microversion: 2.1 time: 0.894352 Oct 04 18:12:03.016159 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 832/1723] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:02 2022] POST /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:03.024621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.026253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.035735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.036466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.036939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.038236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.038707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.046934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.241407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.250992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1d658f48-3afe-440a-a42d-81cde5f11b93 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.230504 Oct 04 18:12:03.251732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 892/1724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.599095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.601125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.617896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.618835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.619533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.620347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.620911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.622610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.764607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.765344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.776671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.777089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.777597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.778382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.778989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.779370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.862064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.875980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.877466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.878725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf4ca45c-8bb2-45dc-a034-1975b6026342 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1184 microversion: 2.25 time: 0.126108 Oct 04 18:12:03.891905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 893/1725] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1184 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:03.911217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.925431 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0bc4bfa-78d0-4873-bb78-f511996c40b1 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1556 microversion: 2.1 time: 0.332594 Oct 04 18:12:03.926925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 833/1726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1556 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.963404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.963995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.997140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.997644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.001580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.002696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.004745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.010698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.210644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d0b85f7-8829-4525-a7d2-38138f2dfbcc tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251973 Oct 04 18:12:04.211574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 894/1727] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:04.276980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.277812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.285934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.290540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.291237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.294172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.294928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.295642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.675788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.685922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-befb6af2-c802-43d7-a358-e3eae8807c28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.413177 Oct 04 18:12:04.687241 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 834/1728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.906101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.907087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.918287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.920152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.921870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.927262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.928063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.928700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.105071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.114742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.117687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:05.119036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d8d69ea-a811-402b-810c-2a02ff413fa9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1232 microversion: 2.25 time: 0.217225 Oct 04 18:12:05.120660 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 895/1729] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1232 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:05.710673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.711720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.719609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.720252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.720776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.721822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.722353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.722881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.975002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.009652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2992081b-bdb7-4e9b-868c-0a08e2b0b268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.303014 Oct 04 18:12:06.010774 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 835/1730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.148962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.149575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.163764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.164287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.164743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.165479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.165945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.167023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.239334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.249171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.250817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.252349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9f3c13f-33cf-4267-9f69-e6fc2db434c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1240 microversion: 2.25 time: 0.108133 Oct 04 18:12:06.252784 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 896/1731] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:06.841474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7", "tag": "ccc3295b-19a0-429e-b4f1-98b36f089b42"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:06.853415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.853991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.854515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.920905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] Creating event network-changed:ccc3295b-19a0-429e-b4f1-98b36f089b42 for instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 on n-h2-833090-21 Oct 04 18:12:06.939225 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5b80a03d-28ad-4d05-a65b-13e3568f323e req-f71faa30-ee96-4fcd-9282-a384cac98792 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099804 Oct 04 18:12:06.942851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 836/1732] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:07.050541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.051449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.072656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.073478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.085027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.088837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.089539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.090404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.286097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.287023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.294737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.302397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.303911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.305801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.306382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.307195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.507564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.520323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.526703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.527991 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b47bcbc4-c4b6-45dc-b612-6ded488628c3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1250 microversion: 2.25 time: 0.246396 Oct 04 18:12:07.539496 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 837/1733] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1250 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:07.554812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.573361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0bf1207-496b-4c64-8e28-45da39725d23 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.520931 Oct 04 18:12:07.573361 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 897/1734] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:08.562375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.563183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.588243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.598480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.599436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.605717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.606997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.607911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.608390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.608952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.618838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.620492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.620492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.622114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.622880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.623807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.895088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.914584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.916468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.917663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-34252b97-e39b-47e1-9856-96089eaacfa1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.362893 Oct 04 18:12:08.918239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 838/1735] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:09.048350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.060812 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb268b9a-1e19-48dc-8f84-e067207d1238 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.467377 Oct 04 18:12:09.062534 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 898/1736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:09.952878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.954030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.963126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.964047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.964723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.966514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.967422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.968057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.054426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:10.089032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.090374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.117268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.117815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.124483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.125398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.125915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.126452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.236068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.246329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.248442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.250026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b32f989-caf3-4cf2-ac64-de2416622c17 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.302635 Oct 04 18:12:10.250857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 839/1737] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:10.277944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f1d409-62bb-4cde-a0a6-960c9fa0fd13", "tag": "cc34ad76-57b2-46a2-9bf6-56f235b0f69c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:10.292250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.294167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.294881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.309766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] Creating event network-changed:cc34ad76-57b2-46a2-9bf6-56f235b0f69c for instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 on n-h2-833090-21 Oct 04 18:12:10.316324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4f0fc5d9-920a-4a24-9e86-5e1cb79a3c33 req-2b68b4a3-f192-4099-bb48-9579deb92b0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050317 Oct 04 18:12:10.322450 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 840/1738] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:10.379166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.390963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5fa60165-83be-4940-b228-c0bdb5a53341 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1470 microversion: 2.1 time: 0.306896 Oct 04 18:12:10.391600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 899/1739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:11.282703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.284323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.292312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.293172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.293897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.296786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.297472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.298380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.372666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:11.417570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.418205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.429792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.430278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.430983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.432099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.432763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.433485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.545702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.548400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:11.556180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.558555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.559835 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58348dbd-978a-448e-94c8-3d92219b4c67 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.282762 Oct 04 18:12:11.560726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 841/1740] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:11.577898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.586806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfee8c8e-3f61-4b98-a823-7fdfb286eea8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.176496 Oct 04 18:12:11.587397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 900/1741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:12.589240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.590643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.610210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.610899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.622574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.623078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.623544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.633066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.634409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.635168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.635806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.638231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.638950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.639995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.645479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.647301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.721876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:12.873982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.886768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.888485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.890818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e7c96cb-a772-4c1b-b310-153cab015841 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.305793 Oct 04 18:12:12.891674 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 842/1742] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:12.946219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.955078 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5aa47d51-327d-4647-b793-007219f0d561 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.348653 Oct 04 18:12:12.955697 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 901/1743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:13.920534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.921816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.931609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.932240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.932780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.933820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.934351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.934857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.008337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.009138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.016604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.022697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.022697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.022697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.022697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.022697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.172010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.182452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.186159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.187821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb380776-bf59-4174-a3b3-5bd3055f4ea2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.273063 Oct 04 18:12:14.188950 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 843/1744] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:14.300643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.317669 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-743eae98-56d0-4903-983c-9d618f23dd70 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.335165 Oct 04 18:12:14.331497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 902/1745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.220080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.220751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.240828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.343761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.344497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.351871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.352697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.353323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.355427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.356145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.356740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.407384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:15.575967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.588859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.596786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.605739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0446fd5-63fd-483b-b2e2-f643db90b335 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1292 microversion: 2.25 time: 0.388062 Oct 04 18:12:15.619747 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 844/1746] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1292 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:16.000155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.012773 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f5bd6fc-2bc5-43c7-980a-b04543a57a50 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.673050 Oct 04 18:12:16.014852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 903/1747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:16.633828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.634690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.641044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.641617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.642263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.645562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.645562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.645562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.828000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.839852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.849930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.857623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9544f6e2-e8db-4427-bf6a-d57d2f7e99a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.224738 Oct 04 18:12:16.857623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 845/1748] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:16.917423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-182869523", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "286df177-dde3-4675-bad4-0ffd6b0a97f8"}], "block_device_mapping_v2": [{"uuid": "8f5f3b4a-8d6b-47eb-b72a-a809a774f061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:17.002561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] validate_networks() for [('286df177-dde3-4675-bad4-0ffd6b0a97f8', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:17.038324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.039498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.055151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.061420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.061978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.062753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.063227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.063691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.340236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.355455 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ecb214aa-85e8-4990-949e-98bc11e1b834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.316680 Oct 04 18:12:17.355921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 846/1749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:17.888248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.888886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.896424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.896908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.897340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.898306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.898585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.899093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.171905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.180971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.182248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.183380 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b81b58bd-a539-4661-92e2-5659bf878adb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.299118 Oct 04 18:12:18.184151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 847/1750] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:18.353238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:18.354491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:18.354977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:18.355393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:18.355999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:18.378706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.379324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.386353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.389539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.390188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.391110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.398664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.399381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.406580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.410750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.410750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.410750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.410750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.415914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.477434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:18.487169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Getting quotas for user 97934d1450a94f40b1d7a82d05fb47dc and project 2d475decc81c43e7ad36a9b8a51a7fc4. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:18.611336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:18.614500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f5f3b4a-8d6b-47eb-b72a-a809a774f061',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:18.808858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.816782 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4637282b-7a1a-446c-a7b4-b85dcfb64ab6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.442410 Oct 04 18:12:18.817372 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 848/1751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:19.217874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.219267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.241838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.242492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.243063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.243917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.246855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.247439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.491755 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f62877a4-2894-4abd-a89d-d7a8e58efc91 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.579559 Oct 04 18:12:19.500964 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 904/1752] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:19.512052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9a3ee05-29b9-4816-8e61-c4c6730b0f3a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.512698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9a3ee05-29b9-4816-8e61-c4c6730b0f3a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.612863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9a3ee05-29b9-4816-8e61-c4c6730b0f3a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.624195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9a3ee05-29b9-4816-8e61-c4c6730b0f3a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1052 microversion: 2.1 time: 0.114686 Oct 04 18:12:19.644321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 905/1753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1052 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:19.679785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.699823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.701708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.705591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0db45a2f-f7dd-4fd7-a86e-5db1f51b9599 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.497708 Oct 04 18:12:19.706716 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 849/1754] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:19.855099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.858857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.888981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.893795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.900732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.907092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.907892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.924203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.434496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.443719 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfd96c4b-2bc4-4651-873d-63e60c43810c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.605502 Oct 04 18:12:20.448180 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 906/1755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:20.651616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c79efc1-8da3-45fe-9d5a-51c94fd0ba13 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.652858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c79efc1-8da3-45fe-9d5a-51c94fd0ba13 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.743188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.747730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.758198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.758672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.759114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.760278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.761672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.762560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.793200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c79efc1-8da3-45fe-9d5a-51c94fd0ba13 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.800608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c79efc1-8da3-45fe-9d5a-51c94fd0ba13 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1052 microversion: 2.1 time: 0.153408 Oct 04 18:12:20.801202 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 850/1756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1052 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.070687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6778e87d-9e96-489d-a1fa-6223c2142a47 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f9009a7a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-561619837", "description": "tempest-description-1308390622"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:21.109051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.122580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.125476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.129891 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c98d0ae0-4d7c-4a9d-bdee-57d2a9470895 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.397164 Oct 04 18:12:21.132634 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 907/1757] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:21.473206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.473950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.492831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.497533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.497533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.497533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.497533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.497533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.809273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.837537 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0c0925b-e6fb-4e08-874a-9795ea559aa1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.368662 Oct 04 18:12:21.839224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 908/1758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:21.847824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.848444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.890200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.890698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.891143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.892707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.893212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.893945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.980621 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6778e87d-9e96-489d-a1fa-6223c2142a47 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.176833 Oct 04 18:12:21.980621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 851/1759] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:12:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:22.011995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-468f6d23-414f-44b2-8ac2-f93e7b1ab5e3 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90099c7b80>, body: {"security_group_rule": {"parent_group_id": "2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:22.024194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.067516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90431cd7-5c4f-45fd-9141-2ea3eb3e5f84 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1102 microversion: 2.1 time: 0.223441 Oct 04 18:12:22.074152 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 909/1760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1102 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:22.158544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.158826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.178215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.183902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.187057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.187057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.190572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.190915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.454437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.472779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.477199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.486628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b02fdce9-40b1-41c2-b70e-3378fde2fbe7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.332498 Oct 04 18:12:22.490296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 910/1761] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:22.813650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-468f6d23-414f-44b2-8ac2-f93e7b1ab5e3 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.822371 Oct 04 18:12:22.813834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 852/1762] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:22.827375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb43814e-54ec-419c-ba34-84de284eae07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f900970f3a0>, body: {"security_group_rule": {"parent_group_id": "2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:22.868739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.869932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.884759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.885926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.888384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.889544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.892451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.893522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.151535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bb43814e-54ec-419c-ba34-84de284eae07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb43814e-54ec-419c-ba34-84de284eae07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 138 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: {"security_group_rule": {"parent_group_id": "2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: exception: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:23.154343 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:23.160490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:23.160490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:23.160490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f Oct 04 18:12:23.160490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:23.167559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb43814e-54ec-419c-ba34-84de284eae07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: This rule already exists in group 2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:23.171971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb43814e-54ec-419c-ba34-84de284eae07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.348787 Oct 04 18:12:23.175325 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 911/1763] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:23.185033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.187014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.203611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.209790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.209790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.209790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.209790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.209790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.328673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.357989 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-891562fd-eced-4437-9ac3-95c525a35bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.491774 Oct 04 18:12:23.376415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 853/1764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:23.405110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ab540d2-0f3d-4b66-8c67-e6b695984117 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f9009d97310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.427296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.455818 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37cec5d0-4e7b-4a42-91bf-334080c40c2d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1150 microversion: 2.1 time: 0.281416 Oct 04 18:12:23.467652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 912/1765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1150 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:23.523907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.524665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.543413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.552443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.552955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.555114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.555808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.559672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.994363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.008437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.010177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.012015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d96081f8-b7ea-484a-83a5-cac925d162cf tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.499268 Oct 04 18:12:24.013858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 913/1766] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:24.183676 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ab540d2-0f3d-4b66-8c67-e6b695984117 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/621a8cd5-0795-4c66-9aa6-bd42faddaa4f" status: 202 len: 0 microversion: 2.1 time: 0.803209 Oct 04 18:12:24.184582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 854/1767] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 4 18:12:23 2022] DELETE /compute/v2.1/os-security-group-rules/621a8cd5-0795-4c66-9aa6-bd42faddaa4f => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:24.197812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87894920-6265-4847-af55-ebec114ac4a0 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90096031f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1586981972", "description": "tempest-description-680474555"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:24.388875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:24.388875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:24.395563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:24.401633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.404717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.405505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.406270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.406740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.407980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.831590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:24.841205 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eae0cdb8-d7b5-49ed-af61-2536b567ebfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.457564 Oct 04 18:12:24.841796 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 855/1768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:24 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:24.846785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:24.849995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:24.862117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.863943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.868119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.871067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:24.872056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:24.873248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.993053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.002472 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c25de54f-112c-4a46-9e25-32651cf9c9c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1168 microversion: 2.1 time: 0.159426 Oct 04 18:12:25.003725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 856/1769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:24 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:25.041650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.042276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.052183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.053181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.053752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.059071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.059730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.060195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.361449 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87894920-6265-4847-af55-ebec114ac4a0 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.164386 Oct 04 18:12:25.361449 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 914/1770] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:12:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:25.362080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.376383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7de6676-8917-49f8-9fae-525e24d8e851 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f9009673550>, body: {"security_group_rule": {"parent_group_id": "902e54b7-e8b0-4522-8310-6091481e4cb7", "ip_protocol": "tcp", "from_port": 674130977, "to_port": 22}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:25.392631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.401087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.404460 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd3b2bad-7eb4-4594-a446-e147bc7d3503 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.368021 Oct 04 18:12:25.407652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 857/1771] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:25 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:25.801652 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e7de6676-8917-49f8-9fae-525e24d8e851 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Invalid port range 674130977:22. Former value cannot be greater than the later Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7de6676-8917-49f8-9fae-525e24d8e851 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 145 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: {"security_group_rule": {"parent_group_id": "902e54b7-e8b0-4522-8310-6091481e4cb7", "ip_protocol": "tcp", "from_port": 674130977, "to_port": 22}} Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid port range 674130977:22. Former value cannot be greater than the later Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'security_group_rule': {'parent_group_id': '902e54b7-e8b0-4522-8310-6091481e4cb7', 'ip_protocol': 'tcp', 'from_port': 674130977, 'to_port': 22}}} Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 674130977:22. Former value cannot be greater than the later Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 674130977:22. Former value cannot be greater than the later Oct 04 18:12:25.803682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 674130977:22. Former value cannot be greater than the later Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7de6676-8917-49f8-9fae-525e24d8e851 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: Invalid port range 674130977:22. Former value cannot be greater than the later {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7de6676-8917-49f8-9fae-525e24d8e851 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.433625 Oct 04 18:12:25.818056 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 915/1772] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:25 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 436 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:25.821907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4ca5ce3-8c1c-4c20-a6f2-cfab4175838c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90098c7670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2098725278", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:25.823926 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d4ca5ce3-8c1c-4c20-a6f2-cfab4175838c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Security group id should be uuid Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4ca5ce3-8c1c-4c20-a6f2-cfab4175838c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 131 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2098725278", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group id should be uuid Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2098725278', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:25.826711 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:25.839194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 18:12:25.839194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:25.839194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4ca5ce3-8c1c-4c20-a6f2-cfab4175838c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: Security group id should be uuid {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:25.839194 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4ca5ce3-8c1c-4c20-a6f2-cfab4175838c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010948 Oct 04 18:12:25.839194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 858/1773] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:25 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:12:25.848185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-964a5b2c-eb3e-4685-8554-49033582c1ad tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f900967d430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-890141483", "description": "tempest-description-1332632584"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:25.868596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.869653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.898764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.899283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.904436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.905086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.905792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.906078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.347175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:26.361305 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91fba950-42fd-4c56-b035-891b0fbe8f9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.498148 Oct 04 18:12:26.384916 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 859/1774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:25 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:26.400444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.410755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.443728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.449903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.451573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.452497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.455400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.463567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.699115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:26.714867 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90060871-9de0-4f41-88c1-a58c081e0294 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.320227 Oct 04 18:12:26.715512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 860/1775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:26.726805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.731875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.751304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.762151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.762737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.763541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.764024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.769795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.882253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-964a5b2c-eb3e-4685-8554-49033582c1ad tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.039986 Oct 04 18:12:26.882841 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 916/1776] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:12:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:26.896599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6434c745-d565-4cd6-a5c3-327019f7ca07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90096ea1f0>, body: {"security_group_rule": {"parent_group_id": "816ddee7-23a8-489b-adae-2bf172807d1f", "ip_protocol": "tempest-999-300030298", "from_port": 22, "to_port": 22}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:27.008905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.020239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.022305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.032154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-247b1476-d203-4a15-aadd-107c2bba53f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.314330 Oct 04 18:12:27.047623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 861/1777] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:27.141665 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6434c745-d565-4cd6-a5c3-327019f7ca07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Invalid IP protocol tempest-999-300030298. Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6434c745-d565-4cd6-a5c3-327019f7ca07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 156 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: {"security_group_rule": {"parent_group_id": "816ddee7-23a8-489b-adae-2bf172807d1f", "ip_protocol": "tempest-999-300030298", "from_port": 22, "to_port": 22}} Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid IP protocol tempest-999-300030298. Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'security_group_rule': {'parent_group_id': '816ddee7-23a8-489b-adae-2bf172807d1f', 'ip_protocol': 'tempest-999-300030298', 'from_port': 22, 'to_port': 22}}} Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-300030298. Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-300030298. Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:27.143632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-300030298. Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6434c745-d565-4cd6-a5c3-327019f7ca07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: Invalid IP protocol tempest-999-300030298. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6434c745-d565-4cd6-a5c3-327019f7ca07 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.252920 Oct 04 18:12:27.154270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 917/1778] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:26 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:12:27.162526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bf9a0d3d-ab51-4283-8234-a124ef78fe1c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90097e20d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-796123192", "description": "tempest-description-1702242818"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:27.386553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:27.387502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:27.396980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.402755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.406596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.406596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.406596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.406596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.839621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:27.867867 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:12:27.872782 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 18:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.40) !!! Oct 04 18:12:27.887875 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7088d8ef-1b3a-4b77-aa3f-ca1ccfb7a782 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.504153 Oct 04 18:12:27.890754 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 918/1779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:27 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:27.899406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:27.900069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:27.914149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.916917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.917399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.925068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:27.925582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:27.926388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:27.939192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bf9a0d3d-ab51-4283-8234-a124ef78fe1c tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.781376 Oct 04 18:12:27.940653 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 862/1780] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:12:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:27.953599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ef0a0c4-d874-4025-86d8-549bb664e89a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f900981b1f0>, body: {"security_group_rule": {"parent_group_id": "196d1de0-585a-4535-8039-431dbd7f7cea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:28.121643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5ef0a0c4-d874-4025-86d8-549bb664e89a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ef0a0c4-d874-4025-86d8-549bb664e89a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 138 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: {"security_group_rule": {"parent_group_id": "196d1de0-585a-4535-8039-431dbd7f7cea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'security_group_rule': {'parent_group_id': '196d1de0-585a-4535-8039-431dbd7f7cea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:12:28.122356 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ef0a0c4-d874-4025-86d8-549bb664e89a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ef0a0c4-d874-4025-86d8-549bb664e89a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.174464 Oct 04 18:12:28.126859 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 863/1781] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:27 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:28.129692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.130832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.154262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.154767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.155215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.158567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.159060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.159554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.210371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.219388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45c85680-821f-4de9-9601-089948dc6393 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.326891 Oct 04 18:12:28.220588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 919/1782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:27 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:28.225644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2494f8b3-0385-4df4-8dd7-8f4cf0031150 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f9009712820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2130637771", "description": "tempest-description-2084393091"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:28.426077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.437677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:28.456604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.458490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.459827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b0f5d0d-dc43-4e64-af7f-600e7b16742b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.334037 Oct 04 18:12:28.483640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 864/1783] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:28.488981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d63a7c-e6eb-4f7c-9a62-a9df853b8478", "tag": "61fedb4c-2033-4d4d-83a1-6030584d7777"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:28.502949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.503995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.509940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.518107 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] Creating event network-changed:61fedb4c-2033-4d4d-83a1-6030584d7777 for instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 on n-h1-833090-21 Oct 04 18:12:28.524218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-280c5f43-c477-48ed-a5b5-085d84b232f3 req-07fd0eae-295c-42dc-9a9a-6c940f1f0afb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044774 Oct 04 18:12:28.525817 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 865/1784] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:28.924505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.924505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.936639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.940210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.941346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.967091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.967691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.968474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.972032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:29.501755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:29.517100 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f6434bd-1bc1-4cd7-bd21-e70a5d1e09ad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.604614 Oct 04 18:12:29.519526 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 866/1785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:29.533040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.535188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:29.548961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.551594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.553098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.555900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.556667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.557333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.621212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:29.796620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:29.816610 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1dfd006-c292-402e-ba7b-de6aeeb68bde tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.295612 Oct 04 18:12:29.835149 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 867/1786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:29 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:29.847250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f1d409-62bb-4cde-a0a6-960c9fa0fd13", "name": "network-vif-plugged", "status": "completed", "tag": "cc34ad76-57b2-46a2-9bf6-56f235b0f69c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:29.874603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.876505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.877515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.909403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] Creating event network-vif-plugged:cc34ad76-57b2-46a2-9bf6-56f235b0f69c for instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 on n-h2-833090-21 Oct 04 18:12:29.926062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-32071f41-7379-4f1b-a11a-b4d3939a7d97 req-c8b2447d-94d7-47d8-b529-38f8d1c43945 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085700 Oct 04 18:12:29.928777 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 868/1787] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:29.966915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.967933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:30.004977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.010901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.011367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.017060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.017642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.018104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.194764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2494f8b3-0385-4df4-8dd7-8f4cf0031150 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.972498 Oct 04 18:12:30.196363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 920/1788] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:12:28 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:30.224008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93b59b6f-681e-4465-a583-c68de6343194 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f900977c670>, body: {"security_group_rule": {"parent_group_id": "99e858ea-8890-4bcd-b4aa-d3a3f9ac6aab", "ip_protocol": "tcp", "from_port": 22, "to_port": 1847085433}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:30.379677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.396831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.401199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.404200 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a402a3b7-ca49-4619-a154-b2b7ba07b01c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.474164 Oct 04 18:12:30.408435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 869/1789] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:29 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:30.430377 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-93b59b6f-681e-4465-a583-c68de6343194 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93b59b6f-681e-4465-a583-c68de6343194 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 146 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: {"security_group_rule": {"parent_group_id": "99e858ea-8890-4bcd-b4aa-d3a3f9ac6aab", "ip_protocol": "tcp", "from_port": 22, "to_port": 1847085433}} Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99e858ea-8890-4bcd-b4aa-d3a3f9ac6aab', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1847085433}}} Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 Oct 04 18:12:30.432663 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 Oct 04 18:12:30.437219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.440105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93b59b6f-681e-4465-a583-c68de6343194 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 400 to user: Invalid port range 22:1847085433. Valid TCP ports should be between 1-65535 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:30.442085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93b59b6f-681e-4465-a583-c68de6343194 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.234488 Oct 04 18:12:30.446887 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 921/1790] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:30 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:30.457136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Action: 'create', calling method: .version_select at 0x7f90099caaf0>, body: {"security_group_rule": {"parent_group_id": "04045ea1-a34f-44b1-a9ee-85fec3aad2d2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:30.509815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:12:30.510489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Neutron security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:12:30.511332 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.511332 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 138 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: {"security_group_rule": {"parent_group_id": "04045ea1-a34f-44b1-a9ee-85fec3aad2d2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'security_group_rule': {'parent_group_id': '04045ea1-a34f-44b1-a9ee-85fec3aad2d2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:12:30.513314 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 404 to user: Security group 04045ea1-a34f-44b1-a9ee-85fec3aad2d2 does not exist Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-e30af4cb-f13f-4242-a3b9-2a8ab3b4b369'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc51cc34-84c2-4784-8197-8b5f9d302296 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.063174 Oct 04 18:12:30.526867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 870/1791] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 4 18:12:30 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:30.536067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f9009673dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:30.542423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:30.543125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:30.557577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.558072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.558643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.560858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.561462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.564438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.638786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:12:30.638786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Neutron security group rule e665eb50-334e-4897-86dd-f72023c799f6 not found {{(pid=123887) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 18:12:30.639348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] HTTP exception thrown: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.639348 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Request method failure captured: Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-security-group-rules/e665eb50-334e-4897-86dd-f72023c799f6 HTTP/1.1 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHeEmcxZfbYD9mrvqDV_-GL9PWOTSVBVH1gtBXDA-qTB5XEVKyZo_aBCbCZVltBJiq0uNrGB0JKJmjWe1EB3WWRvn_Xo8hraEsCvXF_9rkXZuoLtePHj2V3UP2ynaLkqa7exZ1H60b4jCE1EZmeCz8Nc3vLoC_Z9GNNOo6FQnBtCH68 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ed00719197b467b9986be627091589e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ed00719197b467b9986be627091589e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ed00719197b467b9986be627091589e"}]}] Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9ed00719197b467b9986be627091589e Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ec1458722eb341808de980e6f23bfaaa Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e665eb50-334e-4897-86dd-f72023c799f6'} Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:12:30.641089 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Returning 404 to user: Security group rule e665eb50-334e-4897-86dd-f72023c799f6 does not exist Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-660d05a9-875a-4fe2-a05a-b7500e8df8cf'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-53ce56a8-6723-4778-b450-fef3bb4d88d1 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/e665eb50-334e-4897-86dd-f72023c799f6" status: 404 len: 199 microversion: 2.1 time: 0.118235 Oct 04 18:12:30.648574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 922/1792] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 4 18:12:30 2022] DELETE /compute/v2.1/os-security-group-rules/e665eb50-334e-4897-86dd-f72023c799f6 => generated 199 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:30.654718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21f9ecee-5385-48f8-8011-eb89f17eae31 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f9009689280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:30.769206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.780176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c133caef-d12e-42e4-832f-49b8e628ccda tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.241451 Oct 04 18:12:30.795607 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 871/1793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:30 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:30.842278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:30.843199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:30.850806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:30.852892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.853615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.854473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.855601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.856231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.856827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.222612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:31.242252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-416ed11b-616e-4580-8f57-dbafc04fcc6c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.403805 Oct 04 18:12:31.242991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 872/1794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:30 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:31.439948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:31.440714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:31.460074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.476122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.476775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.478660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.494505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.499922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.554452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21f9ecee-5385-48f8-8011-eb89f17eae31 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/99e858ea-8890-4bcd-b4aa-d3a3f9ac6aab" status: 202 len: 0 microversion: 2.1 time: 0.905073 Oct 04 18:12:31.555042 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 923/1795] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:12:30 2022] DELETE /compute/v2.1/os-security-groups/99e858ea-8890-4bcd-b4aa-d3a3f9ac6aab => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:12:31.575085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e404efe0-8814-4181-929e-49c52117956f tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f9009607790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:32.285640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.299754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.305358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.307291 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d66b1a88-9b5a-4a13-aaee-436874cf3b94 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1280 microversion: 2.25 time: 0.871325 Oct 04 18:12:32.310776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 873/1796] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:31 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1280 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:32.316179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:32.317167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:32.325457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.326361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.327048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.328053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.329210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.329457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.505642 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e404efe0-8814-4181-929e-49c52117956f tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/196d1de0-585a-4535-8039-431dbd7f7cea" status: 202 len: 0 microversion: 2.1 time: 0.944987 Oct 04 18:12:32.507242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 924/1797] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:12:31 2022] DELETE /compute/v2.1/os-security-groups/196d1de0-585a-4535-8039-431dbd7f7cea => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:12:32.518387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:32.519235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:32.526517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:32.539724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.547866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.549950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.554371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.554371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.554811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.108384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.119349 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e38c5ae-c8e8-41ec-9f8b-05b607f42e00 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1475 microversion: 2.1 time: 0.807022 Oct 04 18:12:33.121384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 874/1798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:32 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1475 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:33.137890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-184ca2b0-bcb2-42d2-a664-e6b4199b4695 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f90099f6af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:33.225876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.242623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8742b962-80ca-4fc2-adb8-5d9fc83bad37 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.731515 Oct 04 18:12:33.255492 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 925/1799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:32 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:33.345244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:33.346087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:33.370806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.371320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.375068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.376545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.377332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.377937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.776333 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-184ca2b0-bcb2-42d2-a664-e6b4199b4695 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/816ddee7-23a8-489b-adae-2bf172807d1f" status: 202 len: 0 microversion: 2.1 time: 0.650336 Oct 04 18:12:33.777489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 875/1800] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:12:33 2022] DELETE /compute/v2.1/os-security-groups/816ddee7-23a8-489b-adae-2bf172807d1f => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:33.788436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92dec0eb-cef4-4964-9f8d-af85278d0d7a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f900a229e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:33.964473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.977714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.991324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.991324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff38fa9f-1a51-4a32-9124-1db30fae6999 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1475 microversion: 2.25 time: 0.649658 Oct 04 18:12:33.991324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 926/1801] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:33 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1475 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:34.527919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.529354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.539346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.540197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.548458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.549493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.550149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.550771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.841199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92dec0eb-cef4-4964-9f8d-af85278d0d7a tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/902e54b7-e8b0-4522-8310-6091481e4cb7" status: 202 len: 0 microversion: 2.1 time: 1.053336 Oct 04 18:12:34.842776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 876/1802] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:12:33 2022] DELETE /compute/v2.1/os-security-groups/902e54b7-e8b0-4522-8310-6091481e4cb7 => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:12:34.858484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.859215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.905012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.910089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.915285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.918422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.921566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.923583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.062265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:35.091437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae5226b8-cd31-48cd-b194-a41fbf3fcbba tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1969 microversion: 2.25 time: 1.077981 Oct 04 18:12:35.099823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 927/1803] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1969 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:35.110038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.111397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.124341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.124892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.125329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.126268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.127063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.129151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.446576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.447385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.456853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65e97072-6002-4170-a0fd-e514260a3e6a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1210 microversion: 2.1 time: 0.355439 Oct 04 18:12:35.457126 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dddb14c-0f81-4ef6-b642-4505a67f5af0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1474 microversion: 2.1 time: 0.612258 Oct 04 18:12:35.461221 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 877/1804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1474 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:35.462513 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 928/1805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1210 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:35.473314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0042fec2-beb5-432a-953b-1a61aa3884d8 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] Calling method '.version_select at 0x7f90097a7ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.479588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.480614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.487456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.492859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.493457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.494310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.497028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.497744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.756023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:35.780588 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9351f2fd-5044-4629-8622-8ec02e43f897 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1969 microversion: 2.25 time: 0.316873 Oct 04 18:12:35.795942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 929/1806] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:35.806235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "name": "network-vif-unplugged", "status": "completed", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:35.817000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.817794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.821320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.836648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Creating event network-vif-unplugged:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h2-833090-21 Oct 04 18:12:35.843753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:12:35.857484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-940f7ac1-838e-4a49-8231-e4c864c1ab44 req-8421414a-fd72-41e2-ab78-3f25f163def3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059990 Oct 04 18:12:35.858366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 930/1807] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:35.864765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.868953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.872870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.872870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.872870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.872870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.872870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.898483 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a509d048-a57e-4464-ac75-fcce363b799f tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038747 Oct 04 18:12:35.899716 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 931/1808] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:12:35.914574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-21", "block_migration": "auto"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:35.917937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.926051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.927608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.928456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.929425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.930072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.930758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.957252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:35.965440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'flavor' on Instance uuid 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:35.989787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Going to try to live migrate instance to n-h1-833090-21 {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:12:36.267716 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0042fec2-beb5-432a-953b-1a61aa3884d8 tempest-SecurityGroupRulesNegativeTestJSON-1750593463 tempest-SecurityGroupRulesNegativeTestJSON-1750593463-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f" status: 202 len: 0 microversion: 2.1 time: 0.803350 Oct 04 18:12:36.268942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 878/1809] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:12:35 2022] DELETE /compute/v2.1/os-security-groups/2259e8d2-8b9e-4c7a-89f8-6a2c4d4af83f => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:36.487540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.488717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.511960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.512752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.513579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.519746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.521497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.522170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.952775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.967429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46eea7f6-c6ce-483d-ac17-901241e674c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.483043 Oct 04 18:12:36.971331 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 879/1810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:36.981390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.984408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.992446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.993185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.993862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.995181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.996025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.996680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.268259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:37.283093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1acd92b-97a0-49ec-abf6-ebf7104d0040 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1474 microversion: 2.1 time: 0.309702 Oct 04 18:12:37.284038 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 880/1811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1474 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:37.289562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c77d5cd0-2793-4b50-aee2-cf26457e84ef tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Action: 'create', calling method: .version_select at 0x7f90098c7dc0>, body: {"keypair": {"name": "tempest-keypair-882465920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk0E/vHh5h1xbtEihA35pYTk1+bKfKbvhnlwoxNff5mR9jiB4dwtLeCev6zHVGIRkEF9IpkHAHpCVkf1bqee1ipPjHIcS51W9R1asOolSpDS8xZcnu1UJIzpw34/nqvig=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:37.312701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c77d5cd0-2793-4b50-aee2-cf26457e84ef tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Getting quotas for project 1a05721f5e9a41feb9ecd39e15053f17. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:37.331177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c77d5cd0-2793-4b50-aee2-cf26457e84ef tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Getting quotas for user 17cc595cd4ad46ae9fbfd6089997d5f7 and project 1a05721f5e9a41feb9ecd39e15053f17. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:37.453787 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c77d5cd0-2793-4b50-aee2-cf26457e84ef tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.167302 Oct 04 18:12:37.455828 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 881/1812] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:12:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:12:37.877520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:37.931999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.932822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.934568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.970778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Creating event network-changed:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h2-833090-21 Oct 04 18:12:37.989162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:12:38.016979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ce39852c-bd48-4de2-9dad-a365401914d8 req-5cc756cb-2aca-420f-8288-3dc251d70fe5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141837 Oct 04 18:12:38.024547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 882/1813] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:38.037725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:38.038605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.047369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.048301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.049005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.049967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.050658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.051309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.769716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.807140 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3d1ee3e-0ae5-4ddf-bf0a-017a693cc577 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.780053 Oct 04 18:12:38.825007 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 883/1814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:38 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:38.853373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:38.854912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.872845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.873770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.874220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.875407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.875903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.876334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.597292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.607526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dbea103e-e5c7-4041-ac85-2e2722c8c95d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1472 microversion: 2.1 time: 0.773950 Oct 04 18:12:39.608923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 884/1815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:38 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1472 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:39.712925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-449147480", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "c3a2a82d-a0f8-49e0-9bd5-7c577ab70ff6"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:39.796945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] validate_networks() for [('c3a2a82d-a0f8-49e0-9bd5-7c577ab70ff6', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:40.242871 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-870e795c-f2f7-41e4-9379-f60a2d9fcf5b tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13/action" status: 202 len: 0 microversion: 2.25 time: 4.332253 Oct 04 18:12:40.244836 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 932/1816] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:12:35 2022] POST /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13/action => generated 0 bytes in 4337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:12:40.254005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.255317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.264218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.265117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.265753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.267441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.268228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.268903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.484726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.494879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7cceb2b-f777-462b-b52e-a3bed5f833d6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.248867 Oct 04 18:12:40.506207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 933/1817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:40.506207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.506207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.509160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.512047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.512047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.512047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.512047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.512510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.672089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.681954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.684645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.686199 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ada6b0e-3fde-4999-98fc-d6c159971ba7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.189141 Oct 04 18:12:40.687353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 934/1818] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:40.693983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.694961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.702711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.703840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.704444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.710391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.710391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.710391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.778719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:40.779482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:40.780016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:40.780483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:40.780956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:40.794596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.795677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.796328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.797298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.798687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.799380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.822006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Getting quotas for project 00ee13bacdd343bcaf621a37c1dec2bd. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:40.829054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Getting quotas for user 3a36da8b90014019bdcc3e2eb604db0d and project 00ee13bacdd343bcaf621a37c1dec2bd. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:40.846688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:40.856763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:40.927138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.938967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfbbf5fc-98ee-4f27-b85d-1c06b4b13e51 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1472 microversion: 2.1 time: 0.250233 Oct 04 18:12:40.939582 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 935/1819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:41.120292 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91e37af6-cf67-4aac-aafd-f757af64169f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509862 Oct 04 18:12:41.127725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 885/1820] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:41.133466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4c0fe2d-e989-4ec3-9067-8091fce10d71 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.134186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4c0fe2d-e989-4ec3-9067-8091fce10d71 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.205461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c4c0fe2d-e989-4ec3-9067-8091fce10d71 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.213784 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4c0fe2d-e989-4ec3-9067-8091fce10d71 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1227 microversion: 2.1 time: 0.084856 Oct 04 18:12:41.223841 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 936/1821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1227 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:41.522850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.523638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.544560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.545055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.545498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.556041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.556546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.556999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.717385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.718014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.727277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.727277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.727555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.728448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.729544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.730175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.946935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.957821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.961054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.961253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-617fcc00-24b2-4561-bd43-e10aff36a515 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.249645 Oct 04 18:12:41.962357 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 937/1822] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:41.967768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.968576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.975648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.976733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.977338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.978282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.978910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.979730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.100487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.109842 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42a7af3f-9acc-4b00-a389-273ef01a22fd tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.593548 Oct 04 18:12:42.120139 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 886/1823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:42.193688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.205924 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff00c7bb-7236-43a6-b66d-562b205f303d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1469 microversion: 2.1 time: 0.242293 Oct 04 18:12:42.220420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 938/1824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:42.233523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:42.234075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.247945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.248831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.250808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.252760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.253440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.254986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1c9ac2e-77a0-483b-b950-ec1e84d107f5 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.255745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.257355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1c9ac2e-77a0-483b-b950-ec1e84d107f5 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.364146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1c9ac2e-77a0-483b-b950-ec1e84d107f5 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.373542 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1c9ac2e-77a0-483b-b950-ec1e84d107f5 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1227 microversion: 2.1 time: 0.129300 Oct 04 18:12:42.374146 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 939/1825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1227 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:42.639176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62fd8739-f77f-4c12-8162-4064b70685ee tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568/action" status: 204 len: 0 microversion: 2.1 time: 0.410999 Oct 04 18:12:42.640263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 887/1826] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:42 2022] POST /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568/action => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:42.649302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.649924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.657457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.657960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.658435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.659428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.659987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.660422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.993198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.994073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.006692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.008512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.009498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.010465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.011158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.012007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.041601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:43.270130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.280271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.286793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.290096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c353321d-80e9-4532-8542-75877bcfd00e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.301436 Oct 04 18:12:43.294139 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 888/1827] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:43.311843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.312468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.320523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.327326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.327326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.327326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.327326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.327326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.477219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.486302 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53b7cd00-e8e1-4fb4-afb4-6e8668285f70 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.190730 Oct 04 18:12:43.487300 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 889/1828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:43.494167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-168621826", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c7cbd9e0-5e5b-4fb2-b009-5d1f3c52b065"}, {"port": "c70a47a6-9e24-4a26-bf4d-acb66858a391", "tag": "port-1"}, {"port": "1631307a-60e8-430b-a272-eddadcf33c16", "tag": "port-2"}, {"uuid": "28408054-85ff-4145-81dd-3eae0cbbe9b6", "tag": "net-1"}, {"uuid": "28408054-85ff-4145-81dd-3eae0cbbe9b6"}, {"uuid": "ee0602a5-7001-4b58-9238-72577391fa35", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ee0602a5-7001-4b58-9238-72577391fa35", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "af710c56-93cf-48c4-a30e-6140367ec9ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2069497f-efba-4bbd-a2ab-09d31d64d8c4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "16b9752b-7c05-4d20-aa7d-e50e9cabe89a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1050759857"}], "key_name": "tempest-keypair-882465920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:43.543637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.560288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-766066cc-b141-4953-84d8-e1c6889e46e6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1469 microversion: 2.1 time: 0.911013 Oct 04 18:12:43.562751 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 940/1829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1469 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:43.577233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.578246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.612272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.613031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.615565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.616367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.616842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.618568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.707974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] validate_networks() for [('c7cbd9e0-5e5b-4fb2-b009-5d1f3c52b065', None, None, None, None, None), (None, None, 'c70a47a6-9e24-4a26-bf4d-acb66858a391', None, None, None), (None, None, '1631307a-60e8-430b-a272-eddadcf33c16', None, None, None), ('28408054-85ff-4145-81dd-3eae0cbbe9b6', None, None, None, None, None), ('28408054-85ff-4145-81dd-3eae0cbbe9b6', None, None, None, None, None), ('ee0602a5-7001-4b58-9238-72577391fa35', '10.2.2.100', None, None, None, None), ('ee0602a5-7001-4b58-9238-72577391fa35', '10.2.2.200', None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:43.769118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.792841 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94fdd0aa-5959-4d1f-8ce7-5acce1c99953 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1223 microversion: 2.1 time: 0.228434 Oct 04 18:12:43.796992 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 941/1830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1223 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:44.324174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.325779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.338436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.338648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.340399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.341873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.342849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.344206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.851347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.870367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.877924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.880007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9cb3b56-c6d5-4d31-9379-1d27c9405b36 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.560492 Oct 04 18:12:44.882889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 942/1831] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:44.896742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.923147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.938666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.940630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.940630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.943716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.944918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.945357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.229001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.244544 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2351561e-9bad-4d32-b592-a9df1c2f688f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.362662 Oct 04 18:12:45.245485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 943/1832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:45.274954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.276615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:45.286374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.287155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.287844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.288857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.289807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.291253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.522105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.531993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-154fdc6f-382b-48ab-80e1-107e50062329 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1469 microversion: 2.1 time: 0.261858 Oct 04 18:12:45.548475 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 944/1833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:45.556438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.557062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:45.564156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.564648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.565083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.565789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.566238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.566655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.717593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.727861 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b158ff08-5621-48ec-bcc5-bb3e2e6841f8 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1287 microversion: 2.1 time: 0.178169 Oct 04 18:12:45.728464 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 945/1834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:45.920583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.926880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:45.975287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:45.989806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.996958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.998419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.003780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.005730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.007112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.385249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.406025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.409447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.411399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df20f910-e119-4618-899c-7cc532871150 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.502334 Oct 04 18:12:46.412547 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 946/1835] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:46.425557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.427545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.434555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.436276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.436832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.437935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.438998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.439611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.624281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.638375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b614ca18-33e1-452a-9334-db3fc54d81bc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.224317 Oct 04 18:12:46.655493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 947/1836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:46.655493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.655493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.667390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.668750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.669440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.671982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.673776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.674328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.857391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.859918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:46.888611 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94973ef2-807c-4ab3-ad26-32557576f95a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1461 microversion: 2.1 time: 0.244868 Oct 04 18:12:46.889808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 948/1837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:46.895714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.896681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.911739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.912460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.913100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.913992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.914533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.915160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.066654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.078870 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d66c1a0e-367f-49ba-aa5f-646691c2fe3f tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1285 microversion: 2.1 time: 0.186142 Oct 04 18:12:47.081505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 949/1838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:47.087527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.088570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.097427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.100643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.103162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.103162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.103802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.104788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.314597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.325273 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68288a3b-b788-4339-869a-e24dbb59d905 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1461 microversion: 2.1 time: 0.241398 Oct 04 18:12:47.326604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 950/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1461 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:47.339677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "name": "network-vif-plugged", "status": "completed", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:47.351232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.352084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.352679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.368805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] Creating event network-vif-plugged:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h2-833090-21 Oct 04 18:12:47.376308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b01f384e-aaab-4f22-98fb-4ed3ec1b098c req-b32bfc6b-15ca-4533-87d4-bd926067975e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042399 Oct 04 18:12:47.377621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 951/1840] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:47.384696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a9d3e77-5526-4bec-adae-f887b5cdf6d7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'create', calling method: .version_select at 0x7f9009712430>, body: {"keypair": {"name": "tempest-keypair-165692088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdLtd4hlwsG8mddOh5QLtyPC995v7HR162Bybqbzr4geAIHSy+PCAcR0TAEnCQZaAekhBOEO6+nq1VuKnEQOul6y195vZE918juskvMxsgiJw7T1FdSlm5jMlf8oY28SQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:47.402005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6a9d3e77-5526-4bec-adae-f887b5cdf6d7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:47.415561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6a9d3e77-5526-4bec-adae-f887b5cdf6d7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:47.541195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a9d3e77-5526-4bec-adae-f887b5cdf6d7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162143 Oct 04 18:12:47.543023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 952/1841] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:12:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:47.547037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.570157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.570611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.571681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.571827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.572240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.572669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.765800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.779137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.783301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:47.784587 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a668541b-f822-4c98-a892-1ad0fc57d113 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.241452 Oct 04 18:12:47.801984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 953/1842] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:47.809188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.810400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.820025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.820674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.821568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.822586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.823330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.823903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.030409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.040812 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ecb1501-ea85-4273-acd6-03e86a98ad17 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.237100 Oct 04 18:12:48.044165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 954/1843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:48.105616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:48.106313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:48.122960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.124018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.125470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.126590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.127447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.128322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.342232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.352384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-606f46e1-a988-463b-b9f6-531748a6d7be tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.251014 Oct 04 18:12:48.353249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 955/1844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:48 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:48.812513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:48.813351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:48.821301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.821791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.822219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.823114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.823800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.824216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.905498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:48.906158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:48.907310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:48.907912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:48.908556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:48.919101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.924963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.924963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.924963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.924963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.924963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.950733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Getting quotas for project 1a05721f5e9a41feb9ecd39e15053f17. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:48.960263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Getting quotas for user 17cc595cd4ad46ae9fbfd6089997d5f7 and project 1a05721f5e9a41feb9ecd39e15053f17. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:49.017259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.029445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.034626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.037183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b83cb711-eeda-48c7-9457-6dd1ae0b9166 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.227425 Oct 04 18:12:49.039432 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 956/1845] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:48 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:49.070950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.071737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.080059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.080794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.081383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.082160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.083365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.084001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.246176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:49.248747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='af710c56-93cf-48c4-a30e-6140367ec9ce',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2069497f-efba-4bbd-a2ab-09d31d64d8c4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16b9752b-7c05-4d20-aa7d-e50e9cabe89a',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:49.303232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.316204 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3cdeea9e-a372-44c1-a6e5-1dd06e8fbf50 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.247959 Oct 04 18:12:49.317884 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 957/1846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.376336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.377187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.387378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.387378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.387378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.388673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.389301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.389893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.563876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.587411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db44f79b-809c-4dca-8b3a-fcf50c93d092 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.215132 Oct 04 18:12:49.589336 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 958/1847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.609081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d63a7c-e6eb-4f7c-9a62-a9df853b8478", "name": "network-vif-plugged", "status": "completed", "tag": "61fedb4c-2033-4d4d-83a1-6030584d7777"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:49.620335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.620819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.621250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.633750 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] Creating event network-vif-plugged:61fedb4c-2033-4d4d-83a1-6030584d7777 for instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 on n-h1-833090-21 Oct 04 18:12:49.639206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b2aa3dda-4d39-484d-801c-411f975e252c req-9af3ba80-d924-47b5-b2db-ccec69d8cccb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048445 Oct 04 18:12:49.643379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 959/1848] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:49.941956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed2299f-e1f0-4617-9409-3503b0ab2e88", "tag": "af16069c-8449-4e5a-9e58-d5b3f04e57c4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:49.970942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.970942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.970942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.970942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] Creating event network-changed:af16069c-8449-4e5a-9e58-d5b3f04e57c4 for instance bed2299f-e1f0-4617-9409-3503b0ab2e88 on n-h2-833090-21 Oct 04 18:12:49.970942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9a5aab73-0c45-46ab-875c-e1bb14f0e791 req-b7b11a22-62e4-4ffe-a98d-a95e5b57d6ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032687 Oct 04 18:12:49.972982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 960/1849] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:50.074324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.074324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.074324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.074324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.074324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.074843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.075016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.075624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.322611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.339014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.342577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.355742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0004b2e0-db09-4e6d-8f77-832ce1375a33 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.283615 Oct 04 18:12:50.363618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 961/1850] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:50.383968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.385107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.392427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.397216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.397216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.397216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.397216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.397216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.610649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.620007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-265d36ce-517e-45aa-a808-e0cd6699c6fb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1198 microversion: 2.1 time: 0.254211 Oct 04 18:12:50.624308 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 962/1851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1198 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:50.630256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.631113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.637973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.638742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.639180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.639918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.640585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.641247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.875104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.892969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-927afd50-a0f1-4a74-bb7f-ab258aeb8910 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.267215 Oct 04 18:12:50.894235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 963/1852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:50.918903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-378fff32-0583-4641-8f17-64b720ab99c5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.429809 Oct 04 18:12:50.922271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 890/1853] 10.222.0.40 () {62 vars in 1189 bytes} [Tue Oct 4 18:12:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 7434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:12:50.940341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.943201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.064972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.074430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.076048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.077496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e506f36-ccee-410d-9d7d-edf4f74ebc8a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1284 microversion: 2.32 time: 0.143651 Oct 04 18:12:51.078067 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 964/1854] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:51.398096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.404271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.409128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.411103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.420116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.421641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.422303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.422902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.651322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.652806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.655517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:51.663272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.663804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.664246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.665023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.665483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.665939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.824337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.830064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.833051 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3260f064-f24a-4e72-a03d-9f13538c33fc tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1381 microversion: 2.1 time: 0.185977 Oct 04 18:12:51.845852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 965/1855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1381 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:51.845852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-421e4b5e-92f6-4113-b41d-492b8b733058 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '.version_select at 0x7f900d7e1280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.845852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421e4b5e-92f6-4113-b41d-492b8b733058 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.845852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421e4b5e-92f6-4113-b41d-492b8b733058 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.845852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-421e4b5e-92f6-4113-b41d-492b8b733058 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.851513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.859858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.859858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2fe50b5a-39d8-4883-817d-bd18e3636410 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.463656 Oct 04 18:12:51.859858 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 891/1856] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:51.862956 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-421e4b5e-92f6-4113-b41d-492b8b733058 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3526 microversion: 2.1 time: 0.027976 Oct 04 18:12:51.864409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 966/1857] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/os-migrations => generated 3526 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:51.893638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b2fc6ff-208b-40bb-b244-14ac6e2e277b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.900977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b2fc6ff-208b-40bb-b244-14ac6e2e277b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012203 Oct 04 18:12:51.905852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 967/1858] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:51.919052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.920148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.928374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.928917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.929412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.930246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.930697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.931184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.037776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.038489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.040491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:52.045546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.046045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.046484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.047166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.047875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.048501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.083519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.092774 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cb78199-3daf-48cc-9b8c-4642649a2c98 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.178357 Oct 04 18:12:52.093942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 968/1859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:52.099167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b23736bd-2dae-4634-bc3d-6aa42975b157 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2141854626", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:52.203029 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-628fff55-4451-4e7c-956a-9d22577514d1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1534 microversion: 2.1 time: 0.335456 Oct 04 18:12:52.203715 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 892/1860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1534 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:52.208291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.208938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.263989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.271710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.273152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.274365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f5a0065-5e21-412f-a22c-c4f0272bebf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1284 microversion: 2.32 time: 0.069671 Oct 04 18:12:52.274931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 893/1861] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1284 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:52.279244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.279880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.285666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.286155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.286615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.287324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.287813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.288332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.415238 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5475b6b-f330-44cb-b9a6-e4faabd218b5 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1534 microversion: 2.1 time: 0.139196 Oct 04 18:12:52.415867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 894/1862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1534 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:52.438307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.442569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.443123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.443608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.444328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.444778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.445197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.469350 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5765dff-bd35-4972-80b0-c18f3b20d661 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.034619 Oct 04 18:12:52.469970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 895/1863] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:52.482195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-21", "block_migration": false, "disk_over_commit": false}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:52.484590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.491108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.491622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.493868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.493868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.493868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.493868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.519964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lazy-loading 'flavor' on Instance uuid 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:52.532735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Going to try to live migrate instance to n-h2-833090-21 {{(pid=123886) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:12:52.559879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b23736bd-2dae-4634-bc3d-6aa42975b157 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.464313 Oct 04 18:12:52.562327 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 969/1864] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Oct 4 18:12:52 2022] POST /compute/v2.1/flavors => generated 499 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:52.574972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-245f0840-d819-4c96-945e-437a701eae04 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.583163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-245f0840-d819-4c96-945e-437a701eae04 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012130 Oct 04 18:12:52.583907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 970/1865] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:12:52.755564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1060208899", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "533f62fa-b086-4dd7-a3d0-46275fe0ac06"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:52.814706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:53.058239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:53.059291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:53.060494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:53.061737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:53.062778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:53.073773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.074349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.074907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.075872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.076331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.076825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.100178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:53.105517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:53.132112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:53.134758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:53.426295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6aa493b4-df58-4004-80e5-04cd4aad03d1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675263 Oct 04 18:12:53.428507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 971/1866] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:53.433318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.434363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.441153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.442859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.443558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.460740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.463886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.464427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.641700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.659631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.661576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.663095 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a22a486-a534-4a99-8a8a-ea01a53c489b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.233744 Oct 04 18:12:53.664104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 972/1867] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:53.669570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.670241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.677269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.678076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.678702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.679653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.680286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.680893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.834871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.837427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:53.844354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54a09fd3-027a-42ad-8326-02dc405b2a9d tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.178957 Oct 04 18:12:53.848548 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 973/1868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:53.850860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.851507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.911756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.919537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.921072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:53.922348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd311400-6d5c-47c8-a6c1-4c08924064d0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1284 microversion: 2.32 time: 0.076331 Oct 04 18:12:53.922924 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 974/1869] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1284 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:53.928037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2faf6f48-a8cf-4f95-96d1-fe6ee3990ee8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.928646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2faf6f48-a8cf-4f95-96d1-fe6ee3990ee8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:54.013931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2faf6f48-a8cf-4f95-96d1-fe6ee3990ee8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.022534 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2faf6f48-a8cf-4f95-96d1-fe6ee3990ee8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1279 microversion: 2.1 time: 0.098433 Oct 04 18:12:54.023263 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 975/1870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:54.691358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:54.692020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:54.698825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.699314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.699768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.700466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:54.700918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:54.701345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:54.966812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.983598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.989764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.989764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93683568-9d32-42c4-8eda-46b295d9a5c0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.302313 Oct 04 18:12:54.991785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 976/1871] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:55.004576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.006004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.012893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.014788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.016041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.017874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.018541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.019165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.230030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.240178 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dda4c204-4a79-478b-aed3-3447a530e5cb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.247063 Oct 04 18:12:55.253768 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 977/1872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:54 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:55.264761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.265618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.273082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.273868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.274794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.276380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.276852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.277286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.406189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.417910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.421314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.421314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a20ed11e-4882-4326-a0bd-0ef93c551d4b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1574 microversion: 2.32 time: 0.167740 Oct 04 18:12:55.427486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 978/1873] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:55.448410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.450016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.466440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.466942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.469478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.471376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.471899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.478779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.590554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.601866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9241515b-e98c-4f8f-8f43-c6e4ba809dae tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1283 microversion: 2.1 time: 0.172572 Oct 04 18:12:55.602672 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 979/1874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:56.026543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.027857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.039880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.040598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.041190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.042055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.042664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.043210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.190969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.200927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.202548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.203796 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06768ab8-9a63-440d-bd94-76fa3b145c99 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.187566 Oct 04 18:12:56.204383 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 980/1875] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:56.266475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.267186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.274092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.274589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.275030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.276073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.276697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.277326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.431436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.440401 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-496647ab-d4c9-4d33-ba9b-8363c8026806 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.177845 Oct 04 18:12:56.441001 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 981/1876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:56.449041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.449986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.456297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.578066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.598171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.600645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.605007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b086d49b-1ad6-45f2-a7be-831f477f5155 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1582 microversion: 2.32 time: 0.159710 Oct 04 18:12:56.605857 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 982/1877] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1582 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:56.638331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.638331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.639318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.639855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.640292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.641010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.641462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.641881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.850747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.876414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9fa9a541-952f-4eb3-a144-a42722df2c57 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1331 microversion: 2.1 time: 0.250859 Oct 04 18:12:56.878733 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 983/1878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:56.944236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9caed8ac-80d0-49d1-950e-82b3a6ce7e8f tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478/action" status: 202 len: 0 microversion: 2.1 time: 4.465201 Oct 04 18:12:56.949269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 896/1879] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:52 2022] POST /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478/action => generated 0 bytes in 4467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:12:56.954459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.955429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.968297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.970000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.971236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:56.974003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:56.974781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:56.975920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.229379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.230252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.237923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.246101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.246101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.246101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.246101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.246101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.264205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.274246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-262043a3-231f-4476-9cd2-323d90dabfef tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.324006 Oct 04 18:12:57.290864 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 984/1880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.457595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.466426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.466753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.467303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.468923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.470358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d9dd369-d057-4859-a714-d8aa6a87152d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.244961 Oct 04 18:12:57.471119 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 897/1881] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:57.473659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.474144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.474585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.475533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.476196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.476622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.634075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.634729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.657009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.658092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.658553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.659284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.659774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.670839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.902255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.919012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.920653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.927445 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aadf2edd-473c-48cd-b6f0-fc5d5f6c0b14 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1592 microversion: 2.32 time: 0.297269 Oct 04 18:12:57.928085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 898/1882] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1592 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:57.951918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed2299f-e1f0-4617-9409-3503b0ab2e88", "name": "network-vif-plugged", "status": "completed", "tag": "af16069c-8449-4e5a-9e58-d5b3f04e57c4"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:57.961904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.962391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.962860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.975314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] Creating event network-vif-plugged:af16069c-8449-4e5a-9e58-d5b3f04e57c4 for instance bed2299f-e1f0-4617-9409-3503b0ab2e88 on n-h2-833090-21 Oct 04 18:12:57.981279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9a6c38ef-507b-4f3d-a17c-0d49de8f2d78 req-23da2a70-e69e-4f44-ba1b-6833ae2fa87b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Oct 04 18:12:57.982310 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 899/1883] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:57.988002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.989461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.996598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.998535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.998535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.998875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.000003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.000714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.133303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.140967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.145702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-faf97b0b-4866-4f3b-bed5-1fbca0937d74 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.683249 Oct 04 18:12:58.146642 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 985/1884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:58.155947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6cd0403-6305-459e-a148-1a0db2aac6f9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1339 microversion: 2.1 time: 0.171010 Oct 04 18:12:58.157506 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 900/1885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:58.299374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.300808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.311945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.315906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.316589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.320856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.320856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.321490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.497877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.498671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.512741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.513403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.515088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.515988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.524691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.525345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.625182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.635221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c69449fe-1c74-4024-a683-773c0f14c942 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.341074 Oct 04 18:12:58.640554 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 986/1886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:58.809549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.834192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.836953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.838371 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5e3fdae-3097-44d7-b2b5-c3b2519179a1 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.343971 Oct 04 18:12:58.840253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 901/1887] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:58.959278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.960332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.971197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.972363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.974041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.977312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.978724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.981428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.174143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.174784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.193825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.194546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.195354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.196590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.197247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.197882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.373076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.388150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.389622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.398779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-675a3d64-0741-4abd-aaaf-428fe8a506f8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1660 microversion: 2.32 time: 0.443822 Oct 04 18:12:59.399482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 987/1888] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1660 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:59.407294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.408328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.416445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.419214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.419214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.419214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.419214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.420214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.537427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.551029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a9abf43-d1d9-4636-a3b2-bcc0e2962750 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1337 microversion: 2.1 time: 0.150203 Oct 04 18:12:59.555118 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 988/1889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1337 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:59.563245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:59.577579 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09847cef-0aa7-4326-af2e-76401bfef602 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1327 microversion: 2.1 time: 0.407179 Oct 04 18:12:59.580562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 902/1890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1327 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:59.665604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.666217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.679522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.680123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.680731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.681520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.681980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.684511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.866494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.869022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.892369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.893151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.894475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.899856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.900585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.901198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.271877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.286257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.289473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.290925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e87505f8-1093-4096-a457-a1a79dbafa5a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.429625 Oct 04 18:13:00.292414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 903/1891] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:00.429508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:00.430233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:00.438149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.439022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.439755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.440731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.441463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.442135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.686043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.692804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.698809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.704865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.729317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ccc78ba-a688-435f-8fc1-bea89cb3e000 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1660 microversion: 2.32 time: 0.283737 Oct 04 18:13:00.729317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 904/1892] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:00 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1660 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:00.730577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5bbb3036-3b1d-4b11-979b-193977db94e3 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 1.055376 Oct 04 18:13:00.737540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 989/1893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:00.749844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:00.750246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:00.751620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:00.751971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:00.760879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.762458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.763746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.764228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.765718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.766732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.767059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.767668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.767799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.768426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:00.770302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:00.772132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.958945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.963617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:00.977408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2936e9db-ed70-48ab-808c-f453f9a64bd7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1337 microversion: 2.1 time: 0.244716 Oct 04 18:13:00.981598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 905/1894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:00 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1337 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.086871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb0e1d10-6557-4eaf-8214-e108147e0d18 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Action: 'create', calling method: .version_select at 0x7f90097e2160>, body: {"keypair": {"name": "tempest-keypair-1199204748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5fTDBRhMW4lZCMhsJB08kp1ivIX5smbCYcNEnC4LP7d2YKSdWDh4SKDbRxc5ZTVOfPFSFUEG6XDzXkm5xJ/3k9NwLRhknIyHhzf/RAjaOjB70FkHa6JMuh099l7D+Izg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:01.103374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-eb0e1d10-6557-4eaf-8214-e108147e0d18 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Getting quotas for project 33428d8d8282498c87726b26d1200ed1. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:01.111184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-eb0e1d10-6557-4eaf-8214-e108147e0d18 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Getting quotas for user 5ba81aacb59a40469cd37b6ee1a24424 and project 33428d8d8282498c87726b26d1200ed1. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:01.328524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.330134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb0e1d10-6557-4eaf-8214-e108147e0d18 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.347147 Oct 04 18:13:01.338427 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 906/1895] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:13:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:01.344023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c21fc93-9161-4bf3-a515-53b98f1d9f75 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1527 microversion: 2.1 time: 0.602319 Oct 04 18:13:01.345012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 990/1896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:00 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1527 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.345722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f1d409-62bb-4cde-a0a6-960c9fa0fd13", "name": "network-vif-unplugged", "status": "completed", "tag": "cc34ad76-57b2-46a2-9bf6-56f235b0f69c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:01.351458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.364195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.364195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.364195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.364512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.364512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.364709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.364803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.364890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.364890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.364890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.385558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] Creating event network-vif-unplugged:cc34ad76-57b2-46a2-9bf6-56f235b0f69c for instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 on n-h2-833090-21 Oct 04 18:13:01.396491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a236e40e-1294-4ded-bcaa-856e96201498 req-ca00b5c3-b070-49a6-ba4c-83e15e6b2d39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055636 Oct 04 18:13:01.397347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 907/1897] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:01.421223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.424660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.438277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.440736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.446358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.446358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.446358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.449654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.798886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.817630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e5b9347-8156-492a-b1c1-6fe08ff3b010 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1527 microversion: 2.1 time: 0.413427 Oct 04 18:13:01.818680 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 908/1898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1527 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.825745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.826629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.836010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.836854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.837630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.839676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.840401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.841009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.941926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.961146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.964059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.966775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a1aeae9-8328-43a1-a8f8-1ea6c49a7c4e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.620605 Oct 04 18:13:01.977897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 991/1899] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:01.985196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.987458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.997583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.998429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.999136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.001060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.005076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.009275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.046615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:02.267749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.287360 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f7f4114-58d7-46db-8c79-457440d1016e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.467088 Oct 04 18:13:02.288158 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 909/1900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:02.452464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:02.457106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.457665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.474262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.491840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.491840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.491840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.491840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.491840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.525286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] HTTP exception thrown: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Request method failure captured: Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 HTTP/1.1 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeWrfcWr9FFH0YB5dONwRqU1FQkVlRJP6CgeMgHz4bwLoFhvtHuhweGUaDZEz5Cv3MxdQ0IdUUeuRiWd02hVveY_0eCFIIlY5q2mKOihvBb68GdR0HFmBZS0Ot9odPIt8IPoSFNdo3hRvzuL9WZ1LMhHCPETqRYnZezm8gOmw6rNuQ Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b6ca4e8829cc46a9b14d462758dd8148 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6ca4e8829cc46a9b14d462758dd8148"}]}] Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b6ca4e8829cc46a9b14d462758dd8148 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestMultiTenantJSON-170515294-project Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 99a567dd362c4727868416652caae0f0 Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294-project Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'bed2299f-e1f0-4617-9409-3503b0ab2e88'} Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:02.527255 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Returning 404 to user: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b763f73-797c-40db-b463-5f00941c5197 tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 404 len: 111 microversion: 2.1 time: 0.239650 Oct 04 18:13:02.537991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 910/1901] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:02 2022] DELETE /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:02.545685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.546884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.559448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.561085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.562550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.566585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.567372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.568050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.656825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.675105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.677759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.680355 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5294351c-bfa4-41db-99a4-890882169b72 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1660 microversion: 2.32 time: 0.700215 Oct 04 18:13:02.683595 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 992/1902] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1660 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:02.697395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.699550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.716837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.721966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.722760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.725076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.725733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.726368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.838112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.859118 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8efdeed0-b545-4d17-9666-cdae8feb512f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.324015 Oct 04 18:13:02.860461 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 911/1903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:02 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:03.008209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.009235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.034560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.036328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.037613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.038790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.039445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.039926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.086394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:03.334815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.348515 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c77683f6-f3f7-44c4-a181-654a56948927 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1527 microversion: 2.1 time: 0.662483 Oct 04 18:13:03.349109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 993/1904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:02 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1527 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:03.367003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.371084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.379028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.380101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.381071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.382681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.383410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.384196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.481244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.501997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.508325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.512378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8157a105-51c8-492e-b7d2-e90cfc2b39a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.507867 Oct 04 18:13:03.514032 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 912/1905] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:03.522366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Action: 'update', calling method: >, body: {"server": {"name": "bed2299f-e1f0-4617-9409-3503b0ab2e88_new"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:03.527521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.537926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.538695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.539332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.540324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.541616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.542303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.569648 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] HTTP exception thrown: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Request method failure captured: Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 HTTP/1.1 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 64 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeWrfcWr9FFH0YB5dONwRqU1FQkVlRJP6CgeMgHz4bwLoFhvtHuhweGUaDZEz5Cv3MxdQ0IdUUeuRiWd02hVveY_0eCFIIlY5q2mKOihvBb68GdR0HFmBZS0Ot9odPIt8IPoSFNdo3hRvzuL9WZ1LMhHCPETqRYnZezm8gOmw6rNuQ Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b6ca4e8829cc46a9b14d462758dd8148 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b6ca4e8829cc46a9b14d462758dd8148"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b6ca4e8829cc46a9b14d462758dd8148"}]}] Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b6ca4e8829cc46a9b14d462758dd8148 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestMultiTenantJSON-170515294-project Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 99a567dd362c4727868416652caae0f0 Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-170515294-project Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "bed2299f-e1f0-4617-9409-3503b0ab2e88_new"}} Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'bed2299f-e1f0-4617-9409-3503b0ab2e88', 'body': {'server': {'name': 'bed2299f-e1f0-4617-9409-3503b0ab2e88_new'}}} Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:13:03.575946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:03.589259 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:03.602550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] Returning 404 to user: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:03.604641 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4646825-de0c-476a-a8cd-f6ed91a0fe4c tempest-ServersNegativeTestMultiTenantJSON-170515294 tempest-ServersNegativeTestMultiTenantJSON-170515294-project] 10.222.0.40 "PUT /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 404 len: 111 microversion: 2.1 time: 0.088975 Oct 04 18:13:03.614615 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 913/1906] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:13:03 2022] PUT /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:03.619938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f1d409-62bb-4cde-a0a6-960c9fa0fd13", "tag": "cc34ad76-57b2-46a2-9bf6-56f235b0f69c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:03.634057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.639837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.639837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.678767 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] Creating event network-changed:cc34ad76-57b2-46a2-9bf6-56f235b0f69c for instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 on n-h2-833090-21 Oct 04 18:13:03.685491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a11dfba2-6140-4c14-b601-5a34ed36d576 req-429514ef-4caf-4322-a232-b11d052b935d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075453 Oct 04 18:13:03.686549 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 914/1907] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:03.697984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.697984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.703063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.703063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.703402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.705332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.705805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.706488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.730584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:03.741837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a743798-d8dc-48e4-982d-6e204cf3254f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.387135 Oct 04 18:13:03.742610 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 994/1908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:03.747636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:03.761780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.762433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.777445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.778260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.779016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.782986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.783919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.785574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.020372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=20 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:04.306688 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cb5e15f-01c0-4e23-be23-0c154ea4f3c6 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 204 len: 0 microversion: 2.1 time: 0.617825 Oct 04 18:13:04.307724 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 915/1909] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:03 2022] DELETE /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:04.314937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.318431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.337889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.338944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.345053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.346937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.351137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.351137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.426393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.442183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.453305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.454535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-630c03b3-e0d0-4a99-bec7-e80380d08747 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1707 microversion: 2.32 time: 0.711053 Oct 04 18:13:04.455116 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 995/1910] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1707 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:04.460237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.460863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.478689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.479234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.479720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.480455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.480923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.481349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.768433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:04.783042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd558ac2-d05c-400c-aa80-6783364f7fa0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.473570 Oct 04 18:13:04.784621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 916/1911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:04.792581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:04.797433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:04.811124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.812253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.813009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:04.814098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:04.814819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:04.815511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.015319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.043289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.045582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.047086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8b08f37-a496-4393-bf68-f566d146d82e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.261189 Oct 04 18:13:05.049577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 917/1912] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:05.056629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.057499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.065482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.067072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.068196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.069316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.069964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.070562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.338540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.348506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08c017d5-defd-4670-8484-a409d8e6e9e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.296976 Oct 04 18:13:05.367723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 918/1913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:05.494184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.497276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.497964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.506099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6d930bc-c222-4474-bda4-e05f86895a06 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1533 microversion: 2.1 time: 1.049774 Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.511130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.513011 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 996/1914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:04 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1533 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:05.774139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.788270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.789861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.791204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aabc6a46-e2c4-4809-8884-e5adb1919065 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1707 microversion: 2.32 time: 0.303299 Oct 04 18:13:05.791814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 919/1915] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1707 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:05.809392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.810370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.817391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.818224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.818970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.820141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.820896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.821622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.999528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:06.033066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.033613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.034058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.057461 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] Creating event network-changed:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:13:06.084655 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7659e6bf-a75e-4381-944e-1a519ce648db req-47766060-3b6c-40db-89b0-87607c312134 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088806 Oct 04 18:13:06.086603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 920/1916] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:06.099025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.105219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.117715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.118373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.118927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.119871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.120558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.121186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.407896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.430390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd0eabb8-f938-4642-91e5-ad770b7a7acd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.621555 Oct 04 18:13:06.434976 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 997/1917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:06.452355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.455676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.464235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.476138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.476632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.479534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.483358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.483740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.484908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.485393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.485882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.487317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a88f3903-ad97-4f95-93af-2e58e12c711b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.397208 Oct 04 18:13:06.491150 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 921/1918] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:06.539750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.540610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:06.549196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.549854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.550412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.551327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:06.551999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:06.552790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:06.972780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:06.988882 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7699cbc2-7434-4627-8050-5dbb0689364b tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1533 microversion: 2.1 time: 0.453999 Oct 04 18:13:06.990215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 922/1919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1533 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:06.998143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:06.999012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.008844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.009607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.014532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.014532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.014532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.021350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.540626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.556806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7b2b7a9-d9a5-47cb-adbd-61a18b8a68c8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 1.120242 Oct 04 18:13:07.561602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 998/1920] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:07.577442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.578378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.604105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.606488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.607281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.616370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.617395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.621770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.741803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.757871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.768567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.768567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b1a3263-afa1-4f63-a634-77c70f0b2bed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1754 microversion: 2.32 time: 0.768714 Oct 04 18:13:07.768567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 923/1921] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:06 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1754 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:07.775576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:07.776432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:07.783760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.786472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.786472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.786472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:07.787021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:07.787675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a75167e-73b6-4ed4-93bb-4c821e34f24b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.196662 Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 924/1922] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed2299f-e1f0-4617-9409-3503b0ab2e88", "name": "network-vif-deleted", "tag": "af16069c-8449-4e5a-9e58-d5b3f04e57c4"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] Creating event network-vif-deleted:af16069c-8449-4e5a-9e58-d5b3f04e57c4 for instance bed2299f-e1f0-4617-9409-3503b0ab2e88 on n-h2-833090-21 Oct 04 18:13:08.101575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e5226053-220e-4d67-968e-98cab05b218e req-c9ff0412-430e-4023-bd0c-25a23c57d20a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046540 Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 925/1923] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.106173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.150875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.163384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d652841b-1dad-49df-94f3-8c1d3323dccb tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1491 microversion: 2.1 time: 0.126590 Oct 04 18:13:08.164740 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 926/1924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1491 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.315209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.326510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79bb8b6d-7a2a-4949-b2d2-48c1909759db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.763103 Oct 04 18:13:08.327998 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 999/1925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.615261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.616199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.623978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.624700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.625276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.626168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.626787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.627357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.803226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.804730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:08.814012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.815055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.816507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.817640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:08.818433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:08.819431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:08.847268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:08.860955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b718c96-0e86-4d6b-b040-b3941b36802c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.251446 Oct 04 18:13:08.865723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 927/1926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:08.990434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:08.991291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.010027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.012890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.019353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.030695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.031244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.031814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.213928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.226174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.227955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.229223 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0b84725-ba51-42da-b6c3-cfea8a0f7e61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.247066 Oct 04 18:13:09.229793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 928/1927] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:09.246853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.248164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.256305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.257128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.257703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.259808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.260344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.260980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.308676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.309384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.310000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.310761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lazy-loading 'fault' on Instance uuid bed2299f-e1f0-4617-9409-3503b0ab2e88 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:09.356930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a36da8b90014019bdcc3e2eb604db0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ee13bacdd343bcaf621a37c1dec2bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.367504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6eb34c8e-c7d9-4835-82e0-35fe225971fa tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 200 len: 1317 microversion: 2.1 time: 0.132769 Oct 04 18:13:09.368097 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 929/1928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 1317 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.373929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.374751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.381045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:09.382723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.383364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.387596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.387596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.387596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.387596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.591412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.604577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa6c00ce-3f11-4285-9465-162b8484f7dc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.235129 Oct 04 18:13:09.616821 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 930/1929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:09.630089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.642172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.645481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:09.645481 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79bec2df-56ab-4ca6-bdaf-5dc012e95d91 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1754 microversion: 2.32 time: 0.848253 Oct 04 18:13:09.647734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "99968730-6b91-46ab-a216-17ba3e0c7938"}], "security_groups": [{"name": "tempest-securitygroup--288806517"}], "key_name": "tempest-keypair-1199204748", "user_data": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:09.656665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1000/1930] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:08 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1754 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:09.791029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] validate_networks() for [('99968730-6b91-46ab-a216-17ba3e0c7938', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:09.890514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:09.892091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:09.905174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.905907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.906518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:09.909324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:09.920562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:09.921618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.434525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:10.435067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:10.435727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:10.436292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:10.436790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:10.449644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=23 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:10.452331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.453351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.454302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.456064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.457462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.458282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.461699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.479215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Getting quotas for project 33428d8d8282498c87726b26d1200ed1. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:10.487502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3509fdeb-8a45-4db0-a24d-ba9740c03bff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.601004 Oct 04 18:13:10.494119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Getting quotas for user 5ba81aacb59a40469cd37b6ee1a24424 and project 33428d8d8282498c87726b26d1200ed1. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:10.506800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1001/1931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:09 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:10.516691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.517836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.525511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.526178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.526761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.527656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.528294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.528861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.538473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:10.545614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:10.772495 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ad0a558-f01e-4009-9b49-3741b00bf395 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.154211 Oct 04 18:13:10.773782 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 931/1932] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:10.779577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.780397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] [instance: bed2299f-e1f0-4617-9409-3503b0ab2e88] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.791519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.792312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.792752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.793811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.793970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.794679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.812252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] HTTP exception thrown: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Request method failure captured: Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 HTTP/1.1 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHeHbGwvUZz4mW9GDlY2_EoYrxmfXjkA_Gxu42HkcTX9fuJdwzOFrUZh3SO_wcEJH-kBCzU3QLMuV0eydY4uvLIoBuC1M9b8vlZ3TudjYdrIB9fCbX5LBptq2tgcNyQI7HWty8M5WJew_H6ZuGDH8dbb2nUdsKiEpO6Nvv-drOoocGI Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 00ee13bacdd343bcaf621a37c1dec2bd Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2048182622 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ee13bacdd343bcaf621a37c1dec2bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ee13bacdd343bcaf621a37c1dec2bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ee13bacdd343bcaf621a37c1dec2bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ee13bacdd343bcaf621a37c1dec2bd"}]}] Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2048182622 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 00ee13bacdd343bcaf621a37c1dec2bd Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2048182622 Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2048182622-project Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 3a36da8b90014019bdcc3e2eb604db0d Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2048182622-project Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'bed2299f-e1f0-4617-9409-3503b0ab2e88'} Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:10.814454 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. Oct 04 18:13:10.818665 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:10.819365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] Returning 404 to user: Instance bed2299f-e1f0-4617-9409-3503b0ab2e88 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:10.820557 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac6873bc-ae2d-43e9-ab9c-b374da3c7521 tempest-ServersNegativeTestMultiTenantJSON-2048182622 tempest-ServersNegativeTestMultiTenantJSON-2048182622-project] 10.222.0.40 "GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88" status: 404 len: 111 microversion: 2.1 time: 0.045152 Oct 04 18:13:10.821890 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 932/1933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/bed2299f-e1f0-4617-9409-3503b0ab2e88 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:10.827832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.828769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.852559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.853439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.854804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.855674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.856693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.858305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.860211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.869825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.873328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:10.877968 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6d09ec9-83a9-497d-a84a-0958c0b60c3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.370063 Oct 04 18:13:10.903421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1002/1934] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:10.929800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.372753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.384369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75edfb90-6e6d-4efd-b18f-1b75d94d0a2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.559711 Oct 04 18:13:11.384369 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 933/1935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:11.399660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9a73d15-db98-4572-80ea-1fa9280e7814 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.400354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9a73d15-db98-4572-80ea-1fa9280e7814 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.502603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.519926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.521443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.526268 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5d95cbc-e677-431c-b87b-579ce774965e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1801 microversion: 2.32 time: 0.621602 Oct 04 18:13:11.527512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1003/1936] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:10 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1801 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:11.532603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.533410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.541648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.552543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.552543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.552543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.552543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.552543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.709837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9a73d15-db98-4572-80ea-1fa9280e7814 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.721502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9a73d15-db98-4572-80ea-1fa9280e7814 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1226 microversion: 2.1 time: 0.336735 Oct 04 18:13:11.724683 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 934/1937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1226 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:11.913618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:11.914638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:11.932705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:11.944751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.945321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.946334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-befae67e-ccec-4130-81cf-d2faf2139b51 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.416182 Oct 04 18:13:11.948785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1004/1938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:11.949140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:11.950774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:11.951518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:11.952059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.205455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.214845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.219842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.222719 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6143e772-5e26-4d6a-95d3-be341fbbfb65 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.316333 Oct 04 18:13:12.226713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 935/1939] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:11 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:12.412710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.413793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.435630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.436139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.436582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.439106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.439404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.445429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.561304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.562703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.576346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.577750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.578989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.580913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.582669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.583861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.752836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.782034 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aad06a5c-2072-47c1-b8c9-0667cd2eb44a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.375041 Oct 04 18:13:12.797761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1005/1940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.805720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a13d264c-99d3-451b-9638-cb3044cdeecd tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.806846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a13d264c-99d3-451b-9638-cb3044cdeecd tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.813889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:12.902350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a13d264c-99d3-451b-9638-cb3044cdeecd tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:12.911162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a13d264c-99d3-451b-9638-cb3044cdeecd tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1226 microversion: 2.1 time: 0.110067 Oct 04 18:13:12.912900 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1006/1941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:12.972322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:12.973914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:12.985154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.989791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.990360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:12.991409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:12.992015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:12.992637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.165040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:13.179609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:13.180920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:13.182514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ab8c2e1-76df-453f-9f66-406e56df149b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1848 microversion: 2.32 time: 0.628539 Oct 04 18:13:13.204905 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 936/1942] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1848 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:13.259954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:13.272022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:13.290476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.292464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.293463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.298579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.299701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.305481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.538041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:13.568988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69d433a7-c2ed-4c15-985c-5bdc458bc8db tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.600748 Oct 04 18:13:13.572995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1007/1943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:12 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:13.593042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-plugged", "status": "completed", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:13.634895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.638393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.643649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.717685 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] Creating event network-vif-plugged:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:13:13.740956 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8d7c5e16-c940-4ba3-87a5-ceefadd445d8 req-fa62a5aa-cd76-43bf-b6fc-dabefd5aebea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161017 Oct 04 18:13:13.748738 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1008/1944] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:13.833072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:13.837844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:13.862003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.863779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.865465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:13.866989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:13.868065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:13.869056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.025383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.044975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.060419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.061630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f1fb670-b4f3-4a4b-af1f-095254f02203 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.809782 Oct 04 18:13:14.062995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 937/1945] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:13 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:14.094640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.102179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.132837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.134093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.135323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.136427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.137432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.139785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.145388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.154576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64de2c49-e551-4dd0-8907-9225fcc0e33b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.326277 Oct 04 18:13:14.156099 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1009/1946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:13 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:14.212958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.214418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.233150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.233742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.234189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.236594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.237065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.238450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.455275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.502834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ef16767-3b3a-4341-8311-6d9c684d17e0 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1278 microversion: 2.1 time: 0.437611 Oct 04 18:13:14.504001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 938/1947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1278 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:14.530110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.533272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:14.546519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.548257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:14.551374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8092de2b-5070-4af8-9e49-9ceec31552ae tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1848 microversion: 2.32 time: 0.341525 Oct 04 18:13:14.556220 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1010/1948] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1848 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:14.597214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:14.597854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:14.609484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.617552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.618509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.621424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.624011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.629316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.846135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "b31e804b-098e-4fbd-bb38-ff0475bfe7fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:14.884534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:14.885061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:14.887621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:14.943994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] Creating event network-changed:b31e804b-098e-4fbd-bb38-ff0475bfe7fb for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:14.962872 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-42aebca3-71fd-46bc-b2e0-aecc0e4c642c req-29ccea1f-ada0-4171-ac1f-195b7a99cc12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121362 Oct 04 18:13:14.966667 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1011/1949] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:15.073369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.082374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48ad4bad-f0e8-4cfb-9196-c46e1a158ad2 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.489015 Oct 04 18:13:15.099764 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 939/1950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:14 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:15.118837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.119566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.135373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.136455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.139869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.140746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.141230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.141669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.203941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.204804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.215964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.216451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.216883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.217594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.224276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.225113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.649235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.668962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.671900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.673506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7c80271-7b4f-4314-a7db-324995ec0903 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.558985 Oct 04 18:13:15.675307 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1012/1951] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:15.719968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.721260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.737309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:15.750109 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcd59643-18dc-48d7-b197-853902a3ebfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1379 microversion: 2.1 time: 0.551466 Oct 04 18:13:15.751193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.751307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 940/1952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1379 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:15.752069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.757795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.760228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:15.760699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.762888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:15.764257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.765487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.780314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.781087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.781696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:15.782548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:15.783144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:15.783731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.145797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.161535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5b08e47-372d-4662-894b-8b3e8b426c73 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1286 microversion: 2.1 time: 0.481049 Oct 04 18:13:16.163517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1013/1953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1286 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:16.186928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.188752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.208016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.210552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.210552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.210552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.211039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.211581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.232893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.245931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.247329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.248661 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86efdb93-0545-4d7a-a548-8b4613bf04c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1848 microversion: 2.32 time: 0.495650 Oct 04 18:13:16.249236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 941/1954] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:15 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1848 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:16.439182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.449958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d452f588-cddd-4ed7-8a78-ce20e0763a55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.283867 Oct 04 18:13:16.454816 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1014/1955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:16.725692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.726647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.738026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.739538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.740639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.741805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.742481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.743749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.779836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.780692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.789941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.792873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.796629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.799789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.801016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.803533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.171272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.191688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0fc56d7a-4bd3-4afc-855e-3eade38d83a4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1529 microversion: 2.1 time: 0.414422 Oct 04 18:13:17.205076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.228829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.234777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.241771 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f812c33e-aff6-4e17-8178-5e2f49378648 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.516185 Oct 04 18:13:17.241895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1015/1956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1529 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.242015 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 942/1957] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:17.250808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.252542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.270417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.270417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.273681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.274181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.274617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.275329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.275805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.276284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.286638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.287349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.293386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.294334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.294982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.295614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.397500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.410048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbd965bd-0f00-4fa9-85df-14b5703261d3 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1284 microversion: 2.1 time: 0.166027 Oct 04 18:13:17.411629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1016/1958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.420369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.422099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.432205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.433080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.433729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.434733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.435634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.436340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.744340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.757795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.758994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.760183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c2e6b0f-4c29-440e-a8e1-638105412a9f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1869 microversion: 2.32 time: 0.347078 Oct 04 18:13:17.772591 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1017/1959] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1869 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:17.794605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.794605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.801126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.801789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.806634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83a088f9-5ceb-4daf-a17b-8b273b1afb2e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1529 microversion: 2.1 time: 0.552959 Oct 04 18:13:17.807908 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 943/1960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1529 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.823270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "c70a47a6-9e24-4a26-bf4d-acb66858a391"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:17.842821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.852463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.853302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.871270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] Creating event network-changed:c70a47a6-9e24-4a26-bf4d-acb66858a391 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:17.879731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2cd4f08d-e6d7-44b9-b423-063ba4811ff2 req-b7985e0b-e0ac-431e-b63e-c40bb7c3af57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070239 Oct 04 18:13:17.880893 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 944/1961] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:17.896368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e66f7f2-d8dc-4444-867a-7bdfa67351f2 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.067932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e66f7f2-d8dc-4444-867a-7bdfa67351f2 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/533f62fa-b086-4dd7-a3d0-46275fe0ac06" status: 202 len: 0 microversion: 2.1 time: 0.183265 Oct 04 18:13:18.069314 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 945/1962] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:17 2022] DELETE /compute/v2.1/flavors/533f62fa-b086-4dd7-a3d0-46275fe0ac06 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:18.079379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa3a89bb-808e-44ae-be99-07e979d9d85c tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.130116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa3a89bb-808e-44ae-be99-07e979d9d85c tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055402 Oct 04 18:13:18.145170 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 946/1963] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:18.158302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:18.160900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.168525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.169039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.169494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.170562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.171616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.171616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.177198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:18.232312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.238984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Old instance type tempest-test_resize_flavor_-2141854626, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:13:18.249019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:18.249444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:18.249927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:18.250332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:18.250747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:18.260817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.274194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12f09e58-c593-479f-a16d-093a04fffe78 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.499340 Oct 04 18:13:18.281812 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1018/1964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:18.287221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.287876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.302087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.302591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.303037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.303813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.304278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.304710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.514327 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cdfd109-3053-4a32-9053-cc02755417d2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba/action" status: 202 len: 0 microversion: 2.1 time: 0.361423 Oct 04 18:13:18.518168 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 947/1965] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:18 2022] POST /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:13:18.520987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.526629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.547154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.551128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.559665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.562015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.562015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.563155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.217123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.228476 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43c81305-6d16-4811-bbbb-8a844af3a865 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.710636 Oct 04 18:13:19.229090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 948/1966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.243122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.244657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.252652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.253925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.254511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.255389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.260669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.260669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.336363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.354279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.357179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.384568 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9399d4a9-a4cd-480a-9768-02334570e7e2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 1.095869 Oct 04 18:13:19.385934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1019/1967] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:19.410953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.417191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.458000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.459235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.461549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.462848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.463693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.467234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.680008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.692894 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73d01b41-5301-49ed-a0e1-23c1fdb37f06 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1538 microversion: 2.1 time: 0.461816 Oct 04 18:13:19.704864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 949/1968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1538 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.720548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.721318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.730499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.736840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.736840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.736840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.736840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.736840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.802130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.817873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.819570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.821366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33a7a535-5be9-4240-969e-1c7279901bdb tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1869 microversion: 2.32 time: 0.431766 Oct 04 18:13:19.852150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1020/1969] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1869 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:20.229544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.249138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e186cbcf-c755-4dc1-a87a-233222b70303 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.538789 Oct 04 18:13:20.249756 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 950/1970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.256740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.257850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.296002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.301004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.301649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.302939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.307225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.308725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.416696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.417221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.423885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.424455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.424926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.425648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.426108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.426534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.473649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:20.609314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.627779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5322c868-3f9c-45a8-a9c3-bf478bca22c9 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.378834 Oct 04 18:13:20.629283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1021/1971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:20.702651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "1631307a-60e8-430b-a272-eddadcf33c16"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:20.719627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.720386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.721076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.747666 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] Creating event network-changed:1631307a-60e8-430b-a272-eddadcf33c16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:20.751076 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9cb1ddf3-9537-4116-b827-6af2a59a59b5 req-7afea65e-1bc0-4739-91ed-2d739c500803 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052192 Oct 04 18:13:20.754907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1022/1972] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:20.761617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.763645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.773363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.774166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.775044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.777039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.777039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.777039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.909002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.928147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.973720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.982746 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c349bc55-a314-48fd-ac0f-0ea27fbd7c9a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.567268 Oct 04 18:13:20.992653 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 951/1973] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:21.015400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.017869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.045472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.045472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.045472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.049911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.052312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.052996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.232145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.246206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5efd1a06-a580-4ac2-bdc1-0bf741bbec2f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1538 microversion: 2.1 time: 0.489582 Oct 04 18:13:21.261047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1023/1974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1538 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.282359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def28efd-500d-46ce-93c4-d1a1d9380fca"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:21.286094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.304110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.306519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.309591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.313505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.317916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.319119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.718111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:21.751936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.775293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.777990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.781180 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef81c5b5-83e6-4bd9-b09d-a67ebafc6f85 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.786095 Oct 04 18:13:21.789546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 952/1975] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:21.806122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.808951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.826168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.827330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.828065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.829158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.829849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.830463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.306233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.321074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-586386bb-fc14-4ab3-bc3e-7800e8161211 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.529799 Oct 04 18:13:22.324327 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 953/1976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.339323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.343090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.360333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.360844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.361541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.367588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.368490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.369391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.669392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ed3b10e-35c9-4013-8d03-a6161755e3d5 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "POST /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.405831 Oct 04 18:13:22.671185 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1024/1977] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:13:21 2022] POST /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments => generated 194 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:22.686225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.686225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.696450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.696971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.697429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.698137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.698599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.699025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.910759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:23.029522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.051806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05066fc2-950f-4dcf-aab1-deb9bc379706 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.724847 Oct 04 18:13:23.054281 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 954/1978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.089244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.090131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.109357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.110394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.111738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.112923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.114965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.116801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.375817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.385329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.391921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.398233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d97e402-9cb0-45f3-b7d2-9a289fd3f776 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.724717 Oct 04 18:13:23.400672 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1025/1979] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:23.413900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c", "tag": "c9749f1b-3b2e-4337-aa7e-9f16572a51a3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.463677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.468951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.473617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.528539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] Creating event network-changed:c9749f1b-3b2e-4337-aa7e-9f16572a51a3 for instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c on n-h2-833090-21 Oct 04 18:13:23.548555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a4c4cee9-7ed9-4d90-9ee8-6a89eb9570c8 req-90c4f2e8-74ed-4a26-abb2-96cba193a2ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144148 Oct 04 18:13:23.551983 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1026/1980] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:23.573655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.573655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.595524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.598747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.600016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.601705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.602976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.605801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.606016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.615034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6c5f91f0-7ab2-44eb-86b5-5eece954fa38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1538 microversion: 2.1 time: 0.530158 Oct 04 18:13:23.638544 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 955/1981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1538 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.638544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d63a7c-e6eb-4f7c-9a62-a9df853b8478", "name": "network-vif-unplugged", "status": "completed", "tag": "61fedb4c-2033-4d4d-83a1-6030584d7777"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:23.664636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.665654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.666348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.692780 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] Creating event network-vif-unplugged:61fedb4c-2033-4d4d-83a1-6030584d7777 for instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 on n-h1-833090-21 Oct 04 18:13:23.701340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2233ed3e-aa0b-4816-bb09-b65816f5cd6a req-24396c04-7ac9-4473-b3e9-ca0d0b372bc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070602 Oct 04 18:13:23.708269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 956/1982] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:23.713963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.720579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.761461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.762211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.762835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.763726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.764332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.764911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.517258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.546683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8c6989f-e687-41be-a4ca-7128ea387c3c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.836562 Oct 04 18:13:24.548872 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 957/1983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.559254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.561530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.575849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.577103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.581941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.583145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.583809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.584458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.924483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.937104 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c816e7ba-26c4-4fd1-9b1b-41090f6de347 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.384547 Oct 04 18:13:24.939868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 958/1984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.950359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.954464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.972082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.972864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.973383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.974184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.974899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.975408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.248923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.260665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.262862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.264308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79a84537-3e46-4556-b96c-e6a0e1d39b02 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.323040 Oct 04 18:13:25.265197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 959/1985] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:25.277700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.278824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.295048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.295404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.295984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.297240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.299838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.301085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.776463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.816965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.823023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.824616 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e52c215e-7fbc-4b19-9c0f-a731d384186f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 2.270143 Oct 04 18:13:25.832538 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1027/1986] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:25.840748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.844701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.862153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.868315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.869026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.871287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.874180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.874833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.888291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:25.910948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.923911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9644c76-c4c2-4db4-8b5d-daf95e55e3f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1538 microversion: 2.1 time: 0.656544 Oct 04 18:13:25.929746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 960/1987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1538 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:25.966959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.974628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.998328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.999400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.000960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.002711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.004704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.005456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.563182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.574938 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e485668-04df-4ed5-ac60-a599c972bdeb tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.615288 Oct 04 18:13:26.587548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 961/1988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.596873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d63a7c-e6eb-4f7c-9a62-a9df853b8478", "tag": "61fedb4c-2033-4d4d-83a1-6030584d7777"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:26.609115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.610445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.611334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.628848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] Creating event network-changed:61fedb4c-2033-4d4d-83a1-6030584d7777 for instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 on n-h1-833090-21 Oct 04 18:13:26.636726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c40be30c-d5c6-4eea-b78d-bb426d13f601 req-f6775786-1a28-4de4-babb-85bd54126e95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049404 Oct 04 18:13:26.638576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 962/1989] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:26.647125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.648225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.657646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.665805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.665805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.665805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.665805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.665805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.916291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.948558 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bb80d08-b10a-498a-abc5-736e31ba4889 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 1.113417 Oct 04 18:13:26.965652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1028/1990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.980014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.981081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.997021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.999698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.000317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.004380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.005099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.005729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.288480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.301760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:27.325841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.327594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.329474 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79292bb3-d74c-4317-8f45-f807fd5cda61 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1485 microversion: 2.25 time: 0.688768 Oct 04 18:13:27.331751 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 963/1991] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1485 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:27.340980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.341801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.349042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.349629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.350741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.350939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.351496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.351997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.645908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.657496 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba9c93f4-1397-491f-bfe7-4b463c52f3a1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.320562 Oct 04 18:13:27.658145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 964/1992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.678202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.679827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.687845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.688903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.689682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.690828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.691709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.692395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.896990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.931714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.936665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.967369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6beeaa1e-6375-4290-96af-0fedbd31769f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.998377 Oct 04 18:13:27.968566 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1029/1993] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:27.980634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.989197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.994320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b68769c-9aea-46f2-865c-f86d8e14f396 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.333649 Oct 04 18:13:27.995829 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 965/1994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.000103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.013754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.015059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.017482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.026493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.027792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.029217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.359706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.360854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.381591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:28.386815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.390996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.393213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.394353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.395002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.399134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.666415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.677721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.679442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.680997 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f1c877d-b190-4acd-a6e4-f12735b95760 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1475 microversion: 2.25 time: 0.327746 Oct 04 18:13:28.682282 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 966/1995] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:28.702489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.703546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.711169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.712293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.714214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.715643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.716488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.717503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.921972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.932617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d47714c8-add8-452f-9711-cfa6022c2d28 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.235430 Oct 04 18:13:28.949476 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 967/1996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.949476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88b3da5d-8ecf-4900-a2fb-b10310f2cc77 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '.version_select at 0x7f9008f1a3a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.958148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b3da5d-8ecf-4900-a2fb-b10310f2cc77 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.960051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b3da5d-8ecf-4900-a2fb-b10310f2cc77 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.967204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b3da5d-8ecf-4900-a2fb-b10310f2cc77 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.007086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88b3da5d-8ecf-4900-a2fb-b10310f2cc77 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 5180 microversion: 2.25 time: 0.065049 Oct 04 18:13:29.018769 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 968/1997] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/os-migrations => generated 5180 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:29.019610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "e6994394-dab0-410e-bc2a-4375d059e115"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:29.059623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.060118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.060745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.073694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] Creating event network-changed:e6994394-dab0-410e-bc2a-4375d059e115 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:29.080138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-745ac0ec-b58a-472b-a1cf-66c6533bce44 req-d5882cc1-42d8-40be-a32c-8a8f95d6c541 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070528 Oct 04 18:13:29.081798 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 969/1998] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:29.088452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.089190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.102513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.103258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.105957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.107016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.108387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.108860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.277554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.294407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97c232a7-a225-47ba-b645-ed807bf14c82 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 1.319909 Oct 04 18:13:29.297043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1030/1999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:29.311656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.314505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.329310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.335217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.335933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.338648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.338648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.338648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.578918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.597292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.600136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.601446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3af3764d-7eb1-4f6b-a2f3-d6fe0c7bda18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.518467 Oct 04 18:13:29.602024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 970/2000] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:29 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:29.619941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.621287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.634030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.634785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.635379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.636294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.636767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.637353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.737412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] Lazy-loading 'services' on Instance uuid 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:29.782574 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6049ebf-ec7e-4ad2-b69c-e2b8edad5c80 tempest-LiveAutoBlockMigrationV225Test-303217473 tempest-LiveAutoBlockMigrationV225Test-303217473-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1969 microversion: 2.25 time: 0.484152 Oct 04 18:13:29.786906 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1031/2001] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:29 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1969 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:29.852135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.853621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.863531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.864166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.864779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.865587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.866161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.867723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.932647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:30.009548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.022640 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a0f417f-0d8d-4b1e-a879-9296009f44c5 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.419375 Oct 04 18:13:30.023163 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 971/2002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:29 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.036032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.036667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.050928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.052367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.053144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.055427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.056721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.057863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.321224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.333214 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ff12dc5-f7a5-4b1c-b085-f26dd2ed0327 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.301568 Oct 04 18:13:30.347860 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 972/2003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.356084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.363514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.364553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Searching by: {'deleted': False, 'project_id': '1de1f2554b8445028077ef14793c77a3'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:13:30.371547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.375527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.375527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.375527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.375527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.375527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.408028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:13:30.481999 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-153b6cbb-f5c9-4207-9c83-70de9631e767 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.129806 Oct 04 18:13:30.482785 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 973/2004] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:30.504714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.507335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.520510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.523101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.523101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.523101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.523101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.532976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.546460 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82ed6810-a683-4ece-8bbf-b2d1b799c47c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 204 len: 0 microversion: 2.25 time: 0.704491 Oct 04 18:13:30.548791 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1032/2005] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:13:29 2022] DELETE /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:13:30.560259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.567532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.569056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Searching by: {'deleted': False, 'project_id': '1de1f2554b8445028077ef14793c77a3'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:13:30.576932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.577655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.578251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.579236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.580339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.580960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.717470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:13:30.820524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.831280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.832019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.832636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.977417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b68a489-0e91-42d1-bd37-04678a5abced tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.426481 Oct 04 18:13:30.978247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1033/2006] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.983725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.984468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.007852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.019833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.020618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.021239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.022445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.022670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.043365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.057451 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fc36f78-7ddf-430b-9a20-5e25f10c5f59 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.571891 Oct 04 18:13:31.060036 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 974/2007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.066025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.067032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.075716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.076617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.077253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.078813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.079569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.080209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.270334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.279507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.281002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.282613 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02eeeb9e-1dbe-4b08-b68d-b7a974e89be5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1481 microversion: 2.25 time: 0.303145 Oct 04 18:13:31.283571 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1034/2008] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1481 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:31.288907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aec525ac-4816-44c2-a7a0-bd9e62096325 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.297880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aec525ac-4816-44c2-a7a0-bd9e62096325 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012640 Oct 04 18:13:31.298925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1035/2009] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:31.305577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.305749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.314195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.314851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.315407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.316435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.317106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.317459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.427968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.472749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.477228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.483323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-438af07a-b107-4548-aff3-472e359d8114 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.420968 Oct 04 18:13:31.487546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 975/2010] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:31.506368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "c4cfa452-b8fc-474c-8735-893bf4599d16"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:31.534922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.536495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.536495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.549489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] Creating event network-changed:c4cfa452-b8fc-474c-8735-893bf4599d16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:31.561390 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ebb07a9d-6a27-475f-a60d-133682c40ed5 req-792833d1-56de-4890-9ca6-c2b56980eb9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067853 Oct 04 18:13:31.570784 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 976/2011] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:31.574118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.579976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.598720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.605331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.605331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.605331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.605331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.605331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.714414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.743840 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-53cbdffe-433a-414e-ad01-069c011d54da tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.428587 Oct 04 18:13:31.743840 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1036/2012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.743840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.743840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.761227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.762010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.762703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.763679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.765604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.766954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.829051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:13:32.098612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.098612 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff5fe85d-1ae5-46e4-8b8e-0dd7e0ddb851 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.522957 Oct 04 18:13:32.098612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 977/2013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:32.098612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c", "name": "network-vif-plugged", "status": "completed", "tag": "c9749f1b-3b2e-4337-aa7e-9f16572a51a3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:32.123502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.124350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.133173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.149277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] Creating event network-vif-plugged:c9749f1b-3b2e-4337-aa7e-9f16572a51a3 for instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c on n-h2-833090-21 Oct 04 18:13:32.162081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0410d2f9-dc3e-4a63-a333-1063fa7a8e65 req-f3e61983-5886-4d5d-8ba3-657b08d6feb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068899 Oct 04 18:13:32.166077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 978/2014] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:32.185991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.189562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.197480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.198444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.199093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.202509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.202509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.202509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.416670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.425786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9194dff5-1fae-4da3-9321-29d910990d49 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.258254 Oct 04 18:13:32.427369 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 979/2015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:32.437463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.439582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.450597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.452030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.452977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.454336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.455269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.456605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.559824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf3d475a-aec8-4550-81d1-f9920b32e1d7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 204 len: 0 microversion: 2.1 time: 0.826208 Oct 04 18:13:32.561317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1037/2016] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:13:31 2022] DELETE /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:13:32.574793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.576218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.607011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.610073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.611277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.619640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.619640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.619640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.697250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.707323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.709166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.711216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36a64ca7-8eee-4d1a-9db7-eeb3dca124b4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1481 microversion: 2.25 time: 0.282554 Oct 04 18:13:32.728968 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 980/2017] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1481 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:32.741373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.743127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.760793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.761691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.762737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.764075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.764923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.766901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.954382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.971179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52709ea6-093c-4d41-9750-4a86648fa67b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1606 microversion: 2.1 time: 0.240210 Oct 04 18:13:32.972088 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 981/2018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1606 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:32.977996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:32.978948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:32.986454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.987968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.988791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.989749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:32.990473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:32.991154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.132410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.147347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.149285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.150728 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8026578-90d7-4cfc-8127-483e094a34c1 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.587467 Oct 04 18:13:33.151312 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1038/2019] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:33.156527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.157425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.166483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.167347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.168849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.169973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.170743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.171699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.249834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.255565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:33.262407 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8920ed5f-f892-4a27-9882-b2ead3766996 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.288946 Oct 04 18:13:33.277903 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 982/2020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:32 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.380352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.391079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-656198c5-dc2e-4cf6-a4b8-6e715913790c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.238365 Oct 04 18:13:33.410917 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1039/2021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.458585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.459388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.479903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.485114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.486616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.488304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.489013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.489586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.584786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f1d409-62bb-4cde-a0a6-960c9fa0fd13", "name": "network-vif-deleted", "tag": "cc34ad76-57b2-46a2-9bf6-56f235b0f69c"}, {"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "5d6fb9ca-6108-4c08-ba1b-8fc12efdc239"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:33.597240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.598036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.598580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.617117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Creating event network-vif-deleted:cc34ad76-57b2-46a2-9bf6-56f235b0f69c for instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 on n-h1-833090-21 Oct 04 18:13:33.618026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] Creating event network-changed:5d6fb9ca-6108-4c08-ba1b-8fc12efdc239 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:33.625528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c66e9933-11ca-458d-a9d9-558115735dc7 req-77e2b028-6a2e-4d0c-87ee-949605415d32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044662 Oct 04 18:13:33.629778 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1040/2022] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:33.703111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.717239 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-236d085d-613c-45a4-8f70-4bcb843573f9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.264579 Oct 04 18:13:33.718472 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 983/2023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.747923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.749065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.756866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.757369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.757816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.758584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.761836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.761836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.838052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.848250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.849846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.851079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7013b75a-1520-4e6d-87bf-6646cd193ad6 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1439 microversion: 2.25 time: 0.108262 Oct 04 18:13:33.851704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1041/2024] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:34.000734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.001393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.010976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.011495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.012331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.013086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.013550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.013980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.182764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.185921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.196404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.197318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.198135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.199111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.200164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.200838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.207382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:34.220797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.232662 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09b3d97e-6602-47a3-aee9-605406a9b4b7 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1606 microversion: 2.1 time: 0.236281 Oct 04 18:13:34.233611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 984/2025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1606 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.292032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.292644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.299773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.300118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.301761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.301761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.301957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.302313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.648647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.661067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cce615ae-ed1c-41a3-84db-d0637ab49217 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1351 microversion: 2.1 time: 0.371382 Oct 04 18:13:34.662411 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 985/2026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1351 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.676417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.677217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.691929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.692591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.695806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.696945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.697647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.698291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.841158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.856313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.858814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.861080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80affdc3-a528-4e51-835b-88cae60d6311 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.684238 Oct 04 18:13:34.863158 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1042/2027] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:34.869209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.871048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.902926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.904853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.906886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.908850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.912195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.913002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.332619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.343582 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61fe57c5-48a3-4fd7-bc2f-582631415527 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.478874 Oct 04 18:13:35.349555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1043/2028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.355532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.368389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.374558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.375059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.375535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.376234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.376673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.377215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.446395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.458123 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18845591-01de-4011-bdbe-923f194cf601 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.793602 Oct 04 18:13:35.472667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 986/2029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.483312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.485006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.485219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.497539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.499569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.501235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ebae998-ee5c-4b36-954a-96ee7a27c3f7 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.150446 Oct 04 18:13:35.519718 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1044/2030] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:35.522648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.523894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.524929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.526744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.538865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.538865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.720587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c967aab1-0a95-4cf5-8406-1dff8b0cfdd3 tempest-ExtensionsTest-1094992268 tempest-ExtensionsTest-1094992268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.724388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c967aab1-0a95-4cf5-8406-1dff8b0cfdd3 tempest-ExtensionsTest-1094992268 tempest-ExtensionsTest-1094992268-project] 10.222.0.40 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.219978 Oct 04 18:13:35.725024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1045/2031] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:35.735278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.737532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.747991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.749195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.750265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.751538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.753004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.753921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.818614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.847532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f11d2726-ec63-4351-bcd5-f5a35c541446 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1606 microversion: 2.1 time: 0.378985 Oct 04 18:13:35.848868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 987/2032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1606 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.861225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73f8f169-eb2a-439c-9baf-0d223ee2978f tempest-ExtensionsTest-1094992268 tempest-ExtensionsTest-1094992268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.865078 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73f8f169-eb2a-439c-9baf-0d223ee2978f tempest-ExtensionsTest-1094992268 tempest-ExtensionsTest-1094992268-project] 10.222.0.40 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.015322 Oct 04 18:13:35.882936 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 988/2033] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:13:35.907176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.908991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.938422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.940493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.941790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.944362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.945610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.948949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.049165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.059626 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb2d27f8-aa8a-4cf3-99c6-315daa142676 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1540 microversion: 2.1 time: 0.333040 Oct 04 18:13:36.061364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1046/2034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1540 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.084450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.084450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.091063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.091590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.092053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.092757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.093212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.093639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.250219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7f6871f-0c3e-4dc8-a723-ea902315b05c tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171401 Oct 04 18:13:36.258460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1047/2035] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:36.284466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "55e150a2-4085-40dd-a60d-a0bb1bf9491f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:36.302685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.304255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.304985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.332681 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] Creating event network-changed:55e150a2-4085-40dd-a60d-a0bb1bf9491f for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:13:36.339975 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5fb7f21f-50a7-44ee-bdb5-695fb6d2fb29 req-17d84c20-4dda-4a0b-b276-a61af7ec78e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081799 Oct 04 18:13:36.341260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1048/2036] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:36.369168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.370406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.378816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.384639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.385100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.385947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.390001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.390662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.391369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.600116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.643922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.645736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.646975 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a11b6aa8-8a00-4b4b-b721-5e87ccd65378 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.752699 Oct 04 18:13:36.653760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 989/2037] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:36.663227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.667569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.685265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.686049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.686641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.687565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.688185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.691538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.887419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.913724 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38a48528-20ce-489d-8896-b54849ad6f79 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.548426 Oct 04 18:13:36.915852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1049/2038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.938548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.939254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.959185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.959185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.959185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.959185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.959185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.967966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.101502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.116615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.119238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.120983 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6114ae4d-c02a-45d6-b869-0d46a0061df2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.203474 Oct 04 18:13:37.123183 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1050/2039] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:37.156985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.159302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.179596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.181625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.181625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.186346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.188650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.189475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.204744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.218177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a878d309-887d-449e-b6d3-016d89bd6bcc tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.562917 Oct 04 18:13:37.218786 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 990/2040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.262696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfeee07-5b47-4659-a449-c512555a4a39", "name": "network-vif-deleted", "tag": "429c30cf-db5b-4b66-92e9-53f9dcd4d8ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:37.278349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.279093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.279716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.294903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] Creating event network-vif-deleted:429c30cf-db5b-4b66-92e9-53f9dcd4d8ad for instance 3cfeee07-5b47-4659-a449-c512555a4a39 on n-h1-833090-21 Oct 04 18:13:37.301805 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1367be2f-f04c-4fbe-a91e-4df8e754cdbd req-be5d3f80-e12a-4750-845b-c9c96af49411 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042926 Oct 04 18:13:37.303277 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 991/2041] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:37.305587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.323145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6741ec7-7c92-4ea9-a24a-952af4288eca tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1539 microversion: 2.1 time: 0.198356 Oct 04 18:13:37.361027 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1051/2042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.684583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.686126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.698935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.700960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.701580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.702834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.704651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.706748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.940741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.941684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.956860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.957600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.958586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.959653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.964847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.965459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.583358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.603627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.608673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.608673 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ed22e0a-9737-40a2-9bcf-505c3537165a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.927564 Oct 04 18:13:38.623552 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 992/2043] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:38.629088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.629792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.637348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.637348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.637551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.638330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.638603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.639031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.778522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.790834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.792480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.793570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a94dd70-ddf7-4360-965d-560efa626ea3 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.168974 Oct 04 18:13:38.796386 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 993/2044] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:38.820824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.821850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.834127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.837766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.838718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.839652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.841737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.843290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.857806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.870607 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e2e3b33-5218-4f00-b4de-5450516b390d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.934268 Oct 04 18:13:38.893236 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1052/2045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:38.899554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.900461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.908790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.909621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.910272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.911931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.913339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.914025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.047926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.063654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cfc892a-19c2-45d8-bd1a-0de02aa0b0b5 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.167990 Oct 04 18:13:39.072592 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1053/2046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.176903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.190304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fa690f2-97f1-43a8-abc4-3c582602a0bf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.391551 Oct 04 18:13:39.191774 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 994/2047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.418532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c", "tag": "c9749f1b-3b2e-4337-aa7e-9f16572a51a3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:39.431461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.432310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.432886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.447078 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] Creating event network-changed:c9749f1b-3b2e-4337-aa7e-9f16572a51a3 for instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c on n-h2-833090-21 Oct 04 18:13:39.452933 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-31e95a94-2e0a-4bbf-8c1f-a858237b48c4 req-bf7dd8b2-ab79-40f0-8b8a-a796e0e23928 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039158 Oct 04 18:13:39.454107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1054/2048] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.639820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.640998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.662660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.665495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.666049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.667888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.668454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.668991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.835712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.836625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.856299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.858143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.864915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.865945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.866552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.867144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.972234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.986073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.988889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.990369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0720079a-a43d-4f1f-ba96-72f220075b8b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.356323 Oct 04 18:13:39.992168 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 995/2049] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:39.998747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.999722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.007333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.008091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.008904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.009836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.010488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.011210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.018045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.039448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.041358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.046679 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67786937-7c15-4b39-b8e4-7c389baa10a0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.227524 Oct 04 18:13:40.050405 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1055/2050] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:40.089983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.092012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.132792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.140222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.140936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.147758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.150617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.151084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.320100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.334162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cabad2fa-1822-4a05-be87-d1c2537fc39c tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.246182 Oct 04 18:13:40.335015 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1056/2051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:40.355826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.356684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.371841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.372559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.373349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.374241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.374844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.375418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.390484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.395538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:40.408118 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae2f4bd8-f306-4fd0-bab1-bde4b70b8708 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.414499 Oct 04 18:13:40.410754 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 996/2052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:40.622016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:40.715097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.741419 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05ffa259-32d0-42d7-ada1-38ca275b9c4b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.389077 Oct 04 18:13:40.742418 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1057/2053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.056736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.059147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.077069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.077852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.080119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:41.093799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.094462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.094902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.095862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.096566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.097143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.108212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.109083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.109974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.115389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.117057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.120465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.274289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.285500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.287307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.288825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e28155a-7829-4bf3-9e9d-d17bdff3148e tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.216648 Oct 04 18:13:41.305085 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1058/2054] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:41.360138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.361016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.375898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.376798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.379564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.380582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.384206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.384829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.478732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.494122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.496360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.497997 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d094a87-dfb7-482a-8965-1a204f219f18 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.448666 Oct 04 18:13:41.501493 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 997/2055] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:41.527624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.527624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.527624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.527624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.529350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.530490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.535503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.536534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.539979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.552671 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07812ba9-ed9e-45b5-89b3-a5865ec7bc8b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.198122 Oct 04 18:13:41.555369 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1059/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.747275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.760816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d92ee9ee-6aaf-4e8e-b208-58a62f44e4f1 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.257649 Oct 04 18:13:41.762271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 998/2057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:41.773312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.774148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.785564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.787051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.792056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.792056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.792056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.792056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.103361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.110484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b2f2935-7793-4306-86b4-a7cb3159c7e7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.341214 Oct 04 18:13:42.112686 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1060/2058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:42.317920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.322406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.345033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.350019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.350827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.352351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.353209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.354257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.482860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.505460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.509160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.512007 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-707bf61f-0bcd-4749-b168-1a7eb9b6d8f5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.198101 Oct 04 18:13:42.513262 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 999/2059] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:42.550481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.555568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.583866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.584804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.586118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.586884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.587389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.590311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.591415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.592560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.601218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.602178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.608413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.608413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.608413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.608413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.650634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:42.782854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.801948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a4f02b6-28f3-4102-b662-91728bb5676e tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.226186 Oct 04 18:13:42.805232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1000/2060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:42.817128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.822142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.831839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.833108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.833922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.835495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.836373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.837395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.847010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:43.070883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.082114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27204c3e-0191-4596-bca0-9ab05aa2222a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.275098 Oct 04 18:13:43.083655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1001/2061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:43.132393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.143152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.143152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.145768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.146280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.146911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.147709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.148194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.148628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.149539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.151900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.157151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1ab34af-7b4d-4f45-9d2c-f4bd29a2cb3d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.614840 Oct 04 18:13:43.157758 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1061/2062] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:43.397930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.403065 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46dcedf8-c2ce-4654-89df-2ce7bca6b610 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.270719 Oct 04 18:13:43.404559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1002/2063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:43.547296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.547633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.559150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.560276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.561035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.562243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.563224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.565130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.664762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.676186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.678201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.680027 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62f4ca40-e845-46b8-8939-59e3361c7f90 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.140075 Oct 04 18:13:43.680970 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1062/2064] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:43.835113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.835773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.842964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.843492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.843938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.844722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.845187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.845625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.954061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.969134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca28e4a5-d578-4277-b7f3-d4b47ddb3d4b tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.138548 Oct 04 18:13:43.970326 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1003/2065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:44.130795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.131923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.145878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.149620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.150557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.152113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.155949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.156779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.192585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.194280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.244930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.246288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.247693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.254246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.257029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.261132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.389894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.400116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-395eaff8-bb05-4204-8e38-d469bec55eb6 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.277035 Oct 04 18:13:44.401447 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1063/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:44.429634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.430430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.438127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.438728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.439241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.440618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.441162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.442012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.589053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.599929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.601733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.603039 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-827df980-a28c-49a5-914c-e18830d17dde tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1890 microversion: 2.32 time: 0.419404 Oct 04 18:13:44.615207 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1004/2067] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1890 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:44.722551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.729061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.730312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.743349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3493caac-b332-452f-93ae-6e6009989eaf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.316711 Oct 04 18:13:44.752625 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1064/2068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:44.752894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.753251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.753722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.754471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.755261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.755884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.872748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.881778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.883353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.884888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c567d05d-5c10-4aaf-82f7-5eddc8a11930 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.164377 Oct 04 18:13:44.886027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1005/2069] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:45.009322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.010174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.031148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.031148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.031655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.032428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.032959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.034159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.107320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.116361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1a9c4b13-629c-4676-9c7e-e1e3c4848dd2 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.111044 Oct 04 18:13:45.117283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1065/2070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:45.446601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.447857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.463907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.464580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.465425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.466773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.467662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.468671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.648092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.649159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.661557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.662369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.663014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.664079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.664799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.665475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.685707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.701263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d95fd685-7f3b-48c9-ac0a-2583b80929b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.260991 Oct 04 18:13:45.701263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1006/2071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.795305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.796095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.803702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.804590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.805082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.805886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.806349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.806808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.903302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.915278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.917210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:45.918315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d60d26-3151-42b3-b1f6-afe3e9855cfc tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.277424 Oct 04 18:13:45.919078 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1066/2072] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:45.925723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.926807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.935255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.936486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.936486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.937234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.937862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.938406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.018800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.031656 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0149c776-4621-4629-8a03-fde2e941ac64 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.243144 Oct 04 18:13:46.032737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1007/2073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:46.056158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.066021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.067737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.069435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d38c797-733a-43f8-9022-2357ed298a0b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.148624 Oct 04 18:13:46.070616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1067/2074] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:46.144271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.144887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.151594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.152148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.152539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.153446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.153901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.154328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.230588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.240305 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72e7cc05-1422-477e-b53b-e09b82060e00 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.100367 Oct 04 18:13:46.243131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1008/2075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:46.729273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.730286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.741060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.741550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.741984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.742696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.743145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.743595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.939201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.948076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:46.948672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:46.961045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.961553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.961995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.962714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:46.963184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:46.963658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.970596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ffa5150b-3627-43fc-b1d2-8b1776094b05 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.248613 Oct 04 18:13:46.972105 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1068/2076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.056822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.059653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.065005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.065732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.066356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.067274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.067911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.068501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.213644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.227016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.229116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.230555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83a3c18a-9b34-4a20-b6f8-503ea8edb29e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.286394 Oct 04 18:13:47.259516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1009/2077] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:46 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:47.259516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.259516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.260130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.260130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.260752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.261545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.262129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.262635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.279050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.288424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c2fd4b86-c42e-466d-9168-9d58cad3bc33 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.235979 Oct 04 18:13:47.290260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1069/2078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:47.306964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.307791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.314155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.315174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.315682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.316383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.316829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.317399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.348444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.360237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.363254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.364802 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5ec118d-f5aa-456c-af63-9ad45dccbc3f tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.124590 Oct 04 18:13:47.369353 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1010/2079] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:47.386171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.395029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82b872a4-9f1a-41ec-9012-b2613d0c88b3 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.103082 Oct 04 18:13:47.395652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1070/2080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.996105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.997393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.006535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.007044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.007508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.008408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.008875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.009399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.175415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.183811 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68a4ce49-9f5f-4296-893e-5f4b59c14ce5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.191873 Oct 04 18:13:48.184405 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1011/2081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:48.258899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.259725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.268624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.271120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.271880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.272514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.272984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.273637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.313298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.313978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.323770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.324440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.329821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.329821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.329821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.329821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.505468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.515427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66a514c1-b1b2-4532-a676-0745c2654f71 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.206728 Oct 04 18:13:48.518243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1012/2082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:48.525566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.526451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.535957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.536932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.538067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.540896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.541722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.542504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.564787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.577153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.578840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.581183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9766a4f-2e67-4d1a-9fd5-b7c3a3294192 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.325798 Oct 04 18:13:48.581482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1071/2083] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:48.596343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.598520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.616121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.616616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.617065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.617794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.618256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.618688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.622546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.634482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.636172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.637599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8878a045-8b62-4404-a9d0-fb6bb881a8ad tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1265 microversion: 2.25 time: 0.118217 Oct 04 18:13:48.650017 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1013/2084] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:48.761384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.775997 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28347ac0-7b12-4d3d-b755-dd85b66f5a78 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1252 microversion: 2.1 time: 0.192576 Oct 04 18:13:48.777811 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1072/2085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1252 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:49.208662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.209339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.217099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.217604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.218395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.219134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.219705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.220193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.402639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.413973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-456cd9bd-64e1-4361-bbf1-4310d4c009f0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.207769 Oct 04 18:13:49.413973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1014/2086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:49.543544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.544844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.557145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.558065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.558779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.560046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.560852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.561601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.621344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.622839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.631443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.632293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.633286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.634209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.635015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.636226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.810185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.821921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b5988b3-8120-44c1-9725-8d45285f7731 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1543 microversion: 2.1 time: 0.284349 Oct 04 18:13:49.823205 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1073/2087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1543 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:49.828735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.829628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.837380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.838571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.838571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.839705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.840796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.841563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.895716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.896561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.897199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.898098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lazy-loading 'fault' on Instance uuid 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:50.007670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.008510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.031046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.034994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.038163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.039045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.041255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62992c07-bebe-4079-922b-3d7958b88819 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 200 len: 1270 microversion: 2.25 time: 0.216943 Oct 04 18:13:50.041943 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fc03528-4361-42b4-a30d-a1b93059d0b6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.430338 Oct 04 18:13:50.057074 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1074/2088] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:50.057526 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1015/2089] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:50.073798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.074314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.075114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.079644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.090213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.093051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.093667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.094531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.095138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.096284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.097317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.097798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.098747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.099874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.101026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.103197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.174671 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7033f934-7b11-4ec1-a50b-839d0899f337 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107034 Oct 04 18:13:50.177291 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1075/2090] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:50.181543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.182036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.182477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.182922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lazy-loading 'fault' on Instance uuid 3cfeee07-5b47-4659-a449-c512555a4a39 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:50.197371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.197888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.216247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.217853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.219278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.219939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.222077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.222512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.254929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.271994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46c94d2a-4752-4d39-99d1-82c958ef547d tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1257 microversion: 2.1 time: 0.212681 Oct 04 18:13:50.290309 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1016/2091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1257 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.362678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lazy-loading 'services' on Instance uuid 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:50.438393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.439765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.446686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:50.449143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.452321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.452321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.452321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.452321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.452321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.474106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:50.612668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b4b2f62-32a2-4d49-ba1b-e5c87dc6a02e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments/def28efd-500d-46ce-93c4-d1a1d9380fca" status: 202 len: 0 microversion: 2.1 time: 0.426922 Oct 04 18:13:50.623865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1076/2092] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:13:50 2022] DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments/def28efd-500d-46ce-93c4-d1a1d9380fca => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:50.687868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.707713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb4b477e-8c1d-44ed-9a9e-64d3802b2107 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.273923 Oct 04 18:13:50.713050 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1017/2093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.756825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-unplugged", "status": "completed", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:50.785258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.786676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.788604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.798120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:50.808235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Creating event network-vif-unplugged:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h2-833090-21 Oct 04 18:13:50.816720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] Instance 06e75e31-a91c-471b-8d45-6425b70eebba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:13:50.834737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ac78df79-8aca-4694-9954-288a6e981cb1 req-a53d7b6f-b829-4102-abf2-132e22f91d55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085798 Oct 04 18:13:50.835912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1077/2094] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:50.852176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.853567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.861670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.862159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.862770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.863743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.864204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.864627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.047023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.077307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.078403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.081235 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-38db0a23-59d1-4159-9616-7a2149d39998 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1542 microversion: 2.1 time: 0.219579 Oct 04 18:13:51.097725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1018/2095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1542 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:51.114375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.114375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 16f1d409-62bb-4cde-a0a6-960c9fa0fd13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.118398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.118893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.119374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.120158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.120618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.121041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.133840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.137285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.137285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.137285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.137285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.138531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.156829 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] HTTP exception thrown: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Request method failure captured: Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 HTTP/1.1 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXSCZmlOwwE1zEGBt6I4_JBaJa9nuY-uFKYAi4xJtdxddxt5j0g6cY4gWUHMsejz526N8ejSwTFCmXRwCjoFaT2Hp99-YlqdJ1rfwA_3T75IY6CfWLO2jO5odOBx0ejhP-pXQvl70hLWX1WyXASfWEpNdKSlDDfYaMr4OYgfexBOVc Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7be3d0ba65a426f939fffd2ffbd16fe"}]}] Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '16f1d409-62bb-4cde-a0a6-960c9fa0fd13'} Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. Oct 04 18:13:51.160807 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. Oct 04 18:13:51.165027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:51.166868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Returning 404 to user: Instance 16f1d409-62bb-4cde-a0a6-960c9fa0fd13 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:51.168177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6803854e-6227-4b55-ba22-178eb9102f48 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13" status: 404 len: 111 microversion: 2.25 time: 0.060622 Oct 04 18:13:51.171230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1019/2096] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/16f1d409-62bb-4cde-a0a6-960c9fa0fd13 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:13:51.298282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.298895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.309999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.310556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.312119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.312306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.313000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.313447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.375139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.375869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.376406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.377550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lazy-loading 'fault' on Instance uuid 3cfeee07-5b47-4659-a449-c512555a4a39 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:51.453720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc8800e6b14a1ab4810be9e05f55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de1f2554b8445028077ef14793c77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.463109 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-303136d9-150c-449b-a214-1a40b5b04269 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 200 len: 1257 microversion: 2.1 time: 0.169212 Oct 04 18:13:51.480555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1020/2097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:51.731801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.732771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.743922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.746923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.746923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.746923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.746923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.746923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.844557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.871983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.872787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.874007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc9c2f03-c160-446a-95f6-a6ae9324add9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.805347 Oct 04 18:13:51.877473 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1078/2098] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:51.953856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.963303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a82625c-3e8a-496f-a2d7-c0a59f97917e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.236030 Oct 04 18:13:51.964516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1021/2099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:52.117705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.118326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.131935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.132476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.132917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.135276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.135809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.136333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.488840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.489617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] [instance: 3cfeee07-5b47-4659-a449-c512555a4a39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.497066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.497724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.498397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.499224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.499943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.507849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.522109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.527759 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] HTTP exception thrown: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Request method failure captured: Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 HTTP/1.1 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHcBui2DXCp50lcu2orw5ys4mM4IQqx9i-97aVmrvvr0xlYxq23wbKu9-Iw4DHRxN-KEJACYHr78pSGIqfW6Bl2wkLwv52ejX--GYpHZPIPKXZzEh392aqF5TBAabX9DladD2n0lK5vgpodFTymXl6MdF8WFotaVsGLjrfXc4OB8VkE Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1de1f2554b8445028077ef14793c77a3 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestBootFromVolume-548221517 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1de1f2554b8445028077ef14793c77a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1de1f2554b8445028077ef14793c77a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1de1f2554b8445028077ef14793c77a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1de1f2554b8445028077ef14793c77a3"}]}] Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestBootFromVolume-548221517 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1de1f2554b8445028077ef14793c77a3 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestBootFromVolume-548221517 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestBootFromVolume-548221517-project Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 86bc8800e6b14a1ab4810be9e05f55e2 Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestBootFromVolume-548221517-project Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3cfeee07-5b47-4659-a449-c512555a4a39'} Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:52.529754 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. Oct 04 18:13:52.533600 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:13:52.534005 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6bdb3cc-bb7b-4d0b-982b-7a8e80072cfa tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1542 microversion: 2.1 time: 0.417708 Oct 04 18:13:52.537684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Returning 404 to user: Instance 3cfeee07-5b47-4659-a449-c512555a4a39 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:52.538970 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afce58b8-8d52-4ad3-90ff-d314f8f4ed02 tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39" status: 404 len: 111 microversion: 2.1 time: 0.054420 Oct 04 18:13:52.543418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1022/2100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/3cfeee07-5b47-4659-a449-c512555a4a39 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:13:52.546526 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1079/2101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1542 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.562887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ad990ef-1304-45e0-94b3-ad7fa996c19a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] Calling method '.version_select at 0x7f9008f0ea60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.721947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ad990ef-1304-45e0-94b3-ad7fa996c19a tempest-ServersTestBootFromVolume-548221517 tempest-ServersTestBootFromVolume-548221517-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-444193698" status: 202 len: 0 microversion: 2.1 time: 0.157588 Oct 04 18:13:52.721947 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1023/2102] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:13:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-444193698 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:52.910228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.910774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.926019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:52.930723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.931232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.942834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.943823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.944317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.950570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.951086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.951561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.952696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.010498 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Creating event network-changed:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h2-833090-21 Oct 04 18:13:53.035869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] Instance 06e75e31-a91c-471b-8d45-6425b70eebba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:13:53.084703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-df5ab518-aa53-4cb3-9d83-70acc13fc8c5 req-cdab92c4-1312-46ec-a553-4fa5e7c9b5e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182243 Oct 04 18:13:53.085366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1080/2103] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:53.114988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.115785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.137155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.137919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.138514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.139398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.140186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.140780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.419829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.435902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61895ad6-fe23-46a4-8058-1f15899e1020 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.347682 Oct 04 18:13:53.439939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1081/2104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:53.558653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.559642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.567237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.568165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.568284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.571747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.572361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.572871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.708801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.723738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.730859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.733931 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ef0c0b6-c65d-4d44-b277-f4fd528de466 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.831056 Oct 04 18:13:53.737534 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1024/2105] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:54.416643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.432911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42050781-8827-4676-b849-470b5ff38b1f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1542 microversion: 2.1 time: 0.878765 Oct 04 18:13:54.433541 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1082/2106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1542 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.464551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.465377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.473284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.474035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.474658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.475698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.476333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.476918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.772452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.782955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd0a936d-8120-4c3e-921b-680548dfae57 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.323052 Oct 04 18:13:54.784385 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1025/2107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.787991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.788818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.801386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.802136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.802733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.803636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.806459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.807082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.274244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.292904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.294399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.295654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8382d47b-d45f-45c8-9fed-958bd5399db5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.512448 Oct 04 18:13:55.307959 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1083/2108] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:55.460206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.460594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:55.480850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.480850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.480850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.480850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.480850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.482223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.824851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.825791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:55.839633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.840898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.842024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.843405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.844609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.846829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.066947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.092939 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ed964dc-05c4-47ac-9b8e-6ee318736918 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.270046 Oct 04 18:13:56.092939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1084/2109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:56.256885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.271553 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-307b481e-f575-4d01-b172-e1f607f26ad2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1474 microversion: 2.1 time: 0.815493 Oct 04 18:13:56.274289 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1026/2110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1474 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:56.328411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.331810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.356717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.363358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.366604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.370693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.373752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.377180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.711863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.729774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.732961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.734297 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-784a17f4-c5a6-426c-9f2a-8de70d07f9da tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.414474 Oct 04 18:13:56.734887 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1085/2111] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:57.123875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.123875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.134422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.137140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.138974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.139835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.142012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.143065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.304739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.306254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.318114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.319112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.320265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.322584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.333298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.335371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.652817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:57.664046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83aad452-5829-4910-a2a1-e5c737b92c1e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1474 microversion: 2.1 time: 0.363196 Oct 04 18:13:57.666324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1086/2112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:57.692890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:57.704457 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-098fe879-7ab5-4ffe-b4b8-53c54c0b6e14 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.589559 Oct 04 18:13:57.707722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1027/2113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:57.774430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.782425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.813281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.823742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.824591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.836605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.838985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.842999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.263408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.288260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.291207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.298069 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60456367-cbca-4aa8-836b-24d898cc4e1b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.537718 Oct 04 18:13:58.299193 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1087/2114] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:58.691842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.692486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.710205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.711818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.712308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.730034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.730479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.730949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.731043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.731142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.750158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.750658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.751103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.757327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.760259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.760738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.035106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.054876 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a2706e1-b82f-442d-b9aa-e8bcd1625d33 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1391 microversion: 2.1 time: 0.328378 Oct 04 18:13:59.055509 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1088/2115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:58 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:59.227996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.237193 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20f2ef8b-8d85-4b17-b4a0-77058b404207 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1471 microversion: 2.1 time: 0.550900 Oct 04 18:13:59.258634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1028/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:58 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:59.272879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:59.273639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.280513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.281216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.281995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.283654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.284275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.288380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.327093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:59.327093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.336718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.337433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.337896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.342500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.346776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.347375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.380898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.390735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.391207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.392127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.393090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.393525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.479343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:59.481696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:59.729489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.758125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.759740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.760966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-700fe7d4-bc04-4ba7-ac41-d2097df7e2f2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.439923 Oct 04 18:13:59.767965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1029/2117] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:59 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:00.081323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.081323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.088611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.089265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.089846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.090874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.091453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.092036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.285638 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b7a6628-9596-4a75-acfe-464f2832d988 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba/action" status: 202 len: 0 microversion: 2.1 time: 1.016500 Oct 04 18:14:00.290319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1089/2118] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:59 2022] POST /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba/action => generated 0 bytes in 1022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:00.302647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.303357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.316710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:00.320024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.321757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.325098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.326032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.327120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.328154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.438994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:00.453786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a2bfaae-6d52-4733-8dca-5cce9f05d2d7 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1381 microversion: 2.1 time: 0.377383 Oct 04 18:14:00.455991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1030/2119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1381 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:00.477841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b578c3f8-ffd9-4991-b4ad-5ad3cf3a71c6 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '.version_select at 0x7f9008f008b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.486294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b578c3f8-ffd9-4991-b4ad-5ad3cf3a71c6 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.487647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b578c3f8-ffd9-4991-b4ad-5ad3cf3a71c6 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.488302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b578c3f8-ffd9-4991-b4ad-5ad3cf3a71c6 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.513865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b578c3f8-ffd9-4991-b4ad-5ad3cf3a71c6 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3923 microversion: 2.1 time: 0.039353 Oct 04 18:14:00.515232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1031/2120] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/os-migrations => generated 3923 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:00.536095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.536805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.555985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.556746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.556916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.558053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.559393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.559991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.837196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:00.853283 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8adbc796-a2b4-41f4-9c80-86828f4a7177 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.561226 Oct 04 18:14:00.855499 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1090/2121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:00.881641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.882385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.912200 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-360ea068-068f-4964-b88a-86e7ef9baba1 tempest-LiveMigrationTest-2035788412 tempest-LiveMigrationTest-2035788412-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1534 microversion: 2.1 time: 0.381888 Oct 04 18:14:00.913763 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1032/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1534 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:00.932057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.939788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.943129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.943129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.943129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.943129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.978156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.987941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.994040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:01.003166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.007124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.012774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.012774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.012774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.012774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.073836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c243519-5b0a-404a-afd2-bd876aa5e5f9 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132194 Oct 04 18:14:01.074986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1033/2123] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:14:01.080029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.089196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.102168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.102598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.110545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.110545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.110545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.110545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.151277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:01.522070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.559373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.562925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.565812 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d4b3dc-3fc5-4bfd-95d7-62ef40fd7c71 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.708161 Oct 04 18:14:01.567513 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1091/2124] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:01.576984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.585232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.600058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.600058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.600334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.601040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.601500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.601928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.639793 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9079054-834c-4d13-9b34-2838746e153e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 204 len: 0 microversion: 2.1 time: 0.563207 Oct 04 18:14:01.640408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1034/2125] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:01 2022] DELETE /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:01.657038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.657844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.681610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-003ce7e4-f2fe-4bcf-8be7-cf07395a4556 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112801 Oct 04 18:14:01.682215 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1092/2126] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:14:01.683976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.684485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.688121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.690466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.692006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.693236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.775076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:01.821964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.822988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.832612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.836286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.836286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.836286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.836286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.836860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.878286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:01.941892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.952876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79196959-e484-4913-841e-50146ac6a0fa tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1387 microversion: 2.1 time: 0.307080 Oct 04 18:14:01.960658 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1035/2127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1387 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:01.979824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.982428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.991288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.992481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.993150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.994419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.995586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.996301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.182444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.192717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7208b782-6b63-4378-895c-a5297ccd0999 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.230910 Oct 04 18:14:02.193552 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1036/2128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:02.351364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18fd717d-83fa-431a-970c-6e355a89e59f tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 204 len: 0 microversion: 2.1 time: 0.523899 Oct 04 18:14:02.351364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1093/2129] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:01 2022] DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:14:02.360214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.361453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.375019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.375641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.376092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.376852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.377302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.378406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.590328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.599963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.600679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.613156 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfc0ac5a-a06b-480a-bcdd-af15eef3226b tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1681 microversion: 2.1 time: 0.257728 Oct 04 18:14:02.616160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1037/2130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:02.630142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.630646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.631089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.636356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.636885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.637366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.943824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.953248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.955197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.956380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5044f883-9e9f-485d-873b-7754bee801e4 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.364193 Oct 04 18:14:02.967519 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1094/2131] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:02.981848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.981848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.986333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.986853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.987348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.992295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.993182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.994283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.215824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.218840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.224581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.226549 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d7e00b1-60b7-4e02-a594-a7344da58806 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1387 microversion: 2.1 time: 0.252201 Oct 04 18:14:03.241841 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1038/2132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1387 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:03.244382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.245126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.245725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.246633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.247410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.248097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.417458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.427235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5a4cd6e-586c-4ffd-b7eb-9cff3ce949fd tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.214976 Oct 04 18:14:03.427877 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1095/2133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:03.603497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-plugged", "status": "completed", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:03.622628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.623129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.623603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.646153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.647450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.652230 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Creating event network-vif-plugged:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h2-833090-21 Oct 04 18:14:03.657236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.660945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.661743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.662716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.665723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.667317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] Instance 06e75e31-a91c-471b-8d45-6425b70eebba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:14:03.667450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.682242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ea1200ef-b12d-4881-a5d1-9f632fdbef79 req-ab48ad39-ef0b-407d-a79e-743c3061f972 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082996 Oct 04 18:14:03.683191 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1039/2134] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:03.861821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.873533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d37b88e1-8dfc-453a-bd90-97e75c3aa3b4 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1681 microversion: 2.1 time: 0.233855 Oct 04 18:14:03.875233 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1096/2135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:03.987771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:03.988487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:03.995555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.996060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.996504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:03.997233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:03.997780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:03.998223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.252224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.253107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.262861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.264647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.265158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.265592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.267107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.267762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.268485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.279135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.286519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.286519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9360eaa-83de-4f58-9d2c-48bcadd3a13d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.301561 Oct 04 18:14:04.291749 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1040/2136] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:03 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:04.446040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.454566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e443a5f3-8778-46ff-8a27-450ae4ac6dc8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1387 microversion: 2.1 time: 0.208049 Oct 04 18:14:04.455166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1097/2137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1387 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.457964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.458592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.464853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.465353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.465992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.466854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.467319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.467815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.607819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:04.623737 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b39fce7d-7ad3-4be6-9e4c-69415f943bb2 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.169212 Oct 04 18:14:04.624790 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1041/2138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:04.901079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.903151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.917313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.919035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.919734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.920846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.922301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.922939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.089046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.092015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.122100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.123072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.124153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.127056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.131518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.132535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.221380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.232465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ef2562c-5649-4b12-90ad-b698fb3c75e3 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1681 microversion: 2.1 time: 0.336067 Oct 04 18:14:05.235630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1098/2139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:05.240401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:05.316122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.316874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.330363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.334553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.335359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.336370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.337029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.338403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.613966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46096ec9-32bf-42d9-be31-70b82bf39964 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 204 len: 0 microversion: 2.25 time: 0.537657 Oct 04 18:14:05.614841 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1042/2140] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:05 2022] DELETE /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:05.627967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.632943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.652931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.653122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.658541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.658541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.660927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.661522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.662075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.674225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.676284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.679148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee2160f7-7db2-47b5-be5d-2da27394451d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.366795 Oct 04 18:14:05.681388 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1099/2141] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:05.687798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.689699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:05.697655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.703773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.703773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.703773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.703773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.703773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.958382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.974737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.976439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.980794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba9e3733-ffd7-4d8e-993a-6ade50a3ec3a tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1730 microversion: 2.25 time: 0.295600 Oct 04 18:14:05.981674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1100/2142] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:05.992015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:05.994525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.010278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.014158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.014826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.015884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.016503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.017455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.062391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.074535 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29e1e71f-f41a-4dcc-be68-5baa20827c2c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1387 microversion: 2.1 time: 0.458258 Oct 04 18:14:06.076474 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1043/2143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1387 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.263359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.264037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.284324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.284880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.288324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.288324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.288324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.288324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.752264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.761276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a954133c-21d9-42ba-8304-23d1975b0886 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.778135 Oct 04 18:14:06.762710 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1101/2144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:05 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.779742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.785576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.811277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:06.813748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.815912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.823890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.823890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.823890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.823890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.824601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8475b377-7d3b-48e5-835a-84b9f7287932 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1681 microversion: 2.1 time: 0.563203 Oct 04 18:14:06.824601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1044/2145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:07.015807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.016433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.039393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.040235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.040912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.041848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.042519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.043225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.299894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.309070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.310591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.311836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01f05186-3cbe-45f6-bd62-d22ff032c74d tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1730 microversion: 2.25 time: 0.303023 Oct 04 18:14:07.312408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1045/2146] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:07.317054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.318452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.324943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.325656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.326096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.327360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.327360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.327670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.554313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.567807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.576777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.578500 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38984681-2348-4c78-9718-6ac089478a5f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.814475 Oct 04 18:14:07.579351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1102/2147] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:07.739113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:07.757308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7dd0c93-5d97-4b79-9610-c641fa97ae32 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1387 microversion: 2.1 time: 0.443544 Oct 04 18:14:07.757833 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1046/2148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1387 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:07.786742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.787371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.798184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.799148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.800012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.801801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.803299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.804144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.847699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:07.848725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:07.864708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.867764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.868496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:07.869560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:07.871846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:07.878625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.283894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.299895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa41893c-0974-4951-b41a-9049d06f5d7e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1681 microversion: 2.1 time: 0.456923 Oct 04 18:14:08.301973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1047/2149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1681 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:08.339185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.340405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.355746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.359559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.365225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.366490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.367551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.368269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.648210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.659038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.660912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.662665 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5074c579-8f97-4547-97fd-7bd1a670f9a5 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1730 microversion: 2.25 time: 0.328088 Oct 04 18:14:08.664039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.674003 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-645e0e46-ffb2-431c-b411-54c7844b6b53 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1470 microversion: 2.1 time: 0.891177 Oct 04 18:14:08.678588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1103/2150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:07 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1470 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:08.680479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1048/2151] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1730 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:08.693209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.694102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.706118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.707522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.707522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.708190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.709964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.710585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.783072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:08.784137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:08.799340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.799340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.799340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.799832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:08.800138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:08.803648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.984262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.997049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-272a9381-a854-4f39-9555-c4037cecfaf8 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1345 microversion: 2.1 time: 0.218639 Oct 04 18:14:08.998925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1049/2152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.132393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.162302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.169208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.171999 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2cfcf0d9-3d87-4412-a134-63a2fac1efc3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.491876 Oct 04 18:14:09.172877 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1104/2153] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:08 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:09.176944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d63a7c-e6eb-4f7c-9a62-a9df853b8478", "name": "network-vif-deleted", "tag": "61fedb4c-2033-4d4d-83a1-6030584d7777"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:09.209902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.211898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.212867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.232791 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] Creating event network-vif-deleted:61fedb4c-2033-4d4d-83a1-6030584d7777 for instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 on n-h2-833090-21 Oct 04 18:14:09.240815 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-256e3bce-807e-4a60-b384-b24b0775dd58 req-fc971c43-d949-4bd6-bb84-294714aa81fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074341 Oct 04 18:14:09.242722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1050/2154] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:09.330282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.335982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.342819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.343967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.345041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.346633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.347738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.348736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.443670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:09.654902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.672360 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e243d014-9e48-4775-bdef-48c256190161 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1613 microversion: 2.1 time: 0.350449 Oct 04 18:14:09.673588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1105/2155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1613 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.707638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.707638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.708026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.708516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.711560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.716051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.716511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.720660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.721571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.725235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.742287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.742287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.742287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.745973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.750469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.751200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.775870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:09.781789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:09.914072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.941512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.955510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:09.959268 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02b11f94-161c-46a1-8831-0f07eb586ab9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1663 microversion: 2.25 time: 0.266314 Oct 04 18:14:09.981473 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1051/2156] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1663 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:10.005731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-unplugged", "status": "completed", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:10.031601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.032551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.040138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.079902 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Creating event network-vif-unplugged:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:14:10.090950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] Instance 06e75e31-a91c-471b-8d45-6425b70eebba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:14:10.117444 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b09dc84a-f36c-42d9-bad7-b4b05d26b416 req-279a505b-9bde-47eb-a666-bddd8f4e182c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129883 Oct 04 18:14:10.122768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1052/2157] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:10.130909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.150549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.163881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.164989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.166858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.169507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.170191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.172495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.499030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.514907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24ec6291-9506-41e7-a76d-6095caefa93d tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.388922 Oct 04 18:14:10.518858 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1053/2158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.547972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.551391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.596866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.598414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.599983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.601417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.604230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.604859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.721545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.734496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-894668a7-0f8e-4057-b53d-5543e1d70c8d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1536 microversion: 2.1 time: 1.035443 Oct 04 18:14:10.737457 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1106/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1536 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.750947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.752761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:10.768306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.774302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.779526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.783461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:10.784175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:10.786033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.006085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.036226 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-194d3e91-1d0a-4887-96e6-66c07e696927 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1613 microversion: 2.1 time: 0.297434 Oct 04 18:14:11.036845 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1107/2160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1613 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:11.053245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "5d6fb9ca-6108-4c08-ba1b-8fc12efdc239"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:11.085727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.091210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.092685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.124156 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] Creating event network-vif-plugged:5d6fb9ca-6108-4c08-ba1b-8fc12efdc239 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:11.136016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bcb834d8-9144-4e38-8b5e-c0a2ccd8020b req-5549e2ec-7d0f-48c8-b3e9-1f108ff404cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095524 Oct 04 18:14:11.145433 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1108/2161] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:11.153873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.161194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.169271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.169849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.170370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.171167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.171745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.172316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.229147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.229991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.230655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.231453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lazy-loading 'fault' on Instance uuid 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:11.319389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.335126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.343079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.345383 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afd89c9d-bb93-4fd5-aed8-37859fd689bb tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 200 len: 1375 microversion: 2.25 time: 0.197628 Oct 04 18:14:11.351284 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1109/2162] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:11.358585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7", "name": "network-vif-deleted", "tag": "05c69a10-8330-4a3b-8a7c-14f6562ecf9b"}, {"server_uuid": "6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7", "name": "network-vif-deleted", "tag": "ccc3295b-19a0-429e-b4f1-98b36f089b42"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:11.387793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.388447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.388987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.409111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Creating event network-vif-deleted:05c69a10-8330-4a3b-8a7c-14f6562ecf9b for instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 on n-h1-833090-21 Oct 04 18:14:11.410005 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] Creating event network-vif-deleted:ccc3295b-19a0-429e-b4f1-98b36f089b42 for instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 on n-h2-833090-21 Oct 04 18:14:11.420679 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-04834bd5-1da6-4a55-98e6-221ce47de641 req-566647fa-aade-4a26-ab6f-283cc0a74e2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067544 Oct 04 18:14:11.429949 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1110/2163] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:11.525978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.546095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.547119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.549131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.556087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.557650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14bc365b-7175-4dcb-ab99-11d5bc3af2c2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 1.034590 Oct 04 18:14:11.559087 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1054/2164] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:11.566031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.566683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.571168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.572220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.581645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.582355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.744958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:11.759308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cc135396-1771-49ac-8ad1-4e37e56ca929 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.218451 Oct 04 18:14:11.759912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.760193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.760941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1111/2165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:11.774032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.779752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.781612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.782635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.788634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.788634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.075936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.077077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.089075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.106224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.107200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.112446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.114673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.115554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.206085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.209812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.210516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.216966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lazy-loading 'fault' on Instance uuid 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:12.326052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4535696eb0e408198213695ddba2799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4637af03b8846bf852621bf897c7d15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.355808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed4cbe4b-938d-4b7c-ae88-b5a7879e929e tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 200 len: 1331 microversion: 2.1 time: 0.272475 Oct 04 18:14:12.355808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1112/2166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:12.378494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.382041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.397118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.404523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.405216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.406187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.406846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.408072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.443141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] HTTP exception thrown: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Request method failure captured: Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 HTTP/1.1 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXSCZmlOwwE1zEGBt6I4_JBaJa9nuY-uFKYAi4xJtdxddxt5j0g6cY4gWUHMsejz526N8ejSwTFCmXRwCjoFaT2Hp99-YlqdJ1rfwA_3T75IY6CfWLO2jO5odOBx0ejhP-pXQvl70hLWX1WyXASfWEpNdKSlDDfYaMr4OYgfexBOVc Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7be3d0ba65a426f939fffd2ffbd16fe"}]}] Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7'} Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. Oct 04 18:14:12.449899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. Oct 04 18:14:12.454561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:12.457567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Returning 404 to user: Instance 9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:12.458894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52ef8f09-7e98-48f5-b0ae-7ced9d4f27cc tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7" status: 404 len: 111 microversion: 2.25 time: 0.085766 Oct 04 18:14:12.460383 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1113/2167] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/9f28a0f5-5dbe-4e0c-880c-1ba66dc1afc7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:12.479094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1dbf468-42fc-47f4-a570-70279ccfa6b2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '.version_select at 0x7f9008c855e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.597693 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1dbf468-42fc-47f4-a570-70279ccfa6b2 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936672898" status: 204 len: 0 microversion: 2.25 time: 0.130272 Oct 04 18:14:12.598184 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1114/2168] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 4 18:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936672898 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:12.611439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:12.612770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:12.635025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.635754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.636955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.639558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:12.640477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:12.642213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.062049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.082752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.084259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.097356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79d245a4-a962-4483-b51d-0745a883f19a tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.497878 Oct 04 18:14:13.097961 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1115/2169] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:12 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:13.124882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.125498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.143076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.148068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.148884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.149926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.150679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.151873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.437589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.445358 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3948d07-2c34-4d35-aff7-939615cbf136 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.346309 Oct 04 18:14:13.457925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1116/2170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:13.470477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:13.496076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.496928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.497448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.515781 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Creating event network-changed:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:14:13.525253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] Instance 06e75e31-a91c-471b-8d45-6425b70eebba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:14:13.542908 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c157dc3e-e838-4b95-9d6f-9055805c4c11 req-b78dabcd-b93a-49f2-b872-fb712fc720d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084205 Oct 04 18:14:13.544024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1117/2171] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:13.560988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.563288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.595283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.595806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.596474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.597198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.597650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.598250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.622637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] HTTP exception thrown: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Request method failure captured: Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 HTTP/1.1 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHbuF1obZOBC-m0VT5GZmrzZqHMlQeNNEVxSX-syWT0lNB_AH0iBKZ_HsxYGNw9PturQZxRjGq1GjmkAS-Ny-zgWjf8Ysa9UsSGmDIebPBY1OsjgMRlZcEDqzhs2uN3So9HWaUmn7JUHW1Oibo4poJH-NUqus_e9kd7Fn0yypsdQjSU Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4637af03b8846bf852621bf897c7d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4637af03b8846bf852621bf897c7d15"}]}] Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d4535696eb0e408198213695ddba2799 Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7'} Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:13.627824 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:13.631524 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:13.633938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Returning 404 to user: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:13.635015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16c9f101-7ebd-4008-afc5-211a4ee016fe tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 404 len: 111 microversion: 2.1 time: 0.089406 Oct 04 18:14:13.642990 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1118/2172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:13.653214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bde6a50e-7a8c-4e7c-b850-4993bb61d9da tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '.version_select at 0x7f9008c69550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.789224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bde6a50e-7a8c-4e7c-b850-4993bb61d9da tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310457357" status: 202 len: 0 microversion: 2.1 time: 0.140966 Oct 04 18:14:13.790062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1119/2173] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310457357 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:13.883945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:13.897464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a053857a-e859-4d99-9507-202ea6aa08ce tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1536 microversion: 2.1 time: 2.141628 Oct 04 18:14:13.899979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1055/2174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1536 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:14.126931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.128319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.140214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "1631307a-60e8-430b-a272-eddadcf33c16"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:14.158082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.162126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.162722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.164166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.165050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.165625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.166203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.166739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.167267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.215151 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] Creating event network-vif-plugged:1631307a-60e8-430b-a272-eddadcf33c16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:14.227663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e040e31a-7276-4be5-adbf-4a7e906634c1 req-5d016588-954a-4596-914c-0462543c3109 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091791 Oct 04 18:14:14.230637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1056/2175] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:14.471577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.472391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.483135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.483664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.487076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.493043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.496745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.497287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.655045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.686558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6266535-9f52-4197-8bdf-b8c2e44dc313 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.219792 Oct 04 18:14:14.687140 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1057/2176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:14.930734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.931386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.953401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.953907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.961970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.963124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.965644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.966277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.210812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.229109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.233600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.238519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ec98230-2327-4a1c-a59c-ccf57c6edea8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 1.116933 Oct 04 18:14:15.242454 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1120/2177] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:15.664777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.677693 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23811985-6346-48bb-9d34-cb645a62dca6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1536 microversion: 2.1 time: 0.751450 Oct 04 18:14:15.679912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1058/2178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1536 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:15.712752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.713943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.733148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.734582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.737184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.738595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.742340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.745853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.917569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.929559 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33d83caa-5482-4b87-b31d-2ad0b8ed54a4 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.219946 Oct 04 18:14:15.929559 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1121/2179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:16.016790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.018187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.030485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.033270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.034038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.037626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.038116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.039621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.090674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:16.270948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.271852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.286135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.286736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.288437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.289230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.289697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.291232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.535653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:16.597455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.612032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.614143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.619986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03ad813c-ea7c-435f-965b-0e94b19d7f80 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.351411 Oct 04 18:14:16.624036 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1122/2180] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:16.643075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "c4cfa452-b8fc-474c-8735-893bf4599d16"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "e6994394-dab0-410e-bc2a-4375d059e115"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:16.668231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.670440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.672362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.690578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Creating event network-vif-plugged:c4cfa452-b8fc-474c-8735-893bf4599d16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:16.691453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] Creating event network-vif-plugged:e6994394-dab0-410e-bc2a-4375d059e115 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:16.698475 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0454cda6-3f55-4e28-b99c-ce1d684086ac req-818432c4-1e63-4ff1-996d-f77ad8e93a24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072597 Oct 04 18:14:16.699339 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1123/2181] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:16.712687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b34e93d8-f389-46cc-bcd8-4ab2cef6b152 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 204 len: 0 microversion: 2.25 time: 0.695518 Oct 04 18:14:16.712687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1059/2182] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:16 2022] DELETE /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:16.712837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.712837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.716440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.717167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.717297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.718269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.719004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.720036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.720705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.721512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.745157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.751379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.757198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.758979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.761267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.761813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.973799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:16.986394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d155396d-97bf-4b4d-9d4a-c2b3e47de9d3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1536 microversion: 2.1 time: 0.285018 Oct 04 18:14:16.987722 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1124/2183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1536 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:16.993072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.994307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:17.001783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.002782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.003424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.004913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.005645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.006492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.090698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.100255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c893108-7109-43fc-9792-51ae6f8daa6b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.111088 Oct 04 18:14:17.101227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1125/2184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:17.405149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.419331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.421002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.423600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8add0f71-e077-4e86-bbf3-afe2800a18c8 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1548 microversion: 2.25 time: 0.710583 Oct 04 18:14:17.426561 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1060/2185] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1548 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:17.654924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:17.655588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:17.669668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.673185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.675613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.678570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:17.680814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:17.692739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.020421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.025180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.050389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.053848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.054567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.055572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.059448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.060379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.231245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b650605-8ee5-470a-b3c0-b807a5aeb780 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.600716 Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1126/2186] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:17 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.260224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.266352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.267802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.268478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.269438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.270112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.270783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.365431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.377302 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4395e83e-198b-4ede-98ca-3b9f1e19756c tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 200 len: 1183 microversion: 2.1 time: 0.124251 Oct 04 18:14:18.378083 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1127/2187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 1183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:18.452613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.453391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.464391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.486061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.486653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.489348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.491518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.493181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.523716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:18.689536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.699519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a04de83-3e61-433b-84c9-e45ace09edc3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1536 microversion: 2.1 time: 0.689497 Oct 04 18:14:18.700805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1061/2188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1536 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:18.716625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "55e150a2-4085-40dd-a60d-a0bb1bf9491f"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "c70a47a6-9e24-4a26-bf4d-acb66858a391"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-plugged", "status": "completed", "tag": "b31e804b-098e-4fbd-bb38-ff0475bfe7fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:18.730130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.730802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.731437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.753526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Creating event network-vif-plugged:55e150a2-4085-40dd-a60d-a0bb1bf9491f for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:18.753526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Creating event network-vif-plugged:c70a47a6-9e24-4a26-bf4d-acb66858a391 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:18.753526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] Creating event network-vif-plugged:b31e804b-098e-4fbd-bb38-ff0475bfe7fb for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:18.758698 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-25933ce7-8118-4b8c-a48c-82730a31b85b req-6d6554d1-91e9-42c7-86d6-ba418e6bac76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047175 Oct 04 18:14:18.765596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1062/2189] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:18.782692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.806070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.806285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f549322e-f89f-48d9-92f7-7a10bdf098f4", "name": "network-vif-deleted", "tag": "7c365027-ebc4-494b-aabb-affbfd8293f4"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:18.808556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:18.814739 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-080100c3-d522-4fe2-86d0-886608d9d99c tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1506 microversion: 2.25 time: 0.362668 Oct 04 18:14:18.814739 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1128/2190] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:18.864644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.870169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.871138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.908041 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] Creating event network-vif-deleted:7c365027-ebc4-494b-aabb-affbfd8293f4 for instance f549322e-f89f-48d9-92f7-7a10bdf098f4 on n-h2-833090-21 Oct 04 18:14:18.930099 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d135368b-d297-445d-bead-06f58c96483e req-28999472-5812-4b5e-9640-5df18225b5f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155997 Oct 04 18:14:18.931511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1063/2191] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:19.278787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.279732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.290066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.292082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.295949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.297313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.298495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.302680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.404060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.405077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 09d63a7c-e6eb-4f7c-9a62-a9df853b8478] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.423773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.424671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.425425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.426337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.429861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.430922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.482781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] HTTP exception thrown: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Request method failure captured: Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 HTTP/1.1 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXnfUHMocQvDy727FSDweHk2BJhDBASstwup6TIgSzsOR1a78D7W0BV3gFQGiMdsY58NdMHKGSiuqKcVnQQchIb7xZ0iWvMBtCLtlK69U1JRbcPAH0ZkfSZBfXZj-A4RnSZ1KzJR78XlGiFbTLR5LwSTuu9ybMWjlLDezUoO13Se6c Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2d475decc81c43e7ad36a9b8a51a7fc4"}]}] Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveMigrationTest-693087294 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 97934d1450a94f40b1d7a82d05fb47dc Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '09d63a7c-e6eb-4f7c-9a62-a9df853b8478'} Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:19.493710 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. Oct 04 18:14:19.497225 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:19.500406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Returning 404 to user: Instance 09d63a7c-e6eb-4f7c-9a62-a9df853b8478 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:19.505206 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec0ae058-4929-408a-9624-687db9a3beff tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478" status: 404 len: 111 microversion: 2.1 time: 0.105443 Oct 04 18:14:19.523514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1064/2192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/09d63a7c-e6eb-4f7c-9a62-a9df853b8478 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:14:19.726675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.727288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.739896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.745280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.745776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.746216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.746922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.747807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.748401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.753594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.755501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.760202 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9677067a-751a-434a-9065-632901d38685 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 0.485758 Oct 04 18:14:19.764304 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1129/2193] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:19.837842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.838707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.848893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.850480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.850480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.851013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.851960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.852474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.981597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.993985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.994451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.997727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lazy-loading 'fault' on Instance uuid f549322e-f89f-48d9-92f7-7a10bdf098f4 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:20.079782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.093315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.093790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.095539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a4b75638-8d58-4841-b640-960ee01fa376 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 200 len: 1352 microversion: 2.25 time: 0.262442 Oct 04 18:14:20.106150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1130/2194] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 1352 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:20.235345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.256231 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f84d087c-2725-41cc-820d-21958ab857f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1529 microversion: 2.1 time: 0.533358 Oct 04 18:14:20.261114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1065/2195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1529 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.292363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.302684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.327310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.327723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.332665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.335325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.335842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.336273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.793415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.794035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.806064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.806852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.807524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.808973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.812082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.812724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.217768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.234466 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb677187-dabb-4dc7-9af4-900368cd1834 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1529 microversion: 2.1 time: 0.956416 Oct 04 18:14:21.235432 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1131/2196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1529 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:21.864503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.872624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e211e32f-85a3-4bd1-9f02-5c31adb6cf85 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Action: 'create', calling method: .version_select at 0x7f9008d4d700>, body: {"keypair": {"name": "tempest-keypair-268158305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINq/BSBfXCRQBC68t3l5bjp4vvHgF/dnOq98DV4wY3QWdwYwugM7lxpwAEhS9noeiOV5Xe3SLMSkL7tpyCygENW9D+VP+22peTTD5xHIQF2sI3bF4+ieNPTcLqcWm6lAQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:21.884258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:21.890199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.892507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:21.894774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac96721d-216e-4a07-93e3-fe00ae5e32a7 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1878 microversion: 2.32 time: 1.106506 Oct 04 18:14:21.913366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1066/2197] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1878 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:21.914261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e211e32f-85a3-4bd1-9f02-5c31adb6cf85 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for project 62e5bec8f09c4983ba4d512991b54b5b. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:21.922217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.922808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: f549322e-f89f-48d9-92f7-7a10bdf098f4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.930467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.931216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.937629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.937629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.937629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.937629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.977809 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] HTTP exception thrown: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Request method failure captured: Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 HTTP/1.1 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXSCZmlOwwE1zEGBt6I4_JBaJa9nuY-uFKYAi4xJtdxddxt5j0g6cY4gWUHMsejz526N8ejSwTFCmXRwCjoFaT2Hp99-YlqdJ1rfwA_3T75IY6CfWLO2jO5odOBx0ejhP-pXQvl70hLWX1WyXASfWEpNdKSlDDfYaMr4OYgfexBOVc Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7be3d0ba65a426f939fffd2ffbd16fe"}]}] Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'f549322e-f89f-48d9-92f7-7a10bdf098f4'} Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. Oct 04 18:14:21.979958 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. Oct 04 18:14:21.983693 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:21.993652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Returning 404 to user: Instance f549322e-f89f-48d9-92f7-7a10bdf098f4 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:21.995449 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-906dd3fb-0f43-43f9-8343-dcd1ab66ae28 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4" status: 404 len: 111 microversion: 2.25 time: 0.080740 Oct 04 18:14:21.999957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1067/2198] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/f549322e-f89f-48d9-92f7-7a10bdf098f4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:22.009909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d7dd616-d28f-4506-8257-8748d490467a tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.021416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8d7dd616-d28f-4506-8257-8748d490467a tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] HTTP exception thrown: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d7dd616-d28f-4506-8257-8748d490467a tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Request method failure captured: Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/flavors/533f62fa-b086-4dd7-a3d0-46275fe0ac06 HTTP/1.1 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHb4dVKt1IWtdw-kMaPsBRzvbEzdt4oK_EPEHV3zXiJTRJ-kJzlBIzW1IQ9-4bWon5n0s9YkFsn7e42cK93MLAdjyTE-j4DdQw_RjPUOLxg4zUBYcqPj3w5G4XMz8-Yr06h3NPXvWOafhLyhh-2jOUmMWWeigdzvCgwJPqhY12gXi70 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f76713f7d5e64051957c737fd8532514 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-MigrationsAdminTest-1110276756 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f76713f7d5e64051957c737fd8532514"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f76713f7d5e64051957c737fd8532514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f76713f7d5e64051957c737fd8532514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f76713f7d5e64051957c737fd8532514"}]}] Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-MigrationsAdminTest-1110276756 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f76713f7d5e64051957c737fd8532514 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-MigrationsAdminTest-1110276756 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-MigrationsAdminTest-1110276756-project-admin Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 22a8cf242b2344018e985471b23b2733 Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-MigrationsAdminTest-1110276756-project-admin Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: exception: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '533f62fa-b086-4dd7-a3d0-46275fe0ac06'} Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:22.028052 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:22.033188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d7dd616-d28f-4506-8257-8748d490467a tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Returning 404 to user: Flavor 533f62fa-b086-4dd7-a3d0-46275fe0ac06 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:22.033776 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d7dd616-d28f-4506-8257-8748d490467a tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/533f62fa-b086-4dd7-a3d0-46275fe0ac06" status: 404 len: 109 microversion: 2.1 time: 0.030199 Oct 04 18:14:22.036541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1068/2199] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:22 2022] DELETE /compute/v2.1/flavors/533f62fa-b086-4dd7-a3d0-46275fe0ac06 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:22.051542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-plugged", "status": "completed", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:22.068524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.069263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.070580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.085701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] Creating event network-vif-plugged:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:14:22.097678 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ac9b96b8-2d17-4142-97fa-67793c110697 req-e0a85a96-df77-42f0-a4e3-a8cd247d780a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058883 Oct 04 18:14:22.106114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1069/2200] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:22.113687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.115289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.126137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.127077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.127893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.128917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.129534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.130558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.187235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:22.275999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:22.340768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e211e32f-85a3-4bd1-9f02-5c31adb6cf85 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for user 6fd08d70b62f4c10be4bf8f91036d8c9 and project 62e5bec8f09c4983ba4d512991b54b5b. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:22.440602 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e211e32f-85a3-4bd1-9f02-5c31adb6cf85 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.202972 Oct 04 18:14:22.442113 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1132/2201] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:14:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:22.459099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1892462081", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:22.623273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:22.674211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76b576a9-812c-4073-b8f2-b0450ed43971 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "DELETE /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 204 len: 0 microversion: 2.25 time: 0.566150 Oct 04 18:14:22.679515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1070/2202] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:22 2022] DELETE /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:22.699444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.702932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.716538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.717189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.717926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.719701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.731191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.732359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.012794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:23.013211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:23.013686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:23.015781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:23.015781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:23.028259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.029954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.034151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.034942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.035413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.035864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.071403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.075027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:23.080765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Getting quotas for user 222a0ff5ff3f454ab8cb2e8774cb7398 and project d7343997cd9d4767ab6ce8b664897a0b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:23.084124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.086894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.088504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83fda086-9ead-43d7-be25-caddf73c68a4 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1564 microversion: 2.25 time: 0.407074 Oct 04 18:14:23.089650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1071/2203] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1564 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:23.094716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:23.097066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:23.108051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.109721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.136647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.137462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.140029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.143147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.144096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.145890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.252683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67167921-5864-4878-83d0-282675f5e307 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808805 Oct 04 18:14:23.265441 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1133/2204] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:23.296970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ac9ea16-684d-4e5d-9835-ee6ab33f823d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.300953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9ac9ea16-684d-4e5d-9835-ee6ab33f823d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.635102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9ac9ea16-684d-4e5d-9835-ee6ab33f823d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.640034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.649654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9ac9ea16-684d-4e5d-9835-ee6ab33f823d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1213 microversion: 2.1 time: 0.382231 Oct 04 18:14:23.650235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1134/2205] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:23.682031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.683773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.687802 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21a3af34-2152-4117-bdcc-d6e84750f8ff tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2829 microversion: 2.32 time: 0.596902 Oct 04 18:14:23.699910 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1072/2206] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2829 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:23.718450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.719174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.727201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.728011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.728602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.729681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.730293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.730866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.119917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.120531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.133930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.134380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bba76394-e2c9-4294-97e3-3feb86aea2ed tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.419985 Oct 04 18:14:24.134493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.134853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.135412 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1135/2207] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91/os-interface => generated 1829 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:24.147022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.147564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.148018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.674705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6006be9d-953a-42ba-bc49-21058b295b9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.676300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6006be9d-953a-42ba-bc49-21058b295b9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.682310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.691623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.713081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.714332 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64eb429b-44b1-4436-a321-d14a437be9f0 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1564 microversion: 2.25 time: 1.598327 Oct 04 18:14:25.735888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1073/2208] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1564 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:25.737248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6006be9d-953a-42ba-bc49-21058b295b9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.787849 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6006be9d-953a-42ba-bc49-21058b295b9f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1213 microversion: 2.1 time: 1.116426 Oct 04 18:14:25.806120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1136/2209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1213 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:26.328094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "924684cc-8e02-41ca-b044-c3663727d075", "name": "network-vif-deleted", "tag": "6fa69cb8-230d-4e60-9807-4cdc6b033013"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:26.356520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.357042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.358036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.441650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] Creating event network-vif-deleted:6fa69cb8-230d-4e60-9807-4cdc6b033013 for instance 924684cc-8e02-41ca-b044-c3663727d075 on n-h2-833090-21 Oct 04 18:14:26.451534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fab6dc30-a119-4f3b-b0a2-b834969ea54c req-23edd41b-b856-4d86-88ab-29e488a5c6ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127197 Oct 04 18:14:26.455864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1074/2210] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:26.744339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.745149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.762510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.768159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.768755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.771073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.774371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.777506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.832296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.832850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.865840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.874686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.874686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.874686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.874686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.874686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.137449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.171586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.173826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f4c1b0f7b74fe8a5cbfcd87e2a9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7be3d0ba65a426f939fffd2ffbd16fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.175378 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a7f6937-bb12-4c3f-a3ac-fa39f1f106e9 tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 200 len: 1347 microversion: 2.25 time: 0.435258 Oct 04 18:14:27.176196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1137/2211] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 1347 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:27.428014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.441484 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0eaf68e9-b015-464f-aa7b-993f7965768b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1265 microversion: 2.1 time: 0.619037 Oct 04 18:14:27.442416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1075/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1265 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.206873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.209685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] [instance: 924684cc-8e02-41ca-b044-c3663727d075] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.231152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.231831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.233378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.237118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.237721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.238268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.261008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] HTTP exception thrown: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Request method failure captured: Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 HTTP/1.1 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXSCZmlOwwE1zEGBt6I4_JBaJa9nuY-uFKYAi4xJtdxddxt5j0g6cY4gWUHMsejz526N8ejSwTFCmXRwCjoFaT2Hp99-YlqdJ1rfwA_3T75IY6CfWLO2jO5odOBx0ejhP-pXQvl70hLWX1WyXASfWEpNdKSlDDfYaMr4OYgfexBOVc Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7be3d0ba65a426f939fffd2ffbd16fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7be3d0ba65a426f939fffd2ffbd16fe"}]}] Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d7be3d0ba65a426f939fffd2ffbd16fe Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-998393164 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 57f4c1b0f7b74fe8a5cbfcd87e2a9cb4 Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-998393164-project Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '924684cc-8e02-41ca-b044-c3663727d075'} Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. Oct 04 18:14:28.263852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. Oct 04 18:14:28.270745 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:28.273061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] Returning 404 to user: Instance 924684cc-8e02-41ca-b044-c3663727d075 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:28.274718 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fff19ae0-ffa6-47fa-9ee7-d642e92a008b tempest-LiveAutoBlockMigrationV225Test-998393164 tempest-LiveAutoBlockMigrationV225Test-998393164-project] 10.222.0.40 "GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075" status: 404 len: 111 microversion: 2.25 time: 0.074058 Oct 04 18:14:28.275176 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1138/2213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/924684cc-8e02-41ca-b044-c3663727d075 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:28.465276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.466331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.478430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.479725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.489747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.489747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.489747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.489747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.584795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "tag": "b31e804b-098e-4fbd-bb38-ff0475bfe7fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:28.604731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.610403 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d091f791-13cc-4797-a97f-45386cacbff5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1271 microversion: 2.1 time: 0.149002 Oct 04 18:14:28.616598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.622166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1139/2214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:28.636811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.639259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.689497 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] Creating event network-changed:b31e804b-098e-4fbd-bb38-ff0475bfe7fb for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:14:28.700616 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-55c99d22-948d-4648-b923-e1636a44a6e2 req-78034048-8457-4ce0-98c1-30f0aec13f59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407121 Oct 04 18:14:28.707380 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1076/2215] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:28.918580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.919244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.935340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.938651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.939223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.940913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.942585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.944882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.046385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:29.156319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.157487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.172449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.195962 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] HTTP exception thrown: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Request method failure captured: Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 HTTP/1.1 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbuF1obZOBC-m0VT5GZmrzZqHMlQeNNEVxSX-syWT0lNB_AH0iBKZ_HsxYGNw9PturQZxRjGq1GjmkAS-Ny-zgWjf8Ysa9UsSGmDIebPBY1OsjgMRlZcEDqzhs2uN3So9HWaUmn7JUHW1Oibo4poJH-NUqus_e9kd7Fn0yypsdQjSU Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4637af03b8846bf852621bf897c7d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4637af03b8846bf852621bf897c7d15"}]}] Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d4535696eb0e408198213695ddba2799 Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7'} Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:29.197833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.201242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Returning 404 to user: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:29.202777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dacef2b-a48b-4993-97d5-874ab8e5812d tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 404 len: 111 microversion: 2.1 time: 0.047452 Oct 04 18:14:29.207271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1077/2216] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:29 2022] DELETE /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:14:29.218790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.220368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] [instance: 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.228658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.229440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.230104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.231159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.231847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.232508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.248950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] HTTP exception thrown: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Request method failure captured: Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 HTTP/1.1 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHbuF1obZOBC-m0VT5GZmrzZqHMlQeNNEVxSX-syWT0lNB_AH0iBKZ_HsxYGNw9PturQZxRjGq1GjmkAS-Ny-zgWjf8Ysa9UsSGmDIebPBY1OsjgMRlZcEDqzhs2uN3So9HWaUmn7JUHW1Oibo4poJH-NUqus_e9kd7Fn0yypsdQjSU Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4637af03b8846bf852621bf897c7d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4637af03b8846bf852621bf897c7d15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4637af03b8846bf852621bf897c7d15"}]}] Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a4637af03b8846bf852621bf897c7d15 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2078644191 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d4535696eb0e408198213695ddba2799 Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2078644191-project Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7'} Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:29.250957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. Oct 04 18:14:29.255131 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:29.256344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] Returning 404 to user: Instance 6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:29.257358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fd3ec99-b6cf-44d6-ac46-b894ad5a5895 tempest-AttachSCSIVolumeTestJSON-2078644191 tempest-AttachSCSIVolumeTestJSON-2078644191-project] 10.222.0.40 "GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7" status: 404 len: 111 microversion: 2.1 time: 0.045636 Oct 04 18:14:29.258389 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1078/2217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/6b97c50f-9b5e-48bb-a7ab-bcf637cb91b7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:14:29.640201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e87aa3e-43b1-4cc3-b0aa-53d9acb3e4eb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 204 len: 0 microversion: 2.1 time: 0.725672 Oct 04 18:14:29.642914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1140/2218] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:28 2022] DELETE /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:29.652127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.656139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.659666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.664749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.665728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.666507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.667161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.668301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.669246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.670235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.680361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.681033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.681588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.682436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.692184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.692834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.832101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.848647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfe49159-39d4-4ace-8133-3de4de0baa1d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1271 microversion: 2.1 time: 0.194129 Oct 04 18:14:29.849793 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1141/2219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.629578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.649906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5b69f53-93e7-45b1-88d7-ff2b4225314e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1667 microversion: 2.1 time: 1.002393 Oct 04 18:14:30.653723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1079/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1667 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.886879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.887391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.905687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.906184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.907157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.916396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.919917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.920620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.237553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-734517486", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cd1661e6-8cb2-4fc6-ac0e-b830ca53e4be"}], "security_groups": [{"name": "tempest-securitygroup--1332842619"}], "key_name": "tempest-keypair-268158305", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:31.314929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.327986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c935e611-6aea-4b0d-a23a-71d301865ad9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.443054 Oct 04 18:14:31.341008 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1142/2221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:31.652130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] validate_networks() for [('cd1661e6-8cb2-4fc6-ac0e-b830ca53e4be', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:31.680514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:31.681708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:31.690387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.691224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.691884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.692737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.693414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.694330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.916442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.926272 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb6c5427-ae42-4b66-ac65-a4a3d76933b5 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1667 microversion: 2.1 time: 0.249826 Oct 04 18:14:31.941207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1143/2222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:31 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1667 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:32.173824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95dbe4c3-43e0-45c5-b137-9ee2989353f8", "name": "network-vif-deleted", "tag": "e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:32.187275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.187275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.187659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.213301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] Creating event network-vif-deleted:e7d1cfe5-55da-4c08-ac31-e0ad6d56ac4c for instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 on n-h2-833090-21 Oct 04 18:14:32.226260 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6dc1c62a-22ad-4ba5-918c-41dcd2e192c6 req-8bd0c236-716f-4f98-8e5e-113e17b96bee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056440 Oct 04 18:14:32.227850 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1144/2223] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:32.359979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.360184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.393065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.393567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.397199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.397977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.398460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.398919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.680413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.711040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-485d67b1-0584-494f-b16b-7ad7ced748da tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.359265 Oct 04 18:14:32.712411 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1145/2224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.958678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.965573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.969747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.970356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.970906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.971892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.972497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.973302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.018982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.019849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.020314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.020770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lazy-loading 'fault' on Instance uuid 95dbe4c3-43e0-45c5-b137-9ee2989353f8 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:33.044664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:33.091488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.101982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fca0e17a-77cb-4221-af76-642fec119a7f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 200 len: 1324 microversion: 2.1 time: 0.152756 Oct 04 18:14:33.102577 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1146/2225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:33.227094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for project 62e5bec8f09c4983ba4d512991b54b5b. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:33.234575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for user 6fd08d70b62f4c10be4bf8f91036d8c9 and project 62e5bec8f09c4983ba4d512991b54b5b. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:33.257626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:33.260812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:33.260812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:33.260812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:33.261280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:33.278430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.286969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.286969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.286969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.286969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.286969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.305941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for project 62e5bec8f09c4983ba4d512991b54b5b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:33.311691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Getting quotas for user 6fd08d70b62f4c10be4bf8f91036d8c9 and project 62e5bec8f09c4983ba4d512991b54b5b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:33.329610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:33.332231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:33.504950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb2ebac2-f078-4b95-a5e1-dfb3857db11a tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.288699 Oct 04 18:14:33.511643 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1080/2226] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:31 2022] POST /compute/v2.1/servers => generated 407 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:33.526612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8f83559-4a8e-4385-947e-6d21d1c91531 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.527820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8f83559-4a8e-4385-947e-6d21d1c91531 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.679290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8f83559-4a8e-4385-947e-6d21d1c91531 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.690392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8f83559-4a8e-4385-947e-6d21d1c91531 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1268 microversion: 2.1 time: 0.169016 Oct 04 18:14:33.692654 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1147/2227] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:33.738053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.751082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.751082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.751082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.751082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.752379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.755228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.756017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.131311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.132742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 95dbe4c3-43e0-45c5-b137-9ee2989353f8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.142400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.143066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.143540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.144406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.144923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.145354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] HTTP exception thrown: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Request method failure captured: Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 HTTP/1.1 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXnfUHMocQvDy727FSDweHk2BJhDBASstwup6TIgSzsOR1a78D7W0BV3gFQGiMdsY58NdMHKGSiuqKcVnQQchIb7xZ0iWvMBtCLtlK69U1JRbcPAH0ZkfSZBfXZj-A4RnSZ1KzJR78XlGiFbTLR5LwSTuu9ybMWjlLDezUoO13Se6c Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2d475decc81c43e7ad36a9b8a51a7fc4"}]}] Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveMigrationTest-693087294 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 97934d1450a94f40b1d7a82d05fb47dc Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '95dbe4c3-43e0-45c5-b137-9ee2989353f8'} Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:34.163435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Returning 404 to user: Instance 95dbe4c3-43e0-45c5-b137-9ee2989353f8 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f932937a-4b8b-4d6f-90ee-885e81277d1b tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8" status: 404 len: 111 microversion: 2.1 time: 0.037688 Oct 04 18:14:34.172202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1148/2228] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/95dbe4c3-43e0-45c5-b137-9ee2989353f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:34.177628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35837b1e-818a-4665-8010-ac8e23b60fbb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '.version_select at 0x7f90097b2550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.263497 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35837b1e-818a-4665-8010-ac8e23b60fbb tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271000355" status: 202 len: 0 microversion: 2.1 time: 0.091322 Oct 04 18:14:34.264360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1149/2229] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271000355 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:34.587478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.626692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ac27eec-0615-4d14-9471-e5505d8a68de tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.871418 Oct 04 18:14:34.626692 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1081/2230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.716243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-018f5fe1-1dff-4613-9d4e-1423f0ac9292 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.716978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-018f5fe1-1dff-4613-9d4e-1423f0ac9292 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.753424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:34.771946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.772680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.773299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.788830 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] Creating event network-changed:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:14:34.793813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c3676625-43cf-424c-96ad-fc314a861537 req-49206778-a264-4fa6-a86c-f7a73e376afb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044630 Oct 04 18:14:34.794937 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1082/2231] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:35.087566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-018f5fe1-1dff-4613-9d4e-1423f0ac9292 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.098816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-018f5fe1-1dff-4613-9d4e-1423f0ac9292 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1268 microversion: 2.1 time: 0.386708 Oct 04 18:14:35.103300 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1150/2232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1268 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:35.466428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.467027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.476681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.477405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.477999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.482962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.483812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.485185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.527668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:35.642540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.644324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.660024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.661901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.662550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.664148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.666161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.667976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.696321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:35.880192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7fd3742-2635-4ea8-b5ef-43d52a7fa77e tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 204 len: 0 microversion: 2.1 time: 0.418501 Oct 04 18:14:35.882143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1083/2233] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:35 2022] DELETE /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:35.893106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.894214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.903184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.903945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.904791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.906094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.906789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.907428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.950543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:35.961939 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8814dc2c-249c-4a1e-80a6-cd07136e8e0a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.326875 Oct 04 18:14:35.962974 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1151/2234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:36.126333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.127158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.138491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.143433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.144227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.145176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.145802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.147963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.287795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.297128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42b5ed03-1c47-4d7c-894f-c4bff64a58e5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1320 microversion: 2.1 time: 0.176728 Oct 04 18:14:36.313611 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1152/2235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:36.674825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.685878 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb59d779-37d0-409c-867d-7d341f2fe12f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1484 microversion: 2.1 time: 0.798994 Oct 04 18:14:36.687145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1084/2236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1484 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:36.989580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.990359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.999055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.003071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.003856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.004916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.005565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.006227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.329032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:37.329984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.338016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.338506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.338939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.342128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.342601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.343033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.369206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.379212 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e1fe634-f11a-4b30-a9ec-9ee89bf198cf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.395984 Oct 04 18:14:37.399743 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1153/2237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:37.418186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.426988 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df6eff4c-2128-4d39-8a0a-54055ac26c3d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1326 microversion: 2.1 time: 0.102441 Oct 04 18:14:37.427596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1085/2238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:37 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:37.717465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:37.718529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.728244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.730152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.731184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.735595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.736163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.736679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.871368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e", "name": "network-vif-deleted", "tag": "f812e491-76c3-4004-bb2f-361e75518b6c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:37.877084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.889009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.889639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49c4a55c-3ea5-4cc3-a5d4-c2b55dd5c64f tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1442 microversion: 2.1 time: 0.175744 Oct 04 18:14:37.889891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.890470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.897737 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1154/2239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:37 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1442 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:37.928582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] Creating event network-vif-deleted:f812e491-76c3-4004-bb2f-361e75518b6c for instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e on n-h1-833090-21 Oct 04 18:14:37.944378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4eea893d-2715-4543-9c00-2959842c3d64 req-74de6226-b980-4709-bd69-ae941d3b6755 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080327 Oct 04 18:14:37.945535 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1086/2240] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:38.406988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.407979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.415915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.416646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.417089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.417845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.418297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.418872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.450660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.451371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.471924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.472427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.472948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.473667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.474129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.474561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.885961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.892943 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9224f86-3012-4680-97f3-3887b91aa3a5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.445877 Oct 04 18:14:38.894830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1087/2241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:38.924922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.925549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.958153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.958153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.958153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.968312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.969541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.969999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.054057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:39.055890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.056381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.057649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.058298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lazy-loading 'fault' on Instance uuid 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:39.153609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.162230 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57fe50b5-9768-4762-88a4-a3580a858e0a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 200 len: 1300 microversion: 2.1 time: 0.242199 Oct 04 18:14:39.163372 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1088/2242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 1300 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:39.217405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.226827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-204027bb-f04b-4cab-839e-b498f5e93c8f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.824195 Oct 04 18:14:39.228107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1155/2243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:39.928464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.930099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.943628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.944437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.945309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.946318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.947065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.947973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.969780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:40.158527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:40.166788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-402259e0-3d13-400b-95b5-4ea4a0c05728 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.244480 Oct 04 18:14:40.167489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1089/2244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:40.186991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.187875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.194498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.194983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.195501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.196145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.196664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.197137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.214427 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] HTTP exception thrown: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Request method failure captured: Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e HTTP/1.1 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHXnfUHMocQvDy727FSDweHk2BJhDBASstwup6TIgSzsOR1a78D7W0BV3gFQGiMdsY58NdMHKGSiuqKcVnQQchIb7xZ0iWvMBtCLtlK69U1JRbcPAH0ZkfSZBfXZj-A4RnSZ1KzJR78XlGiFbTLR5LwSTuu9ybMWjlLDezUoO13Se6c Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2d475decc81c43e7ad36a9b8a51a7fc4"}]}] Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-LiveMigrationTest-693087294 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 97934d1450a94f40b1d7a82d05fb47dc Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e'} Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:40.215941 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Returning 404 to user: Instance 5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:40.220802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4fc08290-6d6e-41b1-a2d9-01b8a48963c0 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e" status: 404 len: 111 microversion: 2.1 time: 0.035175 Oct 04 18:14:40.226796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.227298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.230200 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1156/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:40 2022] GET /compute/v2.1/servers/5d96d7fd-e7b0-4b2d-910c-1de9da2d4e6e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:40.233207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.234965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.234965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.235124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.235647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.236075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.250216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.251110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.258398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.259063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.259698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.260556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.261449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.262017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.301476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:40.725875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:40.736257 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44863b85-2203-4d59-81f0-12a845653d27 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.489635 Oct 04 18:14:40.755827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1157/2246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:40 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:40.854247 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6103f2dd-cea4-4521-aff5-6b026506ec2a tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 204 len: 0 microversion: 2.1 time: 0.630833 Oct 04 18:14:40.858941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1090/2247] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:40 2022] DELETE /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:40.866847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.867761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.874417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.874929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.876072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.883439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.883973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.884418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.191868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.198163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.216430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.216948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.217419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.218125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.218589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.219237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.229491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.241805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-778f0f9b-bbd1-40ac-a204-f0ecfd918b55 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1501 microversion: 2.1 time: 0.378882 Oct 04 18:14:41.243095 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1158/2248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:40 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.387345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66a274a-9580-47bb-9508-16f294d02282", "tag": "05b1f378-866a-46aa-a5f8-0c8692896b0a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:41.405131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.405966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.407252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.425457 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] Creating event network-changed:05b1f378-866a-46aa-a5f8-0c8692896b0a for instance f66a274a-9580-47bb-9508-16f294d02282 on n-h2-833090-21 Oct 04 18:14:41.436887 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7b1827d8-081f-438f-839e-562a5000c2b3 req-e0db5034-47d0-4e84-bbbd-0a77aa57052c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059689 Oct 04 18:14:41.438989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1159/2249] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:41.442470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.451733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f12dcac3-ac1e-48e9-8d65-fd2809861b22 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.265045 Oct 04 18:14:41.458035 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1091/2250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:41 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.761838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.762627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.776130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.777467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.778804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.782102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.782523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.784167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.267191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.268386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.285181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.292479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.293104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.294545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.296287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.297227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.340081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.348398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6235ab00-95a5-4b61-b598-7741ce325e3d tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.591051 Oct 04 18:14:42.374262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1160/2251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:41 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:42.478454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:42.479076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:42.482173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:42.486507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.486999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.487435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.488348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.488972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.489554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.574748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.583700 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a19033bd-c7cf-4f8f-b957-d9e62d31a1e9 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1501 microversion: 2.1 time: 0.321464 Oct 04 18:14:42.584816 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1092/2252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:42.966756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:42.982862 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42a3c3ea-cdc9-49d2-9ee5-7f31cfbf57f0 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.508122 Oct 04 18:14:42.983506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1161/2253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:42 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:43.381384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.382642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.386346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:43.389047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:43.403197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.405150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.407878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.408884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.409557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.411530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.472397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c2c02e-31e1-4c65-9b2c-29e40d5438ec", "name": "network-vif-deleted", "tag": "1e560aa1-5d0d-4eb8-8c06-c7ad4002645e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:43.506593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.509700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.510524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.539588 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] Creating event network-vif-deleted:1e560aa1-5d0d-4eb8-8c06-c7ad4002645e for instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec on n-h1-833090-21 Oct 04 18:14:43.545655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2cb1b666-69f7-47e4-9d7e-2f2cffe2bcd1 req-e5a15dac-4a5c-4d1f-bb15-b9c6cf26b9a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081888 Oct 04 18:14:43.546785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1162/2254] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:43.611819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.612774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.649842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.650787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.659158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.663076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.664163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.668317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.725074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.740624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ddfe408-f7bf-4c6b-9d33-c81bacce4164 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.363414 Oct 04 18:14:43.752229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1093/2255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:43.776026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-plugged", "status": "completed", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:43.801747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.804590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.805055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.857207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] Creating event network-vif-plugged:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:14:43.863390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.873134 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10d52342-cef6-463c-9ced-c51205d29a60 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1296 microversion: 2.1 time: 0.266471 Oct 04 18:14:43.889490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1163/2256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1296 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:43.889641 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a63e29ec-20ae-4d50-b45f-3210e5ec252f req-ab35ba1f-7687-4e56-a5b1-16ee3d40b251 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117931 Oct 04 18:14:43.889641 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1094/2257] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:44.016183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.016802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.028115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.032448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.035610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.036525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.036939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.037367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.472648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:44.486181 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-555e1142-69aa-4c15-aba0-d45abe1a228e tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.475285 Oct 04 18:14:44.494350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1164/2258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:44.780252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.781051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.802213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.802955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.803625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.804509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.805115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.806120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.906879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:44.907638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:44.919721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.920453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.922280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.924503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.925695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:44.927701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:44.995689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:44.996334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.003188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.003188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lazy-loading 'fault' on Instance uuid 98c2c02e-31e1-4c65-9b2c-29e40d5438ec {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:45.063331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.072210 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24ca3a7a-e1d1-41d1-83ce-6eb997da61db tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1313 microversion: 2.1 time: 0.298455 Oct 04 18:14:45.074824 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1095/2259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:45.092415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:45.116673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97934d1450a94f40b1d7a82d05fb47dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d475decc81c43e7ad36a9b8a51a7fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.132919 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0fbda5c3-0067-4228-ac22-60cd624c2145 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 200 len: 1301 microversion: 2.1 time: 0.232260 Oct 04 18:14:45.133112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1165/2260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:44 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 1301 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:45.517453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.517453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:45.523611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.524200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.526173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.526987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.527576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.528118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.710539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.731205 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8be1532e-ba12-4208-a7ad-e2e13a69986d tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.224414 Oct 04 18:14:45.743291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1096/2261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:45 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.101980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.102780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.118521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.118990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.135437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.136584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.137500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.138087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.161646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.166786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] [instance: 98c2c02e-31e1-4c65-9b2c-29e40d5438ec] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.194782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.197497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.201113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.202820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.205104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.210051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.273848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] HTTP exception thrown: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Request method failure captured: Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec HTTP/1.1 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHXnfUHMocQvDy727FSDweHk2BJhDBASstwup6TIgSzsOR1a78D7W0BV3gFQGiMdsY58NdMHKGSiuqKcVnQQchIb7xZ0iWvMBtCLtlK69U1JRbcPAH0ZkfSZBfXZj-A4RnSZ1KzJR78XlGiFbTLR5LwSTuu9ybMWjlLDezUoO13Se6c Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2d475decc81c43e7ad36a9b8a51a7fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2d475decc81c43e7ad36a9b8a51a7fc4"}]}] Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-LiveMigrationTest-693087294 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2d475decc81c43e7ad36a9b8a51a7fc4 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-LiveMigrationTest-693087294 Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 97934d1450a94f40b1d7a82d05fb47dc Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-LiveMigrationTest-693087294-project Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '98c2c02e-31e1-4c65-9b2c-29e40d5438ec'} Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:46.284147 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. Oct 04 18:14:46.296278 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.297579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] Returning 404 to user: Instance 98c2c02e-31e1-4c65-9b2c-29e40d5438ec could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:46.299571 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-399566f0-eba9-42e7-bdf8-3995b8e39469 tempest-LiveMigrationTest-693087294 tempest-LiveMigrationTest-693087294-project] 10.222.0.40 "GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec" status: 404 len: 111 microversion: 2.1 time: 0.150311 Oct 04 18:14:46.305884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1097/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/98c2c02e-31e1-4c65-9b2c-29e40d5438ec => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:46.730303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.751483 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2a4eaa27-a093-408c-81ad-b86898be7130 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1463 microversion: 2.1 time: 0.653206 Oct 04 18:14:46.764875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.769629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1166/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1463 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.770222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.778498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.779455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.787109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.788451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.789103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.790147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.790805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.791587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.792857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.796483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.797461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.800837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.801964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.807891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.982615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7136549e-727c-4482-9363-5c2221db132b tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1616 microversion: 2.1 time: 0.208704 Oct 04 18:14:47.002452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1167/2264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1616 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:47.007747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:47.008651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:47.017685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.018412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.019124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.020470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.021112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.021849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.116333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '22a8cf242b2344018e985471b23b2733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76713f7d5e64051957c737fd8532514', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:47.116333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] flavor_id is None. Assuming migration. {{(pid=123887) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:14:47.116333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123887) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:14:47.508397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:47.539281 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23319477-869c-4ff6-855b-48450b822c14 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.778383 Oct 04 18:14:47.541622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1098/2265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:47.782432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:48.044194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12331b22-940e-4edd-ba66-72c30823ae5e tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8/action" status: 202 len: 0 microversion: 2.1 time: 1.040096 Oct 04 18:14:48.044819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1168/2266] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:47 2022] POST /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8/action => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:48.054243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.055240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:48.062659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.063315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.064131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.065174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.065849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.067166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.299560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:48.308619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5cf23a3-26da-49fd-bdbb-5680563bc355 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1472 microversion: 2.1 time: 0.258512 Oct 04 18:14:48.310243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1099/2267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:48.568588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.569288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:48.577532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.578029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.578598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.579163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.579648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.580128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.766868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:48.775507 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95a1b5f1-7e5c-4f58-99fa-bcbf14b28105 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.212678 Oct 04 18:14:48.776144 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1169/2268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.334540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.335809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.345397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.345955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.346433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.347351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.347839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.348270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.597287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.615585 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f93b6cc4-aa67-477f-8ffd-2d1e2062e078 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1472 microversion: 2.1 time: 0.285869 Oct 04 18:14:49.618399 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1100/2269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.800942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.801806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.808082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.809031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.809613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.810506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.811113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.811716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.142484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66a274a-9580-47bb-9508-16f294d02282", "name": "network-vif-plugged", "status": "completed", "tag": "05b1f378-866a-46aa-a5f8-0c8692896b0a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:50.165700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.166419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.167522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.198643 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] Creating event network-vif-plugged:05b1f378-866a-46aa-a5f8-0c8692896b0a for instance f66a274a-9580-47bb-9508-16f294d02282 on n-h2-833090-21 Oct 04 18:14:50.216165 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fb57a860-2d5a-41b3-9e83-41a256dd4696 req-cfbeab7b-de02-457f-867a-06c2bb89b811 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.620636 Oct 04 18:14:50.216826 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1170/2270] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:50.408834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.422470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ad9ac08-2d75-4bcb-a4ad-24ab44084d80 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.625515 Oct 04 18:14:50.425206 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1101/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:50.644592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.645625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.653455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.654017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.654664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.655356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.655847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.656335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.816440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.846355 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02de4587-4cda-4c19-b09a-e13d40bd8bf9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1472 microversion: 2.1 time: 0.186767 Oct 04 18:14:50.846355 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1171/2272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.451000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.451714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.476081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.476815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.478265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.480061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.482303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.485332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.728580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.735169 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b97e9a0-3eed-492b-90fc-6c29042a67a3 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1394 microversion: 2.1 time: 0.287230 Oct 04 18:14:51.747740 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1102/2273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1394 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:51.864640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.865962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.873500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.873993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.874602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.875528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.875997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.876427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.050788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.059310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40dd7322-d9e5-45e7-a6cb-583e12803268 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1472 microversion: 2.1 time: 0.198284 Oct 04 18:14:52.065652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1172/2274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.760819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.761543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.768710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.769204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.773236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.780632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.782659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.783102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.964337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-39a86a17-899b-4544-9eca-d5a9a0b78e24 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.985455 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-39a86a17-899b-4544-9eca-d5a9a0b78e24 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.516554 Oct 04 18:14:52.989305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1103/2275] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.002820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c07aaa8-b077-4f02-b681-335f7dc964a3 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.070685 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c07aaa8-b077-4f02-b681-335f7dc964a3 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.069325 Oct 04 18:14:53.072714 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1104/2276] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:53.100550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.102908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.122948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.123456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.123924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.124673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.125137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.125565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.154350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.163715 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7cf3e8c1-3d14-44ed-99e3-cc44b8932393 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1576 microversion: 2.1 time: 0.408242 Oct 04 18:14:53.164314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1173/2277] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1576 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:53.170828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c13a228-aa04-447a-880d-0db0d1940b58 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.179886 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c13a228-aa04-447a-880d-0db0d1940b58 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014261 Oct 04 18:14:53.180536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1174/2278] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.186464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.187209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.195225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.195747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.196422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.197155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.197614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.198211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.314480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.324615 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-790f1c0e-5481-4144-8b53-598c3030e47e tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1472 microversion: 2.1 time: 0.236040 Oct 04 18:14:53.326422 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1105/2279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.332247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2cf2b568-99a4-4d3d-8d58-72c58fa7ac06 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.341053 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2cf2b568-99a4-4d3d-8d58-72c58fa7ac06 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013348 Oct 04 18:14:53.343718 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1106/2280] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.354878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-273ad077-ccb5-4a0b-a348-141c8a8bd7f3 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.356955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19c6ac7e-f26c-4fa2-b59e-34ff2c895a5f tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174118 Oct 04 18:14:53.360424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1175/2281] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.400591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-273ad077-ccb5-4a0b-a348-141c8a8bd7f3 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.050039 Oct 04 18:14:53.401737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1107/2282] 10.222.0.40 () {58 vars in 1165 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.431202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-629e40ca-7f7c-4157-8779-cdf8e8406f08 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.446331 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-629e40ca-7f7c-4157-8779-cdf8e8406f08 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029756 Oct 04 18:14:53.448048 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1176/2283] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.461129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b78245d0-cd3f-4577-bbad-80064b8515da tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.497309 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b78245d0-cd3f-4577-bbad-80064b8515da tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039800 Oct 04 18:14:53.498258 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1108/2284] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.519632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80ebb77f-401b-4a6a-ac6a-f2aaf7603e30 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.551095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.551857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.563385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80ebb77f-401b-4a6a-ac6a-f2aaf7603e30 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.050744 Oct 04 18:14:53.577550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1177/2285] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.579932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.580664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.588002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.588002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.588002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.588002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.605892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db1ba891-57d1-4196-a3b8-a8bfb17e8a6b tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.620071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db1ba891-57d1-4196-a3b8-a8bfb17e8a6b tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018549 Oct 04 18:14:53.624254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1178/2286] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:53.641589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3cc9493e-11ee-4ce6-8c75-c11a3a4e39be tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.650325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:53.739586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:53.754892 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3cc9493e-11ee-4ce6-8c75-c11a3a4e39be tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.118647 Oct 04 18:14:53.764594 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1179/2287] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.790048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0df0172-a1dd-4f09-8138-e96d05ab4055 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.805790 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0df0172-a1dd-4f09-8138-e96d05ab4055 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025387 Oct 04 18:14:53.806601 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1180/2288] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.958017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c04a5458-bb0d-4e1d-9d1c-efed3b5b3dda tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.967727 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c04a5458-bb0d-4e1d-9d1c-efed3b5b3dda tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.159533 Oct 04 18:14:53.969400 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1181/2289] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:53.974463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44df80d5-f1c6-4263-80a4-e5b769fafbb6 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.039521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44df80d5-f1c6-4263-80a4-e5b769fafbb6 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.068575 Oct 04 18:14:54.049739 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1182/2290] 10.222.0.40 () {58 vars in 1144 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:54.055907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-356ea400-94ce-4be5-be17-4dc6a94108e5 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.065331 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-356ea400-94ce-4be5-be17-4dc6a94108e5 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014006 Oct 04 18:14:54.065996 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1183/2291] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:54.078895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f80c221-b37c-4600-997a-e362a985ad66 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.104792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f80c221-b37c-4600-997a-e362a985ad66 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030409 Oct 04 18:14:54.105385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1184/2292] 10.222.0.40 () {58 vars in 1148 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:54.119684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd941cdb-d736-4006-8af4-482b2b923bbc tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.132802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd941cdb-d736-4006-8af4-482b2b923bbc tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016945 Oct 04 18:14:54.133382 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1185/2293] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:54.146189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34dd5438-e948-44c0-956f-1a5c8ff40075 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.154400 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34dd5438-e948-44c0-956f-1a5c8ff40075 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012192 Oct 04 18:14:54.155185 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1186/2294] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:14:54.167797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-429f4323-fd68-4bc9-9415-f5e0e836cb0d tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.190634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-429f4323-fd68-4bc9-9415-f5e0e836cb0d tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.026826 Oct 04 18:14:54.191414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1187/2295] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:54.215069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70795883-6603-49ad-9d63-487846851997 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.248514 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70795883-6603-49ad-9d63-487846851997 tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047187 Oct 04 18:14:54.259797 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1188/2296] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:54.279173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-780cf4c4-dcfa-4240-a57d-d5abae5fa75a tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.295878 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-780cf4c4-dcfa-4240-a57d-d5abae5fa75a tempest-FlavorsV2TestJSON-980087103 tempest-FlavorsV2TestJSON-980087103-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024104 Oct 04 18:14:54.296423 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1189/2297] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:54.347528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b66c9e68-8f2c-4478-bbd4-d3ead8cdde35 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 204 len: 0 microversion: 2.1 time: 0.804241 Oct 04 18:14:54.348186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1109/2298] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:53 2022] DELETE /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 0 bytes in 806 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:14:54.352030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.352648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.357699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.364653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.364785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.370619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.372941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.373622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.375072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.375722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.376309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.573528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.581523 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b1d2d0b-3051-4e2b-b2cc-3ebc8f091a48 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.235439 Oct 04 18:14:54.582106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1190/2299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:54.669797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.675783 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae005be3-16af-4c5e-aba4-c216b1fb9b69 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1665 microversion: 2.1 time: 0.321412 Oct 04 18:14:54.677020 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1110/2300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1665 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:54.869286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.872177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.880410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66a274a-9580-47bb-9508-16f294d02282", "tag": "05b1f378-866a-46aa-a5f8-0c8692896b0a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:54.898205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.898714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.899168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.899293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.899926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.900052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.900399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.900531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.900831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.923915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] Creating event network-changed:05b1f378-866a-46aa-a5f8-0c8692896b0a for instance f66a274a-9580-47bb-9508-16f294d02282 on n-h2-833090-21 Oct 04 18:14:54.930062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bcf390d5-c9ba-4ae7-8cf9-28e340cac84e req-d1706c78-5e1d-4849-999a-6e48f269dac9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053773 Oct 04 18:14:54.936193 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1111/2301] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:55.381920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:55.390559 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f2c5f4bd-6140-4a1e-81fe-265a80ebcadc tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1576 microversion: 2.1 time: 0.527703 Oct 04 18:14:55.391948 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1191/2302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1576 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:55.611700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.613694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.635093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.635777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.636339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.637341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.640734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.641340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.700681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.701449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.716585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:56.097294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.107264 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0101269e-0a7f-4cbb-bcd9-cb892d7f2f66 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1665 microversion: 2.1 time: 0.410675 Oct 04 18:14:56.111840 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1192/2303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1665 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:56.357299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1730998769", "imageRef": "29e875a8-5e77-4c64-a650-3f8693965729", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:56.393771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:56.422973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10d6b515-f49f-4112-852a-fb5246be40e0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.815582 Oct 04 18:14:56.426713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1112/2304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:55 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:56.480098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:56.981751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] Request method failure captured: Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 143 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHgd4hxixypEPr_8keR-5nldGyr3_CzT8SgNDRG8eSGUb2RwWV6Z_GCgl-yQHg1nE9szUDVoWvywEirzIAlA7mtXdtIpzVigafMTME9vxxHWfaMoT_N5jCm8ewv1GlmDcpMGvTnJz2QE5ScUEYJkJZvk4BNgHiuzujUUwKFBgduVO2c Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 8af429c3184045f6b2d2667232c522d0 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-FlavorsV2NegativeTest-1196143582 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8af429c3184045f6b2d2667232c522d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af429c3184045f6b2d2667232c522d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8af429c3184045f6b2d2667232c522d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8af429c3184045f6b2d2667232c522d0"}]}] Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-FlavorsV2NegativeTest-1196143582 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 8af429c3184045f6b2d2667232c522d0 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1196143582 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-FlavorsV2NegativeTest-1196143582-project Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f2122302defb4efb8db0a0f4810c4872 Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-FlavorsV2NegativeTest-1196143582-project Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1730998769", "imageRef": "29e875a8-5e77-4c64-a650-3f8693965729", "flavorRef": "452"}} Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: exception: Flavor's memory is too small for requested image. Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1730998769', 'imageRef': '29e875a8-5e77-4c64-a650-3f8693965729', 'flavorRef': '452'}}} Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:56.983879 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 18:14:56.988786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:56.990815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:56.991874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a7707fd-6217-4362-8c50-604177c0bef9 tempest-FlavorsV2NegativeTest-1196143582 tempest-FlavorsV2NegativeTest-1196143582-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.645914 Oct 04 18:14:56.992925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1193/2305] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:56 2022] POST /compute/v2.1/servers => generated 93 bytes in 649 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:14:57.134189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.134840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.142969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.143512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.144136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.145061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.145681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.146285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.422629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.434680 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51183ecf-0d8e-48ba-843d-e927a5d32b96 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1665 microversion: 2.1 time: 0.304633 Oct 04 18:14:57.438760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1113/2306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1665 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:57.449031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.449984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.462725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.466911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.466911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.466911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.473613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.476084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.687745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.696055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6abbc3c2-77a4-4470-86c4-f022fb5b9e8c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.251486 Oct 04 18:14:57.707410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1194/2307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.206800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c", "name": "network-vif-deleted", "tag": "c9749f1b-3b2e-4337-aa7e-9f16572a51a3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:58.229993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.229993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.229993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.246718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] Creating event network-vif-deleted:c9749f1b-3b2e-4337-aa7e-9f16572a51a3 for instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c on n-h2-833090-21 Oct 04 18:14:58.258821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3758b81c-5c88-4325-b967-000dd1d116f0 req-547a4ddb-a0b8-4ff9-966d-71632ab98a29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060595 Oct 04 18:14:58.266737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1114/2308] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:58.462807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.463356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.476832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.480726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.481430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.482424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.483052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.490924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.601069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba81aacb59a40469cd37b6ee1a24424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33428d8d8282498c87726b26d1200ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.613329 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-139e3522-2ef1-45ea-b254-ff8763d3be88 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 200 len: 1311 microversion: 2.1 time: 0.154654 Oct 04 18:14:58.614171 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1195/2309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:58.726953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.728024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.736639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.737141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.737755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.741142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.741142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.741607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.192084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.231330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f8178f54-51dd-4359-98b9-a4f8129f4f2c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.505416 Oct 04 18:14:59.234700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1115/2310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:59.636183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.637523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] [instance: 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.645934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.646431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.647089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.647999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.648630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.649060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.673775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] HTTP exception thrown: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Request method failure captured: Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c HTTP/1.1 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHesR_1kO100Z0XywEirzpWfdAfBZhy5orwCbyYEZj6QLCCEiM9LG864EuIMyslgooygamva3JYR9N3cc_2lfzuYFAgXH04ZrksgoV2sLFmYD3Mcc7Q_iLvq4jtBx6_kU43Rc4DsC2HFM-UxeLM8aYJ6OqEZB7HeMhak4TfAWXanAGg Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 33428d8d8282498c87726b26d1200ed1 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestFqdnHostnames-1184260609 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_33428d8d8282498c87726b26d1200ed1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33428d8d8282498c87726b26d1200ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33428d8d8282498c87726b26d1200ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/33428d8d8282498c87726b26d1200ed1"}]}] Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestFqdnHostnames-1184260609 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 33428d8d8282498c87726b26d1200ed1 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1184260609 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestFqdnHostnames-1184260609-project Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 5ba81aacb59a40469cd37b6ee1a24424 Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestFqdnHostnames-1184260609-project Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c'} Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:59.675713 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. Oct 04 18:14:59.679503 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:14:59.680759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Returning 404 to user: Instance 13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:59.681827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4283affa-425b-4ebb-8b8e-761579af1774 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c" status: 404 len: 111 microversion: 2.1 time: 0.049776 Oct 04 18:14:59.682720 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1196/2311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/13f5ca8e-0b6f-40b3-a235-76d9b3e57a9c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:59.691561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4980e489-3e4a-44d1-a674-602eb0f821e2 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] Calling method '.version_select at 0x7f900d8a6430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.840742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4980e489-3e4a-44d1-a674-602eb0f821e2 tempest-ServersTestFqdnHostnames-1184260609 tempest-ServersTestFqdnHostnames-1184260609-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199204748" status: 202 len: 0 microversion: 2.1 time: 0.153498 Oct 04 18:14:59.843975 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1116/2312] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199204748 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:00.261458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.265647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.268598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.269081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.269520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.270211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.270668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.271216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.466479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-779b8210-bb65-4ef3-a67e-1a1994cf23d0 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f900998e940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.518598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-779b8210-bb65-4ef3-a67e-1a1994cf23d0 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27" status: 200 len: 637 microversion: 2.1 time: 0.057086 Oct 04 18:15:00.519673 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1117/2313] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27 => generated 637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:00.536642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9275320-8f67-46b7-93b9-c1065bc479fa tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f900998e790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:00.594243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a9275320-8f67-46b7-93b9-c1065bc479fa tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:00.600252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a9275320-8f67-46b7-93b9-c1065bc479fa tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:00.805842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.818552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a90c96d4-b7b0-4e02-8261-10c48505bf54 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.561018 Oct 04 18:15:00.829713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1197/2314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:01.047350 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9275320-8f67-46b7-93b9-c1065bc479fa tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.514482 Oct 04 18:15:01.048420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1118/2315] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:00 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:01.065978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1bf6048-584b-4052-891e-ba18a40b6bae tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f9009bc7430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.477068 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1bf6048-584b-4052-891e-ba18a40b6bae tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "DELETE /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.415449 Oct 04 18:15:01.477861 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1198/2316] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 4 18:15:01 2022] DELETE /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_version => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:01.487838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-684e4636-156d-45f2-b282-72894917cfb7 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f900d8a63a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.537323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-684e4636-156d-45f2-b282-72894917cfb7 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 37 microversion: 2.1 time: 0.055045 Oct 04 18:15:01.546220 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1119/2317] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:01.560796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75a39877-2906-42c4-8db2-0e696a45d084 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f9009937e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:01.635266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-75a39877-2906-42c4-8db2-0e696a45d084 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:01.645408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-75a39877-2906-42c4-8db2-0e696a45d084 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:01.850540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:01.850540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.855790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.856588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.857248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.858152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.861362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.862069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.053497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.062508 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4101339-d112-4783-89da-aa25742f6a5a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.220633 Oct 04 18:15:02.064750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1120/2318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:01 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.094986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75a39877-2906-42c4-8db2-0e696a45d084 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.545758 Oct 04 18:15:02.100934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1199/2319] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:01 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:02.105412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c73a4cd-b2ee-4851-af5d-4a1ceacd6456 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f900d8a60d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.148726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c73a4cd-b2ee-4851-af5d-4a1ceacd6456 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047321 Oct 04 18:15:02.149322 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1121/2320] 10.222.0.40 () {58 vars in 1290 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:15:02.166305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50987ed4-15c7-4f43-848a-09ed442072bd tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f9008cc60d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.231547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-50987ed4-15c7-4f43-848a-09ed442072bd tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:02.237384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-50987ed4-15c7-4f43-848a-09ed442072bd tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:02.428931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50987ed4-15c7-4f43-848a-09ed442072bd tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.272031 Oct 04 18:15:02.429725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1200/2321] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:02 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:02.445775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c42ad34-128e-4bbe-9879-57ab40cc8910 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f9008f0edc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.499871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c42ad34-128e-4bbe-9879-57ab40cc8910 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055649 Oct 04 18:15:02.499871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1122/2322] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:02.508752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ec790bf-6a29-43dd-8760-4dab356d7942 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f90099375e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.585779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6ec790bf-6a29-43dd-8760-4dab356d7942 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:02.605670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6ec790bf-6a29-43dd-8760-4dab356d7942 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:02.609742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:02.868684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ec790bf-6a29-43dd-8760-4dab356d7942 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.363601 Oct 04 18:15:02.869256 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1201/2323] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:02 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:02.880386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-271e3b2d-fe66-44de-bb5f-1313c0e0ed6b tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f900998ee50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.960913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-271e3b2d-fe66-44de-bb5f-1313c0e0ed6b tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:02.968775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-271e3b2d-fe66-44de-bb5f-1313c0e0ed6b tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:03.467977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.467977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.478518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.479050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.479734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.480838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.485022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.485619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.644413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-271e3b2d-fe66-44de-bb5f-1313c0e0ed6b tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 64 microversion: 2.1 time: 0.768093 Oct 04 18:15:03.646770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1123/2324] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:02 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 64 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:03.659323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4867b86-3a17-4551-8c64-4a80de478b64 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f900d8a6c10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.712566 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4867b86-3a17-4551-8c64-4a80de478b64 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 64 microversion: 2.1 time: 0.058192 Oct 04 18:15:03.719057 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1124/2325] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 64 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:03.724677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e3a931a-d02c-496a-80e6-2aae36f98567 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f9008f12820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:03.790746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0e3a931a-d02c-496a-80e6-2aae36f98567 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:03.797446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0e3a931a-d02c-496a-80e6-2aae36f98567 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:04.153084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.166135 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-32ee8320-6459-4d11-919a-d86c29e0b8f6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 1.077070 Oct 04 18:15:04.167666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1202/2326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:04.436421 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e3a931a-d02c-496a-80e6-2aae36f98567 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.715704 Oct 04 18:15:04.442078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1125/2327] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:03 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:04.451921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e246b450-6ed1-4028-bd42-3ca6e2d86afc tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update', calling method: .version_select at 0x7f90097c15e0>, body: {"meta": {"os_version": "alt"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:04.561561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e246b450-6ed1-4028-bd42-3ca6e2d86afc tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:04.574232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e246b450-6ed1-4028-bd42-3ca6e2d86afc tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:05.059941 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e246b450-6ed1-4028-bd42-3ca6e2d86afc tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.616621 Oct 04 18:15:05.060721 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1203/2328] 10.222.0.40 () {60 vars in 1313 bytes} [Tue Oct 4 18:15:04 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata/os_version => generated 31 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:15:05.073444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9866a30c-1595-4884-b2e4-cdc7ce28d3fb tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f9008f0e940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.151430 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9866a30c-1595-4884-b2e4-cdc7ce28d3fb tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079720 Oct 04 18:15:05.151430 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1126/2329] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 58 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:05.164624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46a973fa-2924-4ab0-b889-7f992be64925 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'update_all', calling method: .version_select at 0x7f900977c3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:05.191322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.191824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.205700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.206146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.210661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.210661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.210661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.210661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.266198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-46a973fa-2924-4ab0-b889-7f992be64925 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:05.274735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-46a973fa-2924-4ab0-b889-7f992be64925 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:05.644924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.658009 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8dae88ba-0d53-41bf-9ccb-2f8679d05a85 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.471259 Oct 04 18:15:05.674561 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1127/2330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.803382 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46a973fa-2924-4ab0-b889-7f992be64925 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 61 microversion: 2.1 time: 0.648464 Oct 04 18:15:05.804318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1204/2331] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:15:05 2022] PUT /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 61 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:05.816797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-deafa207-9806-48ca-8f7c-40dcafa481f2 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Action: 'create', calling method: .version_select at 0x7f900d8a6f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:05.900298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:05.915819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-deafa207-9806-48ca-8f7c-40dcafa481f2 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:05.949384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-deafa207-9806-48ca-8f7c-40dcafa481f2 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Getting quotas for user 7404b92bcce84b02be4d64703d397fd3 and project 9f8d538d3cde4c1c8ddc3a6826afd3db. Resources: dict_keys(['metadata_items']) {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:06.642400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ade02c1e-8116-4d93-adf0-15c4a476e4c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f900977cee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.697497 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-deafa207-9806-48ca-8f7c-40dcafa481f2 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "POST /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 85 microversion: 2.1 time: 0.887470 Oct 04 18:15:06.704584 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1128/2332] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 4 18:15:05 2022] POST /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 85 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:06.718743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.719386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.734338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.734338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.734338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.735421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.736076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.737202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.791172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ade02c1e-8116-4d93-adf0-15c4a476e4c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7" status: 200 len: 371 microversion: 2.1 time: 0.407722 Oct 04 18:15:06.791916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1205/2333] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:06.817517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9af9220-ae3f-4ed0-972e-b6fcd44b9c76 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] Calling method '.version_select at 0x7f90097640d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.898375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9af9220-ae3f-4ed0-972e-b6fcd44b9c76 tempest-ImagesMetadataTestJSON-1674237038 tempest-ImagesMetadataTestJSON-1674237038-project] 10.222.0.40 "GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata" status: 200 len: 85 microversion: 2.1 time: 0.105039 Oct 04 18:15:06.899270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1206/2334] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/images/132b70f6-a7e3-47c6-8619-5c84b3587c27/metadata => generated 85 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:15:06.908162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Action: 'update', calling method: .version_select at 0x7f900977c670>, body: {"quota_set": {"ram": "5120"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:07.000496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.011057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77691777-2226-463d-9c01-9a93f1769b0b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.301953 Oct 04 18:15:07.012381 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1129/2335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.865987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.880856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.884925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.886715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.897166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.897969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.051137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.055589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.085100 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-336b3718-dc29-4a4a-9379-a2584c48ce64 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7" status: 200 len: 328 microversion: 2.1 time: 1.183821 Oct 04 18:15:08.086620 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1207/2336] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:06 2022] PUT /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7 => generated 328 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:08.088255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.090872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.091342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.096299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.097084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.100580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.104504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25d53181-61f8-432b-99b5-e4fbdcbeca5b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.215016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25d53181-61f8-432b-99b5-e4fbdcbeca5b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7" status: 202 len: 0 microversion: 2.1 time: 0.114916 Oct 04 18:15:08.216148 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1208/2337] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:15:08 2022] DELETE /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:15:08.229466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86b75921-f29b-487f-851b-33061320271d tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f900977cb80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.689849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.701204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6e0ac73-b1b5-4b70-a56d-111e2f9ef954 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.668156 Oct 04 18:15:08.702056 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1130/2338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:08.725437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86b75921-f29b-487f-851b-33061320271d tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7" status: 200 len: 371 microversion: 2.1 time: 0.503429 Oct 04 18:15:08.726864 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1209/2339] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/os-quota-sets/f567163680ba40b5bff60feb5b64a5a7 => generated 371 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:09.178302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ae3716b-654f-44f4-a55a-cda794344892 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f9008f1df70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.728242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.730054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.746478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.747430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.748565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.749671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.752993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.754251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.957475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.968505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d75ace31-98e5-4c86-8534-e520324ec3a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.245612 Oct 04 18:15:09.969708 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1210/2340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:10.064352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ae3716b-654f-44f4-a55a-cda794344892 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62/defaults" status: 200 len: 371 microversion: 2.1 time: 0.889558 Oct 04 18:15:10.065544 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1131/2341] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62/defaults => generated 371 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:10.574812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Action: 'update', calling method: .version_select at 0x7f900977c3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:10.998350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.001827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.013801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.014809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.016282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.018099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.026899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.026899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.304597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.312763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9005fbcf-ca37-4a37-9b0d-4d9cfc5254f3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1477 microversion: 2.1 time: 0.323135 Oct 04 18:15:11.313358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1132/2342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.369134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.369678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.370153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.371084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.375501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.375501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.639029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb9ac38a-74c8-4c50-9f8a-e0a77bd74634 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487" status: 200 len: 328 microversion: 2.1 time: 1.068594 Oct 04 18:15:11.640397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1211/2343] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:10 2022] PUT /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487 => generated 328 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:11.653088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f90096894c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.037542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Calling method '.version_select at 0x7f900d8a6160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.058307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:12.058913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Neutron security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:12.059546 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] HTTP exception thrown: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.059546 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Request method failure captured: Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 HTTP/1.1 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgvM8UEf0Dor-Ed1OltFSo4sLdA9iuNNyDQDJyMirP2TtgzYr1vqVPFkUiuAvArwoBCngSwI2topAz66ah4zoD0m0TMgM1b5hNn1wjAG1Ov40ykzRxPDTdmnlr1DVkJCV4WlYqaNrHRGvZFvAGq8fMqVlBNpCcX4-7cI8P7c2q-O6M Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0de0fe4af01a466ebd78de120a219bbf"}]}] Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2ccf7b233bef4ed0a18b83f2a806de9a Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ec59c78d-a2f0-4be2-9d58-0d581e4e78f5'} Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:12.063898 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Returning 404 to user: Security group ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 does not exist Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bb98649d-1fcd-4a17-97bb-db6ea2912e59'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8498bfc4-6ad8-4e85-bec0-89de762d4fa2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ec59c78d-a2f0-4be2-9d58-0d581e4e78f5" status: 404 len: 194 microversion: 2.1 time: 0.555803 Oct 04 18:15:12.072503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1133/2344] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:11 2022] DELETE /compute/v2.1/os-security-groups/ec59c78d-a2f0-4be2-9d58-0d581e4e78f5 => generated 194 bytes in 557 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:12.098785 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf75187b-c047-48d6-a9c0-2d656b263239 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010543 Oct 04 18:15:12.099358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1134/2345] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 4 18:15:12 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:15:12.115540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a168308-d792-447c-950e-e54ca09a29c0 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Calling method '.version_select at 0x7f9008f1d5e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.275220 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a168308-d792-447c-950e-e54ca09a29c0 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.170745 Oct 04 18:15:12.275905 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1135/2346] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:12.293576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Calling method '.version_select at 0x7f9008ee1790>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.434193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:12.434980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 18:15:12.434980 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Request method failure captured: Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/247e763e-70b0-4179-b3a9-4390f339bbb7 HTTP/1.1 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgvM8UEf0Dor-Ed1OltFSo4sLdA9iuNNyDQDJyMirP2TtgzYr1vqVPFkUiuAvArwoBCngSwI2topAz66ah4zoD0m0TMgM1b5hNn1wjAG1Ov40ykzRxPDTdmnlr1DVkJCV4WlYqaNrHRGvZFvAGq8fMqVlBNpCcX4-7cI8P7c2q-O6M Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0de0fe4af01a466ebd78de120a219bbf"}]}] Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2ccf7b233bef4ed0a18b83f2a806de9a Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: exception: Insufficient rights for removing default security group. Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '247e763e-70b0-4179-b3a9-4390f339bbb7'} Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:12.437505 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-f74feffd-d897-4093-be18-713f17795dbd'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:12.442828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9eb17fb0-8586-439d-8c36-8c4c29c924c9 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/247e763e-70b0-4179-b3a9-4390f339bbb7" status: 400 len: 182 microversion: 2.1 time: 0.150792 Oct 04 18:15:12.446485 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1136/2347] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:15:12 2022] DELETE /compute/v2.1/os-security-groups/247e763e-70b0-4179-b3a9-4390f339bbb7 => generated 182 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:12.452706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.453334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.467386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.468131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.468817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.469801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.470406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.470990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.643522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.664169 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-38841eed-12c6-4022-bfe8-5bcb8d6da1a3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1476 microversion: 2.1 time: 0.216340 Oct 04 18:15:12.670249 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1137/2348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.673769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Calling method '.version_select at 0x7f9008ee1670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.738096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:12.739023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Neutron security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:12.739801 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] HTTP exception thrown: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.739801 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Request method failure captured: Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-security-groups/f48dddd0-01f2-4d6a-a57e-104761ad79b1 HTTP/1.1 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgvM8UEf0Dor-Ed1OltFSo4sLdA9iuNNyDQDJyMirP2TtgzYr1vqVPFkUiuAvArwoBCngSwI2topAz66ah4zoD0m0TMgM1b5hNn1wjAG1Ov40ykzRxPDTdmnlr1DVkJCV4WlYqaNrHRGvZFvAGq8fMqVlBNpCcX4-7cI8P7c2q-O6M Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0de0fe4af01a466ebd78de120a219bbf"}]}] Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2ccf7b233bef4ed0a18b83f2a806de9a Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'f48dddd0-01f2-4d6a-a57e-104761ad79b1'} Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:12.744957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Returning 404 to user: Security group f48dddd0-01f2-4d6a-a57e-104761ad79b1 does not exist Oct 04 18:15:12.748753 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-08ce8803-9c24-490f-a0b7-a7f7bc8c09d4'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:12.753977 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d5db712-ee9e-41df-af0b-d189dbf605e2 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/f48dddd0-01f2-4d6a-a57e-104761ad79b1" status: 404 len: 194 microversion: 2.1 time: 0.077239 Oct 04 18:15:12.760365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1138/2349] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/os-security-groups/f48dddd0-01f2-4d6a-a57e-104761ad79b1 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:12.767494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Action: 'update', calling method: .version_select at 0x7f90099ca670>, body: {"security_group": {"name": "tempest-sg-996909352", "description": "tempest-description-1667500504"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:12.799323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:15:12.800539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Neutron security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:15:12.801667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] HTTP exception thrown: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.801667 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Request method failure captured: Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/os-security-groups/99ff5ed6-b89d-4649-a843-018ae3d8ca6b HTTP/1.1 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 101 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgvM8UEf0Dor-Ed1OltFSo4sLdA9iuNNyDQDJyMirP2TtgzYr1vqVPFkUiuAvArwoBCngSwI2topAz66ah4zoD0m0TMgM1b5hNn1wjAG1Ov40ykzRxPDTdmnlr1DVkJCV4WlYqaNrHRGvZFvAGq8fMqVlBNpCcX4-7cI8P7c2q-O6M Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0de0fe4af01a466ebd78de120a219bbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0de0fe4af01a466ebd78de120a219bbf"}]}] Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0de0fe4af01a466ebd78de120a219bbf Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-322151590 Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2ccf7b233bef4ed0a18b83f2a806de9a Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-322151590-project Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: {"security_group": {"name": "tempest-sg-996909352", "description": "tempest-description-1667500504"}} Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '99ff5ed6-b89d-4649-a843-018ae3d8ca6b', 'body': {'security_group': {'name': 'tempest-sg-996909352', 'description': 'tempest-description-1667500504'}}} Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:15:12.806716 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] Oct 04 18:15:12.810227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:12.817699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] Returning 404 to user: Security group 99ff5ed6-b89d-4649-a843-018ae3d8ca6b does not exist Oct 04 18:15:12.817699 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-32d9506a-53a3-4fb8-a8e1-56bafecd6a0a'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:12.820929 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-372427bd-b5fc-43e3-b511-8f95d1af4e65 tempest-SecurityGroupsNegativeTestJSON-322151590 tempest-SecurityGroupsNegativeTestJSON-322151590-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/99ff5ed6-b89d-4649-a843-018ae3d8ca6b" status: 404 len: 194 microversion: 2.1 time: 0.058459 Oct 04 18:15:12.832432 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1139/2350] 10.222.0.40 () {60 vars in 1290 bytes} [Tue Oct 4 18:15:12 2022] PUT /compute/v2.1/os-security-groups/99ff5ed6-b89d-4649-a843-018ae3d8ca6b => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:12.883891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.884403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.885848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.888822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.890809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.891666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.958124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb8d8dea-00ef-44bf-b9e7-ec0f8513e501 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487/detail" status: 200 len: 916 microversion: 2.1 time: 1.308909 Oct 04 18:15:12.970962 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1212/2351] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487/detail => generated 916 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:13.165418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-unplugged", "status": "completed", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:13.185962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.186520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.187890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.212259 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Creating event network-vif-unplugged:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h2-833090-21 Oct 04 18:15:13.218984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:15:13.247304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5ae37173-ddfe-4ead-bba4-0ab3600fa6d8 req-40f3c3b9-5278-4e38-9056-ae4ffc1bbbd4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.415355 Oct 04 18:15:13.248061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1140/2352] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:13.693525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.700615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.706982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.709563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.710281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.717186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.718129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.718842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.416423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.426235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0eb6adea-302a-433e-b3b4-e4e97620b17f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1476 microversion: 2.1 time: 0.736818 Oct 04 18:15:14.426976 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1213/2353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1476 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.435744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Action: 'update', calling method: .version_select at 0x7f900979f040>, body: {"quota_set": {"ram": "2048"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:14.478459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86ca3778-10a4-4a2e-a20d-40ec0a552fe2 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.445331 Oct 04 18:15:14.479014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1141/2354] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:15:14.499607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7452ab64-0a3a-4404-b5c6-4230230a9062 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Calling method '.version_select at 0x7f9009043160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.542290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7452ab64-0a3a-4404-b5c6-4230230a9062 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] HTTP exception thrown: Image not found. Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7452ab64-0a3a-4404-b5c6-4230230a9062 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Request method failure captured: Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgx2incnx6YxICwA67eieIaVuKyPAVM-9H_VMxJbSp7IObGUm4yzpufvLJO14GVoxk1Va1KAxQoOwHYvqX7M6Aznv8pEZiOr5Ay4g_2ad7t2vcXBS4ra9-LFzod4R_LJrypBHNk6C-qn7fMzyV5-Pbc2hS93YU3UzxDUfmdGoaluQs Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ffb4f86673624ab3bb56a9fc9731f39b"}]}] Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 918521dc76664f18811b3afdd31f0945 Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '-1'} Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.543725 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:14.547699 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.550405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7452ab64-0a3a-4404-b5c6-4230230a9062 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.551413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7452ab64-0a3a-4404-b5c6-4230230a9062 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.066091 Oct 04 18:15:14.558663 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1142/2355] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:14.571348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d83d5ba4-86ca-4c5e-8f2e-42dbb89f1c34 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Calling method '.version_select at 0x7f9008f005e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.652403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d83d5ba4-86ca-4c5e-8f2e-42dbb89f1c34 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] HTTP exception thrown: Image not found. Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d83d5ba4-86ca-4c5e-8f2e-42dbb89f1c34 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Request method failure captured: Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/7ad6e30d-572f-47dc-a379-97e94b8d579j HTTP/1.1 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgx2incnx6YxICwA67eieIaVuKyPAVM-9H_VMxJbSp7IObGUm4yzpufvLJO14GVoxk1Va1KAxQoOwHYvqX7M6Aznv8pEZiOr5Ay4g_2ad7t2vcXBS4ra9-LFzod4R_LJrypBHNk6C-qn7fMzyV5-Pbc2hS93YU3UzxDUfmdGoaluQs Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ffb4f86673624ab3bb56a9fc9731f39b"}]}] Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 918521dc76664f18811b3afdd31f0945 Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '7ad6e30d-572f-47dc-a379-97e94b8d579j'} Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7ad6e30d-572f-47dc-a379-97e94b8d579j to delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ad6e30d-572f-47dc-a379-97e94b8d579j could not be found. Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.659146 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d83d5ba4-86ca-4c5e-8f2e-42dbb89f1c34 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.662863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d83d5ba4-86ca-4c5e-8f2e-42dbb89f1c34 tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/7ad6e30d-572f-47dc-a379-97e94b8d579j" status: 404 len: 62 microversion: 2.1 time: 0.098596 Oct 04 18:15:14.668194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1143/2356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/7ad6e30d-572f-47dc-a379-97e94b8d579j => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:14.674968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63ae89e2-41f9-4859-994c-0942408c3f0a tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Calling method '.version_select at 0x7f90099caca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.707069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-63ae89e2-41f9-4859-994c-0942408c3f0a tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] HTTP exception thrown: Image not found. Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63ae89e2-41f9-4859-994c-0942408c3f0a tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Request method failure captured: Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/10b67a5e-851b-4340-9d1f-0512987d0b811 HTTP/1.1 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgx2incnx6YxICwA67eieIaVuKyPAVM-9H_VMxJbSp7IObGUm4yzpufvLJO14GVoxk1Va1KAxQoOwHYvqX7M6Aznv8pEZiOr5Ay4g_2ad7t2vcXBS4ra9-LFzod4R_LJrypBHNk6C-qn7fMzyV5-Pbc2hS93YU3UzxDUfmdGoaluQs Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ffb4f86673624ab3bb56a9fc9731f39b"}]}] Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 918521dc76664f18811b3afdd31f0945 Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '10b67a5e-851b-4340-9d1f-0512987d0b811'} Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 10b67a5e-851b-4340-9d1f-0512987d0b811 to delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 10b67a5e-851b-4340-9d1f-0512987d0b811 could not be found. Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.715759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63ae89e2-41f9-4859-994c-0942408c3f0a tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63ae89e2-41f9-4859-994c-0942408c3f0a tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/10b67a5e-851b-4340-9d1f-0512987d0b811" status: 404 len: 62 microversion: 2.1 time: 0.048201 Oct 04 18:15:14.719416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1144/2357] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/10b67a5e-851b-4340-9d1f-0512987d0b811 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:14.739611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d59afe7f-f530-4899-b765-4259025600aa tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Calling method '.version_select at 0x7f9009043d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.777636 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d59afe7f-f530-4899-b765-4259025600aa tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] HTTP exception thrown: Image not found. Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d59afe7f-f530-4899-b765-4259025600aa tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Request method failure captured: Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/tempest-invalid-472819428 HTTP/1.1 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgx2incnx6YxICwA67eieIaVuKyPAVM-9H_VMxJbSp7IObGUm4yzpufvLJO14GVoxk1Va1KAxQoOwHYvqX7M6Aznv8pEZiOr5Ay4g_2ad7t2vcXBS4ra9-LFzod4R_LJrypBHNk6C-qn7fMzyV5-Pbc2hS93YU3UzxDUfmdGoaluQs Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ffb4f86673624ab3bb56a9fc9731f39b"}]}] Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 918521dc76664f18811b3afdd31f0945 Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'tempest-invalid-472819428'} Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-472819428 to delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-472819428 could not be found. Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.780252 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.785946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d59afe7f-f530-4899-b765-4259025600aa tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.788622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d59afe7f-f530-4899-b765-4259025600aa tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/tempest-invalid-472819428" status: 404 len: 62 microversion: 2.1 time: 0.059380 Oct 04 18:15:14.790664 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1145/2358] 10.222.0.40 () {58 vars in 1203 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/tempest-invalid-472819428 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:14.803550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8bc88eee-029e-491f-bd77-090c36646b3b tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Calling method '.version_select at 0x7f9008f674c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.838616 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8bc88eee-029e-491f-bd77-090c36646b3b tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] HTTP exception thrown: Image not found. Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8bc88eee-029e-491f-bd77-090c36646b3b tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Request method failure captured: Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/b2805351-3016-4f86-8f2d-461d765e841e HTTP/1.1 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHgx2incnx6YxICwA67eieIaVuKyPAVM-9H_VMxJbSp7IObGUm4yzpufvLJO14GVoxk1Va1KAxQoOwHYvqX7M6Aznv8pEZiOr5Ay4g_2ad7t2vcXBS4ra9-LFzod4R_LJrypBHNk6C-qn7fMzyV5-Pbc2hS93YU3UzxDUfmdGoaluQs Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ffb4f86673624ab3bb56a9fc9731f39b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ffb4f86673624ab3bb56a9fc9731f39b"}]}] Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ffb4f86673624ab3bb56a9fc9731f39b Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 918521dc76664f18811b3afdd31f0945 Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2008376296-project Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b2805351-3016-4f86-8f2d-461d765e841e'} Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b2805351-3016-4f86-8f2d-461d765e841e to delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b2805351-3016-4f86-8f2d-461d765e841e could not be found. Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.841431 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8bc88eee-029e-491f-bd77-090c36646b3b tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:14.846363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8bc88eee-029e-491f-bd77-090c36646b3b tempest-ImagesDeleteNegativeTestJSON-2008376296 tempest-ImagesDeleteNegativeTestJSON-2008376296-project] 10.222.0.40 "DELETE /compute/v2.1/images/b2805351-3016-4f86-8f2d-461d765e841e" status: 404 len: 62 microversion: 2.1 time: 0.049489 Oct 04 18:15:14.848351 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1146/2359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] DELETE /compute/v2.1/images/b2805351-3016-4f86-8f2d-461d765e841e => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:15:14.932678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.933194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.933638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.934383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.934904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.938646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.054661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.055391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.056027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.057751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.058621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.059411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.078609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:15.268268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:15.292804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.294341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.296675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.316195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1249ec40-275f-4f70-bfe0-d16e3e216a91 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487?user_id=cfed4bb542d04425b8d6ca82a8500088" status: 200 len: 328 microversion: 2.1 time: 0.888252 Oct 04 18:15:15.318156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1214/2360] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:15:14 2022] PUT /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487?user_id=cfed4bb542d04425b8d6ca82a8500088 => generated 328 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:15.329894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36c7fc3c-d1d2-4713-b508-7c16c1ef35c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f900970f9d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.334170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Creating event network-changed:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h2-833090-21 Oct 04 18:15:15.348538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:15:15.372752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-daa5481c-44ad-42b7-956b-3e2273c9ee1f req-7359f296-54b3-488f-9ae5-1376a0350f91 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109998 Oct 04 18:15:15.373558 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1147/2361] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:15.456138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.457601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.473775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.476581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.480618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.480618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.481342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.481904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.966437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:15.970305 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36c7fc3c-d1d2-4713-b508-7c16c1ef35c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487?user_id=cfed4bb542d04425b8d6ca82a8500088" status: 200 len: 370 microversion: 2.1 time: 0.645050 Oct 04 18:15:15.975751 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1215/2362] 10.222.0.40 () {58 vars in 1323 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/os-quota-sets/4360d0c33aa745229b896ab99b26f487?user_id=cfed4bb542d04425b8d6ca82a8500088 => generated 370 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:16.424167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.442864 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1742dafc-9266-4163-90d4-9c1ea1b0e5a5 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1476 microversion: 2.1 time: 0.989900 Oct 04 18:15:16.447937 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1148/2363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1476 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:17.040308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37c355a1-ee5f-4072-bc6f-f26dadd42f34 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Calling method '.version_select at 0x7f90098aa160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.407380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:17.409300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37c355a1-ee5f-4072-bc6f-f26dadd42f34 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62/defaults" status: 200 len: 371 microversion: 2.1 time: 0.392076 Oct 04 18:15:17.410115 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1216/2364] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62/defaults => generated 371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:17.424152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Action: 'update', calling method: .version_select at 0x7f90099ca550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:17.469830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.471448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.496595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.497496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.499204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.502343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.502950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.503530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.611951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.618623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.619163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.620266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.620822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.621460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.891058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.901227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0dd5e56b-2b7c-44ad-ab6f-58452a159cad tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1474 microversion: 2.1 time: 0.436316 Oct 04 18:15:17.901227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1217/2365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:18.925602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.926283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.942287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.944933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.946741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.947795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.949674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.951910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.365142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35552e6c-3441-44d8-be02-85807302999b tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62" status: 200 len: 329 microversion: 2.1 time: 1.946411 Oct 04 18:15:19.372061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1149/2366] 10.222.0.40 () {60 vars in 1263 bytes} [Tue Oct 4 18:15:17 2022] PUT /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62 => generated 329 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:19.388072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Action: 'update', calling method: .version_select at 0x7f900d8a6d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:19.666706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.722170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ee69e5a-5192-4909-ba7a-a8ef6d50df9a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1474 microversion: 2.1 time: 0.763763 Oct 04 18:15:19.722170 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1218/2367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1474 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:19.975245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.975819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.976333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.977137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.977810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.978472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.709988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.711297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.720277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.720987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.721998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.722872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.723512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.724090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.054779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.064862 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-406b272c-7901-4819-801b-088ffbe600ef tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1471 microversion: 2.1 time: 0.359136 Oct 04 18:15:21.072212 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1219/2368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.096169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:21.096965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.102565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=22,nova_api:UPDATE=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:21.104156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.104667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.105106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.105831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.106289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.107816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.679678 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bd7abb6-6a08-4246-ab10-1a0ca4119660 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "POST /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.586598 Oct 04 18:15:21.682092 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1220/2369] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:21 2022] POST /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:21.715619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.716334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.734546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.735051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.735517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.736243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.736698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.737117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.078423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.095325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e832cf1-c9f5-451e-b2e4-944aefc12245 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.386598 Oct 04 18:15:22.097009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1221/2370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.587731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae7a3740-ea72-4e31-b29c-ef88321803c5 tempest-QuotasAdminTestJSON-1134760373 tempest-QuotasAdminTestJSON-1134760373-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62" status: 200 len: 329 microversion: 2.1 time: 3.203022 Oct 04 18:15:22.590870 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1150/2371] 10.222.0.40 () {60 vars in 1263 bytes} [Tue Oct 4 18:15:19 2022] PUT /compute/v2.1/os-quota-sets/f7d32d1c1256454ebaa5e7e38ef0ab62 => generated 329 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:22.616660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-plugged", "status": "completed", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:22.648320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.649714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.651127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.728084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Creating event network-vif-plugged:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h2-833090-21 Oct 04 18:15:22.756308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:15:22.810513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1d76d48f-b5e9-46b3-8aee-cd2f38ed0fe8 req-2df21c25-2d94-4c36-9fb5-924d6fefc965 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200509 Oct 04 18:15:22.813724 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1222/2372] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:23.128981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.129695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:23.156862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.157462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.157967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.159311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.159884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.160383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.022550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:24.039513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5041cae2-bc7a-4389-98ac-acc97fc45ecf tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.916966 Oct 04 18:15:24.061705 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1151/2373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.892424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-548408556", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "7f146417-fc63-4b83-a5ba-6d28e87ebff8"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:25.063560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] validate_networks() for [('7f146417-fc63-4b83-a5ba-6d28e87ebff8', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:25.068421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.069047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:25.081067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:25.087130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.087866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.089595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.094661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.095383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.096590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.648895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.662195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:25.672001 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f2bde34-d316-4e22-867b-d4d569b086b7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.608946 Oct 04 18:15:25.678113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1152/2374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:25 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:25.950156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=58 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:26.341011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:26.345998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:26.347458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:26.348264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:26.348762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:26.362179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.362757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.363324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.364690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.365278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.366544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.398239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:26.406248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for user dbf908d61d404d9bb9f84faddbe59d9d and project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:26.431050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:26.433608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:26.634117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c90a8957-1f86-433f-ad3b-960f66c3d044 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938540 Oct 04 18:15:26.649631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1223/2375] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:26.660422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f3f66d0-9bf1-454f-bc99-64393852fe50 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.661291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f3f66d0-9bf1-454f-bc99-64393852fe50 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.708762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.710676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.760670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.762829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.763897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.786537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.787207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.787692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.944980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f3f66d0-9bf1-454f-bc99-64393852fe50 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:26.956087 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f3f66d0-9bf1-454f-bc99-64393852fe50 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1217 microversion: 2.1 time: 0.299629 Oct 04 18:15:26.959843 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1153/2376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:27.548870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.565712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12caad75-7fd2-48bd-a00e-114225a4b83c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.864918 Oct 04 18:15:27.567841 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1224/2377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:27.988792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-010c8af2-c6d2-4008-b941-3bae8576cef5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.989844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-010c8af2-c6d2-4008-b941-3bae8576cef5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.102584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-010c8af2-c6d2-4008-b941-3bae8576cef5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.113564 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-010c8af2-c6d2-4008-b941-3bae8576cef5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1217 microversion: 2.1 time: 0.132586 Oct 04 18:15:28.114716 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1154/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:28.593105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.593729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.612369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.613329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.614029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.614920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.615577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.616161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.140309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.141483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.161152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.162524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.162985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.165864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.169542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.169542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.254955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.266329 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e483dc1-8a14-46c8-b5bb-4cc93a44b423 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.676594 Oct 04 18:15:29.266984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1225/2379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.305521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.311823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-unplugged", "status": "completed", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:29.320411 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec476ab6-0487-4c45-a0cf-7f514fa29535 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1221 microversion: 2.1 time: 0.185943 Oct 04 18:15:29.327202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.332044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.332721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.335795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1155/2380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.363358 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Creating event network-vif-unplugged:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:15:29.377484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:15:29.391865 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c6f0df3b-22c8-4bd5-91e2-b426e9feee8b req-5aa5266a-1655-4fd0-8ee8-885122b34ff4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084312 Oct 04 18:15:29.394800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1226/2381] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:30.294903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.296372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.302454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:30.315971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.316696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.317304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.318267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.318783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.319216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.350654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.351654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.372915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.373451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.373899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.376220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.378927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.380070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.562704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.574595 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6a8e458-b9d5-4d48-b8d5-47e681605fb2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1269 microversion: 2.1 time: 0.233639 Oct 04 18:15:30.577854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1227/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:30.839174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.866030 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc632814-aca6-42a3-bd15-2ffee6ebb40c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.576175 Oct 04 18:15:30.866729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1156/2383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.405740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f29223f-3b81-4254-a323-104e072169e0 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Calling method '.version_select at 0x7f90096ab280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.450290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:31.487217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.488224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.489340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.525661 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Creating event network-changed:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:15:31.538810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:15:31.573239 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7393a232-ef8d-4de7-9fd4-985058b38b7f req-28f325b0-c453-4fe7-b350-4dc1ae84b30c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123631 Oct 04 18:15:31.574727 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1157/2384] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:31.610415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.611152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.629374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.629925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.631062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.631834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.632303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.636347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.913885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f29223f-3b81-4254-a323-104e072169e0 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 371 microversion: 2.1 time: 0.733660 Oct 04 18:15:31.921650 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1228/2385] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 371 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:31.921650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.921650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.930837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.933868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.933868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.936570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.937552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.937867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.979076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:31.999256 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffb10670-8d57-4dc4-b12c-97c952afc494 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1275 microversion: 2.1 time: 0.399441 Oct 04 18:15:32.000652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1158/2386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1275 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:32.008004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9009a3f670>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:32.150175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.151740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.155410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.155410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.155410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.158493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.335773 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e844358b-ed4c-437c-8062-b35bc71307f1 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 328 microversion: 2.1 time: 0.333658 Oct 04 18:15:32.347602 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1159/2387] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:32 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:32.495349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.515195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d45d1bd-d064-43ac-892c-4b8500f3ee6b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.595480 Oct 04 18:15:32.519145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1229/2388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:32.617577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-538613626", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:32.716745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:32.960236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:32.960899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:32.961579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:32.962141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:32.962715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:32.981923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.987637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.988317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.989363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.993833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.996045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.035179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.037577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.067377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:33.075938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for user 215ac762522b43c184cedb1e9344dbec and project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:33.082382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.083222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.086988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.094387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.096816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.097652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.120803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.utils [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] cores quota exceeded for 6354a249ac1641b7940854b0ed0a11e4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:15:33.120803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Request method failure captured: Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 144 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhBU3T3Dgq7yJ7VU0_4Sc2vcPpk8DQ7zegRRlLmHMmJNPCAmstBvbVaitdfEEGPzWcaYU7ODpq3FRi7XvBMDSbxq2hzq5TL6GU7W3CFsK41OxlUVZUKetI-FciShxiRnpyF14JVJMUNPFNY4ptgbAsIXbQcRLqZCiJinnWYJB-6mc0 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6354a249ac1641b7940854b0ed0a11e4"}]}] Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 215ac762522b43c184cedb1e9344dbec Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-538613626", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-538613626', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452'}}} Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:33.141924 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df27c981-7f98-4fac-b975-035f6016377d tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.652140 Oct 04 18:15:33.158307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1160/2389] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 655 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:15:33.171562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9009043940>, body: {"quota_set": {"cores": 20}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:33.403902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:33.418510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-816b5d1c-d131-433f-8452-3ef9d954b2a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1275 microversion: 2.1 time: 0.395116 Oct 04 18:15:33.420182 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1230/2390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1275 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.544492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.546335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.547046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.549709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.550822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.553690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.555745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.557958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.561770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.565697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.565697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.565697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.565697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.565697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.869927 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97466dc1-3b3e-4da6-ac1b-83e39212b0f3 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 329 microversion: 2.1 time: 0.707831 Oct 04 18:15:33.889150 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1161/2391] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:33 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 329 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:33.895371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-013a9c0a-89e6-4f91-8d4c-9b79dd784b72 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Calling method '.version_select at 0x7f9008f00280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:34.024832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-013a9c0a-89e6-4f91-8d4c-9b79dd784b72 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 371 microversion: 2.1 time: 0.134124 Oct 04 18:15:34.026033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1162/2392] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:34.043961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9008ee1700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:34.163792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.166193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.166868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.170615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.173091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.173091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.183942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.211227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=8,nova_api:INSERT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:34.224528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e2cda33-e689-448b-b5b8-e834855816ed tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.685080 Oct 04 18:15:34.229080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1231/2393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:34.257536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:34.402744 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42afc277-3d70-447f-890e-dae07ca57b3e tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 328 microversion: 2.1 time: 0.365969 Oct 04 18:15:34.403409 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1163/2394] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:34 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 328 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:34.450024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:34.450871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:34.466998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.468530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.470875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.472001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:34.472821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:34.474252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.589385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.598728 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3a1c74b-1c43-4385-a5bb-bf2779f10608 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1275 microversion: 2.1 time: 0.154694 Oct 04 18:15:34.599674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1232/2395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:34 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:34.627046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1654077534", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:34.692909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:35.160830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:35.163739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:35.167012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:35.171215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:35.171215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:35.194183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.194183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.194183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.198074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.198582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.199029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.253381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:35.273238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for user 215ac762522b43c184cedb1e9344dbec and project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:35.304948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.utils [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] instances quota exceeded for 6354a249ac1641b7940854b0ed0a11e4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:15:35.305791 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Request method failure captured: Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 145 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhBU3T3Dgq7yJ7VU0_4Sc2vcPpk8DQ7zegRRlLmHMmJNPCAmstBvbVaitdfEEGPzWcaYU7ODpq3FRi7XvBMDSbxq2hzq5TL6GU7W3CFsK41OxlUVZUKetI-FciShxiRnpyF14JVJMUNPFNY4ptgbAsIXbQcRLqZCiJinnWYJB-6mc0 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6354a249ac1641b7940854b0ed0a11e4"}]}] Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 215ac762522b43c184cedb1e9344dbec Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1654077534", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1654077534', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452'}}} Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:35.317526 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:35.325243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:35.330588 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5573349-675f-4260-928e-d55e42eee476 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.708619 Oct 04 18:15:35.338188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1164/2396] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:34 2022] POST /compute/v2.1/servers => generated 119 bytes in 717 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:35.356416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.356416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.359826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.360327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.360833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.361584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.362227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.362843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.430119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1523606209", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ec625e81-ca91-4a0a-9548-0d29505e29b1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:35.542568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] validate_networks() for [('ec625e81-ca91-4a0a-9548-0d29505e29b1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:35.772387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:35.790406 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-39041d31-3134-4c11-921c-4b27a046ace3 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1470 microversion: 2.1 time: 0.444461 Oct 04 18:15:35.792640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1165/2397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1470 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.809343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9008f0e790>, body: {"quota_set": {"instances": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:36.270127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.270127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.276234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.277583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.278096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.288138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.381035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:36.558863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97f5bf1f-809b-40ff-95f6-23561a041ae4 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 329 microversion: 2.1 time: 0.765015 Oct 04 18:15:36.562134 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1166/2398] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:35 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 329 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:36.580801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:36.580801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:36.601403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.602245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.602757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.603511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.603980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.604408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.943282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.957127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-706de679-5051-45d3-94b1-05e284d40fbf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.393289 Oct 04 18:15:36.958500 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1167/2399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:36.963747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03a34299-34af-4e9b-9012-4d415dd4dc12 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Calling method '.version_select at 0x7f900998e4c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.061587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:37.062420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:37.062915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:37.063325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:37.063981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:37.075706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.075706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.075706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.076758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.077225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.077656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.098874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:37.104590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for user fbeab59f52ec46f69af37842f5475896 and project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:37.120370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:37.122953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:37.314757 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03a34299-34af-4e9b-9012-4d415dd4dc12 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 371 microversion: 2.1 time: 0.354838 Oct 04 18:15:37.318935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-388a27d8-f073-4e3c-be66-c88d95a29f15 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165429 Oct 04 18:15:37.319735 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1233/2400] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:37.326881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1168/2401] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:37.327374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9009a76d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:37.330786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.340901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:37.370639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.371128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.375682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.376503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.377164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.377782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.433090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:37.977438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.978639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.979726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.981477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.982122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.982988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.147289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.160287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5113220c-26eb-40f6-9af6-27c7d563d896 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1463 microversion: 2.1 time: 0.834366 Oct 04 18:15:38.160914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1234/2402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1463 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.163996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed64a429-41af-4073-995c-a70d60b6a592 tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 325 microversion: 2.1 time: 0.831959 Oct 04 18:15:38.164725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1169/2403] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:37 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 325 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:38.170678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b87242be-73cb-47e7-9b68-37a7883d827f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.171312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b87242be-73cb-47e7-9b68-37a7883d827f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.182181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.183089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.190451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.195024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.198008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.198008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.198008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.198008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.327843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b87242be-73cb-47e7-9b68-37a7883d827f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.338226 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b87242be-73cb-47e7-9b68-37a7883d827f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1225 microversion: 2.1 time: 0.174845 Oct 04 18:15:38.340081 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1235/2404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.491694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.507525 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-612c68a1-2747-4eb4-be84-3fe774a69a91 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.341027 Oct 04 18:15:38.508349 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1170/2405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.515125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1703995794", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:38.631815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:38.683953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.684719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.707157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.708719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.711035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.712977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.714009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.715451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.069772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:39.071694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:39.073975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:39.074621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:39.075574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:39.109616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.110725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.111649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.112670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.113352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.114349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.120048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51be3bf7-5b48-4cd6-b980-2df0199c0236 tempest-MigrationsAdminTest-1110276756 tempest-MigrationsAdminTest-1110276756-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1616 microversion: 2.1 time: 0.778482 Oct 04 18:15:39.134674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1236/2406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1616 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:39.147396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7077f5-a183-4fd9-8d2d-b1a132946077", "tag": "ed47b897-8e6e-4605-81c2-97ebca96634d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:39.162355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.164538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:39.166913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.172744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.180414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Getting quotas for user 215ac762522b43c184cedb1e9344dbec and project 6354a249ac1641b7940854b0ed0a11e4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:39.202866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] Creating event network-changed:ed47b897-8e6e-4605-81c2-97ebca96634d for instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 on n-h2-833090-21 Oct 04 18:15:39.209355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.utils [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] ram quota exceeded for 6354a249ac1641b7940854b0ed0a11e4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 18:15:39.212144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:15:39.218510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2751a15b-641f-4a6e-9b00-af8057c74cde req-70f2a96a-117c-46f1-a39b-9c15103ae24f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086253 Oct 04 18:15:39.218510 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1237/2407] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:39.221077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Request method failure captured: Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 145 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhBU3T3Dgq7yJ7VU0_4Sc2vcPpk8DQ7zegRRlLmHMmJNPCAmstBvbVaitdfEEGPzWcaYU7ODpq3FRi7XvBMDSbxq2hzq5TL6GU7W3CFsK41OxlUVZUKetI-FciShxiRnpyF14JVJMUNPFNY4ptgbAsIXbQcRLqZCiJinnWYJB-6mc0 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6354a249ac1641b7940854b0ed0a11e4"}]}] Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 215ac762522b43c184cedb1e9344dbec Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1703995794", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1703995794', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452'}}} Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:15:39.221468 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 18:15:39.225811 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:39.230656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.242324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:39.243686 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5371e485-aa50-45dd-8587-51c13d3fd953 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.733792 Oct 04 18:15:39.244645 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1171/2408] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 735 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:39.252257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.252762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.262787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.262787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.262787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.262787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.263236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Action: 'update', calling method: .version_select at 0x7f9009043a60>, body: {"quota_set": {"ram": 51200}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:39.293519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:39.774448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.775664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.775791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.776534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.777170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.777865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.809612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59cf7c3c-c63e-4460-b75b-a53930328aac tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 204 len: 0 microversion: 2.1 time: 0.593246 Oct 04 18:15:39.811306 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1238/2409] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:39 2022] DELETE /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:39.818081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.821321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.847812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.852676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.853317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.857555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.858557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.858996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.010055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.033472 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c7a3c0f-b979-49b0-8d8a-226b0e15fb90 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1229 microversion: 2.1 time: 0.220700 Oct 04 18:15:40.044374 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1239/2410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1229 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.053607 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b182aa5d-db08-469e-89ce-731c1ed0298c tempest-QuotasAdminNegativeTest-1121135047 tempest-QuotasAdminNegativeTest-1121135047-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 200 len: 329 microversion: 2.1 time: 0.803832 Oct 04 18:15:40.055581 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1172/2411] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:39 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 329 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:40.068502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.070511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.078800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.079320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.082883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.083381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.083853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.088037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.088580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.089029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.099578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.100446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.101049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.102232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.114153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.115740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.392930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.408606 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f9c4f40-d9c0-4d08-8865-1df50380ece4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1469 microversion: 2.1 time: 0.335944 Oct 04 18:15:40.410024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1173/2412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1469 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.425296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-861806bc-5411-4591-a3e6-041dd409e216 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Action: 'update', calling method: .version_select at 0x7f9009043d30>, body: {"quota_set": {"ram": 0}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:40.440621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-861806bc-5411-4591-a3e6-041dd409e216 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '215ac762522b43c184cedb1e9344dbec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6354a249ac1641b7940854b0ed0a11e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-861806bc-5411-4591-a3e6-041dd409e216 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Request method failure captured: Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 HTTP/1.1 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 25 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhBU3T3Dgq7yJ7VU0_4Sc2vcPpk8DQ7zegRRlLmHMmJNPCAmstBvbVaitdfEEGPzWcaYU7ODpq3FRi7XvBMDSbxq2hzq5TL6GU7W3CFsK41OxlUVZUKetI-FciShxiRnpyF14JVJMUNPFNY4ptgbAsIXbQcRLqZCiJinnWYJB-6mc0 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6354a249ac1641b7940854b0ed0a11e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6354a249ac1641b7940854b0ed0a11e4"}]}] Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6354a249ac1641b7940854b0ed0a11e4 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2039534401 Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 215ac762522b43c184cedb1e9344dbec Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-QuotasAdminNegativeTest-2039534401-project Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: {"quota_set": {"ram": 0}} Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6354a249ac1641b7940854b0ed0a11e4', 'body': {'quota_set': {'ram': 0}}} Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:15:40.448621 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-861806bc-5411-4591-a3e6-041dd409e216 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:40.453308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-861806bc-5411-4591-a3e6-041dd409e216 tempest-QuotasAdminNegativeTest-2039534401 tempest-QuotasAdminNegativeTest-2039534401-project] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4" status: 403 len: 116 microversion: 2.1 time: 0.037705 Oct 04 18:15:40.454805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1174/2413] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:15:40 2022] PUT /compute/v2.1/os-quota-sets/6354a249ac1641b7940854b0ed0a11e4 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:40.500886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.510443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa97fb0a-5c15-4b6e-aece-baa31938ba1c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.464708 Oct 04 18:15:40.511047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1240/2414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.822496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-plugged", "status": "completed", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:40.861169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.864877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.865600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.899822 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] Creating event network-vif-plugged:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:15:40.907567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e6de0eda-fa07-48b5-9986-e7c12ad64ac0 req-83b89e38-5a2e-46f5-a543-7f379422d5fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089449 Oct 04 18:15:40.908672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1175/2415] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:41.070065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.070920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.082539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.083148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.083627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.084348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.086812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.086812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.242808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.252525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92364445-27f1-4cff-9110-c7ab21b21163 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1229 microversion: 2.1 time: 0.187796 Oct 04 18:15:41.268165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1241/2416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1229 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.440942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.440942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.444794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.445373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.445905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.447006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.447611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.448148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.534073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.535367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.542983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.543854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.544410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.545949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.546496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.547004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.047652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.079077 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2fd4e388-eacf-4f70-996e-11e35fc4d073 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.549832 Oct 04 18:15:42.102096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1242/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:42.115296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.130542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f20f013f-5944-4c4e-b363-f2c0a20190cb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1469 microversion: 2.1 time: 0.699029 Oct 04 18:15:42.139969 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1176/2418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.277736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.307169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.393564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.408645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f98f0b0-d787-4944-ab51-5241002a0d1c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1277 microversion: 2.1 time: 0.134814 Oct 04 18:15:42.409265 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1243/2419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.896897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2638bc03-f8b5-4b74-860d-6e2a363bb1b8", "name": "network-vif-deleted", "tag": "0cf34669-23b7-46a6-835b-1c056a0fca6d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:42.928366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.947142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.950422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.016804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] Creating event network-vif-deleted:0cf34669-23b7-46a6-835b-1c056a0fca6d for instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 on n-h1-833090-21 Oct 04 18:15:43.041086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-8d79ad7f-b912-4cc5-a158-653941cc9b94 req-44e77b35-69fd-42c4-9d61-ccd18e7dde3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151665 Oct 04 18:15:43.041494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1177/2420] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:43.114463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.115184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.135776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.143314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.143314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.143314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.143314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.143314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.165144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.166469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.169907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:43.183057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.184988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.186914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.189306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.189939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.190474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.286657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.305448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40d4de9e-d815-4fe2-ad3c-1f4aa6aa7cc0 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1427 microversion: 2.1 time: 0.144688 Oct 04 18:15:43.306277 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1178/2421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.433954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.434855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.467314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.468068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.468693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.470415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.471199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.472056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.581969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.597824 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50bd0300-825e-4b8f-b47a-7decf42b0def tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1295 microversion: 2.1 time: 0.168530 Oct 04 18:15:43.600579 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1179/2422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1295 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:43.685884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.693359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fea530e3-53af-4c73-b405-3434ec65c373 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.582274 Oct 04 18:15:43.698007 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1244/2423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:44.337650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.339133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.358811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.362583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.377550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.380614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.381694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.382153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.449342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.451179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.452631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.453404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lazy-loading 'fault' on Instance uuid 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:44.527157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:44.541696 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85c5a888-2263-4082-9d35-bd2bd9a0f2b4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 200 len: 1303 microversion: 2.1 time: 0.213491 Oct 04 18:15:44.555501 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1180/2424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 1303 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:44.628581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.629795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.638096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:44.646981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.651443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.652267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.653735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.655059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.656783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.725317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.738860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.755113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.755662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.756104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.761048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.761784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.762400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.073659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.077533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:45.089984 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c2b78f8-0274-4744-a988-a04ef10a1447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.375773 Oct 04 18:15:45.090589 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1181/2425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:45.442799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.457984 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40d44fcf-d924-432d-aa5c-c60fa36e9585 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.830631 Oct 04 18:15:45.457984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1245/2426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:45.572025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.575746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 2638bc03-f8b5-4b74-860d-6e2a363bb1b8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.622838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.625840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.626405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.627743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.631089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.631672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.670973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] HTTP exception thrown: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Request method failure captured: Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 HTTP/1.1 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHb3oySNBCCmOknp0Poz6dFELzsWb_1Cxn3oNLX_b0_rNH_JfWmgQFhUMlWmVTDCcf0uTCV8gGbNPo0VL2wXUAW5c6BKBk0-GV6Aij5MqcL3-y_T26AeOAKurVyrO3lHYzJNipik2NKuzIqP-6LzX6ikJen1JjIwFpoDPjmJmb5kId0 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7343997cd9d4767ab6ce8b664897a0b"}]}] Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-MigrationsAdminTest-877036578-project Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 222a0ff5ff3f454ab8cb2e8774cb7398 Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-MigrationsAdminTest-877036578-project Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2638bc03-f8b5-4b74-860d-6e2a363bb1b8'} Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:45.677460 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Returning 404 to user: Instance 2638bc03-f8b5-4b74-860d-6e2a363bb1b8 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:45.685382 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94afc463-ffc8-43fc-9dbb-6a4d936d17b9 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8" status: 404 len: 111 microversion: 2.1 time: 0.115248 Oct 04 18:15:45.689092 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1182/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:45 2022] GET /compute/v2.1/servers/2638bc03-f8b5-4b74-860d-6e2a363bb1b8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:45.697624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:45.704058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:45.710035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.716529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.717975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.719304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:45.719975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:45.720643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.776931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:46.118519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.119451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.130469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.130977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.131419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.134954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.135559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.135970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.321008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93027411-619c-4501-823a-3ae02eca3869 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 204 len: 0 microversion: 2.1 time: 0.627203 Oct 04 18:15:46.325416 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1246/2428] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:45 2022] DELETE /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:15:46.333910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.334734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.353454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.356525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.356983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.361473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.363075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.366621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.399566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.408227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df67da84-0b1c-40c9-b12b-14698cb78055 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.293703 Oct 04 18:15:46.408829 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1183/2429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:46.480594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.481249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.490284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.490757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.491624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.501142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.501142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.501142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.637342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.649729 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ecc7e2a-3676-4b0c-99d4-8bca72756944 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1535 microversion: 2.1 time: 0.322648 Oct 04 18:15:46.651946 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1247/2430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1535 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.689338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.695254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33d25d52-63bb-4c9b-af9e-1fac35e8646e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.218997 Oct 04 18:15:46.708748 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1184/2431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.749989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7077f5-a183-4fd9-8d2d-b1a132946077", "name": "network-vif-plugged", "status": "completed", "tag": "ed47b897-8e6e-4605-81c2-97ebca96634d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:46.756335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.757921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.758559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.808935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] Creating event network-vif-plugged:ed47b897-8e6e-4605-81c2-97ebca96634d for instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 on n-h2-833090-21 Oct 04 18:15:46.827163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e9dcd35e-6bf4-4b2a-b36f-7f5b9cce56d8 req-f391d765-035a-4154-85d6-0433683087a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088658 Oct 04 18:15:46.828836 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1248/2432] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:47.436453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.437639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.446828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.447654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.448267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.449189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.450215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.450799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.597640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:47.608918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41546eb5-fe7b-48aa-82ed-9be27c4d79c5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.179779 Oct 04 18:15:47.610032 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1185/2433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:47.681841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:47.688117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.689152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.702314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.703196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.703668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.704385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.704838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.705285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.723266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.723919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.744407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.744933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.745380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.746143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.746566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.746989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.059739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.072452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d267575b-08e8-4520-85f7-632eeee28967 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.354727 Oct 04 18:15:48.073375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1186/2434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:48.078832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c38b75c-a1ce-4964-a760-411bc6abebba", "tag": "188a7be6-0f5f-412d-8ec9-0a8e13668c3e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:48.094045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.094644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.095282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.109710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] Creating event network-changed:188a7be6-0f5f-412d-8ec9-0a8e13668c3e for instance 5c38b75c-a1ce-4964-a760-411bc6abebba on n-h1-833090-21 Oct 04 18:15:48.114888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a9c3cee7-43ca-4a66-bb3b-916f6c3bb942 req-0a2b3244-323f-450f-b526-4a905d6a65f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040280 Oct 04 18:15:48.115529 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1187/2435] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:48.216024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.241458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b53da65a-43f6-4474-8aae-80f4a4234d25 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1535 microversion: 2.1 time: 0.556945 Oct 04 18:15:48.245341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1249/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1535 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:48.638492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.640539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.643904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:48.649700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.650401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.651019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.651917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.652596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.653027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.678121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:48.830095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1349467179", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:48.902372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:49.169642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:49.170326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:49.170809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:49.171226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:49.171735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:49.184832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.185336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.186024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.186939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.187617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.188055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.207302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:49.213312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for user f2cfa0ac146a4d7894fccd9bc792b50a and project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:49.227770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:49.230258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:49.234949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.243492 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34025443-a905-4657-abed-37bec39891ec tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1317 microversion: 2.1 time: 0.611923 Oct 04 18:15:49.247853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1250/2437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.254562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.256503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.268163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.268710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.269866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.270599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.271036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.271460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.409652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8fb9410a-59bc-4a17-a8de-f9816895a4a0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802218 Oct 04 18:15:49.426796 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1188/2438] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:49.440716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.441510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.449912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.450876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.453482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.454437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.455087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.458865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.548464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.563671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cc7a5bb-9a70-4f04-bf3b-16168a400dfb tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1493 microversion: 2.1 time: 0.130438 Oct 04 18:15:49.570574 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1189/2439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1493 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.601312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-541646971", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:49.664514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.680196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:49.684387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2fb7b254-4c16-4e22-ba65-f9d3fe342a4d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.435229 Oct 04 18:15:49.696413 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1251/2440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:49.983458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:49.989791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:49.989791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:49.989791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:49.989791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:49.997673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.998327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.999404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.000286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.000988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.001708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.032672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:50.039906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for user f2cfa0ac146a4d7894fccd9bc792b50a and project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:50.060286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:50.063528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:50.140923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e75e31-a91c-471b-8d45-6425b70eebba", "name": "network-vif-deleted", "tag": "34cd7215-a553-412b-a9e9-d7649243f2fb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:50.182348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.183616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.184265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.203913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] Creating event network-vif-deleted:34cd7215-a553-412b-a9e9-d7649243f2fb for instance 06e75e31-a91c-471b-8d45-6425b70eebba on n-h1-833090-21 Oct 04 18:15:50.214637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6b83379d-7650-45ad-b08c-6c05f7a99d7d req-e0ecba2c-fd84-457b-b340-3d95afce4c92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078826 Oct 04 18:15:50.215405 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1252/2441] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:50.277383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.278295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.296693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.297275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.297889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.299012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.299380 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f83aa828-01eb-4aaa-96d9-0486116735b3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721262 Oct 04 18:15:50.299686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.300185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.301385 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1190/2442] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:50.325311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59cbce04-32c5-4847-8d8d-1522f4257591 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.327439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59cbce04-32c5-4847-8d8d-1522f4257591 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.405361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59cbce04-32c5-4847-8d8d-1522f4257591 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.415260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59cbce04-32c5-4847-8d8d-1522f4257591 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1213 microversion: 2.1 time: 0.105873 Oct 04 18:15:50.416720 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1191/2443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:50.587130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.587838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.598980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.599531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.600385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.601431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.602089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.602769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.647399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.649105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.649843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.650524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lazy-loading 'fault' on Instance uuid 06e75e31-a91c-471b-8d45-6425b70eebba {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:50.708568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.725832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b304388-64ff-4c8d-8d64-7a6e02f4e112 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 200 len: 1369 microversion: 2.1 time: 0.139659 Oct 04 18:15:50.725832 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1192/2444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 1369 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:50.728637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.729584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.745685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.746332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.746859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.747754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.749232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.749943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.972439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.980593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62897c3a-d07f-4f1f-99ff-548881b1c330 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.256465 Oct 04 18:15:50.996517 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1193/2445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:51.056619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.068521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f1f43f8-8a7e-480b-bf65-e2874e01f65d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1507 microversion: 2.1 time: 0.805583 Oct 04 18:15:51.083491 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1253/2446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1507 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:51.098560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.099957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.116064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.116626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.117083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.119095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.119815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.120898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.332485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.343647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-533c6b63-db05-483d-aca9-26eda0b7d6a9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1507 microversion: 2.1 time: 0.250154 Oct 04 18:15:51.344461 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1194/2447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:51.370755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:51.372291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.381010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.381516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.381958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.382661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.383410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.384276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.443226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96cd228e-dbab-4cc7-b30f-671809c398e0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.443901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-96cd228e-dbab-4cc7-b30f-671809c398e0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.563328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:51.572574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:51.574412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:51.581456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:51.584616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:51.612019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-96cd228e-dbab-4cc7-b30f-671809c398e0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.621273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-96cd228e-dbab-4cc7-b30f-671809c398e0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1213 microversion: 2.1 time: 0.181179 Oct 04 18:15:51.625266 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1195/2448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:51.757635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.757635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 06e75e31-a91c-471b-8d45-6425b70eebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.761761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.762251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.762684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.763627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:51.764320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:51.764960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:51.785250 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] HTTP exception thrown: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Request method failure captured: Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba HTTP/1.1 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHb3oySNBCCmOknp0Poz6dFELzsWb_1Cxn3oNLX_b0_rNH_JfWmgQFhUMlWmVTDCcf0uTCV8gGbNPo0VL2wXUAW5c6BKBk0-GV6Aij5MqcL3-y_T26AeOAKurVyrO3lHYzJNipik2NKuzIqP-6LzX6ikJen1JjIwFpoDPjmJmb5kId0 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7343997cd9d4767ab6ce8b664897a0b"}]}] Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-MigrationsAdminTest-877036578-project Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 222a0ff5ff3f454ab8cb2e8774cb7398 Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-MigrationsAdminTest-877036578-project Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '06e75e31-a91c-471b-8d45-6425b70eebba'} Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:51.787689 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. Oct 04 18:15:51.791758 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:51.794446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Returning 404 to user: Instance 06e75e31-a91c-471b-8d45-6425b70eebba could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:51.796367 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d3aad469-490b-4532-a7be-f13f012b47f1 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba" status: 404 len: 111 microversion: 2.1 time: 0.050286 Oct 04 18:15:51.800245 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1196/2449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/06e75e31-a91c-471b-8d45-6425b70eebba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:51.817981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-518d3a8d-4748-420c-ab7d-113b8aa02686 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '.version_select at 0x7f9009a7aaf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.936809 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-518d3a8d-4748-420c-ab7d-113b8aa02686 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165692088" status: 202 len: 0 microversion: 2.1 time: 0.134652 Oct 04 18:15:51.942904 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1197/2450] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165692088 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:51.987410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.005489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.006108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.009540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.014840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.015953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.018236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.018824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.018969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.019406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.019777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.020482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.020934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.022102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.035746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.085008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b08f9dea-feaf-4f0d-bcce-81196a9e9e4d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "POST /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077/action" status: 202 len: 1109 microversion: 2.1 time: 0.719884 Oct 04 18:15:52.086578 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1254/2451] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:51 2022] POST /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077/action => generated 1109 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:15:52.112556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.113505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.128662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.129491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.130263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.131736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.132441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.132887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.507096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.527596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad39be76-fbf5-44c4-81a1-43413bb8d1bb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.517447 Oct 04 18:15:52.528761 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1198/2452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:52.546845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.560235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a07921a4-0734-4012-80d0-7d36b52a5aa7 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.453225 Oct 04 18:15:52.561680 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1255/2453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.647489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.648936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.660239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.661474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.682914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.684003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.684846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.686543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.843530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.853293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d29fc99-238f-4bbd-a7e4-d6ebd6a53893 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1209 microversion: 2.1 time: 0.210235 Oct 04 18:15:52.865726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1199/2454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.986873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b75c-a1ce-4964-a760-411bc6abebba", "name": "network-vif-plugged", "status": "completed", "tag": "188a7be6-0f5f-412d-8ec9-0a8e13668c3e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:53.017278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.017765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.042220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.074808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] Creating event network-vif-plugged:188a7be6-0f5f-412d-8ec9-0a8e13668c3e for instance 5c38b75c-a1ce-4964-a760-411bc6abebba on n-h1-833090-21 Oct 04 18:15:53.086512 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f431a4d4-7e16-4cba-8378-2c38ac769cff req-df034e60-6646-4eb1-ae73-1e511c3b1d0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104588 Oct 04 18:15:53.092220 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1256/2455] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:53.556420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.557651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.564309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.564802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.565281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.566584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.567038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.568186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.597539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.598263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.628853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.631081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.638970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.639790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.640277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.649647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.888027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.898210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:53.899587 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c06fb0d-36a1-4ddb-9797-35b4f5854fe4 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.310143 Oct 04 18:15:53.911656 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1257/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:53.923691 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30ab3f6f-2b4a-4fe5-938c-d2cb5bc6c5ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1325 microversion: 2.1 time: 0.356993 Oct 04 18:15:53.923841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.923841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.923841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.923841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.924198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.924846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.927419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.927906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.943050 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1200/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:53.951815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.952706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.960419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.960916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.961476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.962197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.962654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.963085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.963964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:54.039713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.048427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14838403-491f-459a-a8ae-ec1d1e2d4c4c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1265 microversion: 2.1 time: 0.102466 Oct 04 18:15:54.049033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1201/2458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.475101 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b83a8c05-c6b1-446b-adff-3c27bab06611 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 204 len: 0 microversion: 2.1 time: 0.563531 Oct 04 18:15:54.475101 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1258/2459] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:53 2022] DELETE /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:54.483000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.483889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.490327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.490829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.491274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.492056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.492701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.493138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.707801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.717721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59b36f52-7f35-441b-97a2-d37edc3e4473 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1467 microversion: 2.1 time: 0.239639 Oct 04 18:15:54.718492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1202/2460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1467 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.929496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.930234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.941072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.941687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.953429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.953429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.953792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.953883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.953961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.954045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.954201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.957470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.957693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.960627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.960796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.961122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.253721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.275863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03167a48-3abd-43c6-80c7-1e2997282ef8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.336964 Oct 04 18:15:55.275863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1203/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.280696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.282052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.301479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.302547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.303018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.303881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.306005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.306482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.351965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:55.395318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.403858 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-23e350b8-2840-4d38-b194-b0fc5be4e8bb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.481103 Oct 04 18:15:55.420104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1259/2462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:54 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.426160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.434262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.434262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.434262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.434686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.437114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.438049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.438893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.486161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.508243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94665247-55a9-4fc2-9bb8-bb46966504dd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1283 microversion: 2.1 time: 0.228358 Oct 04 18:15:55.510131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1204/2463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.644032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.659397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4a52333-0f73-4c32-a2a8-bf2b9473072c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.237872 Oct 04 18:15:55.664131 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1260/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.686534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84e89b77-466f-4bac-8a08-570e91559a47 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-767235874", "metadata": {"": ""}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84e89b77-466f-4bac-8a08-570e91559a47 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action HTTP/1.1 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 106 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-767235874", "metadata": {"": ""}}} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-767235874', 'metadata': {'': ''}}}} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:55.698293 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:55.704863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:55.716323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84e89b77-466f-4bac-8a08-570e91559a47 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:55.716323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84e89b77-466f-4bac-8a08-570e91559a47 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action" status: 400 len: 170 microversion: 2.1 time: 0.033523 Oct 04 18:15:55.717698 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1205/2465] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 4 18:15:55 2022] POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action => generated 170 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:55.725917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.726639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.741260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.743542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.744131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.747662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.748488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.749545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.750224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.750857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.771118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.775126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.776512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.783312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.784165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.784813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.116449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.139991 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad6569b8-17bf-4261-a5e3-8211d603d74c tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.418085 Oct 04 18:15:56.141207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1261/2466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.175176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.176178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.183459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.184511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.185121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.186040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.186655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.187582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.264644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.274157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7426de5e-8b2c-40de-80cb-3a45291e5c4a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1467 microversion: 2.1 time: 0.535695 Oct 04 18:15:56.275489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1206/2467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1467 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.427354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.428094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.439669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.440193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.440840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.441742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.442401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.443407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.506253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.515853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94d8e3ed-0d69-4e7c-b44c-60f3003d587a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.350062 Oct 04 18:15:56.517598 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1262/2468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:56.536585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.540232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.552075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.553684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.555001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.558325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.559208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.564028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.679836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.698634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:56.699404 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d2fbff9-1237-4d37-b890-57f6987c5485 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.276787 Oct 04 18:15:56.701334 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1207/2469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:56.709385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b14d4c2c-071e-4201-a147-1694fd4cf922 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1271 microversion: 2.1 time: 0.179914 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ed45118-0e0f-4355-9bd9-be1e27186145 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1369918661", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ed45118-0e0f-4355-9bd9-be1e27186145 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action HTTP/1.1 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 619 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1369918661", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:15:56.716792 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1369918661', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:56.725547 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ed45118-0e0f-4355-9bd9-be1e27186145 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ed45118-0e0f-4355-9bd9-be1e27186145 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action" status: 400 len: 938 microversion: 2.1 time: 0.016568 Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1208/2470] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 4 18:15:56 2022] POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.735859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.738041 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1263/2471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.752181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.752948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.753546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.755033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.755953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.756999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.006184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.036412 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7318bad6-8014-4aca-8f09-6dc8963ef740 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.294521 Oct 04 18:15:57.036412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1209/2472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.058612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.059240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.100336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.125127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:57.298375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.298895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.315507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.316051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.317004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.318504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.319232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.319921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.536419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.553775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6714313-d4a0-4195-8ab8-6068e1c87e71 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.505011 Oct 04 18:15:57.554705 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1264/2473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.575898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.578173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7bc0803-477b-4496-9c9f-a5b58de68427 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7bc0803-477b-4496-9c9f-a5b58de68427 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action HTTP/1.1 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 285 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.583201 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:15:57.586678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:15:57.597033 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26d44d19-73a5-439e-ab99-bf0bacef6a38 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1467 microversion: 2.1 time: 0.291780 Oct 04 18:15:57.597033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1210/2474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:57.597605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7bc0803-477b-4496-9c9f-a5b58de68427 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:57.597605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7bc0803-477b-4496-9c9f-a5b58de68427 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action" status: 400 len: 619 microversion: 2.1 time: 0.019570 Oct 04 18:15:57.597605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1265/2475] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:15:57.616869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.618099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.631436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:57.633566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.634436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.635362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.636374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.637047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.637662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.727974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.728672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.746244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.746783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.747230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.748116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.748580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.750060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.917988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.931813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dab2949c-3f15-4972-9175-6f7f77059a40 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.319033 Oct 04 18:15:57.933213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1211/2476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.942288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.944687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.966043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.967048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.967755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.969003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.969792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.970388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.403067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.414880 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94494df2-6001-4a99-8872-71e64a9efaed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.480124 Oct 04 18:15:58.420009 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1212/2477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.422059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.422694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.441387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.441896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.447444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.447444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.455052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.455380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.646769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.664926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6788cfa2-e229-4445-91d2-2007588ff034 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.944751 Oct 04 18:15:58.683448 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1266/2478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.695304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c567097-46c5-49f1-84ff-1a12ec33e568", "name": "network-vif-deleted", "tag": "e86998e2-3602-4869-870a-6287ccf9220b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.705959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.706772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.707395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.714124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.721465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] Creating event network-vif-deleted:e86998e2-3602-4869-870a-6287ccf9220b for instance 4c567097-46c5-49f1-84ff-1a12ec33e568 on n-h2-833090-21 Oct 04 18:15:58.726939 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c6a043b-a425-49f3-bc1a-d00ae3521f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.307954 Oct 04 18:15:58.727731 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-11f5354c-931b-48b8-85fc-94a6afc0587c req-56de0021-86d5-49e2-9d40-f07eab779eed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042021 Oct 04 18:15:58.727899 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1267/2479] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:58.729319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1213/2480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.743944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.743944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.749990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.750841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.751518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.754836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.754976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1169802161"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.756329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.756786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.758086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.764953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.765443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.765895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.766620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.767315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.767948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.877995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:58.887986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb849c0b-07ac-49f0-8f78-8c57bfd68cc8 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1425 microversion: 2.1 time: 0.157475 Oct 04 18:15:58.889616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1268/2481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1425 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:58.894977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:58.905465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.905947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.906395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.925653 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] Creating event network-changed:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:15:58.939321 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8df15fa8-f1d9-40ae-9bb8-62924fa46346 req-c8196c89-eef4-4f2e-93fc-d5e1439c771d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045006 Oct 04 18:15:58.941230 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1269/2482] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:59.442535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.443237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.453376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.454140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.454774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.455709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.456355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.457759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.671685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.677451 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b813ede2-2d66-429c-a2f3-722a30ffb1fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.239548 Oct 04 18:15:59.687522 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1270/2483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:59.699982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.705511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.712925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.713421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.713859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.714563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.715162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.715620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.881452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.890661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e52a101b-a80e-42ca-8a3d-46f3ca1b159c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.196365 Oct 04 18:15:59.892821 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1271/2484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:59.916051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:59.916051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:59.923122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.923913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.924358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.925065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.925526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.925951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.979617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a704d4e5-47ac-40da-a6b5-af2c0b747ce3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action" status: 202 len: 0 microversion: 2.1 time: 1.225390 Oct 04 18:15:59.979617 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1214/2485] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:58 2022] POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action => generated 0 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 18:15:59.980455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.980455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.980455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.980455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lazy-loading 'fault' on Instance uuid 4c567097-46c5-49f1-84ff-1a12ec33e568 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:59.989372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1732132687"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:59.991943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.000336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.000951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.001581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.004809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.004809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.004809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.019979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=22 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:00.028066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:00.036459 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60176e11-9504-4da5-a654-29d0a6ce1aa4 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 200 len: 1303 microversion: 2.1 time: 0.125439 Oct 04 18:16:00.038650 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1272/2486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:59 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:00.044031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Cannot 'createImage' instance 5c38b75c-a1ce-4964-a760-411bc6abebba while it is in task_state image_snapshot_pending Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action HTTP/1.1 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 85 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1732132687"}} Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot 'createImage' instance 5c38b75c-a1ce-4964-a760-411bc6abebba while it is in task_state image_snapshot_pending Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1732132687'}}} Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:16:00.046358 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5c38b75c-a1ce-4964-a760-411bc6abebba while it is in task_state image_snapshot_pending Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5c38b75c-a1ce-4964-a760-411bc6abebba while it is in task_state image_snapshot_pending Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 409 to user: Cannot 'createImage' instance 5c38b75c-a1ce-4964-a760-411bc6abebba while it is in task_state image_snapshot_pending {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-460d6209-5311-4201-b76b-fb097df3f463 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action" status: 409 len: 167 microversion: 2.1 time: 0.064251 Oct 04 18:16:00.053152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1215/2487] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:59 2022] POST /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba/action => generated 167 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:00.060326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4566d10-312e-4a39-8432-2563ce5e436b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f9008d4d160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.707151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.708403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.727165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.728083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.728753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.729532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.730045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.730486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.735416 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4566d10-312e-4a39-8432-2563ce5e436b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/images/150fefec-74cb-4dd0-86a2-363778c0d2c2" status: 204 len: 0 microversion: 2.1 time: 0.677192 Oct 04 18:16:00.735416 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1273/2488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] DELETE /compute/v2.1/images/150fefec-74cb-4dd0-86a2-363778c0d2c2 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:00.743630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.745950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.778143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.778666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.780591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.782111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.783960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.786562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.009454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.026745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eeb5015a-f8f0-449b-bc93-0f51417053a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.326973 Oct 04 18:16:01.028117 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1216/2489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.035671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bdc5e9-9598-4045-ab23-127e0d8160e9", "tag": "eb6fc8c5-7559-49e2-8747-93be3b65016f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:01.047725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.048726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.049703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.080192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] Creating event network-changed:eb6fc8c5-7559-49e2-8747-93be3b65016f for instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 on n-h1-833090-21 Oct 04 18:16:01.090864 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-972f912b-b734-449d-8b22-e8bc9dd0e29c req-571b654b-a580-40f0-a08e-399d8834ab99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058453 Oct 04 18:16:01.093960 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1217/2490] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:01.104600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.106349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.111826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.114691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.115912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.116445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.117926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.118489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.119400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.120265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b3fae46-02c0-4259-acde-ac033370bb43 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1533 microversion: 2.1 time: 0.381617 Oct 04 18:16:01.131768 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1274/2491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1533 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.139830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.140780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 4c567097-46c5-49f1-84ff-1a12ec33e568] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.155097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.157092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.157887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.159270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.161197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.162465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.196867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] HTTP exception thrown: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Request method failure captured: Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 HTTP/1.1 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHb3oySNBCCmOknp0Poz6dFELzsWb_1Cxn3oNLX_b0_rNH_JfWmgQFhUMlWmVTDCcf0uTCV8gGbNPo0VL2wXUAW5c6BKBk0-GV6Aij5MqcL3-y_T26AeOAKurVyrO3lHYzJNipik2NKuzIqP-6LzX6ikJen1JjIwFpoDPjmJmb5kId0 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7343997cd9d4767ab6ce8b664897a0b"}]}] Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MigrationsAdminTest-877036578-project Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 222a0ff5ff3f454ab8cb2e8774cb7398 Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MigrationsAdminTest-877036578-project Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4c567097-46c5-49f1-84ff-1a12ec33e568'} Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:01.199984 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. Oct 04 18:16:01.204921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:01.206963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Returning 404 to user: Instance 4c567097-46c5-49f1-84ff-1a12ec33e568 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:01.208117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15552fae-af21-4d9f-81a0-5443d219c53f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568" status: 404 len: 111 microversion: 2.1 time: 0.083228 Oct 04 18:16:01.209217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1275/2492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/4c567097-46c5-49f1-84ff-1a12ec33e568 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:01.221394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.222282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.229646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.230176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.230626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.231381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.232695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.233648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.262696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:01.456297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.464901 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b7118bc-e7da-47ea-ad9b-ba085e58f779 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.369068 Oct 04 18:16:01.465481 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1218/2493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.753885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62ebe47c-cccc-4e4f-8e96-0fe623eb678f tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 204 len: 0 microversion: 2.1 time: 0.535358 Oct 04 18:16:01.755049 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1276/2494] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:01 2022] DELETE /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:01.770739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.770739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:01.774482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=58 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:01.776904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.777437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.778046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.778763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.779223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.779697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.925021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.933215 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f11fa16b-5f37-499b-9cf7-a6dc8da56b1b tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1469 microversion: 2.1 time: 0.172275 Oct 04 18:16:01.934043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1219/2495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.058104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.060827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.066202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.067154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.068003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.068796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.069271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.069708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.154856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.156416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.168745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.169245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.170322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.172074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.172992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.173544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.238066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.247300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0de560c-1b7e-4425-8be9-297d10cacb18 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.196700 Oct 04 18:16:02.248360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1277/2496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.332303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.340970 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7edfcb1-eeb9-4c90-a5a7-afd38d6456e4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1533 microversion: 2.1 time: 0.195579 Oct 04 18:16:02.341814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1220/2497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1533 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:02.491426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.492078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.500974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.501735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.502348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.504191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.504677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.505123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.756545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.767041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b940229c-fa7e-45cb-b828-f5347f0332ba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.279123 Oct 04 18:16:02.768323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1278/2498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.958832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.959720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.975964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.976686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.977125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.977874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.978332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.978765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.185839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.194240 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8abb28d3-dda4-4c6f-bb04-7623c863ed1c tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1469 microversion: 2.1 time: 0.240564 Oct 04 18:16:03.195230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1221/2499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.270531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.271149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.277586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.278084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.278640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.279431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.280106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.280683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.369760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.370830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.379553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.380280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.381040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.381972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.382895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.383666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.413705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:03.478687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.489471 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-730c8a4e-f416-435e-87d5-f0d9ad5c578c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.222681 Oct 04 18:16:03.490247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1279/2500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.601102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.608276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a41e29b3-c40d-4342-b8f5-37fa750797ed tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1539 microversion: 2.1 time: 0.246107 Oct 04 18:16:03.612554 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1222/2501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:03.797172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.798529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.808065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.808886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.809649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.810592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.811436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.812409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.040247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.040247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b644bdc7-a031-47b6-82f9-59f43dbe7d1b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.249853 Oct 04 18:16:04.041143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1280/2502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.222744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.224296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.236926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.237611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.238220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.238981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.239733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.240175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.253318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94708d16-1b4a-4541-b15d-d186088d9a89", "name": "network-vif-deleted", "tag": "d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:04.263930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.264504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.265153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.276872 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] Creating event network-vif-deleted:d2f9a4ed-265a-4ab7-bf29-c6203b0dbbfa for instance 94708d16-1b4a-4541-b15d-d186088d9a89 on n-h2-833090-21 Oct 04 18:16:04.283402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4be84485-738a-43ff-975c-ad284fcb6feb req-1ef59744-dc5c-4dba-b4f3-3a19d83377ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033684 Oct 04 18:16:04.284277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1281/2503] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:04.316192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.326599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99f8ca32-9526-44ef-97e9-13eab84e568a tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1427 microversion: 2.1 time: 0.111374 Oct 04 18:16:04.337118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1223/2504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.516156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.517121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.529905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.531208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.533693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.535308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.537275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.540257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.639956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.641387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.649513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.650281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.650957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.651859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.652472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.653055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.882011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.893464 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd0ae0aa-53f9-4bd7-80ba-9fa0f0106561 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.382882 Oct 04 18:16:04.906614 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1282/2505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.962613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.974934 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-653c7a2d-7a4f-4169-ad7a-47bb815de55e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1534 microversion: 2.1 time: 0.339338 Oct 04 18:16:05.000188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1224/2506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1534 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:05.068821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.069548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.079270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.080093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.080746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.081567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.082230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.082919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.282786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.285463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:05.293456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dcc3d96d-4b59-40c7-b78c-89b31d2af79b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.228988 Oct 04 18:16:05.294875 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1283/2507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.295002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b75c-a1ce-4964-a760-411bc6abebba", "name": "network-vif-plugged", "status": "completed", "tag": "188a7be6-0f5f-412d-8ec9-0a8e13668c3e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:05.317947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.318446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.318888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.334569 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] Creating event network-vif-plugged:188a7be6-0f5f-412d-8ec9-0a8e13668c3e for instance 5c38b75c-a1ce-4964-a760-411bc6abebba on n-h1-833090-21 Oct 04 18:16:05.341073 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a249de9b-ee0d-4769-b097-59e0a411661f req-c0964129-a79d-404f-b004-64e9bf224035 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050142 Oct 04 18:16:05.342715 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1225/2508] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:05.353090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.353865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.365131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.365703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.372170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.372170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.372170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.372170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.407725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:05.411565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.412983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.413421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.413916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lazy-loading 'fault' on Instance uuid 94708d16-1b4a-4541-b15d-d186088d9a89 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:05.458294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222a0ff5ff3f454ab8cb2e8774cb7398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7343997cd9d4767ab6ce8b664897a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.467022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4418dbd-28df-4ee9-aee8-04e63fbb0af7 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 200 len: 1303 microversion: 2.1 time: 0.119503 Oct 04 18:16:05.467939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1284/2509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.921477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.922294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.933507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.933507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.933507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.934252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.934837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.936294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.004155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.004767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.012823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.013865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.014314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.015058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.015556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.015992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.113791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.125311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d4c85c8-da82-4f25-928c-266e2f94f5d9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.210632 Oct 04 18:16:06.140269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1226/2510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.187004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.202825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3e5b77bc-b49b-4a07-b1fc-5d5ad1a312b3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1521 microversion: 2.1 time: 0.204752 Oct 04 18:16:06.215495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1285/2511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.226198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.226706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.234006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.234618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.235263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.236021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.236599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.237295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.272569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:06.324497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.324997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.332580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.333370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.334021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.334914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.335369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.335969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.582209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.596900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ce84737-032f-48ef-a583-d2589f01af24 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.276398 Oct 04 18:16:06.608208 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1286/2512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:06.621227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.621863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] [instance: 94708d16-1b4a-4541-b15d-d186088d9a89] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.629663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.630600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.630975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.631860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.632555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.633152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.650527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] HTTP exception thrown: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Request method failure captured: Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 HTTP/1.1 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHb3oySNBCCmOknp0Poz6dFELzsWb_1Cxn3oNLX_b0_rNH_JfWmgQFhUMlWmVTDCcf0uTCV8gGbNPo0VL2wXUAW5c6BKBk0-GV6Aij5MqcL3-y_T26AeOAKurVyrO3lHYzJNipik2NKuzIqP-6LzX6ikJen1JjIwFpoDPjmJmb5kId0 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d7343997cd9d4767ab6ce8b664897a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d7343997cd9d4767ab6ce8b664897a0b"}]}] Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d7343997cd9d4767ab6ce8b664897a0b Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MigrationsAdminTest-877036578 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MigrationsAdminTest-877036578-project Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 222a0ff5ff3f454ab8cb2e8774cb7398 Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MigrationsAdminTest-877036578-project Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '94708d16-1b4a-4541-b15d-d186088d9a89'} Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:06.652551 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. Oct 04 18:16:06.657306 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:06.658915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] Returning 404 to user: Instance 94708d16-1b4a-4541-b15d-d186088d9a89 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:06.660036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab64aac0-88ed-4580-8a0d-c5075dcaf6c6 tempest-MigrationsAdminTest-877036578 tempest-MigrationsAdminTest-877036578-project] 10.222.0.40 "GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89" status: 404 len: 111 microversion: 2.1 time: 0.043777 Oct 04 18:16:06.660808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1287/2513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/94708d16-1b4a-4541-b15d-d186088d9a89 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:06.786781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ecd50841-3574-4f06-a843-6fce4466442f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 204 len: 0 microversion: 2.1 time: 0.563583 Oct 04 18:16:06.787269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1227/2514] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:06 2022] DELETE /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:06.803201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.804054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.813865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.814638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.815091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.815921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.816773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.817373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.991160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.001292 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a8ff3839-e9f1-40c8-8caa-7d1e0fb68450 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1527 microversion: 2.1 time: 0.209526 Oct 04 18:16:07.002363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1288/2515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.150797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.151582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.158765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.159590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.160221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.161143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.161831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.162452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.364475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.384073 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2c1686e-2d69-4397-b9ae-7444f8b69914 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.232151 Oct 04 18:16:07.384073 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1228/2516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.400000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bdc5e9-9598-4045-ab23-127e0d8160e9", "name": "network-vif-plugged", "status": "completed", "tag": "eb6fc8c5-7559-49e2-8747-93be3b65016f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:07.425132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.425875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.426331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.440998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] Creating event network-vif-plugged:eb6fc8c5-7559-49e2-8747-93be3b65016f for instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 on n-h1-833090-21 Oct 04 18:16:07.448998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0d06d74b-069f-4659-97b5-23e134fc2dd0 req-75b399dd-b74b-446a-a6cf-756f9d434ad0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055758 Oct 04 18:16:07.449623 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1289/2517] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:07.622623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.623314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.637605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.638079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.638529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.639752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.640379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.641125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.857750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.868846 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d81e6396-f462-4707-bca4-03095b7bff09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.250076 Oct 04 18:16:07.880676 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1229/2518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.026118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.195203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.210102 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d54de03-3478-49a6-bdf6-0fd9ce6ee4bf tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1527 microversion: 2.1 time: 0.188769 Oct 04 18:16:08.210937 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1290/2519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.402454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.403866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.411811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.414976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.414976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.414976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.414976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.414976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.606569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.615923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70fffdb3-54aa-44b3-8ee8-b1c3af40469f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.217380 Oct 04 18:16:08.616836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1230/2520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.894871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.896423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.918139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.921057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.923417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.924906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.926186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.928640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.156196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.164757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04a0f569-951a-4243-949a-ade46401362e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.274309 Oct 04 18:16:09.174628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1291/2521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.236995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.245656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.255927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.256597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.257230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.258432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.259145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.259790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.476300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-plugged", "status": "completed", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}, {"server_uuid": "5c38b75c-a1ce-4964-a760-411bc6abebba", "name": "network-vif-unplugged", "status": "completed", "tag": "188a7be6-0f5f-412d-8ec9-0a8e13668c3e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:09.490760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.491380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.492471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.510952 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Creating event network-vif-plugged:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:16:09.511936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] Creating event network-vif-unplugged:188a7be6-0f5f-412d-8ec9-0a8e13668c3e for instance 5c38b75c-a1ce-4964-a760-411bc6abebba on n-h1-833090-21 Oct 04 18:16:09.521326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-86eb73c9-eeee-4d31-bac0-cc66cf34b65f req-0cf34c1b-f717-4c20-8135-908729577822 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050330 Oct 04 18:16:09.522485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1292/2522] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:09.657023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.657023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.657360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.661631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.662174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.662700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.663652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.664282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.666822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.672423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-789b0ef6-12bb-41e0-a5f3-639e9e93c850 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1527 microversion: 2.1 time: 0.441749 Oct 04 18:16:09.693386 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1231/2523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:09.707123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.708374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.720031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.026081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.041658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91c73dbb-7980-4e8d-9524-a27ed63c572d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1313 microversion: 2.1 time: 0.404507 Oct 04 18:16:10.044371 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1293/2524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:10.052614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c38b75c-a1ce-4964-a760-411bc6abebba", "name": "network-vif-deleted", "tag": "188a7be6-0f5f-412d-8ec9-0a8e13668c3e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:10.089021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.090761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.092318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.152217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] Creating event network-vif-deleted:188a7be6-0f5f-412d-8ec9-0a8e13668c3e for instance 5c38b75c-a1ce-4964-a760-411bc6abebba on n-h1-833090-21 Oct 04 18:16:10.159780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-88c2ec35-f102-41fd-9d18-95ddc04f2c7f req-6998b52b-eb29-4697-ade0-c877f6de64bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112488 Oct 04 18:16:10.161364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1294/2525] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:10.192780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.193455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.206364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.207184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.214758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.214758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.214758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.214758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.215210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.219999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.222015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.224210 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d91c9cd4-7fb3-438d-8ed6-1301e182b0c3 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2948 microversion: 2.32 time: 0.529210 Oct 04 18:16:10.225028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1232/2526] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2948 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:10.257166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.257795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.266846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.267362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.267830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.268555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.269300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.270961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.448710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a56fea8-6ee3-4ca1-b041-569875b35551 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.197582 Oct 04 18:16:10.450098 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1233/2527] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91/os-interface => generated 1829 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:10.469574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.481276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9f7a5f63-6449-494e-8c59-d1b41714f681 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.292745 Oct 04 18:16:10.489450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1295/2528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:10.701188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.701828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.708507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.709479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.710117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.710984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.711637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.712226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.748657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.749409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.750017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.750465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lazy-loading 'fault' on Instance uuid 5c38b75c-a1ce-4964-a760-411bc6abebba {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:10.806691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.815088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0561e7f-7546-4af1-8c93-cd95dfc7d986 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 200 len: 1315 microversion: 2.1 time: 0.118950 Oct 04 18:16:10.815965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1234/2529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 1315 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.079637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.081411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.090320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.090868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.092348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.093063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.093519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.094182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.149318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.155664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.156519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Searching by: {'deleted': False, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:11.162477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.163110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.163824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.164611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.165291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.165767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.193512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:11.238475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03bf083f-619a-4a60-93da-9f6e9199db21 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.093888 Oct 04 18:16:11.239447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1235/2530] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers => generated 333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:11.268623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.273569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.280857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.282001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Searching by: {'deleted': False, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:11.289877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.292373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.305210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.314849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.315557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.316251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.326735 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-362eb365-0a06-42fa-9ac2-ce85b7935991 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1463 microversion: 2.1 time: 0.251175 Oct 04 18:16:11.332125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1296/2531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1463 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.356858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.358265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.375355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.375355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.376533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.377307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.377785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.378208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.405875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:11.466503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.477264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.478065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.478881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.667353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13688a36-bbf6-4d68-9b45-45988a3d7f7b tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.417614 Oct 04 18:16:11.669110 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1236/2532] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:11.679679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.682631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.699650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.701595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.702716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.707849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.708705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.723850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.723850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:12.015932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.024725 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2b4a186-d5d1-4212-a6fe-baf6a328d557 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.351613 Oct 04 18:16:12.029384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1237/2533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.037323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5d69b70-a13b-4f36-ad7e-f4e6690cd976 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.040977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.041172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5d69b70-a13b-4f36-ad7e-f4e6690cd976 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013544 Oct 04 18:16:12.041984 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1238/2534] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:12.046887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.047709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.049570 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95a5bcb7-cbab-4a1a-bcb7-66d6c7a9caed tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1314 microversion: 2.1 time: 0.699243 Oct 04 18:16:12.055529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.055529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.060471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.060471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.060471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.060471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.060906 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1297/2535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:12.081796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba HTTP/1.1 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba'} Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:12.083956 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4218de87-3250-48f1-b96c-4fbcbb1d1fd6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 404 len: 111 microversion: 2.1 time: 0.042524 Oct 04 18:16:12.088033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1239/2536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:12.097785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-763396ed-5713-44ba-8f97-95b462177191 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'create', calling method: .version_select at 0x7f9009a7aee0>, body: {"keypair": {"name": "tempest-keypair-1458014021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtXBz2fFdwcu0nMEkNh5pvo9mMSiQBd6egf+Emk99LrZdJXFwY084zJx7F5eqilWgHhRlv8WG9BKlqUeYliv71qpNU/Snp5Hrtg4IeWfe7wU8d/qs01je0vlDqiK9HpsA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:12.114307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-763396ed-5713-44ba-8f97-95b462177191 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for project 03dd30037d534e0d84d1803ae7466831. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:12.119908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-763396ed-5713-44ba-8f97-95b462177191 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for user fbeab59f52ec46f69af37842f5475896 and project 03dd30037d534e0d84d1803ae7466831. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:12.408316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Calling method '.version_select at 0x7f9009070940>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.411620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.412464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.413230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.438589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.439346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.439917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.455856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.456741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.457455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.467599 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-718a9d6d-223d-4d04-986c-c264020ba2be tempest-PortsAdminExtendedAttrsTestJSON-1798473263 tempest-PortsAdminExtendedAttrsTestJSON-1798473263-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.406039 Oct 04 18:16:12.474827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1298/2537] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:12.474827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.476890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.493854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.494345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.495532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.502781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.503333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.503876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.535873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:12.824108 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-763396ed-5713-44ba-8f97-95b462177191 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.730323 Oct 04 18:16:12.826720 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1240/2538] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:16:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:13.063743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.064545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.080481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.082466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.083386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.084608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.086437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.087272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.359023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5edd78d6-3d96-4558-8a92-9421f866c474 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 204 len: 0 microversion: 2.1 time: 0.888566 Oct 04 18:16:13.360277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1299/2539] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:12 2022] DELETE /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:13.366354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.368401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.388173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.388692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.389134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.389883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.390315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.390738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.558822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.569730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d91d2d15-d68f-488c-b426-b259f550b737 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.511273 Oct 04 18:16:13.570434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1241/2540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:13.579001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.579001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.584768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.585515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.586576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.587520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.588338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.588969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.669965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.681746 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b52694a0-903f-473d-adfd-4384ec3b44ad tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1463 microversion: 2.1 time: 0.320030 Oct 04 18:16:13.682626 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1300/2541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1463 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.896997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c1d238d-96f3-4671-a0ce-d3fd71a9b2e7 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] Calling method '.version_select at 0x7f900967c3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.913567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c1d238d-96f3-4671-a0ce-d3fd71a9b2e7 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.219619 Oct 04 18:16:13.915226 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1301/2542] 10.222.0.40 () {60 vars in 1226 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:16:13.920419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1754377890", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.986734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:14.023013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.039753 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e16fb213-6c6f-4706-8567-6cb5fa4b0753 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1701 microversion: 2.1 time: 0.466981 Oct 04 18:16:14.040396 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1242/2543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1701 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.047143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bcf4edd-d398-4b4e-9ec8-b72f03238001 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] Action: 'update', calling method: .version_select at 0x7f90097daaf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:14.258747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:14.259687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:14.261332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:14.261332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:14.261931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:14.273318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.293078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.295743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.295743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.295743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.295743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.309274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:14.320092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:14.332991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Getting quotas for user f2cfa0ac146a4d7894fccd9bc792b50a and project a29727966f6b4407b8f5a040b267c855. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:14.348118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:14.355408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:14.536168 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9d6550b-fe06-4b19-996a-7f3848aedcbd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619630 Oct 04 18:16:14.536865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1302/2544] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:14.548686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbd5b373-011b-4b37-b85a-9807eaa249ec tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.549451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbd5b373-011b-4b37-b85a-9807eaa249ec tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.624911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbd5b373-011b-4b37-b85a-9807eaa249ec tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.633814 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbd5b373-011b-4b37-b85a-9807eaa249ec tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1214 microversion: 2.1 time: 0.089360 Oct 04 18:16:14.635282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1303/2545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:14.692480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.701139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.703585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.704424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.705042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.706485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.707112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.708109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.850305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:14.951231 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bcf4edd-d398-4b4e-9ec8-b72f03238001 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.909222 Oct 04 18:16:14.951871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1243/2546] 10.222.0.40 () {62 vars in 1247 bytes} [Tue Oct 4 18:16:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:16:14.965647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92042cbb-dcd7-409e-bf71-b340349803ba tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] Calling method '.version_select at 0x7f90098e7dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.998953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92042cbb-dcd7-409e-bf71-b340349803ba tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.031122 Oct 04 18:16:14.998953 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1244/2547] 10.222.0.40 () {60 vars in 1226 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:16:15.010148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bee5a4a7-20ac-419e-a70d-c876c7801f97 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] Action: 'update', calling method: .version_select at 0x7f90097e59d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:15.019260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.030531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec59fe21-6c99-4ee6-83e2-0d07584c9f76 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.394013 Oct 04 18:16:15.038685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1304/2548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.070907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.071957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.079867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.086088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.086088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.086088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.086088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.086088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.424993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.432962 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3965946f-cf36-4bd2-a48b-afdd24a9b325 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1701 microversion: 2.1 time: 0.367959 Oct 04 18:16:15.433553 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1305/2549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1701 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:15.657397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91f427e8-b2f1-4b76-841e-de216e8ea33b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.658038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-91f427e8-b2f1-4b76-841e-de216e8ea33b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.760943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-91f427e8-b2f1-4b76-841e-de216e8ea33b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.783140 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91f427e8-b2f1-4b76-841e-de216e8ea33b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1214 microversion: 2.1 time: 0.129356 Oct 04 18:16:15.787213 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1306/2550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.065192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.066423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.079323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.080478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.081809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.083772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.083772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.084148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.139385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bee5a4a7-20ac-419e-a70d-c876c7801f97 tempest-QuotaClassesAdmin257Test-259509894 tempest-QuotaClassesAdmin257Test-259509894-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.138374 Oct 04 18:16:16.147826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1245/2551] 10.222.0.40 () {62 vars in 1247 bytes} [Tue Oct 4 18:16:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:16:16.459689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.460566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.472483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.473002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.474145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.474873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.476183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.476628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.486003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.499248 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee0a8857-4890-45f9-8ed9-8980e81fbb4c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.439572 Oct 04 18:16:16.518600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1307/2552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:16.608463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.624497 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7dbaf7f3-30f5-4d32-9ea1-110ce5c542b5 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1633 microversion: 2.1 time: 0.170228 Oct 04 18:16:16.636704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1246/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1633 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:16.814751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.814751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.824647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.825159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.826333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.827534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.828202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.828871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.919690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.936535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ecf36b1-48d8-4321-a10f-4c154e8b35f1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1218 microversion: 2.1 time: 0.125929 Oct 04 18:16:16.936535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1308/2554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.237008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66a274a-9580-47bb-9508-16f294d02282", "name": "network-vif-deleted", "tag": "05b1f378-866a-46aa-a5f8-0c8692896b0a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.249534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.250022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.250460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.274083 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] Creating event network-vif-deleted:05b1f378-866a-46aa-a5f8-0c8692896b0a for instance f66a274a-9580-47bb-9508-16f294d02282 on n-h2-833090-21 Oct 04 18:16:17.280895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-38e88194-58db-4489-916f-d894276a89c9 req-2759d4eb-f159-47de-88a8-3be4a5af4ddd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048877 Oct 04 18:16:17.281840 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1247/2555] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:17.527525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.530005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.530154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1666738195", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.545090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.550165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.550972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.551910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.552560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.553142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.612285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] validate_networks() for [('ec625e81-ca91-4a0a-9548-0d29505e29b1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:17.821723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.831098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37544a1b-834c-4209-a1f2-c47ccfe91772 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.308702 Oct 04 18:16:17.832438 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1309/2556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.838043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.840042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.847994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.848971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.849630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.850806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.851782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.852575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.954896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.956977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.957433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.957902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lazy-loading 'fault' on Instance uuid f66a274a-9580-47bb-9508-16f294d02282 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:18.034080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd08d70b62f4c10be4bf8f91036d8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e5bec8f09c4983ba4d512991b54b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80f69646-5f43-46b0-b8d8-365f4ab588af tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 200 len: 1358 microversion: 2.1 time: 0.219676 Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1310/2557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.230820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.272540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.283242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47f6990b-c183-41cd-b0d1-e7554a36fbe8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1266 microversion: 2.1 time: 0.216465 Oct 04 18:16:18.299444 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1311/2558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:18.478261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:18.479280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:18.479907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:18.480421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:18.481213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:18.508222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.513519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.513519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.513519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.513519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.519054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.566735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:18.582162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for user fbeab59f52ec46f69af37842f5475896 and project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:18.621610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:18.627256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:18.751515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b2154ce-dd4a-4e03-820c-4c82fa0fb1f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.226755 Oct 04 18:16:18.761244 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1248/2559] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:18.767851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f211e0df-4972-44c3-addf-586c49563151 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.769034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f211e0df-4972-44c3-addf-586c49563151 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.854120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.854719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.869633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.870196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.870636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.871337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.871818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.872792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.882310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f211e0df-4972-44c3-addf-586c49563151 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.896879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f211e0df-4972-44c3-addf-586c49563151 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1225 microversion: 2.1 time: 0.129891 Oct 04 18:16:18.897530 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1312/2560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.093041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.093041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] [instance: f66a274a-9580-47bb-9508-16f294d02282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.102773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.103320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.103761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.104551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.109227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.109984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.170398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] HTTP exception thrown: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Request method failure captured: Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 HTTP/1.1 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHf8Mqn5tsrYceZ-a2Q-k5478dgc8Wu7BFToS5QJKVUdVyu8lxo2U9rRm_3FYrrrzk_Fk5uG4eCZipCP3fQ7piSR-1Mhee3vnmE02nkJR1_cWhE3pzDdogzOQwlWbAQe0n9xqmK_aEwwVG5eUqnZz88kdFiYK0Kd7FwFXZyKT9pkCHM Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 62e5bec8f09c4983ba4d512991b54b5b Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1664592687 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62e5bec8f09c4983ba4d512991b54b5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62e5bec8f09c4983ba4d512991b54b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62e5bec8f09c4983ba4d512991b54b5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62e5bec8f09c4983ba4d512991b54b5b"}]}] Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1664592687 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 62e5bec8f09c4983ba4d512991b54b5b Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1664592687 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1664592687-project Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fd08d70b62f4c10be4bf8f91036d8c9 Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1664592687-project Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'f66a274a-9580-47bb-9508-16f294d02282'} Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.177001 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Returning 404 to user: Instance f66a274a-9580-47bb-9508-16f294d02282 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:19.182790 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04045af4-1b56-42e8-99b2-17f0eb09a0ea tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282" status: 404 len: 111 microversion: 2.1 time: 0.100013 Oct 04 18:16:19.184255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1313/2561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/f66a274a-9580-47bb-9508-16f294d02282 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:19.201788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a6ba3b6-ae34-4f13-bea0-78c7ac3724d7 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] Calling method '.version_select at 0x7f900d8b8ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.243759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.253555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50f5199d-d477-48a3-bbed-7b4f898de9c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.403206 Oct 04 18:16:19.254145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1249/2562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:19.311866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.312445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.319026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.319578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.320033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.320767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.321381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.321821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.347627 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a6ba3b6-ae34-4f13-bea0-78c7ac3724d7 tempest-ServersTestJSON-1664592687 tempest-ServersTestJSON-1664592687-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268158305" status: 202 len: 0 microversion: 2.1 time: 0.155895 Oct 04 18:16:19.348317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1314/2563] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268158305 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:19.425676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.437421 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6731acf3-9d0b-486b-b2e3-a10152274d1c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1272 microversion: 2.1 time: 0.131440 Oct 04 18:16:19.438620 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1250/2564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:19.925339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9eb5b8eb-df92-4294-bcaf-3d9674dedc62 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.926210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9eb5b8eb-df92-4294-bcaf-3d9674dedc62 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.031440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9eb5b8eb-df92-4294-bcaf-3d9674dedc62 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.044898 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9eb5b8eb-df92-4294-bcaf-3d9674dedc62 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1225 microversion: 2.1 time: 0.124296 Oct 04 18:16:20.045906 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1315/2565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.284142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.285504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.297457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.297911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.299308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.300163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.300966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.302419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.470164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.470788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.480239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.483496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.483496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.483496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.488673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.489142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.772657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.772843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.780413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60bce345-e4fb-407f-b26c-ee5dcc49bb29 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.322030 Oct 04 18:16:20.782093 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1316/2566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:20.782570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d7635b8-f4d0-49a7-aacc-651c21948e48 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1514 microversion: 2.1 time: 0.509016 Oct 04 18:16:20.783382 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1251/2567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1514 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:21.073930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.073930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.083804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:21.094099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.111862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.114227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.115038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.115544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.115987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.228930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.238038 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a05c0079-4d26-4030-a5bf-2480af110b92 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1221 microversion: 2.1 time: 0.173296 Oct 04 18:16:21.238842 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1317/2568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:21.808882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.811553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.819223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.819828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.822232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.822794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.823450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.824148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.824313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.824771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.834506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.835065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.839967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.839967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.839967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.839967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.134557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.147938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f2376afe-0d75-4449-a2e2-40a80bb8433e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.334874 Oct 04 18:16:22.149253 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1318/2569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.168650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df31d7-3900-4a55-a3a0-996cab478cc0", "tag": "34653129-08b2-4b8e-a90a-9fefa69d899f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:22.181862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.182643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.183390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.209534 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] Creating event network-changed:34653129-08b2-4b8e-a90a-9fefa69d899f for instance e5df31d7-3900-4a55-a3a0-996cab478cc0 on n-h1-833090-21 Oct 04 18:16:22.222598 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ca4b2098-c21a-490f-a827-5dee77331e2a req-ccee8afd-9cd6-4570-b749-fb2e1371bca4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071603 Oct 04 18:16:22.223789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1319/2570] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:22.250225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.263301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9a43512-862c-4f3d-bf3d-a56342b95637 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.456504 Oct 04 18:16:22.264024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1252/2571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.265396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.267237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.282203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.285172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.285172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.285172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.285172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.285172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.387715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.400971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9771b0a9-8989-47d1-81ff-e9c6e402c72f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1285 microversion: 2.1 time: 0.142150 Oct 04 18:16:22.402241 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1320/2572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.175178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.175178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.202615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.203116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.208497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.209965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.212251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.213827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.290710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.291909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.301279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.301780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.302230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.302946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.303446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.303908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.515988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.522168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.524484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-314d2e53-630d-46ed-ba61-92a87f40c3cd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.241063 Oct 04 18:16:23.525463 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1321/2573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:23.541551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.542486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.550559 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7f82dd4-61e6-4ef4-bc8f-e32152caebb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.381321 Oct 04 18:16:23.551722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1253/2574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.554374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.560213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.560213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.560213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.560213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.560213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.675568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:23.687247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b3c8db9-f151-4aaf-8591-d1ec889ce393 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1285 microversion: 2.1 time: 0.160391 Oct 04 18:16:23.700931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1322/2575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.115748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-137770989", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.194885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:24.194885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:24.194885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:24.194885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:24.194885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:24.209846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.210415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.210948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.211906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.212540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.212981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.232573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Getting quotas for project f9fd83b2456e41af834fba0b053d0e63. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:24.238816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Getting quotas for user bb3f57969b34414da047b95e70bfeb30 and project f9fd83b2456e41af834fba0b053d0e63. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:24.255248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:24.258062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:24.531411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7077f5-a183-4fd9-8d2d-b1a132946077", "name": "network-vif-unplugged", "status": "completed", "tag": "ed47b897-8e6e-4605-81c2-97ebca96634d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.532084 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ff30ace-4ed1-43d3-b19a-b3a41a95f300 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.568097 Oct 04 18:16:24.545463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:24.548863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1254/2576] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:16:24.562990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.563870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.564521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.565634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:24.586823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.610786 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] Creating event network-vif-unplugged:ed47b897-8e6e-4605-81c2-97ebca96634d for instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 on n-h2-833090-21 Oct 04 18:16:24.618712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2c76d9d5-d69f-4295-93a2-8d010e4e88a5 req-a2e0bb26-b49d-4d88-adbb-d4f386432afd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091993 Oct 04 18:16:24.621584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1323/2577] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:24.654094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.667801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.706768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.709678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.710153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.714195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.714711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.719771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.831069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.831069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.831069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.843835 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3f3681e-ea39-4841-876b-76779225b28b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "PUT /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1358 microversion: 2.75 time: 0.293555 Oct 04 18:16:24.845632 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1255/2578] 10.222.0.40 () {62 vars in 1297 bytes} [Tue Oct 4 18:16:24 2022] PUT /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:24.852182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.859254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.874657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.875229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.875867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.876608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.877218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.877979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.152974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.164032 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46b27e8c-9456-4cba-9598-58f23c6a03a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.317114 Oct 04 18:16:25.186406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1256/2579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.192743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.193643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.206830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.208186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.208920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.211504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.212079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.214104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.332095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.344796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-acb4226a-e2f7-4b42-ba08-a5d68067d105 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1283 microversion: 2.1 time: 0.156902 Oct 04 18:16:25.346425 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1257/2580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.383195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.385959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.539073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.552190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.556565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.569907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3b9351f-7075-4a5c-984d-b2bb75c88dbc tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1358 microversion: 2.75 time: 0.209738 Oct 04 18:16:25.572884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1258/2581] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:25.703113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.716556 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-381a1f73-fd51-44bc-b326-3de8185f53b6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 1.083019 Oct 04 18:16:25.730205 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1324/2582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.195777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.197068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.214256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.215503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.216226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.217267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.220133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.220888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.381087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.381705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.402912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.407060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.407670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.408479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.408942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.411600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.486971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.503221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5da3c0c3-8346-43d5-a1e5-3ce638eceb12 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.313923 Oct 04 18:16:26.516517 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1259/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.626667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.627452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.653086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.656734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.657511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.658579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.660753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.662575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.853679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.864503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.866114 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4363c9e7-0078-447d-a8e1-2031a130b100 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.489651 Oct 04 18:16:26.875870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.877314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.889199 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1325/2584] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:26.895192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.896314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.905409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.906427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.907141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.908168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.909032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.909707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.916157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:26.920816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3642d3b-a819-4b0a-99b1-1c7f53d52c30 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1362 microversion: 2.75 time: 0.309803 Oct 04 18:16:26.921505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1260/2585] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:27.213183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.223892 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d83d81a-c170-475c-b94c-d4637f3ab276 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.335248 Oct 04 18:16:27.244507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1326/2586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.528151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.530093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.537362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.538164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.538832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.539804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.540471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.541139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.895065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.895980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.908719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.911776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.914919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.914919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.915413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.915889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.922937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.969721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-547d92d1-8996-4b56-b94b-95df570351bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.445524 Oct 04 18:16:27.977879 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1261/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.999280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df31d7-3900-4a55-a3a0-996cab478cc0", "name": "network-vif-plugged", "status": "completed", "tag": "34653129-08b2-4b8e-a90a-9fefa69d899f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.051870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.052953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.053800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.080833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] Creating event network-vif-plugged:34653129-08b2-4b8e-a90a-9fefa69d899f for instance e5df31d7-3900-4a55-a3a0-996cab478cc0 on n-h1-833090-21 Oct 04 18:16:28.095148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7d69ebe5-4d8b-4d4f-b51b-2bc73b61ce6d req-acf106d9-9e6b-45c0-9137-bc2271badd4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113863 Oct 04 18:16:28.101464 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1262/2588] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:28.127961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.134300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.152417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:UPDATE=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:28.169331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.177920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.177920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.177920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.177920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.178706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.260883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.270268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.271911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.277405 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e39908f-f327-4877-bb7c-7b1a79da7724 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1410 microversion: 2.75 time: 0.174096 Oct 04 18:16:28.278494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1263/2589] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1410 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:28.285629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.286289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.292994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.293494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.294459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.295427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.295920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.296449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.301019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:28.505642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.515191 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e8aea21-779a-4219-9993-4b04b66df4a9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.235248 Oct 04 18:16:28.516168 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1264/2590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.579039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.605245 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da6dc21b-74d5-49d7-a3e1-3fe564533fa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.714131 Oct 04 18:16:28.607708 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1327/2591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.004488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.005277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.012527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.013045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.013518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.014217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.014677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.015140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.176046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d93507-4e0e-40bf-be10-624cffa9aeb1", "tag": "13fdb71b-0829-4413-bcae-73b1a1e17d37"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:29.206290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.206778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.207216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.234943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.243786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-744ecc7b-41fa-45ea-83bc-bd21fb81afc1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.244601 Oct 04 18:16:29.245956 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] Creating event network-changed:13fdb71b-0829-4413-bcae-73b1a1e17d37 for instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 on n-h2-833090-21 Oct 04 18:16:29.250720 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1265/2592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:29.253802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e16537a2-b073-42a3-b1b2-6028eac45f06 req-dc0831c3-ea47-45ec-b500-6fe784c355da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080198 Oct 04 18:16:29.253802 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1328/2593] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:29.309539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.310569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.317519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.318020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.318631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.319436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.320258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.320703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.404074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.412945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.415031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.425232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8bd5260-5b14-47f5-af76-c43c8c57640e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1416 microversion: 2.75 time: 0.117326 Oct 04 18:16:29.425232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1266/2594] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1416 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:29.544746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.545778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.552251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.552742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.553176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.554081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.554550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.555088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.630591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.631523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.638422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.638925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.640148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.640500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.641037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.641542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.789143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.799484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05c89e93-1cb2-45b5-8029-02a80aa39eeb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1314 microversion: 2.1 time: 0.259310 Oct 04 18:16:29.800558 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1329/2595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.837101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.845559 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b739fcf-9a6d-4170-842a-d2625778e8e6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.218873 Oct 04 18:16:29.846634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1267/2596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.118672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7077f5-a183-4fd9-8d2d-b1a132946077", "name": "network-vif-plugged", "status": "completed", "tag": "ed47b897-8e6e-4605-81c2-97ebca96634d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:30.124157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:30.130377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.130857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.131382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.142936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] Creating event network-vif-plugged:ed47b897-8e6e-4605-81c2-97ebca96634d for instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 on n-h2-833090-21 Oct 04 18:16:30.148040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c65e02c6-2ec0-4c65-8def-8e957f83753c req-e46e790f-f6b5-4be7-b4ca-1864b3a3039e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Oct 04 18:16:30.148698 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1330/2597] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:30.273862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.276373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.283374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.285674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.291663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.292679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.293270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.293944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.449441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.450304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.457422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.457864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.457993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.458340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.459036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.459518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.459948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.466163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8a2fde8-9e1a-4fb1-9d07-035c4509d90f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.196068 Oct 04 18:16:30.466748 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1268/2598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.566446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.576502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.577987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.583762 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-728c71d0-f54a-45ca-8a15-117ac709951b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1416 microversion: 2.75 time: 0.138602 Oct 04 18:16:30.599627 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1331/2599] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1416 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:30.824879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.825821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.832460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.832944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.833437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.834376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.835196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.835672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.871193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.872031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.878297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.878790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.879230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.880196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.880662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.881091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.990620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.999708 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d2e6daf-27f3-4f99-b1e8-7f267a4889f0 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1464 microversion: 2.1 time: 0.179015 Oct 04 18:16:31.013833 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1269/2600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.054476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.067105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b4f5bc1-2533-492b-a6d4-d0289b1f9116 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.200359 Oct 04 18:16:31.068612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1332/2601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.264542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.264542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'deleted': False, 'project_id': 'a7fa7fc1a72e44d78c99b5446389a9b5'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:31.266625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.267115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.267714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.268451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.268911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.269338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.304513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b706ce60-ef23-45e4-a719-14a35e97f896 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.279725 Oct 04 18:16:31.315927 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1270/2602] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:31.327584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.334066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'deleted': False} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:31.340602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.341566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.342089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.342695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.343198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.343575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.490402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.490617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:31.491922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.500715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.501442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.502283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.503714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.504369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.505011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.581338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.581831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.582280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.797361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.819052 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b42a5f61-1100-4d0f-b3c8-1700a3af1cf8 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.332783 Oct 04 18:16:31.832111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1271/2603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:31.843089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.844130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.851577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.852408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.853096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.854043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.854709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.855341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.948632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.958220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.959787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.965078 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3a68f03-174f-46c7-80bf-e5956cbe6b4c tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1416 microversion: 2.75 time: 0.130852 Oct 04 18:16:31.966589 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1272/2604] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1416 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:32.092808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.093908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.103301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.110101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.110101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.110101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.110101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.110101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.211811 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-167138f3-664f-42bd-917e-7c147c948299 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12321 microversion: 2.1 time: 0.888429 Oct 04 18:16:32.214034 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1333/2605] 10.222.0.40 () {58 vars in 1171 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12321 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:16:32.253751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.260453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'deleted': False, 'project_id': 'a7fa7fc1a72e44d78c99b5446389a9b5'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:32.265024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.265757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.266393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.267560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.268187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.268602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.299377 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37c13dad-6fb3-4ed1-8d6a-e684245ef0a2 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?tenant_id=a29727966f6b4407b8f5a040b267c855" status: 200 len: 15 microversion: 2.1 time: 0.049614 Oct 04 18:16:32.300264 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1334/2606] 10.222.0.40 () {58 vars in 1231 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/detail?tenant_id=a29727966f6b4407b8f5a040b267c855 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:32.324248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.332079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'tenant_id': 'a29727966f6b4407b8f5a040b267c855', 'deleted': False} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:32.337211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.338032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.338616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.339549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.340169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.340845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.388849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:32.391818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:32.400270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95ed1467-4352-4367-b3f3-2b396a0017ac tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.310918 Oct 04 18:16:32.403589 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1273/2607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:32.455391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.455899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.456329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.565901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27ed8cf3-002a-42a8-b604-e03467e478fb tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a29727966f6b4407b8f5a040b267c855" status: 200 len: 4832 microversion: 2.1 time: 0.246611 Oct 04 18:16:32.566881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1335/2608] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a29727966f6b4407b8f5a040b267c855 => generated 4832 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:32.595320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.601832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'tenant_id': 'a7fa7fc1a72e44d78c99b5446389a9b5', 'deleted': False} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:32.606640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.607482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.607950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.608890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.609355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.609784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.640314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b099075a-1cf0-483f-bacc-af30eb93973d tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a7fa7fc1a72e44d78c99b5446389a9b5" status: 200 len: 15 microversion: 2.1 time: 0.050949 Oct 04 18:16:32.640897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1274/2609] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a7fa7fc1a72e44d78c99b5446389a9b5 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:32.664916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c42b133-dd8c-4314-9c38-7a92a897e283 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.671519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c42b133-dd8c-4314-9c38-7a92a897e283 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010396 Oct 04 18:16:32.672349 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1336/2610] 10.222.0.40 () {58 vars in 1189 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:32.695490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:32.697961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.704036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.704982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.705422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.706129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.706575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.706993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.847116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.847858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.854917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.855489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.857155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.857843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.858362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.858853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.026376 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a92ad6c1-6986-4e5e-8e03-fbe0c09db2c6 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.334812 Oct 04 18:16:33.029439 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1275/2611] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:32 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:33.034864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.035997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.050324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.050888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.051343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.052333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.052848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.053343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.126845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.136611 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e59b0f16-252c-48ee-8568-b807c51b298f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1520 microversion: 2.1 time: 0.294068 Oct 04 18:16:33.151614 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1337/2612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:33.151764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.151921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.152019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.152128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.152128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a29727966f6b4407b8f5a040b267c855'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:33.152322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.159146 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-430cc459-1b6a-4ff3-8d25-9ffbc6947f39 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1437 microversion: 2.75 time: 0.129043 Oct 04 18:16:33.160654 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1276/2613] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.199346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.209220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:33.214148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.232658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.235839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.242475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.242475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.244703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.247212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.374587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:33.384243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:33.386028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:33.386619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:33.388153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:33.388646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:33.480884 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37f39217-b302-4794-827c-db9269b32a6e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.341713 Oct 04 18:16:33.482631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1338/2614] 10.222.0.40 () {58 vars in 1150 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:33.487983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.488896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.497118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.497783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.498416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.499377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.500021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.500803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.686033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.693040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.693537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.694004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.694712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.695163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.695614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.885409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.900243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.921437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.959417 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5965cf36-e4ce-4cc4-a88d-0581689a3f3b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "POST /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42/action" status: 202 len: 1494 microversion: 2.75 time: 0.754188 Oct 04 18:16:33.960655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1277/2615] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:16:33 2022] POST /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42/action => generated 1494 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 18:16:33.968446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:33.971376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.980613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.981090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.981628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.982834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.983586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.984950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.023049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:34.197145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.205949 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ddd096a0-53da-4571-9ebb-69ccd8248810 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.721976 Oct 04 18:16:34.211543 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1339/2616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.223695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.224787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.238207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.239993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.239993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.241743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.244809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.245945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.398302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.437140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.441031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.452851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b71fd5a-7889-4959-bc80-e55914bd8189 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.490768 Oct 04 18:16:34.460830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1278/2617] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:33 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:34.460830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.460830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.461496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1245ee7d-771b-4334-b45e-baaa2f880616 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.242338 Oct 04 18:16:34.463502 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1340/2618] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:34.477683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.478659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.481600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.482457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.482945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.483940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.484560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.485148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.489530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.490327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.495242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.495242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.495242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.495242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.711034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.720262 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bf99e46-45cf-4d50-b54b-e31caba4f73d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1505 microversion: 2.1 time: 0.265157 Oct 04 18:16:34.720958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1279/2619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.744147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.748518 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-788329f7-c601-463a-a061-5d64786fa3f9 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1616 microversion: 2.1 time: 0.283679 Oct 04 18:16:34.749686 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1341/2620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1616 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.756846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.766697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.768538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.769253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.771678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.772806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.772926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.773574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.774480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.780653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.781137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.781564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.782259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.782702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.783117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.035550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.046142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-612f025c-8343-4bbd-a0ca-9942ae97ada3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 200 len: 1505 microversion: 2.1 time: 0.306013 Oct 04 18:16:35.049467 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1280/2621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:35.078735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.079758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.097654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.104187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.104941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.107155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.107899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.109658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.150031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:35.170385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f22c1bf-ab57-4a1a-877f-9e4b64a99d42 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1616 microversion: 2.1 time: 0.401049 Oct 04 18:16:35.175851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1342/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1616 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:35.197318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.206140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'host': 'n-h1-833090-21', 'deleted': False} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:35.212500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.214453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.214612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.215539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.216540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.217068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.331478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:35.362763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:35.430000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-924f52b6-2c72-4ae5-91d9-491aa75e5e1f tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=n-h1-833090-21&all_tenants=1" status: 200 len: 1633 microversion: 2.1 time: 0.237204 Oct 04 18:16:35.438453 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1343/2623] 10.222.0.40 () {58 vars in 1192 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers?host=n-h1-833090-21&all_tenants=1 => generated 1633 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:35.438453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.438453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.459031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.462374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.463133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.464038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.464566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.464992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.548348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:35.622923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8157c49f-0b82-4cf2-862f-884de11c7514 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 204 len: 0 microversion: 2.1 time: 0.548428 Oct 04 18:16:35.623957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1281/2624] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:35 2022] DELETE /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:35.634018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.645381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.680750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.867771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.875915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1b0097a-8b06-4302-a052-4e9d93717851 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.443362 Oct 04 18:16:35.880808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1344/2625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.888600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.890955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.907227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.914456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.915153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.916012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.916667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.917250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.943644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a11105ac-ea5f-4191-a85a-4d9e69d93de1 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.317939 Oct 04 18:16:35.945802 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1282/2626] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:35.958390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-734598970", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "7f146417-fc63-4b83-a5ba-6d28e87ebff8"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.043370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] validate_networks() for [('7f146417-fc63-4b83-a5ba-6d28e87ebff8', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:36.103256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.116870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.118945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.127104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-85f82c23-279e-4f29-bd49-d65fff01ddc7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.245078 Oct 04 18:16:36.128227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1345/2627] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:36.134502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.137869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.146142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.146986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.147666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.148773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.149736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.150413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.661732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-352bf38c-951c-4e83-bc27-2d7525853969 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.530319 Oct 04 18:16:36.667174 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1346/2628] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:36 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:36.695665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.705166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.737593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.740517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.740517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.740983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.742240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.744098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.915840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:36.916369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:36.916865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:36.917456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:36.918017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:37.120628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:37.121233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:37.121741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:37.123035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:37.123525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:37.140917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.141417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.144942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.145946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.149408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.150047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.204551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:37.213883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for user dbf908d61d404d9bb9f84faddbe59d9d and project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:37.232559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:37.236264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:37.338196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:37.363041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.366112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.368415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.369440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.371966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.372691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.418315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70e689d0-c008-4ca2-84e4-ae355a8a2df8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 1067 microversion: 2.1 time: 0.745923 Oct 04 18:16:37.426015 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1347/2629] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:36 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 1067 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:16:37.437925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.440265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:37.451489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.451981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.456649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.467335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.467335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.467335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.487996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-922c0a5f-dcda-4d9d-bef0-295ace7e8d60 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537219 Oct 04 18:16:37.490403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1283/2630] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:37.506228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d93507-4e0e-40bf-be10-624cffa9aeb1", "name": "network-vif-plugged", "status": "completed", "tag": "13fdb71b-0829-4413-bcae-73b1a1e17d37"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:37.536990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.537381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.537824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.567078 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] Creating event network-vif-plugged:13fdb71b-0829-4413-bcae-73b1a1e17d37 for instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 on n-h2-833090-21 Oct 04 18:16:37.582278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4b917dfb-b5b2-4ba0-a5a2-35c75f4c03ca req-233a7b8f-00aa-4bf0-a28f-054a34494cfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089760 Oct 04 18:16:37.594782 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1284/2631] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:37.614749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:37.618547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:37.634929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.636655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.638160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.642889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.643585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.644195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:37.949048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.973467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:37.977818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.004270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc9d3807-46d0-4b6a-8993-6b86c1a4c16b tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.406131 Oct 04 18:16:38.009968 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1285/2632] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:37 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:38.025668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.026331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.040701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.050516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.052036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.057393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.058347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.062090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.502654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.511072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a66170d7-c44f-4d80-92a4-868e41ad6833 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.499730 Oct 04 18:16:38.525555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1286/2633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.530670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7f01f50-db85-4ab1-aa2d-6c24d76c7c63 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.531520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7f01f50-db85-4ab1-aa2d-6c24d76c7c63 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.641138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e7f01f50-db85-4ab1-aa2d-6c24d76c7c63 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.657640 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7f01f50-db85-4ab1-aa2d-6c24d76c7c63 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1217 microversion: 2.1 time: 0.130710 Oct 04 18:16:38.659426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1287/2634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.949879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.960512 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51101bad-7b4e-43a6-99f3-934331372e87 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 1.533032 Oct 04 18:16:38.961340 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1348/2635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:37 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.038022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.038641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.052688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.060785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.060785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.060785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.060785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.060785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.227042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.249440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.256133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.269056 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-468fa21e-6fbb-4311-aa72-a71bc5993d57 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.234830 Oct 04 18:16:39.269667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1288/2636] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:39.553061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.553817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.563924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.565991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.572791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.574030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.574524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.575512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.686554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.686554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.704831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.705332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.705775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.706495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.710212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.711253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.941085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.950710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c074afcc-90b2-4814-b6b3-2903f884bc0c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1221 microversion: 2.1 time: 0.269259 Oct 04 18:16:39.964214 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1289/2637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1221 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.985910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.990704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.004062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.004916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.005588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.007077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.007900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.008553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.364417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.385896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9565e433-5491-4a61-8dce-bf9811ed0794 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1325 microversion: 2.1 time: 0.405618 Oct 04 18:16:40.404746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1290/2638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:40.420008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.420628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.447849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.456713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:40.459072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.459928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.461441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.462438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.463079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.463712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.474832 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a05b2d0-97f6-4d2f-b7b5-dc52b38e3d6c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.925954 Oct 04 18:16:40.475811 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1349/2639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:40.605173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7077f5-a183-4fd9-8d2d-b1a132946077", "name": "network-vif-deleted", "tag": "ed47b897-8e6e-4605-81c2-97ebca96634d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:40.645331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.655174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.656217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.687872 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] Creating event network-vif-deleted:ed47b897-8e6e-4605-81c2-97ebca96634d for instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 on n-h2-833090-21 Oct 04 18:16:40.710527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-19310906-3012-4137-801e-f41dba237db8 req-f500b558-fef3-4180-a5df-57911a20992c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110193 Oct 04 18:16:40.712541 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1350/2640] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:40.725565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.747410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.773270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.799118 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e85b5aa7-9c7b-44ed-9c60-49ea2488100d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.392951 Oct 04 18:16:40.803165 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1291/2641] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:40.975051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.976468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.005636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.006145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.006594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.007328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.007817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.008249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.171143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.188760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29f7b665-d628-4184-84e6-1ef371652420 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1269 microversion: 2.1 time: 0.218173 Oct 04 18:16:41.190157 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1351/2642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:41.422918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.423602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.433915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.435690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.436423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.438008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.453005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.453695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.508244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.511241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.537350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.540093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.542328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.546449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.548167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.551188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.089472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.102001 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce92b6e1-4eb3-44f9-b0dd-25019b91bd27 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1521 microversion: 2.1 time: 0.688730 Oct 04 18:16:42.105931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1292/2643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1521 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.129287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.132350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.152045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.152519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.155736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.158728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.160850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.161484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.284815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.300172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.302015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.313083 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4bcb1d6-6940-45db-968a-fefee8bcfda7 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.207896 Oct 04 18:16:42.314168 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1293/2644] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:42.323675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.325440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.335294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.336370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.337386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.338599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.339132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.339759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.408984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.425636 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa735074-9245-4671-8ad5-979bc92ad129 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.930852 Oct 04 18:16:42.453389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1352/2645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.460622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.461508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.468448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:42.470975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.471762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.472948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.474054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.474702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.475820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.534154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.539187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:42.545323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-266d49af-20a7-4b29-a554-159912279be4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1521 microversion: 2.1 time: 0.229579 Oct 04 18:16:42.546227 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1294/2646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.551726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5164850-d851-499c-af5e-619a92c1349b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Action: 'create', calling method: .version_select at 0x7f90097e2e50>, body: {"keypair": {"name": "tempest-keypair-1186932488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULAX5Gz8YnnW2qD0y56flviciCoWunqK3atWMRG+yHe8utWwiflsY4nfioeczFIPPXecdD1x6sExz1d1XNCaVcQo3iqx3H1LwjpCek+e1kqgEqfxKhi39/7eej7fdu9g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:42.571306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d5164850-d851-499c-af5e-619a92c1349b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Getting quotas for project 03445077fd3049d680c7c486a7ae2472. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:42.578342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d5164850-d851-499c-af5e-619a92c1349b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Getting quotas for user e652591703a54e2abb5f322ac67f054a and project 03445077fd3049d680c7c486a7ae2472. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:42.585791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.595453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d38e04a-bc5f-4728-b130-4701c45cdffe tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1275 microversion: 2.1 time: 0.140102 Oct 04 18:16:42.597118 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1353/2647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.602489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1632321457"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:42.606124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.613044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.613864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.614485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.615388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.616095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.616834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.734658 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5164850-d851-499c-af5e-619a92c1349b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.183424 Oct 04 18:16:42.734658 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1295/2648] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:16:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:16:43.092385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa5f3058-2ccf-4ea9-8a68-ba6a8b690413 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Action: 'create', calling method: .version_select at 0x7f90099f6ca0>, body: {"keypair": {"name": "tempest-keypair-110277502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFXeFt373Qwz7BB+qTEbqRw51sokFP97K94S3R2bag9ur9k8bxj3YRP3HwZpX710U9D7jW0LR8ea9ISxGX2umuNBSU+aYxUG+5cxvmccEmVLhLMJT1DEMjSc2EBppIqsQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:43.117695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fa5f3058-2ccf-4ea9-8a68-ba6a8b690413 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for project a229d6518a42411d83024cbc09a46c14. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:43.128515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fa5f3058-2ccf-4ea9-8a68-ba6a8b690413 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for user 2ba55a6ab0e3489f952f15aa53e5f650 and project a229d6518a42411d83024cbc09a46c14. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:43.166172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aba419db-8d4d-48e8-bdc7-1b9ba229fb11 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1/action" status: 202 len: 0 microversion: 2.1 time: 0.567566 Oct 04 18:16:43.174696 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1354/2649] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:42 2022] POST /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:16:43.181345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2332388-602b-4248-94cf-b3c7523af541 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f9008ef61f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.254037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa5f3058-2ccf-4ea9-8a68-ba6a8b690413 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.324937 Oct 04 18:16:43.256932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1296/2650] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:16:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:43.345972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.346704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.353567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.354392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.354536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.358556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.358556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.358556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.441114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.452553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.454016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.460287 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cdd7596-82c0-43f6-8b49-db5ee0d456c0 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.120156 Oct 04 18:16:43.473108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1297/2651] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:43.487422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.488078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.497317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.501832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.501832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.501832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.501832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.501832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.505940 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2332388-602b-4248-94cf-b3c7523af541 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681" status: 204 len: 0 microversion: 2.1 time: 0.329439 Oct 04 18:16:43.506943 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1355/2652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] DELETE /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:43.515630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10fcf519-5733-4090-831c-4cec93d4799b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f900d7e1670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.542510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-10fcf519-5733-4090-831c-4cec93d4799b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Image not found. Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10fcf519-5733-4090-831c-4cec93d4799b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681 HTTP/1.1 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '956a9422-46bc-4854-8297-2691cd1e0681'} Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 956a9422-46bc-4854-8297-2691cd1e0681 Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:16:43.547940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 956a9422-46bc-4854-8297-2691cd1e0681 could not be found. Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:16:43.552712 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:16:43.559739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10fcf519-5733-4090-831c-4cec93d4799b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:43.563874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10fcf519-5733-4090-831c-4cec93d4799b tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681" status: 404 len: 62 microversion: 2.1 time: 0.052919 Oct 04 18:16:43.564466 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1356/2653] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:16:43.574619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.579707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.594753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.595437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.595783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.598095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.598827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.599438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.738426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.747884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94cca57b-33f9-4526-ab71-344058710c0a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.265035 Oct 04 18:16:43.765045 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1298/2654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:43.770055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.770689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.777143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.777664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.778115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.778852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.779311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.779893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.855817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.862938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad70d77b-8a88-482c-b3a7-0a17a0f898f0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1533 microversion: 2.1 time: 0.293749 Oct 04 18:16:43.873610 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1357/2655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1533 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:44.011674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.025422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f18c4382-b172-4fad-9786-2bc11b42f70a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.259162 Oct 04 18:16:44.026603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1299/2656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:44.491729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.496904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.502184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.502917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.503675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.504572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.505280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.505810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.511369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:44.678211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.697797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.701120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.709904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d3dc1798-30a3-4c5b-82d0-78178247a3c5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.222189 Oct 04 18:16:44.711401 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1358/2657] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:44.771508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.772753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.779785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.780386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.780839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.781560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.782024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.782465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.888803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.890777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.910215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.910952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.914834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.919729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.920542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.921164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.158427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.167528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa669d2e-b7cb-4f60-b521-d48256e95f07 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.399624 Oct 04 18:16:45.184335 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1300/2658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.192715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.193786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.200657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.201476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.202073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.203187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.203834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.204417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.253303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:45.428675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.442782 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3eab902-a1a4-49aa-be23-e8cd9781879a tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1533 microversion: 2.1 time: 0.558061 Oct 04 18:16:45.443934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1359/2659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1533 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:45.463499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.490130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c44f5e59-2ed5-4a13-9885-8d0b0813dd78 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.303601 Oct 04 18:16:45.494007 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1301/2660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.766011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.769187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.791500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.794131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.796101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.800278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.801648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.802593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.154892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.168906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.170394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.177810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:46.185461 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe3e312f-9a79-4fb5-93cc-24be5b8a9e21 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.432617 Oct 04 18:16:46.192793 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1360/2661] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:46.204830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.208917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.244843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.246171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.247815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.251997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.251997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.251997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.473805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.474573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.497234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.505009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.505487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.506464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.508838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.508838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.751767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.776647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7429f1d8-a26a-457f-8115-1bb2c9c816d1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.582358 Oct 04 18:16:46.783608 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1302/2662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:46.805313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.811975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.828337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.831922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.833712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.839653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.842930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.846333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.158642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.168159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:47.174531 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46d5a3bd-15d1-4133-a3cc-0d3151ae5ace tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.388491 Oct 04 18:16:47.178171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1303/2663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:47.225968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.227379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.244250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.246311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.248227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.250055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.250976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.251817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.375700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.386161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.387884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.394226 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93fa418e-ac58-4b32-a384-0e0a90dc537e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.174186 Oct 04 18:16:47.410115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1304/2664] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:47.463387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.476608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c2574117-8728-42ae-83e9-2c9bb7a92918 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1539 microversion: 2.1 time: 1.010668 Oct 04 18:16:47.477753 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1361/2665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1539 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:47.501888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1993671237", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "156a7799-98e2-48b1-9a5b-b651f51b34eb"}, {"port": "dc4eabdd-b140-47a0-9158-2dc152d32d6b", "tag": "port-1"}, {"port": "a4dc329c-14b4-4653-af03-c7ecc1d06ab1", "tag": "port-2"}, {"uuid": "8c7a0653-c227-41f1-9255-b433c426c824", "tag": "net-1"}, {"uuid": "8c7a0653-c227-41f1-9255-b433c426c824"}, {"uuid": "dfe069f3-46a8-4d87-a2d9-9d34bde4ff94", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dfe069f3-46a8-4d87-a2d9-9d34bde4ff94", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "9c8556d6-f70b-47f9-bccd-59aee0e89d77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "16ffa1bb-9b21-4186-b106-442747b28861", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "03ddc0c0-396c-456f-9860-98f4c5f29ba0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1780487265"}], "key_name": "tempest-keypair-1186932488", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:47.676149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] validate_networks() for [('156a7799-98e2-48b1-9a5b-b651f51b34eb', None, None, None, None, None), (None, None, 'dc4eabdd-b140-47a0-9158-2dc152d32d6b', None, None, None), (None, None, 'a4dc329c-14b4-4653-af03-c7ecc1d06ab1', None, None, None), ('8c7a0653-c227-41f1-9255-b433c426c824', None, None, None, None, None), ('8c7a0653-c227-41f1-9255-b433c426c824', None, None, None, None, None), ('dfe069f3-46a8-4d87-a2d9-9d34bde4ff94', '10.2.2.100', None, None, None, None), ('dfe069f3-46a8-4d87-a2d9-9d34bde4ff94', '10.2.2.200', None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:47.683211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5", "tag": "3006a4c8-263b-4b38-84c0-3cc27abbcd8a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:47.711631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.713249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.715991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.763562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] Creating event network-changed:3006a4c8-263b-4b38-84c0-3cc27abbcd8a for instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 on n-h2-833090-21 Oct 04 18:16:47.769453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f682de6b-262a-4bf8-9f1f-048c073e8618 req-c0f804af-cb28-4cc0-b7b4-19e725b27584 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091691 Oct 04 18:16:47.770436 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1362/2666] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:47.813593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.814597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.823316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.825084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.825951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.826875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.827517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.828156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.262608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.272463 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-556970a6-e4ad-4525-a4f1-59480bc52886 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.465058 Oct 04 18:16:48.273846 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1363/2667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:48.279423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.280049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.287320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.288140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.288998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.290057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.290982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.291667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.781041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.794918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e82255f6-ee14-4f22-a847-b079b04b2aab tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.519480 Oct 04 18:16:48.818186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1364/2668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:48.833978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.835457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.846860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.847673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.848262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.849060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.849900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.850063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.054638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.086077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.092186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.122285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d686eeae-7561-489b-973a-8f5a51635f3d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.297177 Oct 04 18:16:49.124465 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1365/2669] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:49.135026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.136762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.150731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.152910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.153724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.156846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.158086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.159192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.608104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.628957 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82a06862-cb16-4a9c-b6a3-11915eb99a06 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1539 microversion: 2.1 time: 0.502374 Oct 04 18:16:49.630075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1366/2670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1539 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:49.637113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.637971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.653554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.873773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.889782 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbb43ea0-58db-47e5-8fe7-6801500eb2c2 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1471 microversion: 2.1 time: 0.258222 Oct 04 18:16:49.890560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1367/2671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:49.896967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2078113112", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5e5d2489-8d3d-4d53-ac1d-edbeddaacb8a"}], "security_groups": [{"name": "tempest-securitygroup--1784541246"}], "key_name": "tempest-keypair-110277502", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:50.114938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] validate_networks() for [('5e5d2489-8d3d-4d53-ac1d-edbeddaacb8a', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:51.104090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:51.105049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:51.105829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:51.107217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:51.108296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:51.109760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for project a229d6518a42411d83024cbc09a46c14. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:51.118741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for user 2ba55a6ab0e3489f952f15aa53e5f650 and project a229d6518a42411d83024cbc09a46c14. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:51.119707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.120189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.120826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.121647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.122103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.122734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.136096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:51.136096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:51.141522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:51.141522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:51.141522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:51.145292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Getting quotas for project 03445077fd3049d680c7c486a7ae2472. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:51.151031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Getting quotas for user e652591703a54e2abb5f322ac67f054a and project 03445077fd3049d680c7c486a7ae2472. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:51.153021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.153799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.154435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.155383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.156086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.157333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.185151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for project a229d6518a42411d83024cbc09a46c14. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:51.189062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Getting quotas for user 2ba55a6ab0e3489f952f15aa53e5f650 and project a229d6518a42411d83024cbc09a46c14. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:51.206137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:51.210297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:51.343401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:51.346449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9c8556d6-f70b-47f9-bccd-59aee0e89d77',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='16ffa1bb-9b21-4186-b106-442747b28861',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03ddc0c0-396c-456f-9860-98f4c5f29ba0',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:51.517508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97b278b5-206c-4e5c-b085-7ba6f29c3119 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.625361 Oct 04 18:16:51.524775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1368/2672] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:51.531009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.533376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.540264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.541030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.541549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.542475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.542994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.543526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.752747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.769564 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-105ffb98-5eef-4a0b-bdde-a63b2e47d6de tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.243040 Oct 04 18:16:51.775869 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1369/2673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:51.782196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.784117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.814927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.816642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.817880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.828174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.829930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.830527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.950696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.972347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.975041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:51.984036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-897fd155-024a-44ed-b990-9d1142ba9e1a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.210726 Oct 04 18:16:51.985823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1370/2674] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:52.004105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d93507-4e0e-40bf-be10-624cffa9aeb1", "name": "network-vif-plugged", "status": "completed", "tag": "13fdb71b-0829-4413-bcae-73b1a1e17d37"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:52.015913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.016386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.016809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.029857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] Creating event network-vif-plugged:13fdb71b-0829-4413-bcae-73b1a1e17d37 for instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 on n-h2-833090-21 Oct 04 18:16:52.035723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f8b2ac0f-74de-4270-bd19-0a11ca934742 req-c1f5bc73-bb79-4bcb-9596-90e041781519 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048088 Oct 04 18:16:52.036573 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1371/2675] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:52.042975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.046519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.053332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.053826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.054283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.057379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.057379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.057379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.252609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.271021 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6e41242-53e5-478c-b66b-d10b08d06e28 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1534 microversion: 2.1 time: 0.232810 Oct 04 18:16:52.283508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1372/2676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1534 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.283508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.283508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.284737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.286178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.286811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.287760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.288356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.288870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.500934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.509525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c80c9f8d-89be-41b0-b794-da4f34c849cb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.236381 Oct 04 18:16:52.510489 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1373/2677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.516271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79265b49-b55a-4ada-8950-701362c1e882 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.517164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79265b49-b55a-4ada-8950-701362c1e882 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.576995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79265b49-b55a-4ada-8950-701362c1e882 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.587213 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79265b49-b55a-4ada-8950-701362c1e882 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1277 microversion: 2.1 time: 0.075263 Oct 04 18:16:52.588672 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1374/2678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1277 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.808013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.809807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:52.820900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.821697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.822458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.823715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:52.824541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:52.825281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.013045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.029216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-34755fc2-bf4c-4868-95d5-883918c648ca tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.531168 Oct 04 18:16:53.030345 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1305/2679] 10.222.0.40 () {62 vars in 1189 bytes} [Tue Oct 4 18:16:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 5534 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:16:53.038477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.039901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.042867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea6b1b02-da19-4768-a1a1-2bddc2ff0234 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.242070 Oct 04 18:16:53.043485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1375/2680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.050581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.051435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.052076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.052991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.053617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.054371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.055248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.056001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.147170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.158830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.160814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.170214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.170415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d492c151-c6d0-4103-a97c-1c61f8b90eca tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.137361 Oct 04 18:16:53.171382 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1306/2681] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:53.184001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.186265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.187974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54700a6f-368e-4697-9ad3-a202dcd03381 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1286 microversion: 2.42 time: 0.138631 Oct 04 18:16:53.191559 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1376/2682] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:53.310618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.311411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.318633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.319141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.319947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.320690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.321187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.321767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.506762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.518948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30ffd934-479e-4854-8fb3-084ec318c367 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1521 microversion: 2.1 time: 0.212854 Oct 04 18:16:53.519483 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1307/2683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.549544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.549544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.550301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.550301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.555231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.556049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.556541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.558132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.559633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.560335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.566319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.566319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.566319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.566319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.566319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.566921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.614389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:53.659410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:53.851928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:53.866320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a169597-52bc-4807-8182-ce42cc6da18f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.322379 Oct 04 18:16:53.866958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1308/2684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.875346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.876440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.886472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.888024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.888800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.889858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.890669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.891364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.009875 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8ac4367-63b3-40dc-89e1-5df31096aaa6 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 204 len: 0 microversion: 2.1 time: 0.468541 Oct 04 18:16:54.012180 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1377/2685] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:53 2022] DELETE /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:54.023413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.024327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.033040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.039551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.039551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.039551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.039551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.039551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.074809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.085370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8af8102-c0bd-4ee2-b264-aa96d7b5593f tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1273 microversion: 2.1 time: 0.216761 Oct 04 18:16:54.087028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1309/2686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:54.092950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-unplugged", "status": "completed", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:54.103328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.104009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.104537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.117503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] Creating event network-vif-unplugged:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:16:54.124052 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-73d4b51e-80eb-4dfa-a319-5486a8e63876 req-e0b10ebe-c445-4f68-8be1-489154dd58ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035259 Oct 04 18:16:54.125022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1310/2687] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:54.131296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.132443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.140349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.141135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.141794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.142853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.143514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.144110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.218043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.225762 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a9d0bcb-2070-4042-93fb-afe23b1a06d0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1527 microversion: 2.1 time: 0.208936 Oct 04 18:16:54.226350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1378/2688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:54.230888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.231773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.238049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.238718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.239328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.240289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.240896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.241513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.299422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.365554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9529b9c8-f6b0-4ed1-8979-8304625f76c0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.181146 Oct 04 18:16:54.365554 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1311/2689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:54.365554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.366134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.366363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.366482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.366482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.366482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ddb16ac-f97b-4aec-8316-ddbd54037637 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.105493 Oct 04 18:16:54.366482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1379/2690] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:54.385982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.394581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.396037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.397198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-836eab6c-e60a-4eac-bc95-5a7219f55a09 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1286 microversion: 2.42 time: 0.087604 Oct 04 18:16:54.397767 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1312/2691] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:54.894176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.894729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.903820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.904329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.904772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.905497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.905981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.906398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.070170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.077711 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0242d82b-17f5-48dc-9c8a-5aaa8f47c96a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.187682 Oct 04 18:16:55.078349 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1380/2692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:55.111536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.112163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.119709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.120305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.120942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.121738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.122214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.122641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.198648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.210746 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4af171e-55f5-4f79-ae1a-841ea2a566d6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1329 microversion: 2.1 time: 0.103276 Oct 04 18:16:55.213120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1313/2693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.249625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.250377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.257089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.258068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.258068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.258759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.259383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.259857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.390813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.391619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.401439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.402453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.405851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.407342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.408012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.408703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.432713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.449000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-692ad0fb-ce1c-4d9e-8e6a-c27605e5d1cb tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1527 microversion: 2.1 time: 0.202133 Oct 04 18:16:55.450281 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1381/2694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.466361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.467368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.474837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.475513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.476121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.477166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.477910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.478516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.550638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.559524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.561734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.566756 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d92f098b-f042-4745-bc66-2672a98e86e4 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.115113 Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1382/2695] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.584347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.653048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.663821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.665124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.666298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b26d257-17f3-4a47-a5db-97b93a1c6d1c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1528 microversion: 2.42 time: 0.097995 Oct 04 18:16:55.667196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1383/2696] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1528 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:55.711143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.720760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21bcd0f2-0604-4ea0-bb68-166ae6532cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.336722 Oct 04 18:16:55.732771 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1314/2697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:56.102536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.103204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.112291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.112777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.113211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.113910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.114359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.114780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.142565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d93507-4e0e-40bf-be10-624cffa9aeb1", "name": "network-vif-unplugged", "status": "completed", "tag": "13fdb71b-0829-4413-bcae-73b1a1e17d37"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:56.154346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.154830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.155266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.167588 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] Creating event network-vif-unplugged:13fdb71b-0829-4413-bcae-73b1a1e17d37 for instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 on n-h2-833090-21 Oct 04 18:16:56.172959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d81cbbc4-6ac3-402d-baa2-500f30308d50 req-e561f567-a00d-471a-b274-12647af1d4ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035934 Oct 04 18:16:56.174563 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1315/2698] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:56.236498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.238058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.244752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.245500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.246135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.247099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.247840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.248745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.273161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:56.276437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.285340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e75dc98c-3fc1-4298-b2ec-7daddabc6c84 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.187036 Oct 04 18:16:56.285941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1384/2699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.338881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.348326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a1723a3-b2ca-4755-80a1-9e914734f4dc tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1329 microversion: 2.1 time: 0.116010 Oct 04 18:16:56.349145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1316/2700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1329 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.474407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.475160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.484103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.484690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.485201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.485999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.486669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.487325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.600580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.601214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.606172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:56.611310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.612339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.612800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.613625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.614945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.615440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.746289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.754506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.756059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.766790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-635ad7d1-ea11-4e43-9db0-96950d2f496a tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.173383 Oct 04 18:16:56.768883 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1317/2701] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:56.793017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.793017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.793017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.793017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.793017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.793746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.799054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.799661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.897462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.912926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5852c46-2866-43d7-b8cd-7e97fca4dc82 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1527 microversion: 2.1 time: 0.443494 Oct 04 18:16:56.913563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1385/2702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1527 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.930103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.930866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.934254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.950432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.953472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.954273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.954884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.956010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.956827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.957087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.957680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.958798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9b1cf1c-943f-44b7-9b17-d70b82f6b1ef tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1576 microversion: 2.42 time: 0.190139 Oct 04 18:16:56.962501 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1318/2703] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:57.223084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.231748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-625b21a1-9831-49b2-925b-43c66a65d20d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.316824 Oct 04 18:16:57.232585 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1386/2704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.310294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.311053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.320532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.321038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.321555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.322305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.323576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.324038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.374683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.375387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.396432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.396963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.397358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.398304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.398931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.399532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.540370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.557922 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-566b5171-8077-4e98-88c9-b27a846627bb tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1335 microversion: 2.1 time: 0.186939 Oct 04 18:16:57.574966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1387/2705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:57.580196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d93507-4e0e-40bf-be10-624cffa9aeb1", "name": "network-vif-deleted", "tag": "13fdb71b-0829-4413-bcae-73b1a1e17d37"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:57.598260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.598260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.598728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.616112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] Creating event network-vif-deleted:13fdb71b-0829-4413-bcae-73b1a1e17d37 for instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 on n-h2-833090-21 Oct 04 18:16:57.625344 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4d4807b7-0d62-4c80-a307-29dcb25aa531 req-c9d32008-e983-4f6a-8333-c3e9a524d1d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045855 Oct 04 18:16:57.626347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1388/2706] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:57.685826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.698011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-676f763b-38ce-4771-a0e6-db5bd584971a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.392470 Oct 04 18:16:57.699114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1319/2707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.807623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.808425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.812324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:57.816751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.817307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.817945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.818668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.819124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.819743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.900582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.910248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.912020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.918635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7141795e-a8e4-4e19-afc1-d8bcab9823d5 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.115278 Oct 04 18:16:57.923585 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1389/2708] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:57.941005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.941739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.948063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.948767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.949919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.950711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.951177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.951689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.993410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.994282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.000936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.001431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.001868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.002576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.003032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.003480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.023894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.031963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3befcb32-61f1-4d9f-acd6-83f1928f67a9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1310 microversion: 2.1 time: 0.094933 Oct 04 18:16:58.033185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1320/2709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.145055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.158415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.160260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.161425 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f463d147-e583-4dfd-9b83-dde0e8fe2b70 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1584 microversion: 2.42 time: 0.172112 Oct 04 18:16:58.161997 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1390/2710] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1584 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:58.193150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-plugged", "status": "completed", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}, {"server_uuid": "b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5", "name": "network-vif-plugged", "status": "completed", "tag": "3006a4c8-263b-4b38-84c0-3cc27abbcd8a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:58.208584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.209334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.209984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.228968 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Creating event network-vif-plugged:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:16:58.236675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] Creating event network-vif-plugged:3006a4c8-263b-4b38-84c0-3cc27abbcd8a for instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 on n-h2-833090-21 Oct 04 18:16:58.250226 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-056db6ef-ee1b-4fd8-8a4b-b9ebc8eb40a9 req-d8e479a1-8e75-4692-9b1c-611e22c10903 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060750 Oct 04 18:16:58.250226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1321/2711] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:58.258573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.259380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.266505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.267257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.267789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.268658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.269420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.270014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.556887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.566655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad987c53-842e-4790-9a51-7e0451cff470 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.314542 Oct 04 18:16:58.568053 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1391/2712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.587908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.593280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.625918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.626971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.627820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.629239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.630083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.630875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.723547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.724311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.739824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.774689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.791097 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97d4d98c-71e8-411a-b241-8ed8ffb3bf42 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1335 microversion: 2.1 time: 0.209736 Oct 04 18:16:58.805185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1322/2713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1335 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.950751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.951849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.966768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.967581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.968731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.969620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.970659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.971251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.098931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.114116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.117121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.131076 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25eb26ca-a3dc-42b3-8ff5-a2e62dafb2af tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.185475 Oct 04 18:16:59.132419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1323/2714] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:59.165555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.165555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.178271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.180359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.182639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.183859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.185636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.187566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.190163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.192905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1640dbbe-4bd2-4b02-b94e-95539346f7a6 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1477 microversion: 2.1 time: 0.473417 Oct 04 18:16:59.193561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1392/2715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1477 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.213725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.217085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.234821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.235117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.235625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.236351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.236799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.237218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.276043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.276559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.277002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.278111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lazy-loading 'fault' on Instance uuid 19d93507-4e0e-40bf-be10-624cffa9aeb1 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:59.370407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.381426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82df937f-7a17-40d2-9bf4-402bbd6bed68 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 200 len: 1315 microversion: 2.1 time: 0.247060 Oct 04 18:16:59.382022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1324/2716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.483092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.496692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.499181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.500807 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-abb4a40a-b25a-4a89-ada7-db383f83a66a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1662 microversion: 2.42 time: 0.306300 Oct 04 18:16:59.501650 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1393/2717] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1662 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:59.595235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.595874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.607314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.609581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.610997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.612442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.613775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.615814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.821691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.823190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.844881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.845422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.847589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.850128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.854721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.856107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.888966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.899915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-acbc6e03-0a7b-4c76-a9f7-b7be6fcbfa54 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1317 microversion: 2.1 time: 0.308454 Oct 04 18:16:59.917810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1325/2718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:59.936969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:00.164537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.165257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.174820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.180732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.181303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.182152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.186129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.186689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.291717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.321935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.322268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.336536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4bf7951b-d730-4df4-a2cf-f4e0db9e1111 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.175827 Oct 04 18:17:00.337033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1326/2719] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:00.342870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.368195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.406766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.409022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.410096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.413600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.414909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.416484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.670389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.674477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.697748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb6ef0b3-b0fb-467e-b8eb-ffcf89c48270 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1463 microversion: 2.1 time: 0.359165 Oct 04 18:17:00.699830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1327/2720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:00.708752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-747cc4a8-9abb-441d-af28-b597f0f435a1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.893818 Oct 04 18:17:00.721965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.722869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.723890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1394/2721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:00.746290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.746920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.747425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.747900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.748859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.749319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.749749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.752483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.788171 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:00.789562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.790689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.791820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 HTTP/1.1 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '19d93507-4e0e-40bf-be10-624cffa9aeb1'} Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:00.793405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:00.804224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f97cb2e-f04a-47ef-ad95-5f65a3d0b0ff tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 404 len: 111 microversion: 2.1 time: 0.096227 Oct 04 18:17:00.805493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.813446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.814731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.815800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1328/2722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:00.838395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.845728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.862406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.862800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.863345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.866266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.869971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.870467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.134357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:01.171378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:01.290391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.305371 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-939bbd3d-bdd0-4291-9da1-2cfc6cbb884a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1463 microversion: 2.1 time: 0.484625 Oct 04 18:17:01.306279 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1329/2723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1463 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:01.333017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.333926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.340560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.341373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.341986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.343126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.343820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.344424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.488489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.500392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.502224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.504037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c881ee77-3a07-4791-97af-e4c93795b8df tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1709 microversion: 2.42 time: 0.778055 Oct 04 18:17:01.504943 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1395/2724] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:00 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1709 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:01.510866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-563866411", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:01.598878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] validate_networks() for [('ec625e81-ca91-4a0a-9548-0d29505e29b1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:01.733530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:01.750743 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3adc10c-4ba4-4b7a-85d8-b49a866f5269 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1506 microversion: 2.1 time: 0.443017 Oct 04 18:17:01.753314 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1330/2725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:01.760095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:01.768321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.778622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.780114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.780917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.781976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.782731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.783383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.907794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:01.908510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:01.909606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:01.910126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:01.912313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:02.157872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.166783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.167603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.168323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.169463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.170570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.171747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.214589 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b192a200-d73c-4d97-a154-3fd6201013dc tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 1067 microversion: 2.1 time: 0.459738 Oct 04 18:17:02.218810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1331/2726] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:01 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 1067 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:17:02.229545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.232449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.255759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.258692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.260307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.267775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.267775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.267775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.270477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:02.356568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.367659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.369737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.376936 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a8a919d-d284-443b-bb09-48270c063e2d tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.155648 Oct 04 18:17:02.379002 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1332/2727] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:02.382743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.383734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.391773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.392091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.392532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.393394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.393872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.394304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.684894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.693804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71413173-9361-40e7-8d68-4b062062fc22 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.315555 Oct 04 18:17:02.695075 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1333/2728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.702492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.703406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.713217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.713985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.714593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.715609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.716262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.716864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.048628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.059844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1abf68d-b8ac-4ceb-9158-e9338b067991 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1506 microversion: 2.1 time: 0.363311 Oct 04 18:17:03.060634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1334/2729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.087642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.088286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.097157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.097664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.098117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.101734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.102465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.102924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.122890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:03.124156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:03.125186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:03.129171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:03.129171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:03.147341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.148889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.150060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.151526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.153130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.153967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.194686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:03.202365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Getting quotas for user fbeab59f52ec46f69af37842f5475896 and project 03dd30037d534e0d84d1803ae7466831. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:03.224742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:03.226558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:03.369937 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83967983-064f-4e68-b415-93a6e3534e54 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.863372 Oct 04 18:17:03.370570 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1396/2730] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:03.385751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7b1cf5-7260-40b9-a210-dbd9b758a9c7", "tag": "095d6790-aa13-4f84-bc6f-27fad869ab8f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:03.414309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.415385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.416246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.452388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] Creating event network-changed:095d6790-aa13-4f84-bc6f-27fad869ab8f for instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 on n-h2-833090-21 Oct 04 18:17:03.463509 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cac159d6-010c-4073-a94f-b9135a15b190 req-707c280a-bdd4-4e92-b5bc-18fb5a04b46a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091403 Oct 04 18:17:03.466302 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1397/2731] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:03.478758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.483108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.499098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.504671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.506196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.507489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.510442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.511299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.593534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.607364 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32bbdf27-08f9-425c-9675-0c7a138b3870 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.532734 Oct 04 18:17:03.618343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1335/2732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.641001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:03.644263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.652826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.653582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.654176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.655086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.655820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.656408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.868229 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c4ad3ac-4113-4583-89c6-4f329c1d672b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "PUT /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1078 microversion: 2.1 time: 0.234027 Oct 04 18:17:03.868995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1336/2733] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:17:03 2022] PUT /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1078 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.883115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8777909a-f3d8-4cbf-b346-6995bd1514f9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.889046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8777909a-f3d8-4cbf-b346-6995bd1514f9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.977370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.977370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.980149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.980149 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05ee704c-2b7c-4091-b692-a93424e2bb0b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1756 microversion: 2.42 time: 0.509779 Oct 04 18:17:03.980581 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1398/2734] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1756 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:03.986306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.987300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.996826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.997802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.998606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.999716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.000577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.001389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.018412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8777909a-f3d8-4cbf-b346-6995bd1514f9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.054045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8777909a-f3d8-4cbf-b346-6995bd1514f9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1224 microversion: 2.1 time: 0.180079 Oct 04 18:17:04.066157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1337/2735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1224 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.084749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.085546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.102764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.103260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.103942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.104923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.108264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.109031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.318397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.328176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66974a6a-acd2-4a50-8131-fb82513df1b6 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.260345 Oct 04 18:17:04.329085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1338/2736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.335101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.336305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.348548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.349478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.349999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.352154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.354515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.355006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.583458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.606624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.613660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.631283 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d9f0f81-05d6-4e83-ada0-51a0a858b82f tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.646895 Oct 04 18:17:04.631972 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1399/2737] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:04.646069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.646679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.664476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.664979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.665485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.666227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.666814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.680726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.987148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.003806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b939562-005c-47c2-b264-a88d0678b285 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.361694 Oct 04 18:17:05.008618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1400/2738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.018854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.023573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.039054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.042292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.044958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.046366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.049718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.050197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.205494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.230542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0999fda4-163b-4726-8119-89f88f948fa5 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1504 microversion: 2.1 time: 0.899829 Oct 04 18:17:05.237156 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1339/2739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1504 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.259246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.259895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.267202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.270913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.270913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.270913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.270913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.270913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.331779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.349873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.356656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.360896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a48fe15-00e0-4ecc-889e-6038f1e99409 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1803 microversion: 2.42 time: 0.350400 Oct 04 18:17:05.361557 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1401/2740] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1803 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:05.388743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.390595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.393935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.407753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.409080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.409818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.410810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.411518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.412138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88d8d18e-aca2-4d47-be77-ffe183c8c4d9 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1228 microversion: 2.1 time: 0.156082 Oct 04 18:17:05.412483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.413620 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1340/2741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1228 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.446277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.447553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.457588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.458291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.458919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.459862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.460540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.461248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.662624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.671222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.684306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c56ba3cb-b89a-4c86-814e-e33eb2943ed2 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.249155 Oct 04 18:17:05.687822 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64198e0f-064b-409f-9f2d-1a9aabdd0dba tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1504 microversion: 2.1 time: 0.324019 Oct 04 18:17:05.689654 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1402/2742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.690756 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1341/2743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.700922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.701939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.709442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.710945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.710945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.713029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.713794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.715237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.776029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:05.780660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.801683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.805029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.806503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.808735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.809852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.811159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.855421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.866563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.869122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.876628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-faceb8c3-e72b-49e0-8b71-9a98022ecd74 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1446 microversion: 2.75 time: 0.185774 Oct 04 18:17:05.877347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1403/2744] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:05.971702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:05.972319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:05.973016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:05.973474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:05.974219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:06.039330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.040053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.051268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.051813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.052263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.053105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.053586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.058232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.261157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.269386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.270572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.271198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.272155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.272823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.273711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.316475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71c551c9-3b3e-406a-992e-0edc38837239 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "POST /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5/action" status: 202 len: 1110 microversion: 2.1 time: 0.545327 Oct 04 18:17:06.321230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1342/2745] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:05 2022] POST /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5/action => generated 1110 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 18:17:06.345213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.345872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.355843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.356697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.357050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.357791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.358345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.358969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.715116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:06.760879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a62cb735-f99c-49b6-a688-ce17e830326a tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.708964 Oct 04 18:17:06.761852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1404/2746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:06.781972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.789094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.843315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.843932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.844379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.845287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.845779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.848557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.054760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.071545 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a034fa47-cbd9-445f-bace-233dffac7857 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.734341 Oct 04 18:17:07.094440 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1343/2747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:07.110526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.111673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.119357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.121265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.122055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.123192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.124186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.125023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.248435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.270370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdb1c285-5eb2-4159-aa87-dc8c0b88e305 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1220 microversion: 2.1 time: 0.173560 Oct 04 18:17:07.274061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1344/2748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.305236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.306913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.316484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.317230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.317781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.318987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.319617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.320236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.798644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.814001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.818155 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95e36aaf-dc2f-48f7-a99c-9b79e154b230 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.535052 Oct 04 18:17:07.833402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.835523 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1345/2749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.836951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.838013 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72811a5b-f1b5-4e76-ac17-eab99f66e15d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1803 microversion: 2.42 time: 1.074561 Oct 04 18:17:07.840823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1405/2750] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:06 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1803 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:07.846139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.847006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.856826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.857740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.876730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.879073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.879834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.882952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.887998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.887998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.904898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.908293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.909307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.912623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.913327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.913945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.220671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.239285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.241430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.249486 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b077c6b3-724d-4016-a675-80d0198c0519 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1452 microversion: 2.75 time: 0.412726 Oct 04 18:17:08.275676 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1346/2751] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1452 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:08.281939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.282586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.289733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.290502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.291183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.292179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.292934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.293718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.317207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:08.595205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.604578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdc9716e-639c-4d41-a45c-586d2e66f85c tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.762592 Oct 04 18:17:08.619149 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1406/2752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.619149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.619149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.619696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.620288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.621619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.622806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.623519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.624124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.784904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.804447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75ef2029-558d-4e18-901d-a26d2c9b6f42 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1276 microversion: 2.1 time: 0.191927 Oct 04 18:17:08.809593 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1407/2753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.850876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.852387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.867193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.867763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.868221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.869051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.869756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.870545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.898249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.907087 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15a78bc1-54c7-4e62-875c-54931e7cf207 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.629913 Oct 04 18:17:08.908090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1347/2754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.929378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.929378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.931451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.932019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.932457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.936714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.940971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.941429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.246706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.260616 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e78fe00-2da7-4f06-8deb-8e57cc242055 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.413509 Oct 04 18:17:09.261819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1408/2755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:09.269776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7b1cf5-7260-40b9-a210-dbd9b758a9c7", "name": "network-vif-plugged", "status": "completed", "tag": "095d6790-aa13-4f84-bc6f-27fad869ab8f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:09.301575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.302430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.303563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.337527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] Creating event network-vif-plugged:095d6790-aa13-4f84-bc6f-27fad869ab8f for instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 on n-h2-833090-21 Oct 04 18:17:09.351722 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-61a3b925-e6d1-43bb-9ac4-0abc993405a9 req-c3a0e163-9ef4-40ba-8c4a-fbeb33d66d8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087298 Oct 04 18:17:09.355080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1409/2756] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:09.371367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.373628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.391542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.392435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.393106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.395592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.398746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.399739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.471518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.492078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.499790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.504424 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0974e5fc-1899-426a-bd46-f66df109a944 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1850 microversion: 2.42 time: 0.592003 Oct 04 18:17:09.504424 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1348/2757] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1850 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:09.588176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.599661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.602057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.620673 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62d2bca7-102e-4fbe-83b0-336b881abbb3 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1452 microversion: 2.75 time: 0.262301 Oct 04 18:17:09.622749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1410/2758] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1452 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:09.641402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.643393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.652064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.652955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.653575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.654640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.655251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.656198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.820665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.832865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.840469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.846734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22aaba60-d3cd-480c-a1da-45e19e282810 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.219433 Oct 04 18:17:09.849096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.852578 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1349/2759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:09.852866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.853879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.858360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.859596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.860254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.922673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "6001a711-fff4-4bb3-aa13-e6ffbf0fddf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:09.946123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.946653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.947098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.970355 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] Creating event network-changed:6001a711-fff4-4bb3-aa13-e6ffbf0fddf6 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:09.988548 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d3a95e85-50ee-4286-bb48-9ad9ee922f28 req-81a51ff0-442b-4461-91a4-a581c57d6657 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069653 Oct 04 18:17:09.991531 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1350/2760] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:10.004926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.010064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.018397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.019154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.019781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.020705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.021346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.021986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.229893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.240842 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d3646a8-8068-46b8-b94a-10b9c9c122c1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.247072 Oct 04 18:17:10.260277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.260430 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1351/2761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:10.264306 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-649222c4-440f-4e23-a120-195e182f37fe tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1276 microversion: 2.1 time: 0.435636 Oct 04 18:17:10.265278 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1411/2762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1276 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:10.291455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.292116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.298957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.299496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.300049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.300766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.301229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.301662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.481953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.491612 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d1ef8c7-e1c1-4a35-b440-6ac6b0387c72 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1403 microversion: 2.1 time: 0.204057 Oct 04 18:17:10.510941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1352/2763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1403 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:10.535004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.535662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.552672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.553103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.558168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.558168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.558168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.558168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.650566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.651347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.667246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.669324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.672985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.672985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.672985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.672985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.811841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.827287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.830360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.849501 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-704919f2-ade1-4a3e-a6dc-c6f011490328 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1437 microversion: 2.75 time: 0.202781 Oct 04 18:17:10.850886 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1353/2764] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1437 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:10.879575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.880491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.888819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.889799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.890688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.891637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.892208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.892749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.055651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.064020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.065945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.067294 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc1576ab-d77a-4f33-9485-c1df4748ec82 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1850 microversion: 2.42 time: 0.538324 Oct 04 18:17:11.068091 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1412/2765] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1850 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:11.314256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.330545 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cebd6f4d-97a0-4e72-8780-e43c26a348fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.455652 Oct 04 18:17:11.364609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1354/2766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.373508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.374544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.382201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:11.383867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.384740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.385964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.387885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.388718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.389080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.466081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:11.469679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.486373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.490446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.492198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.492966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.496614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.497690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.508318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:11.623349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:11.624089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:11.625183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:11.625760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:11.626339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:11.648978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.663275 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ee1d47b-1feb-4b00-8fd1-820d30a5b6f9 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.297142 Oct 04 18:17:11.682224 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1355/2767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.689438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.690173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.697808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.698400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.698959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.699864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.700470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.701023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.781629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:11.792471 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08040033-ef4a-4faa-bc6d-5f1d00335afd tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1282 microversion: 2.1 time: 0.108896 Oct 04 18:17:11.794235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1356/2768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.815194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.816692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.825290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.826078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.827321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.828708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.829362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.830025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.878376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.896543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.898293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.898763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.899551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.900015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.900446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.084089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:12.134794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea78a88a-cc69-4a81-9139-c32d5d9f9cae tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42/action" status: 202 len: 1942 microversion: 2.75 time: 1.065429 Oct 04 18:17:12.151503 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1413/2769] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:17:11 2022] POST /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42/action => generated 1942 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:17:12.153102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.154629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.181271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.184479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.185491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.187006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.188852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.190841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.285479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.295753 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82426f0c-c955-49bf-ad8e-f34b4b722809 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1589 microversion: 2.1 time: 0.499891 Oct 04 18:17:12.296657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1357/2770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1589 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:12.309440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.313085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.320899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.322858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.323305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.324974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.325443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.325873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.485462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:12.553465 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06b5c404-0b09-4df1-b2d6-ea2ad49f490d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.253530 Oct 04 18:17:12.554443 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1358/2771] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:12.574589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.575603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.581763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.582263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.582707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.583508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.583979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.584508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.587158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.604095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.607220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.608696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fdbc076b-6fc1-406d-9249-567252850e00 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1871 microversion: 2.42 time: 0.467020 Oct 04 18:17:12.623535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1414/2772] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1871 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:12.636963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.637970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.644767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.645716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.646404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.647363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.648100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.648755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.800479 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f8449ba-7bae-487b-a2ad-728e8492ee97 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244827 Oct 04 18:17:12.801085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1359/2773] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:12.805769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:12.806388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:12.820262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.821705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.823218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:12.825167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:12.825958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:12.826734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.126311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.138762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84750410-f0fe-45d6-906e-cdbfa9466a08 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.336591 Oct 04 18:17:13.139370 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1360/2774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.163787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "dc4eabdd-b140-47a0-9158-2dc152d32d6b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:13.179980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:13.188514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.190305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.190756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.212349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.217127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] Creating event network-changed:dc4eabdd-b140-47a0-9158-2dc152d32d6b for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:13.221266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=20 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:13.229243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-859171b8-694b-4056-b3fd-f5a03e4ae02c req-0861cb67-f412-4e2f-a833-35774881502c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071036 Oct 04 18:17:13.232073 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5191c08b-a624-44ad-a10e-35a793c5d25b tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.606756 Oct 04 18:17:13.232871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1361/2775] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:13.251776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.251776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.252205 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1415/2776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:12 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.260614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.261120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.263321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.264119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.264593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.275650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.579251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.583544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.583544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.593989 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61071ba8-61e5-445d-bfc7-25d49b7811ba tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.359746 Oct 04 18:17:13.594940 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1362/2777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.629740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.644977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.645901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.657767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.658271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.658715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.659434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.659938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.660374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.887603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.899037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.900680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.902790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcc16680-d8a5-4e15-9631-dddd9ac63c1b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1871 microversion: 2.42 time: 0.262348 Oct 04 18:17:13.904185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1363/2778] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1871 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:14.164224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.165431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.173518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=26 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:14.175733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.176325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.176992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.177714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.178387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.178865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.260149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:14.291188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e83933aa-df54-497b-ba83-ee812206e917 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.711212 Oct 04 18:17:14.295556 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1416/2779] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:14.298054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.298866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.305401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.306294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.306903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.307808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.308958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.309574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.457222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.466042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1801255d-9528-4728-aabe-6810a906b3bf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.307442 Oct 04 18:17:14.480025 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1364/2780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:14.621392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.622027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.629104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.629892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.630513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.631229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.631709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.632328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.641638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:14.932106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.952538 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ccd6553-a7e9-478b-8c5f-db9b479c16f5 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.335687 Oct 04 18:17:14.955043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1365/2781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:14.960245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.961388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.968259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:14.970009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.970698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.971548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.972519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.973289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.973879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.978103 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa98de77-dcde-4313-b0c7-02ada8f6fbaf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.684327 Oct 04 18:17:14.981810 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1417/2782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:15.324324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.325893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.338597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.341289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.342075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.343699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.346281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.346876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.348572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.362353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.364688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.366197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71c31ac7-544a-4865-8a63-297c4eee1c33 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 0.411384 Oct 04 18:17:15.367445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1366/2783] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:15.383756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "a4dc329c-14b4-4653-af03-c7ecc1d06ab1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:15.396774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.398373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.398373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.412272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] Creating event network-changed:a4dc329c-14b4-4653-af03-c7ecc1d06ab1 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:15.419017 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-59a20a91-dcb6-4e51-ab23-3d4e1b605853 req-1906d5a2-d855-474f-9807-34e002e25a75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049945 Oct 04 18:17:15.420128 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1367/2784] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:15.490926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.491806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.499628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.500247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.500772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.501570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.502153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.503417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.782028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:15.792158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.802038 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-686a0d2f-278e-45b3-bcdf-f0e2656bf201 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.315325 Oct 04 18:17:15.807831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1368/2785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:15.825084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-56d19ab1-40a7-439b-b60f-32ff568072e3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.504870 Oct 04 18:17:15.846338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1418/2786] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:15.979294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:15.983759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.006809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.007362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.007547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.008332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.008795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.009541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.010002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.010615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.039399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.041196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.041196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.041783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.042402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.042866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.295427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.310283 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64ed0e7a-8ba3-48c6-9cd0-781e9a87c439 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.335289 Oct 04 18:17:16.311229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1369/2787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:15 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:16.393499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.396961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.403272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.403751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.404326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.405390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.406152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.406811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.702675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.739892 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1de702b3-1759-4006-ab35-7f1cbf326ebf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.731825 Oct 04 18:17:16.744121 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1419/2788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:16.826611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.827740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.834822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.835738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.836441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.837428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.838708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.840095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.096312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.116556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.124101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.130423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc96dbf5-5a6e-4066-81d6-4a098a6d5e92 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 0.736395 Oct 04 18:17:17.130423 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1370/2789] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:17.156018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.158588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.170503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.190883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.207592 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57a38eb2-9551-4fce-b83f-c6ef297f165d tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.383099 Oct 04 18:17:17.221966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1420/2790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.229141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.230167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.240301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.242128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.245032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.245032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.245836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.246523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.286138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:17.308932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9c35d17-ac63-4014-8a5e-078947091ec3 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.163184 Oct 04 18:17:17.309672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1371/2791] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:17.314998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7b1cf5-7260-40b9-a210-dbd9b758a9c7", "tag": "095d6790-aa13-4f84-bc6f-27fad869ab8f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:17.325800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.327085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.327806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.342770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] Creating event network-changed:095d6790-aa13-4f84-bc6f-27fad869ab8f for instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 on n-h2-833090-21 Oct 04 18:17:17.349699 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3ae0fbe1-561c-4eca-a7fd-69ab9c2ee5bc req-88df9c78-ed3c-403a-9d13-1399bc0b900d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038193 Oct 04 18:17:17.350890 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1372/2792] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:17.358236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.359165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.366914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.367705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.368317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.369195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.369798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.370374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.644373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.654978 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1f27ac8-087e-47a5-8a71-d8eeb217104f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.302546 Oct 04 18:17:17.659379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1373/2793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.673786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "c11c9b08-6d87-4862-bf57-e7ac95c6ddf0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:17.699131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.699652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.700091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.737808 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] Creating event network-changed:c11c9b08-6d87-4862-bf57-e7ac95c6ddf0 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:17.753344 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a644713e-2b80-4eaf-ba4d-676b99a7f248 req-2b501c68-28d2-47c4-8b07-ae24cc41e017 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092094 Oct 04 18:17:17.757898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1374/2794] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:17.766847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.767736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.785688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.790204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.791108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.792201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.796082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.796539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.158726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.173369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d84b4fc7-84eb-43e0-8ee1-700f188f4975 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1589 microversion: 2.1 time: 0.949230 Oct 04 18:17:18.174350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1421/2795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1589 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.182310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.183863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.205436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.205436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.205436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.208426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.209414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.209670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.255411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.265021 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa3b2f53-9d2c-4a3f-a815-da092658bcb8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.502333 Oct 04 18:17:18.267762 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1375/2796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:18.273873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.274779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.284441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.288439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.288439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.288439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.288439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.288439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.746993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.764865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d7113743-8c20-4e7e-884f-ce63de29a33c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.495733 Oct 04 18:17:18.765755 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1376/2797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.775181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.776158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.800291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.801300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.801933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.802889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.803546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.804411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.974407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:19.021730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e657020e-9a29-4222-adda-718fca1ecd36 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.254623 Oct 04 18:17:19.022657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1377/2798] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:19.035285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.036435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.052083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.054257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.056371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.060362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.061178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.062629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.275818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.300724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.302232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.303441 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27eb7cca-11d5-4934-b7d4-3a95bd72b928 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 1.127866 Oct 04 18:17:19.313517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1422/2799] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:19.318729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.321010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.336268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:19.340801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.341298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.341733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.342578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.351293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.352146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.567259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.577157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9744cb27-3b59-4f39-9c20-dfde6219eb8f tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.552536 Oct 04 18:17:19.577970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1378/2800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.585714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5fefb9-0c63-4b6c-8b62-f0856b761f8e", "tag": "1e68cc0d-b102-475a-a933-62cccb93ce3a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.615319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.632538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.635388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.639777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.642570 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbff1e36-567d-447b-acd9-e9f37dc0a0a8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.324286 Oct 04 18:17:19.643399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1423/2801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.666945 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] Creating event network-changed:1e68cc0d-b102-475a-a933-62cccb93ce3a for instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e on n-h1-833090-21 Oct 04 18:17:19.666945 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-96abddb8-f67c-4d7a-aeea-c27ff9cbe08f req-47275453-54e4-4bde-ac95-73c3767a44e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086805 Oct 04 18:17:19.667702 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1379/2802] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:19.775666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:19.786537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.786950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.788694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.795250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.795998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.802596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.803118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.808557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.808557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.808557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.808557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.810880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] Creating event network-changed:0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:19.816688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-83e4a342-49ac-4ec9-bcd3-39c11c54c962 req-f0c56cae-6736-4187-a59f-a47dae1de1f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045748 Oct 04 18:17:19.817318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1424/2803] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:20.055512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.056845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.065176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.065940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.066558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.068156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.069375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.072303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.135721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.144614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5c4b978-beec-4388-b061-5c816f346081 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.354375 Oct 04 18:17:20.158477 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1380/2804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:20.249531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:20.275245 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f70b195-85f1-41d3-9047-1d5043273631 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.223345 Oct 04 18:17:20.276661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1425/2805] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:20.349654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.351271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.364692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.365982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.367105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.368444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.369829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.371078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.601236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.602010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.609839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.611204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.611909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.612903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.621499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.621499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.788520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.808391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.811027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.812738 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-396009a1-ed6d-4b86-ae5f-99dd1e5ff9f1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 0.473807 Oct 04 18:17:20.814833 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1381/2806] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:20.820922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.822047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.833862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.836508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.837376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.838857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:20.840378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:20.841098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.851797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.859718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:20.872951 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee174434-8698-47e2-8c3d-8b3d71c633c8 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.275690 Oct 04 18:17:20.874156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1426/2807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:21.168850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.169466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.181870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.182779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.183922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.184646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.185105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.185581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.344936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.356672 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4686f0b2-688a-43b0-bfe1-5acdf4adbfe6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.191568 Oct 04 18:17:21.357643 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1427/2808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:21.362678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.363592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.370276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.371540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.372436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.379291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.379291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.379291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.466554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:21.487430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fecb3e25-3455-40b3-b2dd-507a4d5b63ac tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.128619 Oct 04 18:17:21.488669 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1428/2809] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:21.527267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.537603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66217e5d-f47a-4c24-8f27-51b3ef866790 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.721197 Oct 04 18:17:21.540970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1382/2810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.844890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.845863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.854665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.856662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.857341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.858337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.858988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.860018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.862296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "da05b590-9ea7-43df-b119-25810d130950"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:21.874747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.875577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.876170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.889653 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] Creating event network-changed:da05b590-9ea7-43df-b119-25810d130950 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:21.896010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9dc386e9-8dc3-4332-91fe-c3f9fbdfe2f6 req-3c9d4bff-7981-40e7-b6fd-0ba2279cc2a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041359 Oct 04 18:17:21.897385 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1383/2811] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:21.904206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.905133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.912832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.913587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.914357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.915435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.916091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.916681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.962421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:22.121885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.133136 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea0ac980-6f30-488f-bc4c-f3d7bb98efe0 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.234352 Oct 04 18:17:22.134255 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1384/2812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:22.249620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.262520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.264468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.265844 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-decf3923-d417-4229-b9b1-d3312414052b tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 0.426395 Oct 04 18:17:22.266839 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1429/2813] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:22.392560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.395192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.414826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.415998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.419146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.420347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.431685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.432223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.522600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.524410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.533825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.534827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.535634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.536599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.537215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.537701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.638153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:22.675036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e22e67ad-a83a-4a29-931b-0776b8f7ac4e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.162354 Oct 04 18:17:22.675688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1430/2814] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:22.680923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.681651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.688925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.689458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.693495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.695754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.695754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.695754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.817586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.835847 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8b401e5-b6f2-4b63-89a6-9833d76f99b1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.458722 Oct 04 18:17:22.836739 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1385/2815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:22.922795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.938129 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1741f27f-e57d-446e-a411-eb72dabe5518 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.257437 Oct 04 18:17:22.945089 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1431/2816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.159548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.161046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.169901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.170678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.171295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.172217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.172834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.173485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.296237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.297424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.304465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.305302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.305806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.306765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.307301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.307981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.530868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.538819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.540460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.541534 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a75831cb-f303-44db-9913-33ad108eff5c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1892 microversion: 2.42 time: 0.250396 Oct 04 18:17:23.551580 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1432/2817] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1892 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:23.629512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.638301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-389a3a3a-c1b0-404d-8f6b-1db1b624dcf2 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.482548 Oct 04 18:17:23.638999 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1386/2818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.713414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.715079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.727188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.728128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.728950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.730260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.731375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.732198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.824380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:23.843973 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82783e9e-347e-424b-afb4-6f85bb7060a8 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.137201 Oct 04 18:17:23.844587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1433/2819] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:23.882384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.882384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.888908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.889500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.890022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.890809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.891390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.891992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.958483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.959103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.966791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.967280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.967758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.968473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.968936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.969365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.123525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.130201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a7e5425-4bf7-425f-850a-125b926ea0c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.175726 Oct 04 18:17:24.130789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1434/2820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:24.149456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "83497e6e-55ee-4018-94b0-070a178c6b69"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:24.160321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.160795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.161231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.172963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] Creating event network-changed:83497e6e-55ee-4018-94b0-070a178c6b69 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:17:24.178402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-053bd266-45c1-4df7-871b-ddc3a4e15454 req-802726bd-a45c-4cfe-8758-84fbb7d5c45d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036625 Oct 04 18:17:24.179271 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1435/2821] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:24.396264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.404157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f1210ea-c0f3-4d38-8433-e80c7c3ba5e1 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.527733 Oct 04 18:17:24.404736 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1387/2822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:24.578897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.580110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.587846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.588345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.588855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.589885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.590397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.590945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.631517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5fefb9-0c63-4b6c-8b62-f0856b761f8e", "name": "network-vif-plugged", "status": "completed", "tag": "1e68cc0d-b102-475a-a933-62cccb93ce3a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:24.643504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.644212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.644646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.662215 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] Creating event network-vif-plugged:1e68cc0d-b102-475a-a933-62cccb93ce3a for instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e on n-h1-833090-21 Oct 04 18:17:24.670736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ae16e424-21df-46a3-b0bc-88e66a23306b req-33c4a434-b724-43d2-9d7b-bbdbb7355d20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042532 Oct 04 18:17:24.671694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1388/2823] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:24.677211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.677928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.686870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.687609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.689245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.691490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.692461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.693242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.899930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.910318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.914221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.917064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.919216 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8067ac41-809f-4d5f-b8a7-19d0fd793ac6 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.353935 Oct 04 18:17:24.919991 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1436/2824] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:24.925145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.926437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.933031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.933808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.934355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.935517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.936131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.936810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.945478 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c5dc1b9-8d54-40fb-bd6e-73be09a68190 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.272449 Oct 04 18:17:24.963408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1389/2825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.073188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:25.095397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69212121-d2b7-4ee5-8eb1-31f02796e0c9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.174095 Oct 04 18:17:25.096149 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1437/2826] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:25.155360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.156159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.164084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.168487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.168487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.168487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.168487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.168487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.428358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.429204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.434585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.438935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.439745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.440302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.441130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.441820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.442498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.452090 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a13dc0e-d978-4ffb-ac06-611c8e44f07d tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.300997 Oct 04 18:17:25.457894 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1390/2827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.952795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.953685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.961232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.962069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.962778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.963994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.965085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.965769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.030439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.047129 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80847681-d4dc-4ffd-861f-c8f089d83553 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.622558 Oct 04 18:17:26.059165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1438/2828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:26.078569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.079521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.090280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.092263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.092752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.093883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.094531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.095163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.257027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.266408 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-780540bb-9a21-4915-9611-c1047bc95099 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1324 microversion: 2.1 time: 0.197087 Oct 04 18:17:26.267045 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1439/2829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:26.272283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.272993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.283419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.284611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.284842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.285674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.286261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.286875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.290930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.316017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.317503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.318711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2475fa5c-92a4-4f9f-ac4a-4cb87a822102 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.371923 Oct 04 18:17:26.319295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1391/2830] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:26.415755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:26.438785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce7f1848-079d-4cfc-9974-2e8370486662 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.170289 Oct 04 18:17:26.440254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1440/2831] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:26.478472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.480431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.489139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.490701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.491246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.492153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.492734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.493266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.722369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.731221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80e22fbf-903a-457c-81a6-b26319c706e1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.256435 Oct 04 18:17:26.745241 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1392/2832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:27.072775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.073419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.081271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.081764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.082203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.082908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.083361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.083933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.260565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.266479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-63a58625-4618-4b5a-907c-5648c5fc3e9a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.197753 Oct 04 18:17:27.267139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1441/2833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:27.289958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.290579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.297707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.298201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.298638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.299335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.299824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.300253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.346126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.346741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.355502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.355502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.355502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.356737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.356864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.357257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.378263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:27.519737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.536202 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49c4fbdc-a952-4c58-b6dc-060effaab59d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1520 microversion: 2.1 time: 0.249919 Oct 04 18:17:27.551773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1393/2834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:27.559323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.559986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.566267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.578367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.578367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.578367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.578367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.578367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.591811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.601301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.605418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.608309 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69b5d534-623c-4fb6-9607-6c945cdc44c0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.266038 Oct 04 18:17:27.611407 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1442/2835] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:27.613594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.616200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.621365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.622107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.622747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.623719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.624124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.624564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.650382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:27.658186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:27.682243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afbff081-e29e-4530-88dc-2e8ca3536159 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.129214 Oct 04 18:17:27.682897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1394/2836] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:27.754845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.755490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.761594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.762079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.762518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.763212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.763730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.764160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.913387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.922323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7678f4c-d531-4e3d-903c-a2134a57ad5e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.171441 Oct 04 18:17:27.923054 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1395/2837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:27 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:28.048667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0653530-7239-4d6f-8a9c-ceb009471547 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 204 len: 0 microversion: 2.1 time: 0.438444 Oct 04 18:17:28.049277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1443/2838] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:27 2022] DELETE /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:28.057410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.058032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.065056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.065541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.066011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.066723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.067178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.067632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.205484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.213232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c97d9c5-aa67-48a5-8062-7143eff13683 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1526 microversion: 2.1 time: 0.159744 Oct 04 18:17:28.213805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1396/2839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:28.291660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.292371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.299946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.300429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.300863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.301560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.302010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.302431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.588685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.598276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc7a3d4f-9413-413e-98fc-dad4c769d95e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1515 microversion: 2.1 time: 0.310208 Oct 04 18:17:28.598276 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1444/2840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:28.635805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.637070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.644212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.644691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.645127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.645822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.646275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.646785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.713401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.717845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.720735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.721375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.721831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.722632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.723100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.723554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.803724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:28.822420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e69afafa-221a-41bd-83b7-a0a77131e8db tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.113070 Oct 04 18:17:28.823015 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1445/2841] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:28.841257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.851283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.852824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.854020 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f2739d6-77a1-4221-a78f-446b62ede8bf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.222165 Oct 04 18:17:28.854760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1397/2842] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:28.946315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.946921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.953252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.953771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.954206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.954940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.955385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.955831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.137024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.144800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1c94966-99af-48ed-851e-f5e24b6a4152 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.202296 Oct 04 18:17:29.145369 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1446/2843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:29.237540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.238065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.244076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.244557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.244983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.246304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.246758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.247177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.380388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.388921 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86254e47-4e58-4c3f-b384-2ad3a066615d tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1526 microversion: 2.1 time: 0.155386 Oct 04 18:17:29.389502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1398/2844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:29.621696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.622396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.628793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.629348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.631397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.631397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.631397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.631828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.854245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.855109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.863162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.863784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.864295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.865115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.865642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.866253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.945925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:29.967049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f379643-d881-4640-8ae6-46c1c75f10af tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.119731 Oct 04 18:17:29.967670 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1399/2845] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:29.972591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.973213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.976487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:29.981045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.981572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.981999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.982793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.983163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.983613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.282858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.297885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.300919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.302133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b646ff6-d258-40c4-919f-948717c5a5ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.333506 Oct 04 18:17:30.319493 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1400/2846] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:30.319493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.319493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.319493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.320902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.322364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.324667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.325648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.339807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.339807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:30.488854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.499237 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c6865ba-9e41-422c-9623-a17def20c460 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1533 microversion: 2.1 time: 0.882293 Oct 04 18:17:30.500200 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1447/2847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1533 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.505075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.505979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.513367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.514191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.521834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.521834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.521834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.521834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.591459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.599502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61646051-e72a-4ee4-9af1-e9ffef8b4c8e tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.294806 Oct 04 18:17:30.601950 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1401/2848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.883065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.891901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c6ce2bb-c06b-4110-83d2-92633e26fbb4 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1526 microversion: 2.1 time: 0.390338 Oct 04 18:17:30.892849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1448/2849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1526 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.999033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.000917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.010395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.011740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.012287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.015453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.015453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.015453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.020885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5fefb9-0c63-4b6c-8b62-f0856b761f8e", "name": "network-vif-deleted", "tag": "1e68cc0d-b102-475a-a933-62cccb93ce3a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:31.033256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.033943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.034534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.048649 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] Creating event network-vif-deleted:1e68cc0d-b102-475a-a933-62cccb93ce3a for instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e on n-h1-833090-21 Oct 04 18:17:31.056088 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b1751183-3b13-44c9-a65b-c0eff7be1ed7 req-eb339177-74df-4e8d-8338-08cd21bab134 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038770 Oct 04 18:17:31.057363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1449/2850] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:31.113910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:31.135730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c520d8e-ef25-4b9e-850f-f934ecfdb979 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.140595 Oct 04 18:17:31.138001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1402/2851] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:31.336274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.336983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.343773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.344266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.344717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.345413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.346046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.346478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.530682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.531479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.538302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.539019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.539450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.540275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.540791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.541280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.549029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.560120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.561761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.563095 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0ebcf1c-4ade-4399-8298-ebf77a1f2a9f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.231252 Oct 04 18:17:31.564379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1450/2852] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:31.623385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.624084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.631348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.632066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.632629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.633438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.633907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.634341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.805252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.815677 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fca5128b-f778-4e7a-a864-57989350a190 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.196083 Oct 04 18:17:31.827426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.827426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5ab04f7-c264-45a1-be0a-2b61345a9818 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.300392 Oct 04 18:17:31.827426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1403/2853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:31.829249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1451/2854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:31.918042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.918767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.925198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.925807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.926317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.927109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.927677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.928114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.964310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.965209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.965653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.966240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lazy-loading 'fault' on Instance uuid 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:32.014300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbeab59f52ec46f69af37842f5475896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03dd30037d534e0d84d1803ae7466831', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.022442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cfb157ad-a702-4ab2-be47-efd062a9e84e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 200 len: 1314 microversion: 2.1 time: 0.108507 Oct 04 18:17:32.023171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1404/2855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 1314 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:32.170546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.171912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.178449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.178945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.179385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.180167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.180627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.181052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.253970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:32.272033 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fbc4a661-7d2d-4e5c-b475-a03a526b0860 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.107433 Oct 04 18:17:32.272573 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1452/2856] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:32.590313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.590939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.597025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.597551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.599130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.599130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.599130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.599522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.800326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.809300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.810808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.812217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6fdb9acd-bfc5-452c-9d17-755dd729a996 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.225968 Oct 04 18:17:32.812773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1405/2857] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:32.851275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.851275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.851650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.851650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.854272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.855565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.858514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.859003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.859446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.859783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.860515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.860695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.860982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.861100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.861408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.861528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.000838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.009051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a9aca57-ad0b-44ea-971d-2968e76ab4cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.162289 Oct 04 18:17:33.009847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1406/2858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:33.014148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5", "name": "network-vif-unplugged", "status": "completed", "tag": "3006a4c8-263b-4b38-84c0-3cc27abbcd8a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:33.024800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.025404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.025708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.047442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.053062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] Creating event network-vif-unplugged:3006a4c8-263b-4b38-84c0-3cc27abbcd8a for instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 on n-h2-833090-21 Oct 04 18:17:33.056824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24b12553-bc5a-4ad0-8056-077309a66918 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.219376 Oct 04 18:17:33.058293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0a479287-7690-4667-86a4-8fc64ee1a46e req-0c196fe7-f669-4392-a5e4-ca47454fe478 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047400 Oct 04 18:17:33.059023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1407/2859] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:33.059319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1453/2860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:33.064535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.065220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.071508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.072003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.072445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.073146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.073778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.074214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.088339 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e HTTP/1.1 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6b5fefb9-0c63-4b6c-8b62-f0856b761f8e'} Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.090620 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 6b5fefb9-0c63-4b6c-8b62-f0856b761f8e could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-965bc489-1624-462e-9988-c39da094e4e1 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e" status: 404 len: 111 microversion: 2.1 time: 0.031624 Oct 04 18:17:33.096001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1408/2861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/6b5fefb9-0c63-4b6c-8b62-f0856b761f8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:33.102730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3150f1b0-6088-49df-bf47-ae8eba541708 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f900906eee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.125233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-3150f1b0-6088-49df-bf47-ae8eba541708 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Image not found. Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3150f1b0-6088-49df-bf47-ae8eba541708 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681 HTTP/1.1 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '956a9422-46bc-4854-8297-2691cd1e0681'} Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 956a9422-46bc-4854-8297-2691cd1e0681 to delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 956a9422-46bc-4854-8297-2691cd1e0681 could not be found. Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.127093 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3150f1b0-6088-49df-bf47-ae8eba541708 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3150f1b0-6088-49df-bf47-ae8eba541708 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681" status: 404 len: 62 microversion: 2.1 time: 0.029907 Oct 04 18:17:33.169111 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1454/2862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] DELETE /compute/v2.1/images/956a9422-46bc-4854-8297-2691cd1e0681 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 HTTP/1.1 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:17:33.172115 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '19d93507-4e0e-40bf-be10-624cffa9aeb1'} Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.174823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.179915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:33.179915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f61a08f-55df-447e-ac63-c51daa467f9e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 404 len: 111 microversion: 2.1 time: 0.033103 Oct 04 18:17:33.179915 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1409/2863] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:33 2022] DELETE /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:33.180161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.180161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 19d93507-4e0e-40bf-be10-624cffa9aeb1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.183267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.183786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.184223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.184924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.188612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.188612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.203169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 HTTP/1.1 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '19d93507-4e0e-40bf-be10-624cffa9aeb1'} Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.204841 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 19d93507-4e0e-40bf-be10-624cffa9aeb1 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb376a87-8b0e-4375-be66-18bcb9d018f3 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1" status: 404 len: 111 microversion: 2.1 time: 0.034514 Oct 04 18:17:33.209468 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1455/2864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/19d93507-4e0e-40bf-be10-624cffa9aeb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:33.216013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-411aa24f-c9e3-4bc5-a384-66c1ad17d074 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f9008d38160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.300636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.301243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.307443 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-411aa24f-c9e3-4bc5-a384-66c1ad17d074 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458014021" status: 202 len: 0 microversion: 2.1 time: 0.095862 Oct 04 18:17:33.308415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1410/2865] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458014021 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:33.308577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.309028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.309470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.310300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.310796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.311217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.431537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:33.452966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9acaeac7-479e-4b95-acf5-f94cebda6717 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.156155 Oct 04 18:17:33.453557 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1456/2866] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:33.839427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.840370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.847769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.848324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.848837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.849581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.850063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.850497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.040028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.040646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.047913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.048621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.049261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.049959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.050578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.051002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.095197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.104907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.106650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.107855 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0bf1fd2-0639-43a6-ad14-8045f03c6885 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.272578 Oct 04 18:17:34.109105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1411/2867] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:34.114298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.115156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.126766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.132936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.132936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.132936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.132936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.132936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.232559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.240673 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6bcea8c-ab25-4ffa-9f56-b07cf666525a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.207159 Oct 04 18:17:34.241560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1457/2868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:34.281112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f113ac2-7d10-45bf-976d-0f48a97bbc1e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '.version_select at 0x7f90088ef1f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.306657 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5f113ac2-7d10-45bf-976d-0f48a97bbc1e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Image not found. Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f113ac2-7d10-45bf-976d-0f48a97bbc1e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/images/150fefec-74cb-4dd0-86a2-363778c0d2c2 HTTP/1.1 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: exception: Image not found. Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '150fefec-74cb-4dd0-86a2-363778c0d2c2'} Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 150fefec-74cb-4dd0-86a2-363778c0d2c2 to delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 150fefec-74cb-4dd0-86a2-363778c0d2c2 could not be found. Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.309884 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f113ac2-7d10-45bf-976d-0f48a97bbc1e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Image not found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f113ac2-7d10-45bf-976d-0f48a97bbc1e tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/images/150fefec-74cb-4dd0-86a2-363778c0d2c2" status: 404 len: 62 microversion: 2.1 time: 0.034114 Oct 04 18:17:34.316852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1458/2869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] DELETE /compute/v2.1/images/150fefec-74cb-4dd0-86a2-363778c0d2c2 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:17:34.323411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.323411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.330508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.335298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.336142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.336776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.337544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.338333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.338857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.356395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba HTTP/1.1 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba'} Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:34.357979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50b32287-72dd-46db-8128-efa6d5e36abc tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 404 len: 111 microversion: 2.1 time: 0.042708 Oct 04 18:17:34.390801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1459/2870] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:34 2022] DELETE /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:34.392071 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ac78a1f-103e-42cf-80d5-38013b0b9db1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1472 microversion: 2.1 time: 0.247930 Oct 04 18:17:34.392071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1412/2871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:34.395792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.396380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] [instance: 5c38b75c-a1ce-4964-a760-411bc6abebba] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.402502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.402995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.403437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.404157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.404622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.405051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.419416 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] HTTP exception thrown: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Request method failure captured: Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba HTTP/1.1 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhG_V7ciZuB4xRF9eQNS7zA4-0KLkSKnoc_t4eFRfDCs0mCjZeFD0tBnjbxtYWxTyvo2OPxVGUvoW6sp8IHp9hf3ux4bNnbITpDhkY4uzdfW0hRDWquVrRfhjMc6Uxpw0rE4OTZLvjz_SqfRAFHoimBKOqQ59BLZkEkm48xAIAHqr0 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03dd30037d534e0d84d1803ae7466831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03dd30037d534e0d84d1803ae7466831"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03dd30037d534e0d84d1803ae7466831"}]}] Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03dd30037d534e0d84d1803ae7466831 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-824231057 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: fbeab59f52ec46f69af37842f5475896 Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-824231057-project Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5c38b75c-a1ce-4964-a760-411bc6abebba'} Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.421070 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] Returning 404 to user: Instance 5c38b75c-a1ce-4964-a760-411bc6abebba could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6060263-b633-49f0-9e37-1813b3c5dc64 tempest-ImagesOneServerNegativeTestJSON-824231057 tempest-ImagesOneServerNegativeTestJSON-824231057-project] 10.222.0.40 "GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba" status: 404 len: 111 microversion: 2.1 time: 0.030695 Oct 04 18:17:34.426066 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1460/2872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/5c38b75c-a1ce-4964-a760-411bc6abebba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:34.482481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.483112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.489863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.490460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.490971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.491779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.492307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.492836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.575162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:34.593012 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b06feda-b2c2-48cc-8271-e0dca7b46222 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.115107 Oct 04 18:17:34.593611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1413/2873] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:35.134752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.135280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.143296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.143820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.144268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.144971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.145425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.145851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.150623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:35.265530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.266123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.273452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.274041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.274466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.275158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.275643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.276071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.429281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.438037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e839723b-b2fa-40dc-8a1c-2ae886f44e01 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.177011 Oct 04 18:17:35.438633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1414/2874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:35.443216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.443987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.450542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.461111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.461111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.461111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.461111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.461111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.582381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.595510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.597292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.598559 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac13aa3d-b3d3-4d41-98d7-658270fd8427 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.468205 Oct 04 18:17:35.599327 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1461/2875] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:35.602252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.610750 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02be7dea-5e99-4bb6-95af-2b0af87c58bb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1490 microversion: 2.1 time: 0.171084 Oct 04 18:17:35.611488 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1415/2876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1490 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:35.625861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.626479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.633591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.634086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.634528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.635242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.635754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.636706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.758555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:35.780023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:35.783784 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e8dc8db-b914-4832-ab2d-740777238028 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.161823 Oct 04 18:17:35.785513 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1462/2877] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:36.471401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.472067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.480320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.481077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.481550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.482433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.482920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.483350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.627131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.627876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.637956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.638606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.639149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.640144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.640674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.645721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.732920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.742586 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-222ef00c-e523-4dda-b5ba-43f55b4a8ae6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.280827 Oct 04 18:17:36.755528 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1416/2878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:36.770124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.771559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.783244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.784010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.788792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.788792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.788792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.788792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.949684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.962085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.964133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.968375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b05c9ad-948e-47ef-8c44-d6bb83776464 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.344455 Oct 04 18:17:36.981252 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1463/2879] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:36.995009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.996170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.004428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.005982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.006441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.007163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.008208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.008645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.013498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.021690 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3181b61f-77f2-45a8-a079-37c7f9ca39bd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.266114 Oct 04 18:17:37.022503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1417/2880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:37.027581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5", "name": "network-vif-plugged", "status": "completed", "tag": "3006a4c8-263b-4b38-84c0-3cc27abbcd8a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:37.037997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.038938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.040298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.053196 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] Creating event network-vif-plugged:3006a4c8-263b-4b38-84c0-3cc27abbcd8a for instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 on n-h2-833090-21 Oct 04 18:17:37.061482 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-8a689ffd-2e60-49ab-a0e1-46317d825f81 req-7bdaddd1-f3b8-4a54-bb57-1b71a497594e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Oct 04 18:17:37.061482 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1418/2881] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:37.113807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:37.144270 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c86390f3-51c1-429d-9ccc-8a6cda2e115d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.161565 Oct 04 18:17:37.147210 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1464/2882] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:37.768345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.769762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.781034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.781554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.782186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.782925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.783559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.785017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.998810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.999433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.007229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.007754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.008192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.008936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.009351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.009780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.211412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.233334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.233961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.235170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-678f8a08-f08a-46c1-a8ae-6986f316b9c7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.241078 Oct 04 18:17:38.235762 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1465/2883] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:38.249716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.250333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.262570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.263067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.263700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.264671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.265271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.265876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.429160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.438650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed7ce0fa-4afe-4069-bb54-982bc23f49ac tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.192725 Oct 04 18:17:38.439896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1466/2884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:38.445373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.446406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.458466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.458970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.459416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.460174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.460630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.461055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.467915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.476911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-422d637b-9daa-40d8-91c7-8b839800c505 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1521 microversion: 2.1 time: 0.713289 Oct 04 18:17:38.491610 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1419/2885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1521 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:38.564669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:38.596851 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58db4046-60f1-47f7-9e68-da4a215fa29b tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.147025 Oct 04 18:17:38.596851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1467/2886] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:39.076655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-unplugged", "status": "completed", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:39.092371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.093160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.093829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.126252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] Creating event network-vif-unplugged:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:17:39.139238 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-66ceaeba-3b9b-4649-9cb2-2bfc3707fcc9 req-271d143c-3303-419e-919b-c2db7afd724f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061099 Oct 04 18:17:39.139238 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1420/2887] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:39.265889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.266680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.274350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.274856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.275289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.276018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.276994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.277493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.463701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.465057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.477828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.478572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.479176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.480453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.483359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.483359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.487310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:39.747364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.756292 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5b2b076-c68a-4d4a-8531-ff13d8b09490 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.296810 Oct 04 18:17:39.757211 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1421/2888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:39.764136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.765082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.774385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.775499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.776203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.777604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.778259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.778901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.800150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.815280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.817496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:39.819316 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e74ca5ee-ebb1-43c9-9374-9fee252e022c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.557427 Oct 04 18:17:39.824612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1468/2889] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:39.843750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.843750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:39.851224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.852064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.852660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.855404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:39.856648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:39.857227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:39.980953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:40.020907 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12a180d1-c12b-4184-a4df-cf07450533f9 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.191328 Oct 04 18:17:40.034050 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1469/2890] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:40.145821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.163232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10baae8d-9f04-451b-ade8-29df92f1ba37 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1506 microversion: 2.1 time: 0.404420 Oct 04 18:17:40.170906 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1422/2891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:40.187914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.188436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.195013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.195523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.196013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.196724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.197172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.197907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.382941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.404443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7cc76ca-b483-4367-8bf3-671d88d3fb3e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 200 len: 1506 microversion: 2.1 time: 0.217655 Oct 04 18:17:40.404443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1470/2892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:40.424927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.425589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.431737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.432234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.432673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.433374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.433989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.434588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.467095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:40.783182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.784345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.790350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.790831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.791484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.792402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.792915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.793469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.891909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99f3f605-c803-481e-ab39-cbc13b599d1e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 204 len: 0 microversion: 2.1 time: 0.470466 Oct 04 18:17:40.892515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1423/2893] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:40 2022] DELETE /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:40.898224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.899586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.908714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.909160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.909599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.910308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.910766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.911280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.045266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.053442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3455b94d-789c-4370-b17f-dbd40963cef9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.274192 Oct 04 18:17:41.054090 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1471/2894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:41.059424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1941305209", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "7f146417-fc63-4b83-a5ba-6d28e87ebff8"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:41.123069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] validate_networks() for [('7f146417-fc63-4b83-a5ba-6d28e87ebff8', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:41.156183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.169883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.171653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.172825 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89bc138c-aad0-4a58-bb4c-0ab88fb7ab8d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.278830 Oct 04 18:17:41.173671 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1424/2895] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:41.178467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.179349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.189198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.190281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.192299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.193252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.193724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.194973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.283000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:41.304586 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-860a59ae-da6a-4061-ba5b-35382ff6d24c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.129526 Oct 04 18:17:41.305340 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1425/2896] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:41.697730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:41.698724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:41.699150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:41.699590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:41.700018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:41.709612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.711715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.711715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.711715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.711715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.712222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.731399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:41.736789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Getting quotas for user dbf908d61d404d9bb9f84faddbe59d9d and project 49b0338e25d74d1a9890ce182fef275a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:41.749614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:41.751983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:41.930660 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2cc84bef-2e00-4ba1-87af-ca7a7053f4ef tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875277 Oct 04 18:17:41.932758 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1472/2897] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:41.952392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e68be70-21e5-4b35-8997-4007a285ccee tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.953805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e68be70-21e5-4b35-8997-4007a285ccee tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.023367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4e68be70-21e5-4b35-8997-4007a285ccee tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.036500 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e68be70-21e5-4b35-8997-4007a285ccee tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1218 microversion: 2.1 time: 0.091532 Oct 04 18:17:42.039979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1426/2898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:42.078913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.079557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.087038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.088260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.089179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.090723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.091697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.092732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.200518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.201108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.208228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.209059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.209506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.210377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.211023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.211741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.261947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.271498 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-047ea913-21c5-42e1-9f45-a1640e7899aa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.196784 Oct 04 18:17:42.279682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1473/2899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:42.333029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.334009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.341501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.342477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.343321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.344290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.344919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.345555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.428897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:42.451839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94193b41-3a84-4b0e-b1fa-09755717422e tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.122950 Oct 04 18:17:42.452993 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1474/2900] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:42.497885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.507547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.509006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.510179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fc6bd01-fa31-4c5d-848b-c689df2d8f13 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.314222 Oct 04 18:17:42.510755 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1427/2901] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:42.625196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-plugged", "status": "completed", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:42.640739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.641289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.641726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.654580 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] Creating event network-vif-plugged:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:17:42.660747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-20c82db5-210a-422a-9f98-099a0aab5cdc req-163874d7-e0b4-494f-baa1-fa7c2abb743c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041124 Oct 04 18:17:42.661541 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1475/2902] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:43.061715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50d8e6ed-6337-4f57-91ef-477f2d4235eb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.063389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50d8e6ed-6337-4f57-91ef-477f2d4235eb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.145857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50d8e6ed-6337-4f57-91ef-477f2d4235eb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.154821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50d8e6ed-6337-4f57-91ef-477f2d4235eb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1218 microversion: 2.1 time: 0.097934 Oct 04 18:17:43.155730 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1428/2903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:43.295576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.296303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.303389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.310933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.311405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.314224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.314224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.314224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.433269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5", "name": "network-vif-deleted", "tag": "3006a4c8-263b-4b38-84c0-3cc27abbcd8a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:43.449643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.450223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.450733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.464590 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] Creating event network-vif-deleted:3006a4c8-263b-4b38-84c0-3cc27abbcd8a for instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 on n-h2-833090-21 Oct 04 18:17:43.470110 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3e7d9321-f1a2-4016-bf31-020582d2a2e6 req-6678dbfc-8d35-415a-8fad-0363b7bf521a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042111 Oct 04 18:17:43.470986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1429/2904] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:43.482987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.483731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.491902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.492415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.504047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.505961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.506620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.507240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.525755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.535241 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01d2d4b6-2bc0-46e2-a59e-063fd6b497b1 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.244595 Oct 04 18:17:43.537275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1476/2905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:43.542909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.543816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.550997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.551750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.552375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.553280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.553920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.554686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.577200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:43.598985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:43.631919 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfdc41c8-c11a-4d8c-a284-ae6ece9e0705 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1929 microversion: 2.75 time: 0.152966 Oct 04 18:17:43.633239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1430/2906] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:43.794797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.804452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.805909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.807067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e1e2bf3-836a-41f0-93c1-bbe48ee81306 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.268199 Oct 04 18:17:43.808169 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1477/2907] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:44.179589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.181847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.187817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.190912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.191529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.192536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.193219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.193881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.304983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.317727 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f7efe8e-7e0c-470f-9b53-a6cd5085227e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1222 microversion: 2.1 time: 0.142417 Oct 04 18:17:44.318453 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1431/2908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:44.563231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.568039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.571836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.572331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.572770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.574067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.574523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.574949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.662145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.662773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.671388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.676000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.676000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.676000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.676000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.676000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.771286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:44.792765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-032b0277-d7f9-493f-b641-f187e9e29e03 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1947 microversion: 2.75 time: 0.133676 Oct 04 18:17:44.793881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1432/2909] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1947 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:44.830192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.834246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.834867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.840889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0633275-56af-4eff-be90-d436316d5431 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1478 microversion: 2.1 time: 0.280851 Oct 04 18:17:44.845688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1478/2910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1478 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.853696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.145757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.157351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.161177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.161177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-932e0cc5-b26f-48d6-9e0a-0875773db1a5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.330190 Oct 04 18:17:45.161177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1433/2911] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:45.342698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.343535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.357979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.359047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.359445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.360242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.360863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.362118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.791543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.826521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-274f3ee8-e153-4a25-b700-58a27901cfcc tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1270 microversion: 2.1 time: 0.470679 Oct 04 18:17:45.827966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1479/2912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1270 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:45.828102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.830679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.841287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.841783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.843234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.844376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.845021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.845507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.880720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.881700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.889551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.890370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.891199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.892325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.893658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.894306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.977399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:45.999972 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5d911bb-c073-4250-99d2-3e3d7f56e643 tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1935 microversion: 2.75 time: 0.175550 Oct 04 18:17:46.001737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1434/2913] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1935 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:46.151565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.170750 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73021029-518f-47f3-acc3-47f27f6ff1f9 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1463 microversion: 2.1 time: 0.294534 Oct 04 18:17:46.171403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1480/2914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1463 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:46.204322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:46.205467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.211117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.213203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.213968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.214581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.215329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.216203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.216785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.217334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.224469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.224969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.225410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.226151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.226576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.227008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.694128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1985a898-11bc-485b-92b7-4543fa5bbbfc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.496711 Oct 04 18:17:46.698410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1481/2915] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:46 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:46.703847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.704789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.714481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.720152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.720152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.720152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.720152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.720152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.773179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.775389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.775389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.775389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lazy-loading 'fault' on Instance uuid 0a9775cd-f05b-4c85-b3cf-e880cd297f0a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:46.923243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.944413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.946279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.948888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3ce66b1-7bd8-4408-bc7b-50e53a204c8c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.766159 Oct 04 18:17:46.950243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1435/2916] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:46.965201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.969651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.974375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.975076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.975775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.976670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.977289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.977881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.042992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a6c2791-d4b1-43ec-b782-adc8a0a97f4c tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1599 microversion: 2.1 time: 0.343096 Oct 04 18:17:47.044152 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1482/2917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1599 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:47.066819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.067735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.075022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.075556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.076203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.076908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.077588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.078017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.091072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.102266 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5622ba8b-ff04-4f09-b9a2-0861c53ac37f tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1270 microversion: 2.1 time: 0.150136 Oct 04 18:17:47.103306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1436/2918] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:47.120091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:47.122944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.126675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:47.130432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.130933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.131384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.134251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.134251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.134251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.153887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:47.175498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:47.196017 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0049ec1a-1189-4f1f-a189-3263aa56e49d tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1935 microversion: 2.75 time: 0.148732 Oct 04 18:17:47.196847 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1483/2919] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1935 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:47.471096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-226ff3c6-89e8-403d-9b35-be1dc3b77805 tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.366870 Oct 04 18:17:47.471796 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1437/2920] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:47 2022] POST /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:47.480988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.482109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.488732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.489287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.489917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.490799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.491610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.492224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.696799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f9bb4dd-521e-473c-ad9c-ed6eb2abd8bc tempest-ServersAdminTestJSON-1287717546 tempest-ServersAdminTestJSON-1287717546-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1616 microversion: 2.1 time: 0.220572 Oct 04 18:17:47.702849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1484/2921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1616 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:47.720341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.720745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.728510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.729019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.730100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.731639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.732154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.732612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.762449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:47.975981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.977163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.985288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.988457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.988457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.989306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.989946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.990576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.232553 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-302177b5-1d92-4e16-b670-7b3366a07901 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 204 len: 0 microversion: 2.1 time: 0.516022 Oct 04 18:17:48.234578 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1438/2922] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:47 2022] DELETE /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:48.245809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.247438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.258876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.260159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.260944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.263355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.264723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.265582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.386057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.396341 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e771e11-4d23-4fcf-a4a1-cd0367af691b tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1288 microversion: 2.1 time: 0.159358 Oct 04 18:17:48.412063 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1439/2923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:48.419369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.420336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.428305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.429063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.429707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.430595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.431906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.432573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.545036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] Lazy-loading 'services' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:48.566670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.574436 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8456edf4-b714-4407-8f22-6d0c721f481c tempest-ServersAdmin275Test-1529337020 tempest-ServersAdmin275Test-1529337020-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1920 microversion: 2.75 time: 0.160877 Oct 04 18:17:48.575025 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1440/2924] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1920 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:48.589629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.589629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.603864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.604707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.606046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.607430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.608755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.613708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.619626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.620125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.620986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa4f9011-f550-4c79-a35c-dfe0ab238261 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.649772 Oct 04 18:17:48.621879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1485/2925] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:48.633062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.633869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.647959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.648572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.649142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.650406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.650982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.652272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.686197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:48.851784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.860218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24020d93-2396-4023-882a-bde73dbb7dbb tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1470 microversion: 2.1 time: 0.281695 Oct 04 18:17:48.862942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1441/2926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:49.166108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-320fdfca-9625-438a-a905-2d798d77d08e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 204 len: 0 microversion: 2.75 time: 0.542775 Oct 04 18:17:49.166821 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1486/2927] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:17:48 2022] DELETE /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:17:49.175775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.176549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.184700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.184700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.185147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.185915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.186369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.186922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.267300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.278705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.280634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.293366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bf02b524-b9e4-4cc0-9980-46f0210fb915 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1443 microversion: 2.75 time: 0.121782 Oct 04 18:17:49.297203 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1442/2928] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1443 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:49.427578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.428300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.442330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.442840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.443288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.444046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.444511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.444947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.559265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:49.569084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54196215-f140-4f8d-acf2-16fdf5cc5222 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1276 microversion: 2.1 time: 0.146122 Oct 04 18:17:49.571203 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1487/2929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:49.652577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.653706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.663547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.665911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.666373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.667707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.678804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.678804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.888365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:49.889553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.908772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.908772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.909886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.911322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.912096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.913095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.412079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.426591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.428073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.433967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b68595ca-2ea4-4af3-b38f-b5818e4e7caf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.786102 Oct 04 18:17:50.435877 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1443/2930] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:50.444868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.445887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.465617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.465617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.465617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.465617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.465617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.466300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.478750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.494246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb088346-b7e6-4c8b-83aa-7018ee064f03 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1470 microversion: 2.1 time: 0.610053 Oct 04 18:17:50.497068 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1488/2931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:49 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1470 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:50.594196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.595629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.603598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.605745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.605745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.607121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.607772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.608721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.636461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.651936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.653870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.667692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5347abbc-c444-4d9c-ae55-c75e039d69b8 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1443 microversion: 2.75 time: 0.229741 Oct 04 18:17:50.676169 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1444/2932] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1443 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:50.868720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.875776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57ef5563-6e24-4dc2-8be1-57fbbc3daedf tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.285604 Oct 04 18:17:50.891963 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1489/2933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:51.184594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df31d7-3900-4a55-a3a0-996cab478cc0", "name": "network-vif-deleted", "tag": "34653129-08b2-4b8e-a90a-9fefa69d899f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:51.203124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.204555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.205231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.230418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] Creating event network-vif-deleted:34653129-08b2-4b8e-a90a-9fefa69d899f for instance e5df31d7-3900-4a55-a3a0-996cab478cc0 on n-h1-833090-21 Oct 04 18:17:51.241688 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3349ddb0-9eca-4c41-a212-1ddc3a6e4c95 req-28ac404c-73c9-493e-854e-81bef3f254df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060719 Oct 04 18:17:51.242715 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1445/2934] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:51.471529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.472178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.481925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.482419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.482894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.483599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.484062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.488132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.523074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.523815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.534772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:51.544675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.545565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.546168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.547082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.552343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.553843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.722373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:51.743843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:51.744521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.761565 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-499826a5-6e45-4604-b9f7-7c2994e15650 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1299 microversion: 2.1 time: 0.242969 Oct 04 18:17:51.762158 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1446/2935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:51.790662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.797203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.816921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.931823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.945527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.960890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.976772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c958fc9-949b-4278-96bf-ac3467bf3d96 tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1443 microversion: 2.75 time: 0.189947 Oct 04 18:17:51.977379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1447/2936] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:52.004685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.020320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.028316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.029569 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5fd2d3f0-ce54-4cd8-b671-9a4ed6c85e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.569017 Oct 04 18:17:52.049965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1490/2937] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:52.072663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.073756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.110213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.117813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.118665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.120661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.122487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.123498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.308989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1375451948", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "44443c95-d633-4a6b-81f6-bcef38893ea6"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:52.430971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] validate_networks() for [('44443c95-d633-4a6b-81f6-bcef38893ea6', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:52.558170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.578854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-accd716d-b540-42ab-9551-b12bdf1a06a0 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.526633 Oct 04 18:17:52.580059 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1491/2938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:52.789308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.790548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.815647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.819293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.820995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.823970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.824665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.825290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.928064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.929062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.929711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.930372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lazy-loading 'fault' on Instance uuid e5df31d7-3900-4a55-a3a0-996cab478cc0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:53.015753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.026000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3586dc9c-a829-4287-8a12-c323022dd5d3 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 200 len: 1304 microversion: 2.1 time: 0.240478 Oct 04 18:17:53.027899 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1492/2939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:53.046345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.049685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.057700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.058207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.063127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.063127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.063127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.063127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.114282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.114936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.115389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.115875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lazy-loading 'fault' on Instance uuid e9164f8c-eb78-4180-b7af-7820ffb87a42 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:53.150812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:53.170186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.196671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.205040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb3f57969b34414da047b95e70bfeb30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd83b2456e41af834fba0b053d0e63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.216277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:53.224162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cdf99d9-fc36-48ca-9299-eeda5b5774ee tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 200 len: 1448 microversion: 2.75 time: 0.189124 Oct 04 18:17:53.226597 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1493/2940] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 1448 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:53.236155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.255970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.278628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.279133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.279612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.285944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.290109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.290109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.489481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:53.490075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:53.490653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:53.491275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:53.491911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:53.506366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.506366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.506366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.506366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.506366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.507050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.551375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Getting quotas for project 2713047093794dcdb9be3f39afba3093. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:53.559890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.574236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Getting quotas for user efec48740d4f45d2844b4db8aea765c1 and project 2713047093794dcdb9be3f39afba3093. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:53.586709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.588185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.595350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:53.598223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:53.600110 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-106f7464-b6b5-4a6d-b1fa-6f7dca550b95 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.367941 Oct 04 18:17:53.600908 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1494/2941] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:53.618096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.623961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.644328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.644328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.644753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.645465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.645927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.646344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.797165 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa2298fa-1921-49c1-b798-982756a6be31 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802741 Oct 04 18:17:53.801100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1448/2942] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:53.810475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c05e80b-c7da-4c13-b1a7-854f0921be6e", "tag": "6ff96410-617f-49b7-a93c-0ba76d8a8703"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:53.826199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.826983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.827741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.847289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] Creating event network-changed:6ff96410-617f-49b7-a93c-0ba76d8a8703 for instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e on n-h1-833090-21 Oct 04 18:17:53.853629 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0215bbe0-bde2-4bd6-b4f1-e934e18b091d req-9c2a3192-0806-435a-b00b-67176916601f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054413 Oct 04 18:17:53.855979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1449/2943] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:53.862264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-211b26f0-513b-4afa-995e-4ff008d1aa5b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.863540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-211b26f0-513b-4afa-995e-4ff008d1aa5b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.938828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-211b26f0-513b-4afa-995e-4ff008d1aa5b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.947775 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-211b26f0-513b-4afa-995e-4ff008d1aa5b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1225 microversion: 2.1 time: 0.090388 Oct 04 18:17:53.949646 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1450/2944] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:53.982900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.998527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b86b7af-5366-4637-b973-7c13bd6fec25 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.396365 Oct 04 18:17:53.999140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1495/2945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.054705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.055418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: e5df31d7-3900-4a55-a3a0-996cab478cc0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.070740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.071253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.071731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.072459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.073462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.074071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.099868 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] HTTP exception thrown: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Request method failure captured: Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 HTTP/1.1 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhTrEJmRwWt3AaMF-McnieGPYh5Hra_fZp_AeNdd8KZSCYSU4hcO_D0ZrYCpwZsRBJPkm2eSApmjlHjnvu09j2oe4FE6_8LkAzXbF0XQH_M6Rr1_8sWb7yA9yYrfB7qUSuuEHR28r-A64250nLsRoWXTovvLMErj6FZdmmDC4Pbp2o Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a29727966f6b4407b8f5a040b267c855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a29727966f6b4407b8f5a040b267c855"}]}] Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminTestJSON-384894905 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2cfa0ac146a4d7894fccd9bc792b50a Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e5df31d7-3900-4a55-a3a0-996cab478cc0'} Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:54.101866 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Returning 404 to user: Instance e5df31d7-3900-4a55-a3a0-996cab478cc0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2d2cdc3-b625-4200-b779-86ab008a8910 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0" status: 404 len: 111 microversion: 2.1 time: 0.054595 Oct 04 18:17:54.109143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1451/2946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/e5df31d7-3900-4a55-a3a0-996cab478cc0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:54.114659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.115164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.121893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.122395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.122834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.123589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.124052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.124484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.153599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:54.261611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.263266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] [instance: e9164f8c-eb78-4180-b7af-7820ffb87a42] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.274043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.274936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.275601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.276494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.277168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.277681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.302360 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] HTTP exception thrown: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Request method failure captured: Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 HTTP/1.1 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHh2Xv4hs21EPvHnE0WNVoRpK5AW0UMpNdBMHnXCHbWKILbQxQEBhI_vwRJGluR8xWwNe6VgMMzGnst_5g8OHBrrgWoO_o8ElphM2QtIi3ZJpAwviK3OuJWXNSOkyzPZqqEbsaNz47Xs7TuHNQKg34-4pm6zoX1FIk2nriJv9WGOcOU Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f9fd83b2456e41af834fba0b053d0e63 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdmin275Test-1554911839 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9fd83b2456e41af834fba0b053d0e63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9fd83b2456e41af834fba0b053d0e63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9fd83b2456e41af834fba0b053d0e63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9fd83b2456e41af834fba0b053d0e63"}]}] Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdmin275Test-1554911839 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f9fd83b2456e41af834fba0b053d0e63 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdmin275Test-1554911839 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdmin275Test-1554911839-project Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bb3f57969b34414da047b95e70bfeb30 Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdmin275Test-1554911839-project Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e9164f8c-eb78-4180-b7af-7820ffb87a42'} Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:54.304405 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] Returning 404 to user: Instance e9164f8c-eb78-4180-b7af-7820ffb87a42 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5baf8f9e-64ed-4bef-9019-8c451155d52e tempest-ServersAdmin275Test-1554911839 tempest-ServersAdmin275Test-1554911839-project] 10.222.0.40 "GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42" status: 404 len: 111 microversion: 2.75 time: 0.055117 Oct 04 18:17:54.313194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1452/2947] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/e9164f8c-eb78-4180-b7af-7820ffb87a42 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:17:54.542396 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b997001-b1bb-433b-87c9-f8dce88d8300 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 204 len: 0 microversion: 2.1 time: 0.430813 Oct 04 18:17:54.545849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1496/2948] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:54 2022] DELETE /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:54.556484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.558408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.564702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.565192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.565629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.566616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.567242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.567728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.635044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.635778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.642001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.642459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.642850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.643556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.644017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.644629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.738438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.748273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e428e3f0-74aa-42cc-8ffc-8b9a7e509dea tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1469 microversion: 2.1 time: 0.196368 Oct 04 18:17:54.765209 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1453/2949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.886766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.900827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.900827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.902533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-09edb63a-b2b1-4d3d-887e-b926ccd80e41 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.270145 Oct 04 18:17:54.903497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1497/2950] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:54.975394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6250719f-0d0f-4a5a-8424-104763328013 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.975735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6250719f-0d0f-4a5a-8424-104763328013 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.027905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.028528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.035701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.036629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.037970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.039539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.040381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.041077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.061904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6250719f-0d0f-4a5a-8424-104763328013 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.071749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6250719f-0d0f-4a5a-8424-104763328013 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1225 microversion: 2.1 time: 0.099357 Oct 04 18:17:55.083621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1454/2951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:55.229833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.242800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-11a89468-f41b-4296-95ab-fbb7706b5600 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.220219 Oct 04 18:17:55.243578 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1498/2952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:55.779603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.780275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.789045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.789426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.789876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.791047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.791698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.792142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.929568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.931114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.939083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.939790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.940426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.941452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.941947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.942380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.007614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.018756 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc0acd25-95ef-41ae-b211-65d3786396c8 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1469 microversion: 2.1 time: 0.241442 Oct 04 18:17:56.019371 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1455/2953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1469 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:56.096359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.100024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.105731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.106423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.107035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.108029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.108655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.109242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.114473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:56.181309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.202069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72f2c989-6a11-4e73-af21-323b62e00df6 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1277 microversion: 2.1 time: 0.109738 Oct 04 18:17:56.202699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1456/2954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:56.266221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.271911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.275450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.276512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.283453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.284862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.284862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.285296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.341280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.357214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.358722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.364326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b763638-6eaa-41bb-ae3d-6f190cb2a011 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.438481 Oct 04 18:17:56.367505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1499/2955] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:56.525319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:56.534537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a61edc5-785f-462d-abac-50a8e9b05c09 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.272576 Oct 04 18:17:56.535477 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1457/2956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:57.055593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.056678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.071344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.076067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.076067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.076067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.087941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.092737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.226625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.227314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.237317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.237836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.243970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.245974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.246457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.248329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.358179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.367403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-704c71b1-51cc-4693-8f5e-892f391ab9e8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1285 microversion: 2.1 time: 0.145737 Oct 04 18:17:57.368016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1458/2957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:57.399744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.400369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.406878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.407782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.408437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.409376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.410126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.410779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.786049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.795055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ba439ff-e5b3-47c4-8044-0bbaf6070df7 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1469 microversion: 2.1 time: 0.750149 Oct 04 18:17:57.814952 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1500/2958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1469 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:57.820809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.821867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.828475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.829205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.829837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.830782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.832072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.832747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.878342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.891673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.893183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.894376 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c78a6bdb-8984-4562-8362-fc6a8f782a6c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.498641 Oct 04 18:17:57.895145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1459/2959] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:58.401888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.403279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.411375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.412255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.412915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.413831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.414516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.415156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.498151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.511517 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4dca16c7-8e1a-40f3-84b4-18e094ea67b7 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1283 microversion: 2.1 time: 0.113104 Oct 04 18:17:58.529491 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1460/2960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1283 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:58.662059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.672497 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06c7395a-79ac-419f-b974-b8d6ec84a3d2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.855754 Oct 04 18:17:58.673234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1501/2961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:58.819778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.821545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.828442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.829126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.829756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.831254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.831941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.832530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.925450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.926067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.933889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.936735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.936735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.936735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.936735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.937462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.038105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.049229 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f94268c-22de-4a11-a24a-e5d0370c4d68 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1469 microversion: 2.1 time: 0.233393 Oct 04 18:17:59.050232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1461/2962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1469 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.410648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bdc5e9-9598-4045-ab23-127e0d8160e9", "name": "network-vif-deleted", "tag": "eb6fc8c5-7559-49e2-8747-93be3b65016f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:59.423346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.423893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.424313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.429913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.442272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] Creating event network-vif-deleted:eb6fc8c5-7559-49e2-8747-93be3b65016f for instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 on n-h1-833090-21 Oct 04 18:17:59.446828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f2fbe270-3897-4bcb-81c8-75f1256a188b req-1c223e1c-2cb4-4621-a40e-9eff1f111c29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039198 Oct 04 18:17:59.448577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1462/2963] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:59.467046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.469319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.470726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d342a1d8-66ed-49e8-b298-bdc9ef7821a7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.549656 Oct 04 18:17:59.482716 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1502/2964] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:59.542734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.543664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.550501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.551232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.551912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.552836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.553448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.554039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.650510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.665608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fdbdcc8-dc53-448a-8d1c-c9476f58bc5e tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1283 microversion: 2.1 time: 0.126956 Oct 04 18:17:59.682259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1463/2965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:59.696520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.697159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.704466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.704957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.705494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.706142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.706596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.707026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.019205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.036534 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7e67605-b06b-40e3-82fd-ece983dba182 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.344020 Oct 04 18:18:00.039836 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1503/2966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:00.073875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.074493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.081107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.081605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.082275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.082988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.083445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.083944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.118732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.119308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.120384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.120898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lazy-loading 'fault' on Instance uuid 29bdc5e9-9598-4045-ab23-127e0d8160e9 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:00.225491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.229830 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b34410db-104b-4c9b-a5b0-c5f1bae3791f tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 200 len: 1303 microversion: 2.1 time: 0.160114 Oct 04 18:18:00.231445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1464/2967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:00.502276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.502928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.511080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.511601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.512333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.513309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.513838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.514522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.689810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.690752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.699422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.699942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.700404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.701105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.701553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.702177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.856900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.859513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:00.868655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.870873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.872366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16cbe56b-2a2f-474d-8a31-b38df862be05 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.375110 Oct 04 18:18:00.888043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1504/2968] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:00.962127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.973797 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66ca931c-a4d5-4cb3-a0ab-039ab4c5aca8 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.288869 Oct 04 18:18:00.974551 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1465/2969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.061839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.062581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c05e80b-c7da-4c13-b1a7-854f0921be6e", "name": "network-vif-plugged", "status": "completed", "tag": "6ff96410-617f-49b7-a93c-0ba76d8a8703"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:01.064124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.073512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.074376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.074820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.075551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.075681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.076287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.076812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.077322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.077774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.091364 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] Creating event network-vif-plugged:6ff96410-617f-49b7-a93c-0ba76d8a8703 for instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e on n-h1-833090-21 Oct 04 18:18:01.097856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c874d834-4dcd-425c-81d4-07aaa1758457 req-c99e7557-0215-4146-ab4b-89951ab3b137 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040339 Oct 04 18:18:01.098481 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1466/2970] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:01.255047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.256079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 29bdc5e9-9598-4045-ab23-127e0d8160e9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.262941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.263444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.263967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.264709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.265173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.265697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.287755 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] HTTP exception thrown: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Request method failure captured: Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 HTTP/1.1 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhTrEJmRwWt3AaMF-McnieGPYh5Hra_fZp_AeNdd8KZSCYSU4hcO_D0ZrYCpwZsRBJPkm2eSApmjlHjnvu09j2oe4FE6_8LkAzXbF0XQH_M6Rr1_8sWb7yA9yYrfB7qUSuuEHR28r-A64250nLsRoWXTovvLMErj6FZdmmDC4Pbp2o Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a29727966f6b4407b8f5a040b267c855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a29727966f6b4407b8f5a040b267c855"}]}] Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2cfa0ac146a4d7894fccd9bc792b50a Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '29bdc5e9-9598-4045-ab23-127e0d8160e9'} Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:01.290570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Returning 404 to user: Instance 29bdc5e9-9598-4045-ab23-127e0d8160e9 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89b2cd53-ff76-474c-b535-53c8076d3e22 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9" status: 404 len: 111 microversion: 2.1 time: 0.043024 Oct 04 18:18:01.298513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1467/2971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/29bdc5e9-9598-4045-ab23-127e0d8160e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:01.305868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.313396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.314224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.314725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.315173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.316157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.316514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.316951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.348841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:01.429732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.449627 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41b5b2f8-7c9d-4fb9-b9fb-9974f6036832 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.393357 Oct 04 18:18:01.455547 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1505/2972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:01.642527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:01.757306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fcf64ff-2f5f-4624-a211-d64c1609eccf tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 204 len: 0 microversion: 2.1 time: 0.455576 Oct 04 18:18:01.757986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1468/2973] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:01 2022] DELETE /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:18:01.767016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.767764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.774949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.775448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.776127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.777003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.777658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.778091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.901211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.901996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.909435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.910658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.911157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.912530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.913079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.914506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.074317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.088995 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-930909d0-9e4a-4513-8b4e-fa4f8f70eec4 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1469 microversion: 2.1 time: 0.325163 Oct 04 18:18:02.090499 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1506/2974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:02.097043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873691ee-d4f9-4b80-8714-fa266bd24d86", "tag": "c79df2a5-ac30-4270-b565-db92186d0839"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:02.115481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.116681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.117851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.136110 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] Creating event network-changed:c79df2a5-ac30-4270-b565-db92186d0839 for instance 873691ee-d4f9-4b80-8714-fa266bd24d86 on n-h2-833090-21 Oct 04 18:18:02.143286 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-dc6bc58a-6910-4dea-9827-33fd146f3aec req-10bb3a1b-9802-478d-a2c6-8a5de00229e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051174 Oct 04 18:18:02.144555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1507/2975] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:02.152427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.154004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.167983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.168783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.170771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.170771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.170771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.171083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.249088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.259216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.260823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.262008 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76e8967c-6bda-40db-8a2d-2b2f6f604501 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.365147 Oct 04 18:18:02.262573 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1469/2976] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:02.478958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.483008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.484106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.489863 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22bc2151-24a6-4292-87dc-a2fda59b064f tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.343899 Oct 04 18:18:02.491217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1508/2977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:02.499304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.499884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.500524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.502975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.504111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.504752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.733207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.742730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c811dc31-7da3-4a10-8ed4-b7d27a8b1529 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1318 microversion: 2.1 time: 0.268249 Oct 04 18:18:02.743928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1470/2978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:03.114748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.116144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.128122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.128931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.129574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.130506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.131174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.131840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.291803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.292444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.299619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.303152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.303695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.304448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.304923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.309003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.333300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.343617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6b1e646-fa03-4943-a991-6e105b162394 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1469 microversion: 2.1 time: 0.232635 Oct 04 18:18:03.358551 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1509/2979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:03.515718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.516652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.524385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.524882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.525318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.526102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.526684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.527136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.532250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:04.100658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.114466 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5dd3f97-5244-4097-acb7-f22eb02be379 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.602610 Oct 04 18:18:04.115075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1510/2980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:04.127261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.128908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.134331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.145106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.145892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.147983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.148889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.149697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.150311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.150784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.157908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.159654 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46343e82-bd6c-464c-86d5-282eda3bcf29 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.874255 Oct 04 18:18:04.160814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1471/2981] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:04.364499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.369288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.370747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.373175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7f4e080-6f87-4bcd-b881-3075df7c19aa tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1507 microversion: 2.1 time: 0.256949 Oct 04 18:18:04.377719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.378409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.379037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.379939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.380717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.381296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.388223 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1511/2982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:04.397586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.398350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.406211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.406843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.407346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.410623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.410623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.410623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.564930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.567525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:04.579223 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7453b445-e85f-4372-bb45-ccb5aec22aaa tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1469 microversion: 2.1 time: 0.213640 Oct 04 18:18:04.580815 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1472/2983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:04.605985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.614528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-709ed8be-0f36-486b-b8f8-5e21f69b7cb3 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1507 microversion: 2.1 time: 0.220737 Oct 04 18:18:04.622461 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1512/2984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:04.644882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:04.647420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.654026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.654516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.654949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.655711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.656157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.656770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.828623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a6062ab-7933-49d2-b837-f2ff8b90a0cb tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "PUT /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1079 microversion: 2.1 time: 0.187606 Oct 04 18:18:04.848919 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1473/2985] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:18:04 2022] PUT /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1079 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:04.849684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.850278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.861444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.861983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.862437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.863162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.865897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.866349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.976593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9775cd-f05b-4c85-b3cf-e880cd297f0a", "name": "network-vif-deleted", "tag": "439e59d5-0b56-4d19-9478-08b540360779"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:04.991216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.991724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.992332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.012125 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] Creating event network-vif-deleted:439e59d5-0b56-4d19-9478-08b540360779 for instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a on n-h1-833090-21 Oct 04 18:18:05.024635 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9d0aa3e5-6894-4a47-ad8c-23a821b798ef req-f9872eaa-7a6b-4eba-a715-5b5aac40615c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053893 Oct 04 18:18:05.026635 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1474/2986] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:05.137497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:05.144498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.146655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.167673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.170295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.172287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.173338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.176181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.177076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.189818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.214649 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-132ea143-dc7c-4950-acf0-33850c8cee2a tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1505 microversion: 2.1 time: 0.367268 Oct 04 18:18:05.216042 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1513/2987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:05.234836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.240817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.252983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.256260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.256976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.259030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.264273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.266439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.428787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.441538 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3877f4f0-ded8-4c17-87df-2f7ea030e023 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.304800 Oct 04 18:18:05.442954 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1475/2988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:05.456105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.457685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.473664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.474827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.476931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.477965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.480044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.480933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.652564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.678278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.684454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.685807 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6066fb31-e88f-416e-bca2-5cf32864667a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.468526 Oct 04 18:18:05.686608 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1514/2989] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:05.712024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "dc4eabdd-b140-47a0-9158-2dc152d32d6b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:05.734327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.734824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.738205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.774824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] Creating event network-vif-plugged:dc4eabdd-b140-47a0-9158-2dc152d32d6b for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:05.789826 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5919bfb7-34ec-4f78-a607-d6f86ea7de94 req-cd6f1fbd-403d-4194-bd34-1f43123b2089 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101203 Oct 04 18:18:05.790783 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1515/2990] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:05.811939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.813243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.826504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.836305 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66727255-b2e0-4f3e-a4b2-2050565efa3c tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1505 microversion: 2.1 time: 0.389526 Oct 04 18:18:05.837907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1476/2991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:05.843134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.844383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.844894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.846993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.846993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.846993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.871790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:05.888505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.899574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.904246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.904246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.907944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.913850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lazy-loading 'fault' on Instance uuid 0a9775cd-f05b-4c85-b3cf-e880cd297f0a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:05.916785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.917290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.918047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.918503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.918925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.074057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2cfa0ac146a4d7894fccd9bc792b50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29727966f6b4407b8f5a040b267c855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.092886 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e1413e5-c6f7-4eea-9ddb-49d076f12690 tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 200 len: 1304 microversion: 2.1 time: 0.298411 Oct 04 18:18:06.107908 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1516/2992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.185869 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5c8f7f2-6439-45c5-abb6-7935367cadd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "PUT /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1081 microversion: 2.1 time: 0.320823 Oct 04 18:18:06.187350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1477/2993] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:18:05 2022] PUT /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1081 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:06.206127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.207346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.217533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.218267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.218882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.220479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.221359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.221939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.477142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.479643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.498065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.501990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.503388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.504946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.505749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.509615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.567208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.578623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-48f2f930-6f12-4805-91b3-870a62528477 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1507 microversion: 2.1 time: 0.376064 Oct 04 18:18:06.584350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1517/2994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.613172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.614377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.625779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.626606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.627823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.629014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.629840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.644850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.914000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.927179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-122f0b47-8f66-492d-ab97-03b0644d4e86 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.462785 Oct 04 18:18:06.929634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1478/2995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.933742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.941805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.942446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.942562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-352e799c-984d-45bc-8116-5fe1943ad2d6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1507 microversion: 2.1 time: 0.336922 Oct 04 18:18:06.943148 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1518/2996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.956528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.958229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.958908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.960331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.960906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.962734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.986035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.986740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.005413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.005966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.006406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.007205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.007630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.008064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.056198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:07.295245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.310137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.313477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.314940 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce70f1ba-33cf-4d84-b8fa-78b3432581c3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.384283 Oct 04 18:18:07.315744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1479/2997] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:07.321107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.321940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] [instance: 0a9775cd-f05b-4c85-b3cf-e880cd297f0a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.329373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.330265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.330720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.331405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.331902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.332324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.349854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] HTTP exception thrown: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Request method failure captured: Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a HTTP/1.1 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhTrEJmRwWt3AaMF-McnieGPYh5Hra_fZp_AeNdd8KZSCYSU4hcO_D0ZrYCpwZsRBJPkm2eSApmjlHjnvu09j2oe4FE6_8LkAzXbF0XQH_M6Rr1_8sWb7yA9yYrfB7qUSuuEHR28r-A64250nLsRoWXTovvLMErj6FZdmmDC4Pbp2o Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a29727966f6b4407b8f5a040b267c855"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a29727966f6b4407b8f5a040b267c855"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a29727966f6b4407b8f5a040b267c855"}]}] Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: a29727966f6b4407b8f5a040b267c855 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminTestJSON-384894905 Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f2cfa0ac146a4d7894fccd9bc792b50a Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminTestJSON-384894905-project Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0a9775cd-f05b-4c85-b3cf-e880cd297f0a'} Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:07.351647 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] Returning 404 to user: Instance 0a9775cd-f05b-4c85-b3cf-e880cd297f0a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:07.357948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e74e033c-c965-4ad7-b855-213e5f7375fd tempest-ServersAdminTestJSON-384894905 tempest-ServersAdminTestJSON-384894905-project] 10.222.0.40 "GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a" status: 404 len: 111 microversion: 2.1 time: 0.036022 Oct 04 18:18:07.360086 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1480/2998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/0a9775cd-f05b-4c85-b3cf-e880cd297f0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:07.456423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5bb4831c-3ba9-4cf1-b552-73c1fd43ec21 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 204 len: 0 microversion: 2.1 time: 0.485623 Oct 04 18:18:07.457691 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1519/2999] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:06 2022] DELETE /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:18:07.472038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.472573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.482307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.483630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.484247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.485163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.485805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.486461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.540667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:07.727639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Instance is already in deleting state, ignoring this request Oct 04 18:18:07.728851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4140ea2-c702-4435-b0d9-1fd04deff333 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 204 len: 0 microversion: 2.1 time: 0.263117 Oct 04 18:18:07.734505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1481/3000] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:07 2022] DELETE /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:07.743392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.744154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.757730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.758280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.758735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.759492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.760623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.761284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.839898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "a4dc329c-14b4-4653-af03-c7ecc1d06ab1"}, {"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48"}, {"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "da05b590-9ea7-43df-b119-25810d130950"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:07.862800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.867953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.868890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.903233 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Creating event network-vif-plugged:a4dc329c-14b4-4653-af03-c7ecc1d06ab1 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:07.903481 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Creating event network-vif-plugged:0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:07.903982 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] Creating event network-vif-plugged:da05b590-9ea7-43df-b119-25810d130950 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:07.916375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-709f80be-b92f-4992-9d80-c380ad89ecfb req-78872298-8964-4b14-9b1a-0d201e96e2f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.103041 Oct 04 18:18:07.917386 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1482/3001] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:07.957243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.959398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.968746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.969747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.970643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.971614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.972714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.973302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.114347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.124820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:08.133044 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15a8e2de-c212-4dd0-8f4b-821f4777a1bd tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1513 microversion: 2.1 time: 0.396429 Oct 04 18:18:08.134025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1520/3002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:08.346054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.346857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.360384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.361517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.362624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.364116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.365095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.367497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.453680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.467805 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40597335-d99c-41de-ae48-7a017dc92f69 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.509837 Oct 04 18:18:08.468200 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1483/3003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:08.822161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.834400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.836365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.837994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22b3dc03-2795-4b4e-9a3d-4a45d0041d26 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.497487 Oct 04 18:18:08.839165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1521/3004] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:08 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:09.164342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.165390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.185143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.186217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.186765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.188008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.188699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.189352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.475889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] Calling method '.version_select at 0x7f9008cf6af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.602138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.620534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40951b2d-51d5-4e1c-858b-bcdb57fc683b could not be found", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:18:09.621506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] HTTP exception thrown: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] Request method failure captured: Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-floating-ips/40951b2d-51d5-4e1c-858b-bcdb57fc683b HTTP/1.1 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjgdybiZ1ui9FE28pG0ATzKhOYKvWxoLagaIglcA52Bge6iEjYxRJsbow9oYgW-YdWSIOsvDFBK34EkGzzX1aakedHpsz_m3ZG-S-WzHLqI2hUWNV4OTHkmbLcmX9IxA6-teApbsJjMoEbaK3VgYpcdVX2O4J9HsGaLius_zp7w3bM Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 4da69aac0f7a45769d65287986c674df Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-18566475 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4da69aac0f7a45769d65287986c674df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4da69aac0f7a45769d65287986c674df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4da69aac0f7a45769d65287986c674df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4da69aac0f7a45769d65287986c674df"}]}] Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-18566475 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 4da69aac0f7a45769d65287986c674df Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-18566475 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-18566475-project Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: b140d6779214406e836e5f71290ebd60 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-18566475-project Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: exception: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '40951b2d-51d5-4e1c-858b-bcdb57fc683b'} Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40951b2d-51d5-4e1c-858b-bcdb57fc683b could not be found Oct 04 18:18:09.625826 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f83d682-a6a7-41de-9b3f-385874603a75'] Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b. Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b Oct 04 18:18:09.630443 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:09.638537 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2185e4d3-0fe9-445c-bd51-7e49b0248447 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1513 microversion: 2.1 time: 0.466812 Oct 04 18:18:09.638728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] Returning 404 to user: Floating IP not found for ID 40951b2d-51d5-4e1c-858b-bcdb57fc683b {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:09.639695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92551c90-ed5a-4748-a0a6-99595cef2e01 tempest-FloatingIPDetailsNegativeTestJSON-18566475 tempest-FloatingIPDetailsNegativeTestJSON-18566475-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/40951b2d-51d5-4e1c-858b-bcdb57fc683b" status: 404 len: 111 microversion: 2.1 time: 0.565676 Oct 04 18:18:09.646442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1522/3005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1513 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:09.647597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1484/3006] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/os-floating-ips/40951b2d-51d5-4e1c-858b-bcdb57fc683b => generated 111 bytes in 577 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:09.655688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.660690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.672528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.672528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.672959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.673681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.674146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.674573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.847864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.858175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e80aac74-0d25-4a47-861a-c87d73d526ff tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.210504 Oct 04 18:18:09.859216 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1523/3007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:09.868436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.869452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.892312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.893982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.894958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.897983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.913392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.914256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.973250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "c11c9b08-6d87-4862-bf57-e7ac95c6ddf0"}, {"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "6001a711-fff4-4bb3-aa13-e6ffbf0fddf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:09.991586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.995145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.995145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.008913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Creating event network-vif-plugged:c11c9b08-6d87-4862-bf57-e7ac95c6ddf0 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:10.009689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] Creating event network-vif-plugged:6001a711-fff4-4bb3-aa13-e6ffbf0fddf6 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:10.017252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0541a062-4301-4b00-a2df-2cd1a5a3b058 req-e393bca6-4d67-4c34-ba41-80cbf1daa931 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055322 Oct 04 18:18:10.018972 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1524/3008] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:10.117138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c05e80b-c7da-4c13-b1a7-854f0921be6e", "name": "network-vif-deleted", "tag": "6ff96410-617f-49b7-a93c-0ba76d8a8703"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:10.130810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.130810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.130810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.150673 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] Creating event network-vif-deleted:6ff96410-617f-49b7-a93c-0ba76d8a8703 for instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e on n-h1-833090-21 Oct 04 18:18:10.164861 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ff842d85-7602-4f2b-864a-0bbe395252a0 req-d3cfb661-fe90-433e-8328-daa086858d9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057326 Oct 04 18:18:10.165488 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1525/3009] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:18:10.324026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.339294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.342295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.344354 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67b6ce0a-6697-4173-8074-646e66df38d3 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.479898 Oct 04 18:18:10.345653 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1485/3010] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:10.658336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.660145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.674793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.675894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.677038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.678943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.679682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.680317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.726559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.727261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.727875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.728483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lazy-loading 'fault' on Instance uuid 4c05e80b-c7da-4c13-b1a7-854f0921be6e {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:10.884199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.886271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.893514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.897952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.897952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.897952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.897952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.897952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.962863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf908d61d404d9bb9f84faddbe59d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b0338e25d74d1a9890ce182fef275a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.973562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70cd60d5-05cc-4756-9f26-b0e92c58fd17 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 200 len: 1308 microversion: 2.1 time: 0.323102 Oct 04 18:18:10.975106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1526/3011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.375081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.375738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.382259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.382757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.383198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.383971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.384432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.384857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.486163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.494614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee98d834-06f0-4cd2-8f82-649e544e9b99 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.614415 Oct 04 18:18:11.495525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1486/3012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.807875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.827710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.834974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:11.836508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b447c5a8-cdbf-42dd-8281-358a2e06388d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.465604 Oct 04 18:18:11.841621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1527/3013] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:12.001422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.003004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 4c05e80b-c7da-4c13-b1a7-854f0921be6e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.023607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.027380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.027957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.033953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.033953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.034814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.054500 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] HTTP exception thrown: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Request method failure captured: Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e HTTP/1.1 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHg8lbtZd4DGbsN18t8m9W1dTdVlg8W2Nf96gEYlNTJrUMCrSer8-b11vuKg9Ib-zHg41Q_TYuK64Fwt19SwWU7DYBd6sSYdLlWHrZNyI4xSs_x7KWDm5JmQHbNp1OFBV57btVJ7Ud3FZ3hdhj1gIMrSVotYYDNHhwoJUv3DF92KoMY Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b0338e25d74d1a9890ce182fef275a"}]}] Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbf908d61d404d9bb9f84faddbe59d9d Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4c05e80b-c7da-4c13-b1a7-854f0921be6e'} Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.056385 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Returning 404 to user: Instance 4c05e80b-c7da-4c13-b1a7-854f0921be6e could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44d29af8-b2e4-4052-9bcf-3ef1d51dc7a6 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e" status: 404 len: 111 microversion: 2.1 time: 0.067183 Oct 04 18:18:12.064835 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1487/3014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/4c05e80b-c7da-4c13-b1a7-854f0921be6e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.070697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.071866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.081618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.087063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.087063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.087063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.087063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.087063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.126247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] HTTP exception thrown: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Request method failure captured: Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 HTTP/1.1 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHg8lbtZd4DGbsN18t8m9W1dTdVlg8W2Nf96gEYlNTJrUMCrSer8-b11vuKg9Ib-zHg41Q_TYuK64Fwt19SwWU7DYBd6sSYdLlWHrZNyI4xSs_x7KWDm5JmQHbNp1OFBV57btVJ7Ud3FZ3hdhj1gIMrSVotYYDNHhwoJUv3DF92KoMY Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b0338e25d74d1a9890ce182fef275a"}]}] Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: dbf908d61d404d9bb9f84faddbe59d9d Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5'} Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.128051 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Returning 404 to user: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.132434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10157432-84cb-4ce5-a29b-a65dbcfb975e tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 404 len: 111 microversion: 2.1 time: 0.063165 Oct 04 18:18:12.137113 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1528/3015] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:12 2022] DELETE /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.139960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.140756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.154118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.154629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.158963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.159801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.160640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.161700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.194609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] HTTP exception thrown: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.202273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-plugged", "status": "completed", "tag": "83497e6e-55ee-4018-94b0-070a178c6b69"}, {"server_uuid": "873691ee-d4f9-4b80-8714-fa266bd24d86", "name": "network-vif-plugged", "status": "completed", "tag": "c79df2a5-ac30-4270-b565-db92186d0839"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Request method failure captured: Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 HTTP/1.1 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHg8lbtZd4DGbsN18t8m9W1dTdVlg8W2Nf96gEYlNTJrUMCrSer8-b11vuKg9Ib-zHg41Q_TYuK64Fwt19SwWU7DYBd6sSYdLlWHrZNyI4xSs_x7KWDm5JmQHbNp1OFBV57btVJ7Ud3FZ3hdhj1gIMrSVotYYDNHhwoJUv3DF92KoMY Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b0338e25d74d1a9890ce182fef275a"}]}] Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbf908d61d404d9bb9f84faddbe59d9d Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5'} Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.219329 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. Oct 04 18:18:12.224154 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.225978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Returning 404 to user: Instance b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.228215 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e14a8db-d383-49cd-90ea-e0205eef8dd2 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5" status: 404 len: 111 microversion: 2.1 time: 0.092236 Oct 04 18:18:12.236195 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1488/3016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/b261aff7-8f8e-46d6-8fac-c3c0fc3edcf5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.236623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.236623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.240385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.245792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.246333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.262485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.263041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.265189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.265189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.274393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Creating event network-vif-plugged:83497e6e-55ee-4018-94b0-070a178c6b69 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:12.274804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] Creating event network-vif-plugged:c79df2a5-ac30-4270-b565-db92186d0839 for instance 873691ee-d4f9-4b80-8714-fa266bd24d86 on n-h2-833090-21 Oct 04 18:18:12.275286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.276050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.300936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-72e786dd-d6d0-4643-b7b0-9427a4488cd8 req-14f83462-7093-4d19-a371-2f2067bf1a39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103995 Oct 04 18:18:12.301854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1529/3017] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:12.303156 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] HTTP exception thrown: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Request method failure captured: Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 HTTP/1.1 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHg8lbtZd4DGbsN18t8m9W1dTdVlg8W2Nf96gEYlNTJrUMCrSer8-b11vuKg9Ib-zHg41Q_TYuK64Fwt19SwWU7DYBd6sSYdLlWHrZNyI4xSs_x7KWDm5JmQHbNp1OFBV57btVJ7Ud3FZ3hdhj1gIMrSVotYYDNHhwoJUv3DF92KoMY Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b0338e25d74d1a9890ce182fef275a"}]}] Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbf908d61d404d9bb9f84faddbe59d9d Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '5d7077f5-a183-4fd9-8d2d-b1a132946077'} Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.305785 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.310975 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.314148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Returning 404 to user: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.314148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8697c64c-744d-495b-a424-075670becb73 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 404 len: 111 microversion: 2.1 time: 0.076894 Oct 04 18:18:12.314148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1489/3018] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:12 2022] DELETE /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:12.323552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.324407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] [instance: 5d7077f5-a183-4fd9-8d2d-b1a132946077] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.332229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.332797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.333328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.334172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.337554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.337554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.359217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] HTTP exception thrown: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Request method failure captured: Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 HTTP/1.1 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHg8lbtZd4DGbsN18t8m9W1dTdVlg8W2Nf96gEYlNTJrUMCrSer8-b11vuKg9Ib-zHg41Q_TYuK64Fwt19SwWU7DYBd6sSYdLlWHrZNyI4xSs_x7KWDm5JmQHbNp1OFBV57btVJ7Ud3FZ3hdhj1gIMrSVotYYDNHhwoJUv3DF92KoMY Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/49b0338e25d74d1a9890ce182fef275a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/49b0338e25d74d1a9890ce182fef275a"}]}] Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 49b0338e25d74d1a9890ce182fef275a Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2116224136 Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: dbf908d61d404d9bb9f84faddbe59d9d Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerDiskConfigTestJSON-2116224136-project Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5d7077f5-a183-4fd9-8d2d-b1a132946077'} Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:12.365636 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. Oct 04 18:18:12.371689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:12.373083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] Returning 404 to user: Instance 5d7077f5-a183-4fd9-8d2d-b1a132946077 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:12.377123 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec1d4f55-10fd-4dea-a9fa-fd04afd7d725 tempest-ServerDiskConfigTestJSON-2116224136 tempest-ServerDiskConfigTestJSON-2116224136-project] 10.222.0.40 "GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077" status: 404 len: 111 microversion: 2.1 time: 0.058416 Oct 04 18:18:12.381172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1530/3019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/5d7077f5-a183-4fd9-8d2d-b1a132946077 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:12.527188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.530363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.544595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.545334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.546141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.547910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.548730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.551433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.871225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:12.872422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:12.888648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.889274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.890103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.892348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:12.893057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:12.900970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.086654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.100689 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc144447-d7d9-4ec9-9eb0-d8119e46b831 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.584857 Oct 04 18:18:13.101724 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1490/3020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.392816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.420447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.422939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.425167 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7fd33d2-0582-4bee-b1fa-d712c6ba4feb tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.557722 Oct 04 18:18:13.426487 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1531/3021] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:12 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:14.126252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.126879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.145657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.149878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.149878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.149878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.149878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.149878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.467960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-529442787", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:14.569958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:14.628609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.649014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:14.673642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f1692e8-fc01-4d3e-93d4-4818cc1bb35c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1325 microversion: 2.1 time: 0.549858 Oct 04 18:18:14.676659 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1491/3022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1325 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:14.699088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.701214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.720742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.722195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.723187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.724735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.726347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.727395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.100108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.111120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.113015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.114558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eda6cf79-7864-445e-b215-6b1a3d0b2fd0 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1880 microversion: 2.42 time: 0.428454 Oct 04 18:18:15.115303 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1492/3023] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1880 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:15.170329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:15.170800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:15.171269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:15.171701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:15.172109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:15.181170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.182172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.182570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.183367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.183864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.184286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.203157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:15.205560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:15.209379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:15.222318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:15.224775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:15.458911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16cc47be-eb15-4bdc-8469-e82d429caa01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229701 Oct 04 18:18:15.467213 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1532/3024] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:15.473714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac46b25a-e98f-47c3-a876-89825e38a389 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.474549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac46b25a-e98f-47c3-a876-89825e38a389 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.837669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.838770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.848968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.849566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.850001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.850781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.851398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.851922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.898824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:16.054299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac46b25a-e98f-47c3-a876-89825e38a389 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.066157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac46b25a-e98f-47c3-a876-89825e38a389 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1216 microversion: 2.1 time: 0.596559 Oct 04 18:18:16.067326 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1493/3025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1216 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:16.076708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.076937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.088234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.089017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.089671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.091106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.092447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.103098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.371159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f54bdde-956c-42d1-acf1-58c1f05b8a9b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 204 len: 0 microversion: 2.32 time: 0.821297 Oct 04 18:18:16.373807 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1533/3026] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:15 2022] DELETE /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:18:16.380223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.381743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.401250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.402143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.403202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.405202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.405900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.407085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.462083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.477912 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a1ef435-b757-494a-ad08-2cf81d2627c0 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1522 microversion: 2.1 time: 0.408470 Oct 04 18:18:16.481809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1494/3027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:16.492512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.494950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.505255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.506963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.507950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.508923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.510937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.511513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.724709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.738444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.740421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.746244 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94a1a841-fdba-4dea-a92f-85401d95943f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2836 microversion: 2.42 time: 0.369028 Oct 04 18:18:16.746244 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1534/3028] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2836 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:16.750383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.751699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.764972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.768707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.768707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.768707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.768707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.769840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.828085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] HTTP exception thrown: Action 999 not found Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Request method failure captured: Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86/os-instance-actions/999 HTTP/1.1 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjPSA_7o4YQZYGgwJZjnJCJemSsMmi5GpIIWdWsBd9OhaVLK5EtdylamxeBtQvdBwtXa81uDJITQvNmTCkXjOrvp6E-fXYr7tatTmKO-jYlNbkRdJPrp12nSQ-jffl4UaG8NXMm_ys182RlYhH5z77xijH7ptSkuldIeXwVWZKPeho Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2713047093794dcdb9be3f39afba3093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2713047093794dcdb9be3f39afba3093"}]}] Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: efec48740d4f45d2844b4db8aea765c1 Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: exception: Action 999 not found Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '873691ee-d4f9-4b80-8714-fa266bd24d86', 'id': '999'} Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 18:18:16.839168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.847795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Returning 404 to user: Action 999 not found {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:16.849043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b96dcad-7c0b-468e-a5cb-582a38eb0025 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.105098 Oct 04 18:18:16.850230 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1535/3029] 10.222.0.40 () {58 vars in 1308 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86/os-instance-actions/999 => generated 66 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:18:16.856076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.857524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.864671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.866814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.866814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.868668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.869846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.870757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.929041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.944799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.946633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.949662 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d04a3724-8ade-46ea-840c-3826a1959e52 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2954 microversion: 2.32 time: 0.466024 Oct 04 18:18:16.959509 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1495/3030] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2954 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:16.959509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '.version_select at 0x7f9008cf6e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.959509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 42538678-1e64-4be0-9fad-35a064b28a7f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.963331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] HTTP exception thrown: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Request method failure captured: Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/42538678-1e64-4be0-9fad-35a064b28a7f/os-instance-actions HTTP/1.1 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjPSA_7o4YQZYGgwJZjnJCJemSsMmi5GpIIWdWsBd9OhaVLK5EtdylamxeBtQvdBwtXa81uDJITQvNmTCkXjOrvp6E-fXYr7tatTmKO-jYlNbkRdJPrp12nSQ-jffl4UaG8NXMm_ys182RlYhH5z77xijH7ptSkuldIeXwVWZKPeho Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2713047093794dcdb9be3f39afba3093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2713047093794dcdb9be3f39afba3093"}]}] Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: efec48740d4f45d2844b4db8aea765c1 Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': '42538678-1e64-4be0-9fad-35a064b28a7f'} Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:16.966078 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Returning 404 to user: Instance 42538678-1e64-4be0-9fad-35a064b28a7f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce0cbfe6-0dd6-4244-a405-df9303ab7940 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/42538678-1e64-4be0-9fad-35a064b28a7f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.022789 Oct 04 18:18:16.977533 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1496/3031] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/42538678-1e64-4be0-9fad-35a064b28a7f/os-instance-actions => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:16.988234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.988234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.998694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.999206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.999947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.000730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.001301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.001795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.045617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:17.110544 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-172887e8-3e28-4d97-bbb1-e8a5712fa7a8 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.258642 Oct 04 18:18:17.111218 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1536/3032] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335/os-interface => generated 1830 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:17.116123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.117309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.130805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.131311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.131775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.132495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.132955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.133386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.261709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.274789 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae693b50-5bc7-4c20-9851-3ac068b499c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1220 microversion: 2.1 time: 0.162277 Oct 04 18:18:17.294268 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1537/3033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.407109 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0fa82d1-7cf4-4524-99f5-74855b9b780b tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "DELETE /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 204 len: 0 microversion: 2.1 time: 0.423023 Oct 04 18:18:17.407793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1497/3034] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:16 2022] DELETE /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:18:17.417971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.418797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:17.428302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.439441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.440124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.441074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.445257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.450695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.892566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:17.902415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9ce024e-5a21-48cf-aa98-26f2a8274927 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1528 microversion: 2.1 time: 0.488777 Oct 04 18:18:17.903413 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1538/3035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1528 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:17.984427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:17.990087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.000596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.001436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.002170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.003139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.003848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.004448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.228283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.241045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.242780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.244105 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4292f71-1be7-4370-b8b4-edb67f58123b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2954 microversion: 2.32 time: 0.265582 Oct 04 18:18:18.244880 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1498/3036] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:17 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2954 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:18.302191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.303842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.310354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.310832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.311271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.312013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.312740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.313245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.429607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.433152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:18.440376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3aedc1a5-70b9-4ebb-94c7-af6fb845eeb6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1220 microversion: 2.1 time: 0.142704 Oct 04 18:18:18.441338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1539/3037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:18.926499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.927353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.947152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.948237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.967927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.969005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.969657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.970424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.210718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:19.220085 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4bc1773-ff45-4088-b19d-71c02d420060 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1528 microversion: 2.1 time: 0.297685 Oct 04 18:18:19.236145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1499/3038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:19.276278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:19.276907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:19.285335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.285335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.285335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.285335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.285685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.285985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.470270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:19.471200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:19.481348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.483894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.489806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.490573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.491062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.491557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.620676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:19.633854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1461f339-738f-4502-85be-e68ecf211a51 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1212 microversion: 2.1 time: 0.167796 Oct 04 18:18:19.648031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1500/3039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:19 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:20.009433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "tag": "6001a711-fff4-4bb3-aa13-e6ffbf0fddf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:20.037286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.037770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.041107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.085734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] Creating event network-changed:6001a711-fff4-4bb3-aa13-e6ffbf0fddf6 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:18:20.135393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1710640d-d0e5-435a-9e1d-f44ee2e171d6 req-6a0f54f2-d7c2-475e-a7c0-fef4a9cb87c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098193 Oct 04 18:18:20.135393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1501/3040] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:20.206752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873691ee-d4f9-4b80-8714-fa266bd24d86", "name": "network-vif-deleted", "tag": "c79df2a5-ac30-4270-b565-db92186d0839"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:20.229351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.230018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.230672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.250326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] Creating event network-vif-deleted:c79df2a5-ac30-4270-b565-db92186d0839 for instance 873691ee-d4f9-4b80-8714-fa266bd24d86 on n-h2-833090-21 Oct 04 18:18:20.255635 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e808bfcf-78bc-407c-9d98-5c2f53fc4c9c req-d601e15e-74de-44e5-8cfc-dee5261ba3cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054191 Oct 04 18:18:20.259679 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1502/3041] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:20.266140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:20.266865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:20.273946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.274481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.274952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.276217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.292389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.293098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.437920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.459788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-859ac3c4-350d-4a75-9c0d-e640dc0bdc4d tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1486 microversion: 2.1 time: 0.193981 Oct 04 18:18:20.459788 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1503/3042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:20 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1486 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:20.576163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.592442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.594102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.598487 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-178a5c29-25e6-49e4-9811-94f25319d719 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2954 microversion: 2.32 time: 1.329012 Oct 04 18:18:20.599296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1540/3043] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:19 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2954 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:20.673289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:20.675818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:20.684572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.690966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.691873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.695831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.696601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.702470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.812833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.824224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24d25c85-5cba-4b9a-8778-7c9c0ae3b59e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1276 microversion: 2.1 time: 0.160296 Oct 04 18:18:20.837879 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1504/3044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:20 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:21.485984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:21.486602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:21.493834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.494861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.495276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.496204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.496838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.497273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.551430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.552278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.559046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.559046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lazy-loading 'fault' on Instance uuid 873691ee-d4f9-4b80-8714-fa266bd24d86 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:21.642618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:21.643076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:21.669683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.670196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.674564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.675409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.675725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efec48740d4f45d2844b4db8aea765c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2713047093794dcdb9be3f39afba3093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:21.676196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.676365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.714905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d265280-699f-4ab0-8da7-38ed12c49ac3 tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 200 len: 1315 microversion: 2.1 time: 0.232669 Oct 04 18:18:21.717047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1541/3045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:21 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:21.855681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:21.856443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:21.873399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.878400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.878400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:21.878400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:21.878400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:21.878400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.003897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.016228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cff2749d-b881-46b5-916a-a29cbed1c80f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1274 microversion: 2.1 time: 0.166217 Oct 04 18:18:22.018330 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1542/3046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:21 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:22.341425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.357523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.359008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:22.365765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6c33c08-e383-4e0e-b465-e243d630cd3e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2954 microversion: 2.32 time: 0.731452 Oct 04 18:18:22.369312 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1505/3047] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:21 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2954 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:22.741982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:22.742780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] [instance: 873691ee-d4f9-4b80-8714-fa266bd24d86] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:22.764521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.765056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.765505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.766228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:22.774534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:22.775168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:22.834996 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] HTTP exception thrown: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Request method failure captured: Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 HTTP/1.1 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjPSA_7o4YQZYGgwJZjnJCJemSsMmi5GpIIWdWsBd9OhaVLK5EtdylamxeBtQvdBwtXa81uDJITQvNmTCkXjOrvp6E-fXYr7tatTmKO-jYlNbkRdJPrp12nSQ-jffl4UaG8NXMm_ys182RlYhH5z77xijH7ptSkuldIeXwVWZKPeho Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2713047093794dcdb9be3f39afba3093"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2713047093794dcdb9be3f39afba3093"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2713047093794dcdb9be3f39afba3093"}]}] Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2713047093794dcdb9be3f39afba3093 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1598504444 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: efec48740d4f45d2844b4db8aea765c1 Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1598504444-project Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '873691ee-d4f9-4b80-8714-fa266bd24d86'} Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:22.841407 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] Returning 404 to user: Instance 873691ee-d4f9-4b80-8714-fa266bd24d86 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6dd8abc5-21e8-4fbc-bea7-519cb8fc216c tempest-InstanceActionsNegativeTestJSON-1598504444 tempest-InstanceActionsNegativeTestJSON-1598504444-project] 10.222.0.40 "GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86" status: 404 len: 111 microversion: 2.1 time: 0.106845 Oct 04 18:18:22.851701 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1543/3048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:22 2022] GET /compute/v2.1/servers/873691ee-d4f9-4b80-8714-fa266bd24d86 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:23.048024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.049348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:23.062295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.063138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.067208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.071868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.071868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.071868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.184549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "5d6fb9ca-6108-4c08-ba1b-8fc12efdc239"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:23.208626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.211094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.211904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.228348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] Creating event network-vif-unplugged:5d6fb9ca-6108-4c08-ba1b-8fc12efdc239 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:23.239632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a9b9d125-0e1d-4c49-b630-3fd0026aa80f req-86662921-b92b-4ae6-84a0-46861e04623e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056266 Oct 04 18:18:23.239632 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1544/3049] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:23.401488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.402316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:23.419615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.425953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.428354 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a2edc39-73bc-4e97-9939-e1f93a01287c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.387211 Oct 04 18:18:23.428499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.428931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.432547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:23.433046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:23.433492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:23.434548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1506/3050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:23.795077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0591b7a3-1b85-4a93-9da5-0cd1324a94e9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008ca1ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.846412 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0591b7a3-1b85-4a93-9da5-0cd1324a94e9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7" status: 200 len: 661 microversion: 2.1 time: 0.056619 Oct 04 18:18:23.853329 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1507/3051] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:23.864116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe2752dc-64ab-4898-8501-0aec3e95dd78 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c62160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:23.941396 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe2752dc-64ab-4898-8501-0aec3e95dd78 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7" status: 200 len: 661 microversion: 2.1 time: 0.082695 Oct 04 18:18:23.942314 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1508/3052] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7 => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:23.959118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.983948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.986346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:23.990030 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0677b2e9-d0bc-4aef-a718-5cc555f1169e tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2933 microversion: 2.32 time: 0.593994 Oct 04 18:18:23.990885 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1545/3053] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:23 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2933 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:24.459097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:24.460736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:24.474080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.475040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.477036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.478159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:24.479512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:24.480376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:24.981123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:24.995501 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3bee62b9-f225-451b-b578-ec12ef6b5b90 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.545302 Oct 04 18:18:24.996726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1509/3054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:24 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:25.023769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:25.024404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:25.032992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.033738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.034233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.035227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.035731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.036172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.105370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461c164b-77d5-4f3b-a945-f1cac32068cf", "tag": "6c0a5864-8d92-4700-ac6f-895c320d25ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:25.124907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.127247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.128353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.145564 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] Creating event network-changed:6c0a5864-8d92-4700-ac6f-895c320d25ad for instance 461c164b-77d5-4f3b-a945-f1cac32068cf on n-h1-833090-21 Oct 04 18:18:25.152362 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d74a1de8-b0f6-45f5-8624-87fee52be0a1 req-7eb6780b-c994-4597-b16e-1198834ab4bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051380 Oct 04 18:18:25.157299 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1510/3055] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:25.191859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:25.216337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:25.279723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "1631307a-60e8-430b-a272-eddadcf33c16"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "b31e804b-098e-4fbd-bb38-ff0475bfe7fb"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "55e150a2-4085-40dd-a60d-a0bb1bf9491f"}, {"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "e6994394-dab0-410e-bc2a-4375d059e115"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:25.312877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:25.312877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:25.312877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:25.329452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Creating event network-vif-unplugged:1631307a-60e8-430b-a272-eddadcf33c16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:25.330448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Creating event network-vif-unplugged:b31e804b-098e-4fbd-bb38-ff0475bfe7fb for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:25.331145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Creating event network-vif-unplugged:55e150a2-4085-40dd-a60d-a0bb1bf9491f for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:25.331876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] Creating event network-vif-unplugged:e6994394-dab0-410e-bc2a-4375d059e115 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:25.339250 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3cf207b3-764a-4076-b17b-07ec6bee1caf req-cfbccace-8691-460e-97a1-be0dd1476e6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.064495 Oct 04 18:18:25.340344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1511/3056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:25.678483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.694679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.699873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:25.701866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4680bcd1-bc98-49ce-827a-64e8981424e8 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2912 microversion: 2.32 time: 0.682723 Oct 04 18:18:25.703129 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1546/3057] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:25 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2912 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:26.019889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.022126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.029334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.030085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.030930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.034212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.034949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.035971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.062077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:26.166865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-deleted", "tag": "5d6fb9ca-6108-4c08-ba1b-8fc12efdc239"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:26.172383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.173253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.173873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.188152 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] Creating event network-vif-deleted:5d6fb9ca-6108-4c08-ba1b-8fc12efdc239 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:26.194598 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-58a54db6-36e7-4f7a-82bc-a1ab84ab0156 req-66f91372-b121-4c9b-b1b0-9dab71a0004b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039021 Oct 04 18:18:26.195799 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1547/3058] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:26.210687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.220161 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-184de32d-f4f9-4c6e-b932-c351c6996655 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.205334 Oct 04 18:18:26.221542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1512/3059] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:26.277955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cf3f116-8b49-4909-90bd-315725b7588c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d8b8040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.329195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cf3f116-8b49-4909-90bd-315725b7588c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84" status: 200 len: 661 microversion: 2.1 time: 0.056021 Oct 04 18:18:26.329865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1548/3060] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:26.344472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58fe6aa6-0f1b-4a2b-89ba-ab5ba3bae7dd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cf6310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.404344 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58fe6aa6-0f1b-4a2b-89ba-ab5ba3bae7dd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84" status: 200 len: 661 microversion: 2.1 time: 0.062946 Oct 04 18:18:26.405379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1513/3061] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84 => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:26.729859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:26.730857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:26.737896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.738364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.738813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.739811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.740307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.740740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.947985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.963747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.965835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:26.967273 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81d8e0b4-da9c-4b4a-94be-8e5e90de7842 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2865 microversion: 2.32 time: 0.241578 Oct 04 18:18:26.968346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1549/3062] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:26 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2865 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:27.248031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:27.249473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:27.259120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.260009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.261648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.261648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.262316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.264058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.283242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:27.365244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-unplugged", "status": "completed", "tag": "c4cfa452-b8fc-474c-8735-893bf4599d16"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:27.377749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:27.378726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:27.379941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:27.397670 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] Creating event network-vif-unplugged:c4cfa452-b8fc-474c-8735-893bf4599d16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:27.405201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f32ca383-c355-407d-88be-85064a0f969b req-793efd76-7237-4882-909d-3ac903b9c726 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049623 Oct 04 18:18:27.406486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1550/3063] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:27.623051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:27.632141 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc832423-eafa-443f-8931-ee607c961371 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.390391 Oct 04 18:18:27.635832 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1514/3064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:27 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:28.007182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.008234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:28.016471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.017216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.017851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.019129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.019850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.020507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.282540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-deleted", "tag": "55e150a2-4085-40dd-a60d-a0bb1bf9491f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:28.295370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.296245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.296667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.315704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] Creating event network-vif-deleted:55e150a2-4085-40dd-a60d-a0bb1bf9491f for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:28.322553 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a2bd08d7-3aab-45c0-a7ff-f0ebae04b431 req-42ecd3bf-5333-42c0-8433-ab2091f0d3b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048316 Oct 04 18:18:28.323928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1515/3065] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:28.657736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:28.658719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:28.665612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.666577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.667026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.668511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:28.669337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:28.669804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:28.943271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.965419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.965419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:28.984646 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5006ecf6-b236-4fe3-8a3e-80e97f42531c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2704 microversion: 2.32 time: 0.974864 Oct 04 18:18:28.984646 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1551/3066] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:27 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2704 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:28.992337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:29.006091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95d7f0b6-6077-42ae-9f8b-5f62ec84a8e9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d8d93a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.015970 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-977dae22-29b2-4557-9932-cf31f984f50b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.351608 Oct 04 18:18:29.016782 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1516/3067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:29.081242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95d7f0b6-6077-42ae-9f8b-5f62ec84a8e9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290" status: 200 len: 661 microversion: 2.1 time: 0.105028 Oct 04 18:18:29.081834 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1552/3068] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:28 2022] GET /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290 => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:29.104441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0eede5bb-5123-44fc-96b8-004e1fd4e4ba tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008dccee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:29.196555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0eede5bb-5123-44fc-96b8-004e1fd4e4ba tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290" status: 200 len: 661 microversion: 2.1 time: 0.098831 Oct 04 18:18:29.198484 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1517/3069] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290 => generated 661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:29.381084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-123656193", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:29.467231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:30.002988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.002988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.012224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:30.013017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.013513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.013955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.014656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.015109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.015566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.040951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:30.042935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:30.044019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:30.044639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:30.045063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:30.076831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.079180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.080998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.082404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.083851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.084677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.120572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Getting quotas for project e56daf161e674685a97c23130e286753. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:30.128522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Getting quotas for user 948471454a124638b8c4a3ee800c21de and project e56daf161e674685a97c23130e286753. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:30.159131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:30.177606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:30.329465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.341704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.343454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.344710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-829bf4e6-ab2c-48c8-ac20-82f1298c8947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2499 microversion: 2.32 time: 0.347578 Oct 04 18:18:30.345447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1518/3070] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:29 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2499 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:30.350310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:30.351243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:30.357890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.358583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.359180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.360080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.360706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.361130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.397112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cec328bd-70c2-434d-8a1b-0573f10d656a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020222 Oct 04 18:18:30.398378 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1553/3071] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:30.476814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1162245470", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:30.594682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:30.739902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:30.749373 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-982d9418-301d-4f8d-9580-757db0eb1691 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.402727 Oct 04 18:18:30.753544 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1519/3072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:30 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:30.780682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-deleted", "tag": "b31e804b-098e-4fbd-bb38-ff0475bfe7fb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:30.805739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:30.808605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:30.810023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:30.851908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] Creating event network-vif-deleted:b31e804b-098e-4fbd-bb38-ff0475bfe7fb for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:30.866760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7dc28a7c-7802-4448-9b5e-be6d46d57c2b req-1e4252ca-3470-485b-b0e2-e064d7e68087 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096982 Oct 04 18:18:30.867727 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1520/3073] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:31.156139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:31.156645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:31.157036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:31.157952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:31.158428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:31.185769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.186268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.186708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.193062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.193758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.194394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.215149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Getting quotas for project e56daf161e674685a97c23130e286753. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:31.232300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Getting quotas for user 948471454a124638b8c4a3ee800c21de and project e56daf161e674685a97c23130e286753. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:31.255128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:31.257011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461c164b-77d5-4f3b-a945-f1cac32068cf", "name": "network-vif-plugged", "status": "completed", "tag": "6c0a5864-8d92-4700-ac6f-895c320d25ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:31.258303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:31.268994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.269630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.270865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.304657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] Creating event network-vif-plugged:6c0a5864-8d92-4700-ac6f-895c320d25ad for instance 461c164b-77d5-4f3b-a945-f1cac32068cf on n-h1-833090-21 Oct 04 18:18:31.318798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9d4f273b-2f1a-49b2-8884-1228fe8dadbe req-678e3a70-b3ce-468b-baa2-811ae9c85046 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068421 Oct 04 18:18:31.321359 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1521/3074] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:31.376275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.377816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.386469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.387044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.387584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.388525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.389048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.389599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.472690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-31c476a2-f226-4d54-9f3b-3c2bd303e0eb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999394 Oct 04 18:18:31.473397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1554/3075] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:31.495010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-501c5567-f7c0-4aaf-80c3-4b6727ddab57 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.497085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-501c5567-f7c0-4aaf-80c3-4b6727ddab57 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.708462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-501c5567-f7c0-4aaf-80c3-4b6727ddab57 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.718157 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-501c5567-f7c0-4aaf-80c3-4b6727ddab57 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1218 microversion: 2.1 time: 0.237246 Oct 04 18:18:31.718761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1555/3076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:31.735406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.749665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.751332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.752642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5c0ef8e7-d6c9-49ad-8f3e-9619501a3e2f tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2165 microversion: 2.32 time: 0.381953 Oct 04 18:18:31.767925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1522/3077] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2165 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:31.785280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.785923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.797855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.798362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.798807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.799549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.800090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.800522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.900050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.908855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:31.910047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Searching by: {'deleted': False, 'project_id': 'a229d6518a42411d83024cbc09a46c14'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:18:31.932271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.933039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.935819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.937502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.938699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.939968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.015296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:18:32.079402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-612290ec-b5df-4011-9018-64066f5177e1 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.187765 Oct 04 18:18:32.084274 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1523/3078] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers => generated 340 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:32.104162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.122036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.123387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Searching by: {'deleted': False, 'project_id': 'a229d6518a42411d83024cbc09a46c14'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:18:32.130165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.131046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.131794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.132836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.135697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.136376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.180878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:18:32.293825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.302582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.303240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.303867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.586082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e6de4f6-ee61-4391-b717-71ef9533f62c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.491606 Oct 04 18:18:32.607323 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1524/3079] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.613985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2cfb1130-29f7-4f11-b03d-8a4f95cca64c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.628549 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2cfb1130-29f7-4f11-b03d-8a4f95cca64c tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018465 Oct 04 18:18:32.629707 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1525/3080] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:32.657182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.666280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-efdb261c-030b-4226-a7be-b0ff71cf2d35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1316 microversion: 2.1 time: 0.884608 Oct 04 18:18:32.666884 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1556/3081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.741515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-400c92c1-a2cc-4a67-a470-591f0cdeeea5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.746255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-400c92c1-a2cc-4a67-a470-591f0cdeeea5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.789016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.789663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.798568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.799069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.799541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.800260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.806829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.813092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.873575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-400c92c1-a2cc-4a67-a470-591f0cdeeea5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.884183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-400c92c1-a2cc-4a67-a470-591f0cdeeea5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1218 microversion: 2.1 time: 0.147049 Oct 04 18:18:32.899996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1526/3082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:32.945739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:32.946819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:32.955637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.956687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.957258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.958075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:32.958692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:32.959537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:32.994342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:33.221032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.248907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.255587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.257384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66446da2-8a7d-48f7-968f-bc652c64fa7c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 2165 microversion: 2.32 time: 0.472952 Oct 04 18:18:33.262495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1557/3083] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:32 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 2165 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:33.269430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-deleted", "tag": "c4cfa452-b8fc-474c-8735-893bf4599d16"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:33.320871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.323744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.326190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.396369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] Creating event network-vif-deleted:c4cfa452-b8fc-474c-8735-893bf4599d16 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:33.439714 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7ea0a413-e876-43ce-9812-86a59e75425e req-0ac71df2-eadf-4c97-ac35-2683f8d48111 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169428 Oct 04 18:18:33.440091 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1558/3084] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:33.656186 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd7773b8-2701-4551-b679-bee87d5c5284 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 204 len: 0 microversion: 2.1 time: 0.718265 Oct 04 18:18:33.659841 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1527/3085] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:32 2022] DELETE /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:33.667104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.667853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.675371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.676018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.676502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.677222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.677678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.678149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.713079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.713831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.729365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.730392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.731130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.732588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.733104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.733541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.235404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.249822 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af665082-deb1-4b34-a616-8b11cdbd3309 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1465 microversion: 2.1 time: 0.562146 Oct 04 18:18:34.267581 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1528/3086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1465 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:34.267581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.267581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.289057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.289564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.290304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.290793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.291289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.291749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.444321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.454609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c05a546-7a49-4c1b-b8c8-1697e59a5262 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1214 microversion: 2.1 time: 0.199857 Oct 04 18:18:34.472165 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1529/3087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:34.711941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.713117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.725043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.728918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.729474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.731078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.731661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.732205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.873851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.885998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-135186c7-2b63-41bd-b944-2d86ae6d0c66 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1713 microversion: 2.1 time: 1.224539 Oct 04 18:18:34.891027 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1559/3088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1713 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:34.909523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.910399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.922696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.923295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.924293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.925989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.926674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.927440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.049360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.060388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.061870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.063084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e176619a-d3f3-4d2c-bf49-bcfb51d09aea tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.170951 Oct 04 18:18:35.064015 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1560/3089] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:35.228270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78473006-1722-4c40-a146-4a0afd43be30 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1618 microversion: 2.1 time: 0.754811 Oct 04 18:18:35.240347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1530/3090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1618 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:35.263043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: .version_select at 0x7f900906ec10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1405323860", "policies": ["affinity"]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:35.290112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:35.305103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:35.315389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:35.482990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.484757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.499214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.500235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.500934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.502084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.503004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.503721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.518808 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:18:35.630603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.642582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7380e146-54f8-47e4-9285-2dedc99668c2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1214 microversion: 2.1 time: 0.162696 Oct 04 18:18:35.644171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1531/3091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:35.656866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e11e7-391b-40eb-9011-00705abbae91", "name": "network-vif-deleted", "tag": "e6994394-dab0-410e-bc2a-4375d059e115"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:35.672651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.673472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.674132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.693198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] Creating event network-vif-deleted:e6994394-dab0-410e-bc2a-4375d059e115 for instance 3f1e11e7-391b-40eb-9011-00705abbae91 on n-h1-833090-21 Oct 04 18:18:35.698947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-183d9600-6ce5-49bf-9dd8-45893c349afd req-15a601c0-7af1-4429-a0bb-3b06280bf61e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052735 Oct 04 18:18:35.700400 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1532/3092] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:35.919038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.923747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.943753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.945176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.947528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.949418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.951372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.953671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.467123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.477807 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45e0617c-03d9-4b7f-9682-9d09b6f32303 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1713 microversion: 2.1 time: 0.565534 Oct 04 18:18:36.479036 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1533/3093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1713 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:36.484836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:36.485454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:36.493265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.493882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.494534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.495321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.495808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.496517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.504680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:36.530394 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 50342. Oct 04 18:18:36.588474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:36.602653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:36.627747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.635625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04e01686-279d-40c0-9bdf-55594a1c8d40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 1.381133 Oct 04 18:18:36.637044 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1561/3094] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 4 18:18:35 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:36.644421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.646246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.647981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee24b5d1-4633-4787-8dd7-a17c2540c536 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.167767 Oct 04 18:18:36.652320 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1534/3095] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:36 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:36.670439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:36.671321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:36.699758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.701253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.704054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.711204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.713623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.714885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.890346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-420696788", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "38c4bafe-8ec8-432a-ac46-85e4ae613811"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:36.946850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.955137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67258ef3-8d1a-44bf-94dc-de2fb8c5bcb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1270 microversion: 2.1 time: 0.291214 Oct 04 18:18:36.955777 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1562/3096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:36 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:37.045446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:37.443711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:37.444188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:37.444675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:37.445094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:37.445593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:37.503417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.504072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.532587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.533273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.547822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.548738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.549236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.549685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.559700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.560194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.560644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.576458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.584222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.584882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.625121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:37.632716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:37.653558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 2 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:37.658099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:37.803778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123886) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:18:37.874544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:37.889884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:37.996555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.009819 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39065b2c-538c-4c16-ab9b-0b6c056ef530 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1713 microversion: 2.1 time: 0.510274 Oct 04 18:18:38.012823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1563/3097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1713 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:38.038109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.038848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.053377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.056882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.059355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.060179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.061715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.064806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.106901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:38.146224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:38.222437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=9706fcc5-1764-47bf-8ffe-ffcd06f05fb9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:38.386280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.393986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:38.405067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.408159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.409833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:38.412042 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97b8f37b-7026-4636-9584-336375fde0b5 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.395685 Oct 04 18:18:38.428409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:38.428409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:38.431613 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1564/3098] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:38.446811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.447768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.459808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.461473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.462344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.463776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.464601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.465202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.643614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:38.668375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:38.735321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.754223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd4da6ac-607a-4f91-8ad4-819c48c6b3c1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1276 microversion: 2.1 time: 0.316645 Oct 04 18:18:38.756011 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1565/3099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:38.844871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6da7f10d-a469-4d09-a669-dcf00134d038 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.961264 Oct 04 18:18:38.851868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1535/3100] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1969 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:18:38.854685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.870252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.873542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Searching by: {'deleted': False, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:18:38.941484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.947146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.948570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.953597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.954912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.955382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.031820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:18:39.038808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.039823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.055089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.057257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.057794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.058677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.061200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.062236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.108138 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c13cd8c0-94b2-46dd-90d6-96bab6932918 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.257932 Oct 04 18:18:39.112939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1566/3101] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers => generated 1001 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:39.127180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9db7da1e-19e9-4273-8173-293dc631411a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.127834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9db7da1e-19e9-4273-8173-293dc631411a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.316339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.325260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad75b5cd-d950-4dc8-8b86-6e3f05f8e233 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1645 microversion: 2.1 time: 0.291132 Oct 04 18:18:39.329561 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1536/3102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1645 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:39.450236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.450766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.465335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.465841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.466283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.467062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.467543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.470786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.019849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.051132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.056063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.065490 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9d9e03fa-1842-4c1a-a955-53391cd5f367 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.619981 Oct 04 18:18:40.066973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1537/3103] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:40.086446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.089348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.122700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.125202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.126750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.130407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.131932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.173645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9db7da1e-19e9-4273-8173-293dc631411a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.186373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9db7da1e-19e9-4273-8173-293dc631411a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1218 microversion: 2.1 time: 1.064296 Oct 04 18:18:40.188187 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1567/3104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1218 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:40.359549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.360347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.419020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.434324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.438174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.441156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.442645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.447696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.687669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.698701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e26ad5bd-ebe8-456d-b367-d339fee7d7dc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1276 microversion: 2.1 time: 0.630579 Oct 04 18:18:40.701510 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1538/3105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1276 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:40.716460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7b1cf5-7260-40b9-a210-dbd9b758a9c7", "name": "network-vif-deleted", "tag": "095d6790-aa13-4f84-bc6f-27fad869ab8f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:40.741987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.742645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.743196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.786207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] Creating event network-vif-deleted:095d6790-aa13-4f84-bc6f-27fad869ab8f for instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 on n-h2-833090-21 Oct 04 18:18:40.802429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ccbec4df-4ba6-4f78-84ba-0cb5fe9c530b req-941a3450-c065-4b7d-afda-dcd6277c262a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100060 Oct 04 18:18:40.804408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1539/3106] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:41.106442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.106442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.140312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.142523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.143297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.146035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.149717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.151239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.322662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.340265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f231ebbe-4b95-4d0e-b2f9-8cec9805951a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1645 microversion: 2.1 time: 0.982838 Oct 04 18:18:41.345679 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1568/3107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1645 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:41.355087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.359635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8b069ba-5503-4229-98db-7da881e54560 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.365323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.366926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.367283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8b069ba-5503-4229-98db-7da881e54560 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.368380 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea80a0eb-f059-4470-9bf4-11cbce0d1947 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.274514 Oct 04 18:18:41.385162 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1540/3108] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:41.616980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8b069ba-5503-4229-98db-7da881e54560 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.627039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8b069ba-5503-4229-98db-7da881e54560 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1218 microversion: 2.1 time: 0.284995 Oct 04 18:18:41.631225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1569/3109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:41.726730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.727581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.744896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.745352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.748795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.755956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.757824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.763693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.892887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:41.944924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.948784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.949566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.978965 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] Creating event network-changed:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:18:42.011803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2be5cfbd-45a3-415b-ba77-199adb27fff6 req-52bec0a7-d351-413d-89fd-8618f7aa29cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123242 Oct 04 18:18:42.015003 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1570/3110] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:42.212067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.223989 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48486b3b-0068-4993-8c49-8be8ea2fc850 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1276 microversion: 2.1 time: 0.501101 Oct 04 18:18:42.226930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1541/3111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1276 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:42.367911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.368815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.399050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.399584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.400672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.401414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.401878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.402437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.402890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.403723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.411276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.412639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.412959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.413926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.414689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.416270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.577326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.580535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.581086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.583870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lazy-loading 'fault' on Instance uuid 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:42.704034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.715339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.727109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.729167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8957cf7f-b0c3-4a27-9bd0-cb3f57d0cdc9 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.332175 Oct 04 18:18:42.756296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1542/3112] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:42.765406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.768188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.782861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.786866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.787986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.788951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.789614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.790296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.967136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.984450 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d17272fd-1861-44af-91b5-64826bb20b5f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1214 microversion: 2.1 time: 0.218336 Oct 04 18:18:42.994928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1543/3113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:43.252010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.256062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.269931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.298888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.298888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.298888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.299285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.299666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.361256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba55a6ab0e3489f952f15aa53e5f650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a229d6518a42411d83024cbc09a46c14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.371090 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-409c5bf4-b204-4a1f-a213-a97139f5418a tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 200 len: 1367 microversion: 2.1 time: 1.008289 Oct 04 18:18:43.373706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1571/3114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 1367 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:43.761262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.763549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.764469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.778870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.780072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-762b44ab-4062-437f-9988-9935b3820082 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.527967 Oct 04 18:18:43.796546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.796546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.796546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.796546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.796546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.797845 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1544/3115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:44.029017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.030769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.048227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.049520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.050951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.052444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.059557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.060580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.118311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.144766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.146271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.170511 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28c32092-7a37-497d-9b9c-b3eff41518c6 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.415431 Oct 04 18:18:44.171137 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1572/3116] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:44.397632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.401126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] [instance: 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.420511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.429318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.429669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.430383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.430881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.431811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.432482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.446442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e6d7f331-812b-4e96-aab7-3fe663d219cb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1270 microversion: 2.1 time: 0.430634 Oct 04 18:18:44.451188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1545/3117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1270 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:44.466948 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] HTTP exception thrown: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Request method failure captured: Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 HTTP/1.1 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHiKm2b4ULbjcINuCZxHeJn9oNvRqs7LAMUH0dac9YHoR1HgOwIA2NxpL_U170FmtKBM4qeNrAfMdHz5vYHqx97teleDBYREEX8m2HZGcCu8XnC2ScB9GmN3VG4qvYCzoFPcyHEyU68wg2qkdrXU0lG3hvL2JyMCA1NW2LEqr2TM830 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: a229d6518a42411d83024cbc09a46c14 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestManualDisk-1178041680 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a229d6518a42411d83024cbc09a46c14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a229d6518a42411d83024cbc09a46c14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a229d6518a42411d83024cbc09a46c14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a229d6518a42411d83024cbc09a46c14"}]}] Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestManualDisk-1178041680 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: a229d6518a42411d83024cbc09a46c14 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestManualDisk-1178041680 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestManualDisk-1178041680-project Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2ba55a6ab0e3489f952f15aa53e5f650 Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestManualDisk-1178041680-project Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4c7b1cf5-7260-40b9-a210-dbd9b758a9c7'} Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:44.469056 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. Oct 04 18:18:44.473239 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:18:44.475454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Returning 404 to user: Instance 4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:44.476753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7171c20-7a87-4bf7-baae-8972004a40ec tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7" status: 404 len: 111 microversion: 2.1 time: 0.082940 Oct 04 18:18:44.477603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1573/3118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/4c7b1cf5-7260-40b9-a210-dbd9b758a9c7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:44.491030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-257bc3cb-9eac-406a-aee6-9f26dc5fc322 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] Calling method '.version_select at 0x7f9008ce4e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.713255 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-257bc3cb-9eac-406a-aee6-9f26dc5fc322 tempest-ServersTestManualDisk-1178041680 tempest-ServersTestManualDisk-1178041680-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110277502" status: 202 len: 0 microversion: 2.1 time: 0.229811 Oct 04 18:18:44.714652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1546/3119] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:18:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110277502 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:44.810606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.811647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.826374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.830532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.836676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.838674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.839342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.843247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.202954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:45.203570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:45.221528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.222344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.222974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.223926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.224601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.225238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.413106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.453508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.457308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.462103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b75d103-a79c-4347-8fa4-d09f4991aa4d tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.265906 Oct 04 18:18:45.472733 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1547/3120] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:45 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:45.482680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:45.483825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:45.500705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.503351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.503938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.507080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.507737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.508274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.679352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.696842 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bf9a472-f6ef-4069-8745-7bbec7fe82d6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1288 microversion: 2.1 time: 0.219625 Oct 04 18:18:45.708141 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1548/3121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:45 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1288 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:45.811945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.826584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-baf3271d-8b6f-47bf-b388-619aea5ebefe tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 1.019678 Oct 04 18:18:45.827986 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1574/3122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:46.497590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.498210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.514220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.520606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.522102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.523158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.532846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.534426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.686162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:46.701632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:46.704283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:46.706428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3605277d-cde0-4a79-9d46-bc27813b4b3c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.213303 Oct 04 18:18:46.712157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1549/3123] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:46.727726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.728314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.735588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.736112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.736561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.737268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.737730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.738160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.851788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.852948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.860171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.860711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.861161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.862270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.863507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.864341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.895934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:46.908764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-434d60f8-f5d6-4112-8848-5b6d4b2f55b3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1276 microversion: 2.1 time: 0.184828 Oct 04 18:18:46.910228 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1575/3124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:47.310588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:47.321057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19ef8774-a104-401c-9438-c1d81c68648b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.474298 Oct 04 18:18:47.322108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1550/3125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:47.735052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:47.735754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:47.745403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.745892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.749583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.753410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.767952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.769408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.942525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:47.943638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:47.953818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:47.960624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.960624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.965657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.966805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.967456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.968142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.044827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.064341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.073807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.077642 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5c9ac01-1abe-47bb-9016-f305ed6cef54 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.344409 Oct 04 18:18:48.080590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1576/3126] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:47 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:48.286614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.303634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63f1da09-7c41-4f10-85c5-3dce6d67959a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.367072 Oct 04 18:18:48.304500 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1551/3127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:47 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:48.350579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.351217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.366976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.367617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.367926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.373221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.373908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.374494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.992941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:49.105836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.106462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.111990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=26 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:49.123071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.128302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.208559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.222296 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5836db9-32f3-4ca4-a780-a427f494b9e5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.876493 Oct 04 18:18:49.226589 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1577/3128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:49.328888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.329701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.342619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.343455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.344156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.350701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.351354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.351984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.392291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.424435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.429147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.430393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d899aee3-d939-4a7b-92f8-91f1875a3f8c tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.329531 Oct 04 18:18:49.435303 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1552/3129] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:49.474196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0cbbb44-4357-4882-a4fa-4718c88a0f9c", "tag": "9acad7a8-f03c-406f-8159-556ecfadc0b2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:49.486532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:49.487183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:49.487874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:49.495721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:49.508631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] Creating event network-changed:9acad7a8-f03c-406f-8159-556ecfadc0b2 for instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c on n-h2-833090-21 Oct 04 18:18:49.519538 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c1b77ae6-7a9a-43d8-bc83-fdb6143600c9 req-83290f6f-e9b8-4e6f-b4f5-bc93f14ab17c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050233 Oct 04 18:18:49.519538 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1553/3130] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:50.218890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.236876 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36f5a8b5-a6d7-4002-829e-0e0ac3dc2e39 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.913116 Oct 04 18:18:50.245690 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1578/3131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:50.255798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.257381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.268822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.269569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.270184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.271157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.271823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.272471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.383231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a75ed92-6414-49d9-8d56-0520cfbdb72a", "tag": "c2544d21-ee20-40ed-9a4c-4f96354638b4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:50.413933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.418773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.418773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.489903 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] Creating event network-changed:c2544d21-ee20-40ed-9a4c-4f96354638b4 for instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a on n-h1-833090-21 Oct 04 18:18:50.505407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-920786c9-249c-4f7c-be20-240a7e057df0 req-cef55957-74d2-4b34-ad2d-63033a2ae10f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126897 Oct 04 18:18:50.506091 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1579/3132] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:50.525369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.527128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.547883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.548745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.550342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.552898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.553405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.554906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.873137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.888609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61cd629c-23e5-4200-bb95-942477375f9d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.635725 Oct 04 18:18:50.889504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1554/3133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:50.909986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.928367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.933846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:50.935662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-467cd608-1b2b-4221-850e-03bdbe086156 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.427240 Oct 04 18:18:50.940166 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1580/3134] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:51.266566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.267808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.298100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.300265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.304244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.305544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.306569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.314987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.916465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:51.917096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:51.919364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=26 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:51.936227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.937157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.939073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.952498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:51.958273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:51.958915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.011934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.020628 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1e19cb7-d7c4-41f4-b3cd-e0cb0a0d3f2d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.759816 Oct 04 18:18:52.028069 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1555/3135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:52.052921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.053552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.066522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.067059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.067540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.070853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.070853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.070853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.357382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.377642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.385749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.389272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75d59bef-ec56-477a-9d36-72ef9b3c9b65 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.359987 Oct 04 18:18:52.392706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1556/3136] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:52.573924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-153609858", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:52.680369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] validate_networks() for [('595e95a8-b241-44a6-9552-73f26a78a6e1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:52.867005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.886877 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9355c9e9-35a9-4bf4-9b81-ae68145fb78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.971363 Oct 04 18:18:52.887865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1581/3137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:51 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:53.054984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.058052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.070426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.072171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.072644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.074754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.075244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.075761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.705971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.715837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f33a58f9-1e15-4fe7-b403-0ec92835da15 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.665805 Oct 04 18:18:53.722587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1582/3138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:53.728495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.737230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.755071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.755711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.756213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.757002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.757753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.758351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.977024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.990304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:53.991746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:53.994783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:53.995549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:53.996229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:54.003456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.023612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.028028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.028839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.031160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.031621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-75e53fe6-c7b6-4191-aa30-e679e3b7290b tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.300811 Oct 04 18:18:54.033690 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1583/3139] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:54.034186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.041922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.046988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.051825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-plugged", "status": "completed", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:54.101837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.102378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.105332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.127857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:54.138906 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] Creating event network-vif-plugged:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:18:54.154703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-63b68e0e-bd09-4d12-a2f5-a00dbc7bfabe req-376351ae-314a-49ec-8c21-d45162007e79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118129 Oct 04 18:18:54.155533 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1584/3140] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:54.165053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for user 12e550a02a79411a9e202c7d952d32bb and project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:54.179757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.180484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.198830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.199326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.205474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.205474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.205474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.205474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.205859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:54.211626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:54.261267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:54.453646 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dff52148-f48c-4fe8-af52-1d76a93cf149 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.058294 Oct 04 18:18:54.460479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1557/3141] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:54.466071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46608ce0-2675-4d81-aca3-f2febc128c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.466702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46608ce0-2675-4d81-aca3-f2febc128c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.708225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46608ce0-2675-4d81-aca3-f2febc128c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.720351 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46608ce0-2675-4d81-aca3-f2febc128c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1221 microversion: 2.1 time: 0.258620 Oct 04 18:18:54.721112 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1558/3142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:54.763477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.768321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.788038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.794675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.795457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.797254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.798125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.800068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.844049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.878368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-921d4ebc-6df2-4263-a953-1501d6a0225f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.716641 Oct 04 18:18:54.894088 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1585/3143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:54.895225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2057760360", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:55.031006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] validate_networks() for [('595e95a8-b241-44a6-9552-73f26a78a6e1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:55.670195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.683060 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f044fdde-9e15-4821-852b-92fd91ce4885 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.933980 Oct 04 18:18:55.686706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1559/3144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:55.702260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706fcc5-1764-47bf-8ffe-ffcd06f05fb9", "tag": "e9ed0ae1-7889-47fd-814b-4d715f149b7e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:55.725189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.727211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.730230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.759142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] Creating event network-changed:e9ed0ae1-7889-47fd-814b-4d715f149b7e for instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 on n-h1-833090-21 Oct 04 18:18:55.771425 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-64dcbf5c-54e2-4dc8-8e0f-bede43a37193 req-90f765a3-5543-4297-988c-fb525c191e1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080648 Oct 04 18:18:55.773016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1560/3145] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:55.784439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.798535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:55.830928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.838472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.839171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.842418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.843181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.843997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.000210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.018421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.018421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.031849 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05632472-b1e5-4e08-994f-8dacee6249f0 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 0.257286 Oct 04 18:18:56.048157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1561/3146] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:56.059185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.059858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.079987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.080584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.081030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.107244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.108310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.108934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.508394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.522543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-11c7400b-3379-4b29-9a98-26d77fff1990 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.473161 Oct 04 18:18:56.523145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1562/3147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:56.714306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: .version_select at 0x7f9008c79820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-169474342", "policies": ["affinity"]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:56.735209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:56.741702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:56.795538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:56.974211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:56.983209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:57.018100 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9df24ff0-ea5d-469a-9039-95293b838bc1 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.370948 Oct 04 18:18:57.055119 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1563/3148] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 4 18:18:56 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:57.061285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.063355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.072903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.073652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.074306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.075296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.075932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.076590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.236080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:57.238005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:57.239706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:57.241774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:57.242604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:57.263008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.263986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.264672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.265833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.266548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.267218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.328568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:57.344782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for user 12e550a02a79411a9e202c7d952d32bb and project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:57.368956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:57.378174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:57.426354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.457051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-097b6e18-f864-4528-a222-2ecc699af621 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.399516 Oct 04 18:18:57.460469 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1564/3149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.481339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: .version_select at 0x7f9008d22ee0>, body: {"server_group": {"name": "tempest-server-group-1913444781", "policies": ["affinity"]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:57.552298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:57.559647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:57.751328 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f122225e-0362-4aa3-bf86-c7e5b97dfc15 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.868473 Oct 04 18:18:57.758257 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1586/3150] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:57.777118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.778054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.818099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.818714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.821341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.822975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.825358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.826011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.829344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:57.848435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:57.877917 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02be6eba-7c2d-479c-a044-6c135a06ed30 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.416116 Oct 04 18:18:57.880995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1565/3151] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:18:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:57.891666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.893511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.911971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.912803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.913473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.914440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.915218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.916384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.258139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.276321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72a5e8ab-68a2-4776-b48c-9d0dd98aad7c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.393896 Oct 04 18:18:58.277158 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1566/3152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:58.314095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e1449b6-aaf2-42c7-ae7b-ceda1af2ee47 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.316575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e1449b6-aaf2-42c7-ae7b-ceda1af2ee47 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.486893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7e1449b6-aaf2-42c7-ae7b-ceda1af2ee47 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.498505 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e1449b6-aaf2-42c7-ae7b-ceda1af2ee47 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1222 microversion: 2.1 time: 0.194530 Oct 04 18:18:58.507246 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1567/3153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:58.514086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: .version_select at 0x7f9008ca2280>, body: {"server_group": {"name": "tempest-server-group-1913444781", "policies": ["affinity"]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:58.577257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:58.600758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:58.733455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.752700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.781029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.790245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:58.798387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc242b05-b95b-4cee-9bb3-85a0ef859bf2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1603 microversion: 2.32 time: 1.026927 Oct 04 18:18:58.802770 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1587/3154] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1603 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:58.810976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:58.816058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.817848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.827710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.827710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.828240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.829325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.830184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.831425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.846130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0cf7ebd5-bcf2-4c66-920e-ce0557a96972 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.337605 Oct 04 18:18:58.855144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1568/3155] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:18:58 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:58.869087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-da19fd84-3a95-4a53-816b-c2e3e620105f tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.115082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-da19fd84-3a95-4a53-816b-c2e3e620105f tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/b2c01751-3ace-4a4f-a537-9675e56581bc" status: 204 len: 0 microversion: 2.1 time: 0.258713 Oct 04 18:18:59.120744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1569/3156] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:18:58 2022] DELETE /compute/v2.1/os-server-groups/b2c01751-3ace-4a4f-a537-9675e56581bc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:59.125986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d44d2ec-f4b4-4115-8600-6fa8c320f2e6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.163665 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d44d2ec-f4b4-4115-8600-6fa8c320f2e6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.041420 Oct 04 18:18:59.164615 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1570/3157] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:59.187318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c1607e7-7ed4-4389-af0f-d00705d13689 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.267103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.280701 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78b33577-157b-4ef7-9b02-22e89417c225 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.475615 Oct 04 18:18:59.281594 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1588/3158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:59.302842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.303511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:59.307354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:59.316726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.317587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.318977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.320134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.322451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.323127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.382704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c1607e7-7ed4-4389-af0f-d00705d13689 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/aa977cdf-989b-473a-ad5e-ceff38bf0da6" status: 204 len: 0 microversion: 2.1 time: 0.202897 Oct 04 18:18:59.383312 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1571/3159] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:18:59 2022] DELETE /compute/v2.1/os-server-groups/aa977cdf-989b-473a-ad5e-ceff38bf0da6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:59.392512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-099a6c94-bdeb-4b90-b38a-a79dca4042eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.407179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-099a6c94-bdeb-4b90-b38a-a79dca4042eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018889 Oct 04 18:18:59.408379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1572/3160] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:59.434075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: .version_select at 0x7f9008c79d30>, body: {"server_group": {"name": "tempest-server-group-746246257", "policies": ["affinity"]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:59.450185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:DELETE=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:59.457831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:59.463797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:59.635150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:59.655795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:59.677030 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2543a53-777d-4a4c-8b09-3569b0f0cdce tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.257364 Oct 04 18:18:59.682067 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1573/3161] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:18:59 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:59.697497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.698131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:59.720369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.720874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.721414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.722210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.722678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.723112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.752305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.785452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d063e723-6ece-443c-a294-ce8e15d63e1f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.479178 Oct 04 18:18:59.792410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1589/3162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:59.827064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0236e7fe-5c05-4216-9766-b6eac63d04f3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.963453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.980350 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffa6c326-5d85-4452-ba42-b635a195e276 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1226 microversion: 2.1 time: 0.286366 Oct 04 18:18:59.990967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1574/3163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1226 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:00.000315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0cbbb44-4357-4882-a4fa-4718c88a0f9c", "name": "network-vif-plugged", "status": "completed", "tag": "9acad7a8-f03c-406f-8159-556ecfadc0b2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:00.010209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.013332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.013850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.039133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] Creating event network-vif-plugged:9acad7a8-f03c-406f-8159-556ecfadc0b2 for instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c on n-h2-833090-21 Oct 04 18:19:00.053823 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-17010400-36ee-4ac0-946c-e4bfa91b7d5d req-d6b07892-e84f-4099-9355-c0de7b8e7c48 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068231 Oct 04 18:19:00.055288 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1575/3164] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:00.068245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.068985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:00.075979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0236e7fe-5c05-4216-9766-b6eac63d04f3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e0a44a0e-5542-4ad2-a213-0d2f6ad715b8" status: 204 len: 0 microversion: 2.1 time: 0.270481 Oct 04 18:19:00.077399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1590/3165] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:18:59 2022] DELETE /compute/v2.1/os-server-groups/e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:00.087072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.087072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.087256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.087986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.088483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.088928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.094616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a734f7e-9038-4c92-97ae-775991a9e2df tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.150053 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a734f7e-9038-4c92-97ae-775991a9e2df tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.059630 Oct 04 18:19:00.153901 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1591/3166] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:00.171092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: .version_select at 0x7f9008ef6280>, body: {"server_group": {"name": "tempest-server-group-955325970", "policies": ["anti-affinity"]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:00.174251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.174777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.177402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.178934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lazy-loading 'fault' on Instance uuid 3f1e11e7-391b-40eb-9011-00705abbae91 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:00.256753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:00.265497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:00.325825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.337560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.338826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17cc595cd4ad46ae9fbfd6089997d5f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a05721f5e9a41feb9ecd39e15053f17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.340233 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81aa40d2-ab24-47f2-a12c-8bead3433ff2 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 200 len: 1608 microversion: 2.32 time: 0.281738 Oct 04 18:19:00.341099 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1576/3167] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 1608 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:00.346357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.347220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:00.355253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.356079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.356722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.357652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.358305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.358943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.578407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:00.588091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:00.607411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a12ccc18-863a-461b-8b78-24ced3f37309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.442600 Oct 04 18:19:00.618127 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1592/3168] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:19:00 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:00.653453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bca89778-c8b9-4fb3-aa55-157f93000c2d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.712922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:00.737279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e59b649e-ce12-49be-a8ea-ed0efa98ce84 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.394927 Oct 04 18:19:00.754552 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1577/3169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:00.818800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.819515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:00.834157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.834654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.835102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.835944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.836299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.837411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.875853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bca89778-c8b9-4fb3-aa55-157f93000c2d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/16fe91e6-a970-45ee-9fc7-276c00aa9c5e" status: 204 len: 0 microversion: 2.1 time: 0.238806 Oct 04 18:19:00.880648 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1593/3170] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:00 2022] DELETE /compute/v2.1/os-server-groups/16fe91e6-a970-45ee-9fc7-276c00aa9c5e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:00.897206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8295b78-b574-4264-95a7-89fdf3feca7c tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.952647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8295b78-b574-4264-95a7-89fdf3feca7c tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.064191 Oct 04 18:19:00.953552 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1594/3171] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:01.009934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.010681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:01.018086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.036601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.039528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.041348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.042020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.042653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.122926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:01.131510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35cd8672-4844-4cb6-81ed-37c368669606 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1274 microversion: 2.1 time: 0.129737 Oct 04 18:19:01.132107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1595/3172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:01 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:01.137378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1338779217", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "d9a14a05-4f73-4961-931c-b0fb731496fe"}]}, "os:scheduler_hints": {"group": "2cb49388-a279-4260-9aa6-867a151dbab0"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:01.202288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:01.211574 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b83763a0-ab52-452f-8c99-068527513f71 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1318 microversion: 2.1 time: 0.398868 Oct 04 18:19:01.213335 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1578/3173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:01.261694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] validate_networks() for [('d9a14a05-4f73-4961-931c-b0fb731496fe', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:01.374794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.375458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:01.382849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.383354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.384343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.385143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.385792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.386395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.404459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] HTTP exception thrown: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Request method failure captured: Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 HTTP/1.1 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHcv98x65r2JIgtS540XhGMvKz-MskgfcJKKtAPm9laLxsFb5HFMnerEq-4HGb7A1jInJ3AP7UMbQmh2re3jsjajv8uiWGY_9PzzsCeXjwVh3Ob1v6exWZ07kzG6yRSw7i4FqJhvP-qd3ZYhW2MV_58-QOWakBYjYcmT89pnbKGfoXs Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1a05721f5e9a41feb9ecd39e15053f17"}]}] Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 17cc595cd4ad46ae9fbfd6089997d5f7 Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3f1e11e7-391b-40eb-9011-00705abbae91'} Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:01.406394 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Returning 404 to user: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4fac329-8d73-463b-884f-64f9034ec725 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 404 len: 111 microversion: 2.32 time: 0.041785 Oct 04 18:19:01.412656 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1579/3174] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:01 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:01.422406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1a89449-bc1e-4f1a-9a6b-64ee75bb8738 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '.version_select at 0x7f9008d74af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.556608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1a89449-bc1e-4f1a-9a6b-64ee75bb8738 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882465920" status: 204 len: 0 microversion: 2.32 time: 0.141428 Oct 04 18:19:01.558852 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1580/3175] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 4 18:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882465920 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:19:01.762857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:01.764118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:01.771030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.771797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.772394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.773327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.774068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:01.774688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.101690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:02.105240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:02.105769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:02.106222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:02.106644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:02.156472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.161618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.161618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.161618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.161618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.161618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.185630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:02.203049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:02.213326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.240422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e926331-bde6-49aa-bafc-ae29dd308d45 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.482424 Oct 04 18:19:02.241907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1581/3176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:01 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:02.254051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:02.255148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:02.280416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:02.284321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:02.289373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.289882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.290901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.293582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.297058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.297523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.576780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123887) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 18:19:02.630710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:02.638287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:02.853244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.865769 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2965d721-4215-4f6d-93ea-184c5636ee7e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1274 microversion: 2.1 time: 0.622759 Oct 04 18:19:02.866366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1582/3177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:02 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1274 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:02.875446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:02.875446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:02.912032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.912529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.912975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.913691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.914147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.914566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.938696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:02.966338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Getting quotas for user dbe8156b7b7749648a99f8074627ed40 and project fa1d9060e7a2420fbdfc7bac1bb10e6c. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:03.043666 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9290faa-a414-4a27-b2ea-9bf65d1022eb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.909784 Oct 04 18:19:03.051819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1596/3178] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:19:03.057708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a75ed92-6414-49d9-8d56-0520cfbdb72a", "name": "network-vif-plugged", "status": "completed", "tag": "c2544d21-ee20-40ed-9a4c-4f96354638b4"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:03.072496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.073012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.073499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.093677 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] Creating event network-vif-plugged:c2544d21-ee20-40ed-9a4c-4f96354638b4 for instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a on n-h1-833090-21 Oct 04 18:19:03.104838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fd0b7681-89e3-49d0-ae4f-4021ad0ed8e4 req-55d24b9a-0c0f-455d-9303-559f96b6229f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048491 Oct 04 18:19:03.106739 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1597/3179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:03.119227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-588f29c1-2444-4bcc-bfd1-3a8f14a2e2c2 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.121261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-588f29c1-2444-4bcc-bfd1-3a8f14a2e2c2 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.139225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:03.237836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-588f29c1-2444-4bcc-bfd1-3a8f14a2e2c2 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.251134 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-588f29c1-2444-4bcc-bfd1-3a8f14a2e2c2 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1213 microversion: 2.1 time: 0.143140 Oct 04 18:19:03.252158 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1598/3180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1213 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:03.266255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.267274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.296320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.301528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.301528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.301528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.301528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.301528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.377546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.384880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:03.410774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43e090a9-a40e-4e41-b732-20e6c68ad9ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1467 microversion: 2.1 time: 0.533878 Oct 04 18:19:03.410774 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1583/3181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:02 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1467 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:03.424816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d41405-e13e-4099-82e3-33a64017e70c", "tag": "444cc805-e0eb-4282-9572-aafe69b5cd84"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:03.455688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.456562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.458045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.486396 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] Creating event network-changed:444cc805-e0eb-4282-9572-aafe69b5cd84 for instance 78d41405-e13e-4099-82e3-33a64017e70c on n-h2-833090-21 Oct 04 18:19:03.497417 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-96b1fb1f-ffde-4e8b-b743-2c9ed942f51a req-f6e08643-756a-4bf0-857c-e98447b48a9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087283 Oct 04 18:19:03.497417 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1584/3182] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:03.500446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.503067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.513306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.513843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.514692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.520577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.520577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.520577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.784724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.795803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6a6b931-f975-426a-88a2-501af09869b1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.536438 Oct 04 18:19:03.796698 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1599/3183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:03.891164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.900036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.901136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.901894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.902576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.903568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.904249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.905725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.930636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:03.945516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ff6a456-c394-479e-8cf0-fe63b2a7e7b8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1466 microversion: 2.1 time: 0.442200 Oct 04 18:19:03.945516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1585/3184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:03.961787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1034640533"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:03.965283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.981143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.989432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.990322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.991233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.991888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.992458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.055339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.070637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a00ad41-ffb8-4dee-a848-7c6fad8d30eb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1280 microversion: 2.1 time: 0.183575 Oct 04 18:19:04.084071 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1600/3185] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:04.134966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:04.280766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eae38e48-669b-4883-849d-9dd704cf6d75 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.281496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eae38e48-669b-4883-849d-9dd704cf6d75 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:04.351613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eae38e48-669b-4883-849d-9dd704cf6d75 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.361259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eae38e48-669b-4883-849d-9dd704cf6d75 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1213 microversion: 2.1 time: 0.084222 Oct 04 18:19:04.366527 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1601/3186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:04.821491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.828300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:04.839432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.840222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.840865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.841911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.842544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.843128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.891790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-814e217f-2489-4405-badc-a70e57119f25 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "POST /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac/action" status: 202 len: 0 microversion: 2.1 time: 0.926111 Oct 04 18:19:04.896689 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1586/3187] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:03 2022] POST /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac/action => generated 0 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 18:19:04.908554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99fe1c57-6b87-48fb-8863-d13989f3c89d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008dcac10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.992759 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99fe1c57-6b87-48fb-8863-d13989f3c89d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.088286 Oct 04 18:19:04.995599 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1587/3188] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:05.099706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.100834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.114329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.114464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.114890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.115657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.118109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.118995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.209768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.224062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87230db0-76b8-4dab-8d00-0bf07777f56f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1318 microversion: 2.1 time: 0.409044 Oct 04 18:19:05.225187 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1602/3189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:05.232106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9706fcc5-1764-47bf-8ffe-ffcd06f05fb9", "name": "network-vif-plugged", "status": "completed", "tag": "e9ed0ae1-7889-47fd-814b-4d715f149b7e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:05.246350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.247130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.247785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.268070 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] Creating event network-vif-plugged:e9ed0ae1-7889-47fd-814b-4d715f149b7e for instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 on n-h1-833090-21 Oct 04 18:19:05.277958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a6d91c33-4bb2-43cd-aa80-e2f3c0e6d8d5 req-3fbde019-fc4e-4c47-967d-fddeeaeb1349 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051209 Oct 04 18:19:05.278998 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1603/3190] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:05.387823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e33bd163-46ef-4474-abf0-cdb69b1ef523 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.388705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e33bd163-46ef-4474-abf0-cdb69b1ef523 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.478654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.488016 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6499fabe-fea9-443c-964b-773245a1a3b9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.392085 Oct 04 18:19:05.488621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1588/3191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:05.493664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e33bd163-46ef-4474-abf0-cdb69b1ef523 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.502688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e33bd163-46ef-4474-abf0-cdb69b1ef523 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1213 microversion: 2.1 time: 0.121094 Oct 04 18:19:05.503458 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1604/3192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:06.011107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-11af1e66-d1b0-407e-ba0f-f8352f4b74cd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cf6dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.080014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-11af1e66-d1b0-407e-ba0f-f8352f4b74cd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.073824 Oct 04 18:19:06.080631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1589/3193] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:06.261847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.262481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:06.271331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.272128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.272756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.273660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.274273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.274917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.519254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:06.520239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.521246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:06.531613 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-85965216-6dd2-4f78-95d9-ff5b04751a96 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1466 microversion: 2.1 time: 0.272281 Oct 04 18:19:06.531720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.532163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.537737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.538867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.539377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.539865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.541736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1605/3194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:06.564711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.567341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:06.592746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.593241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.594671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.594671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.594921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.595567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.699309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:06.708048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00daf5c2-f3e1-4538-9f80-681eca6fa32a tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1217 microversion: 2.1 time: 0.159765 Oct 04 18:19:06.708688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1606/3195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:06.713485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.714087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:06.725052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.725638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.726080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.726890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:06.728490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:06.730019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.920294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:06.929281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:06.929531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-239dd3ee-be31-46bf-b4a4-1d5964ab8747 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1318 microversion: 2.1 time: 0.209693 Oct 04 18:19:06.931459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1607/3196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:06.938347 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6afb86f8-4d07-4380-af75-2e9b17b59af0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.423027 Oct 04 18:19:06.942014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1590/3197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:07.095449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02c13c75-4e19-40d0-958b-75f660da9b9a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900967dca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.163986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02c13c75-4e19-40d0-958b-75f660da9b9a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.072544 Oct 04 18:19:07.165861 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1608/3198] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:07.738911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.744015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.761427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.762732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.763395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.764388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.766456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.767302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.869611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:07.897222 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae72034f-8384-420f-ad70-076346d5ee0b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1265 microversion: 2.1 time: 0.170290 Oct 04 18:19:07.897992 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1591/3199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:07.963576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.964338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.975828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:07.976801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.980957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.981469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.981920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.982876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.983344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.983999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.985879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.986384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.987036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.988169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.988811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.989430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.364026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.372993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d61e03a0-90e5-4be9-aff1-e503360fca01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1467 microversion: 2.1 time: 0.414750 Oct 04 18:19:08.373602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1609/3200] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1467 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:08.386428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a578c65a-bb73-4fac-a4d2-65b3d7222096 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008ef68b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.465334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a578c65a-bb73-4fac-a4d2-65b3d7222096 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.090353 Oct 04 18:19:08.475973 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1610/3201] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:08.481567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.499363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.500565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Searching by: {'reservation_id': 'r-64exehbz', 'deleted': False, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:08.517979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.523088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.523088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.523088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.523088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.523088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.542877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.560145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ae368fc-efca-4c6f-9256-1fc6c9af6a07 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.589402 Oct 04 18:19:08.579920 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1592/3202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:07 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:08.685784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:08.786774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.795528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.796060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.796507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.923369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.924570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.932603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.935657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.936357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.939542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.940034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.940752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.169932 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4201e464-5e6b-4bac-83bc-7fb06989343b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-64exehbz" status: 200 len: 2926 microversion: 2.1 time: 0.692413 Oct 04 18:19:09.172197 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1611/3203] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/detail?reservation_id=r-64exehbz => generated 2926 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:09.181343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bc6846-0767-418f-9b96-01d81dec03b6", "tag": "ad726d0f-bd25-4937-a900-184072180be2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:09.202966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.205967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.205967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.224189 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] Creating event network-changed:ad726d0f-bd25-4937-a900-184072180be2 for instance b8bc6846-0767-418f-9b96-01d81dec03b6 on n-h2-833090-21 Oct 04 18:19:09.234173 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-85ba591f-df9e-4d7a-98a1-167d242efa40 req-0d03c981-6730-483f-a525-92090a09587a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060186 Oct 04 18:19:09.235156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1612/3204] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:09.242623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.272431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.compute.server_groups [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Querying cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) for 2 instances {{(pid=123887) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:19:09.273233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.273717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.274154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.310210 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aeb00336-45db-426a-953d-e191f46da9d9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/38c4bafe-8ec8-432a-ac46-85e4ae613811" status: 200 len: 266 microversion: 2.1 time: 0.073019 Oct 04 18:19:09.316770 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1613/3205] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/os-server-groups/38c4bafe-8ec8-432a-ac46-85e4ae613811 => generated 266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:09.322541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.323590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:09.330812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.331683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.332346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.333444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.334105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.334696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.665994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e45ed946-e034-4be0-bb9c-2e07bdb6f381 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1619 microversion: 2.1 time: 0.347156 Oct 04 18:19:09.668262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=42 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:09.669251 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1614/3206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1619 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:09.679739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81d5e733-da2a-43a3-9952-76862a585261 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008ef6f70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.708562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:09.733276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd3dee76-a8df-4c73-849d-37efd1c9e95d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1283 microversion: 2.1 time: 0.814281 Oct 04 18:19:09.735804 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1593/3207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1283 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:09.744048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.745482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:09.766469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.766469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.767586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.768065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.768606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.769114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.791921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81d5e733-da2a-43a3-9952-76862a585261 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.118472 Oct 04 18:19:09.803575 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1615/3208] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:09.810237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.811088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:09.819600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.820310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.822036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.824706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.825308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.825878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.830971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:10.173792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-09b14aa9-749a-4219-8c25-01cd5d29cd3e tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1620 microversion: 2.1 time: 0.368820 Oct 04 18:19:10.174708 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1616/3209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1620 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:10.182731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:10.188842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:10.197762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.202093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.206489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.207496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.208146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.208786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.235501 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] HTTP exception thrown: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Request method failure captured: Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 HTTP/1.1 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHcv98x65r2JIgtS540XhGMvKz-MskgfcJKKtAPm9laLxsFb5HFMnerEq-4HGb7A1jInJ3AP7UMbQmh2re3jsjajv8uiWGY_9PzzsCeXjwVh3Ob1v6exWZ07kzG6yRSw7i4FqJhvP-qd3ZYhW2MV_58-QOWakBYjYcmT89pnbKGfoXs Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1a05721f5e9a41feb9ecd39e15053f17"}]}] Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 17cc595cd4ad46ae9fbfd6089997d5f7 Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '3f1e11e7-391b-40eb-9011-00705abbae91'} Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:10.239792 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.245185 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.246778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Returning 404 to user: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:10.247843 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c091f9f9-8ccf-4b6c-b857-1d32b2413f90 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 404 len: 111 microversion: 2.32 time: 0.071987 Oct 04 18:19:10.248744 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1617/3210] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:19:10 2022] DELETE /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:10.254503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: .version_select at 0x7f900977c670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-142806963", "policies": ["anti-affinity"]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:10.279069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:10.290813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:10.414489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:10.454784 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31d1f81d-704b-4cb5-b99a-98c3115fbdbe tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.715939 Oct 04 18:19:10.474013 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1594/3211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:10.494073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:10.495329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:10.503093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] [instance: 3f1e11e7-391b-40eb-9011-00705abbae91] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:10.509570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:10.534679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.537144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.538870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.539895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.544052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.544052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.554295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b63bf8a-25c3-48fb-9f00-1df6f95ceb77 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.300230 Oct 04 18:19:10.555298 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1618/3212] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 4 18:19:10 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:10.604803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] HTTP exception thrown: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Request method failure captured: Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 HTTP/1.1 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHcv98x65r2JIgtS540XhGMvKz-MskgfcJKKtAPm9laLxsFb5HFMnerEq-4HGb7A1jInJ3AP7UMbQmh2re3jsjajv8uiWGY_9PzzsCeXjwVh3Ob1v6exWZ07kzG6yRSw7i4FqJhvP-qd3ZYhW2MV_58-QOWakBYjYcmT89pnbKGfoXs Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1a05721f5e9a41feb9ecd39e15053f17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1a05721f5e9a41feb9ecd39e15053f17"}]}] Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1a05721f5e9a41feb9ecd39e15053f17 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TaggedBootDevicesTest-185241259 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 17cc595cd4ad46ae9fbfd6089997d5f7 Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TaggedBootDevicesTest-185241259-project Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3f1e11e7-391b-40eb-9011-00705abbae91'} Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:10.609640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] Returning 404 to user: Instance 3f1e11e7-391b-40eb-9011-00705abbae91 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dfe58bb-4c95-4c42-8a80-2ef91b76dd09 tempest-TaggedBootDevicesTest-185241259 tempest-TaggedBootDevicesTest-185241259-project] 10.222.0.40 "GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91" status: 404 len: 111 microversion: 2.32 time: 0.129493 Oct 04 18:19:10.614033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1595/3213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:10 2022] GET /compute/v2.1/servers/3f1e11e7-391b-40eb-9011-00705abbae91 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:10.708278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1017947117", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c4660bfc-be0a-43c4-886e-8d64603f422d"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:10.762069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:10.762872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:10.773707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.777405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.778039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.779677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.780319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.783581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.817177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:11.387908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:11.389708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:11.390478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:11.391713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:11.392407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:11.425764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.427341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.428710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.430016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.430884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.432382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.463997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:11.472382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:11.496522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 2 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:11.500601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:11.631383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:11.642909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fed6fd0-7eb8-4bba-a662-d6e46d76350b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.885352 Oct 04 18:19:11.655943 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1596/3214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:10 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:11.675690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7da64245-34ba-42af-86ee-f3aa7fc59913 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c79ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:11.689797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:11.700914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:11.759189 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7da64245-34ba-42af-86ee-f3aa7fc59913 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.099311 Oct 04 18:19:11.762733 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1597/3215] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:11 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:11.776516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:11.777291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:11.790871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.791697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.794292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.795321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:11.796126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:11.798260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.857422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:11.887200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:11.905919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:11.969931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=2e35c19e-c8bc-4983-aca5-1f939605987a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:12.250572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:12.269950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:12.438021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.459150 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00f785cf-08df-4550-8cba-0410504eb508 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.688755 Oct 04 18:19:12.472224 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1598/3216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:11 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:12.566708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:12.581570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'server_group_members'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:12.612050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0575f723-f255-43ba-b8d2-96b22e0c8f39", "tag": "b8cffbc3-84a8-4723-9497-a307b7bf2d88"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:12.655065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.657292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.659855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.680981 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbc01ebf-4d39-4ad1-8adb-57d36713d3eb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.980495 Oct 04 18:19:12.683008 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1619/3217] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1984 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:19:12.712723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] Creating event network-changed:b8cffbc3-84a8-4723-9497-a307b7bf2d88 for instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 on n-h1-833090-21 Oct 04 18:19:12.712865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:12.712865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:12.713062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-86cfabe0-31a5-4df1-b54d-54d3182cc67c req-83707c69-2a41-4ef6-8bdd-cbac5801dd6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102659 Oct 04 18:19:12.713062 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1599/3218] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:12.719929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:12.725148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.725654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.726102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.726838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.727876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Searching by: {'deleted': False, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:12.732360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.738097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.739019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.749682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.750612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.751292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.767779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.770907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.786436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.878552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:12.948570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61f0734d-efd7-4791-8a5c-4722d7581c0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.234673 Oct 04 18:19:12.956888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1600/3219] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/servers => generated 1663 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:12.963065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-87555cd3-f011-4b07-a4d9-805165e6ad3a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d74820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.030172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-87555cd3-f011-4b07-a4d9-805165e6ad3a tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.077856 Oct 04 18:19:13.030834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1601/3220] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.048409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a00bbe92-4bdc-4806-a387-9d603f3cc8a7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.052994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a00bbe92-4bdc-4806-a387-9d603f3cc8a7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:13.302335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a00bbe92-4bdc-4806-a387-9d603f3cc8a7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.312058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a00bbe92-4bdc-4806-a387-9d603f3cc8a7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1219 microversion: 2.1 time: 0.280190 Oct 04 18:19:13.315167 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1602/3221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:13 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.335094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.348577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cf69ac1-f481-4da6-903e-4e9f8e222136 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.648086 Oct 04 18:19:13.375274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1620/3222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.490664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.491753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:13.512145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.513751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.514429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.519764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.523489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.523489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.560692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d41405-e13e-4099-82e3-33a64017e70c", "name": "network-vif-plugged", "status": "completed", "tag": "444cc805-e0eb-4282-9572-aafe69b5cd84"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:13.586468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.594219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.595009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.632419 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] Creating event network-vif-plugged:444cc805-e0eb-4282-9572-aafe69b5cd84 for instance 78d41405-e13e-4099-82e3-33a64017e70c on n-h2-833090-21 Oct 04 18:19:13.651390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fb87f6c8-a600-4df6-86df-a574361f4bda req-88039e8c-8e41-445d-a73e-412c759e306d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098321 Oct 04 18:19:13.653356 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1621/3223] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:14.048092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd603ba8-8e63-4a16-8310-a860cb78a8b0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096baaf0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:14.132293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd603ba8-8e63-4a16-8310-a860cb78a8b0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.081210 Oct 04 18:19:14.132963 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1622/3224] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:14 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:14.205120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:14.219070 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10118c2f-b27b-4f73-be16-ec2ab6ed2040 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.734772 Oct 04 18:19:14.219896 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1603/3225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:13 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:14.343497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4bae7a82-b98c-443d-84ae-a0d61199efe7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:14.344354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4bae7a82-b98c-443d-84ae-a0d61199efe7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:14.379588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:14.380253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:14.393647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.394155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.394596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.402754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:14.403275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:14.410225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:14.565708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4bae7a82-b98c-443d-84ae-a0d61199efe7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:14.592526 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4bae7a82-b98c-443d-84ae-a0d61199efe7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1219 microversion: 2.1 time: 0.247772 Oct 04 18:19:14.595163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1623/3226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:14 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:14.631951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:14.643673 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af18cf59-f22a-44d6-9bf0-cbf047c32cd6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.269521 Oct 04 18:19:14.644640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1604/3227] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:14 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:15.149621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca3833bf-fcdc-4d33-98d4-fde09a58feaa tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096baca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:15.223684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca3833bf-fcdc-4d33-98d4-fde09a58feaa tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.079335 Oct 04 18:19:15.229320 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1624/3228] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:15 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:15.255435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:15.256188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:15.284401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.287127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.287666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:15.298771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.298771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.298771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:15.619077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:15.620352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:15.667914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.672263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.676411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:15.678742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:15.679918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:15.680973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.468925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.471316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:16.494194 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a80e1030-9ccb-4494-830e-936c5c8dd0dd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 1.247820 Oct 04 18:19:16.496003 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1605/3229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:15 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:16.509448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:16.511247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:16.564164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.566194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.571869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.577286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.578242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.578840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.797475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.830519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6fafebc4-3466-4c85-a5cf-f02e4c2a0541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1223 microversion: 2.1 time: 1.206933 Oct 04 18:19:16.832030 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1625/3230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:15 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1223 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:16.856612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-plugged", "status": "completed", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:16.919433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.923277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.926276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.974926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] Creating event network-vif-plugged:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:19:17.005788 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-67499fbb-b601-4403-9b93-0c437311903e req-0838e305-fa17-4f51-9cae-aeb3f04c38cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168443 Oct 04 18:19:17.009858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1626/3231] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:17.054006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43b7f406-8a33-4af3-a57a-fffc2fbdf050 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009992b80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.183881 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43b7f406-8a33-4af3-a57a-fffc2fbdf050 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.163850 Oct 04 18:19:17.201826 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1627/3232] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:17.256676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:17.271650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bfd553c0-c97f-4d62-bd4b-4d750285f634 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.772655 Oct 04 18:19:17.281773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1606/3233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:16 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:17.520966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.521717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:17.531972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.547345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.547854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.548639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.549105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.549558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.856589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.860131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:17.890445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.891045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.891594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.892392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.892980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.893449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.225278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.236467 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42875c1d-1db3-44c7-92ba-848924e18bf6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1271 microversion: 2.1 time: 0.384217 Oct 04 18:19:18.242542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1607/3234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1271 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:18.271120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a9d1913-3744-40eb-8b83-3ff8eab12287 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c790d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:18.412811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.429420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a9d1913-3744-40eb-8b83-3ff8eab12287 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.184740 Oct 04 18:19:18.430029 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1608/3235] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:18 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:18.457576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-839d0ff1-7854-4c1b-b77b-1e32d84dfbee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.928332 Oct 04 18:19:18.458254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1628/3236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:18.465444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:18.466089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:18.510560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.512240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.520277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.523301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.524044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.528680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.278393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.279395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:19.298768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.305164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.305778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.307048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.313119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.316043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.584573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.602450 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee4b3186-53e3-4fd2-b5f2-e5f53ff0db88 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1289 microversion: 2.1 time: 0.332569 Oct 04 18:19:19.619764 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1629/3237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1289 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:19.619908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.640309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ff0c7f0-926f-4a7e-9bf0-970e6c1b2fe7 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009bc7dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.640475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62edc456-e4aa-4255-98f7-95855fce82fb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 1.197546 Oct 04 18:19:19.641268 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1609/3238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:18 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:19.646967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.647921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:19.666911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.667790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.673151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.675318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.678313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.678777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.781393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ff0c7f0-926f-4a7e-9bf0-970e6c1b2fe7 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.163566 Oct 04 18:19:19.791646 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1630/3239] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:20.466058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:20.481827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7d567e4-33d3-40cc-90e1-91195ea8964b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.834820 Oct 04 18:19:20.511570 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1610/3240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:20.646643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:20.647850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.669615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:20.670337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.685151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.685680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.686092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.686810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.687264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.687710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.692142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.692747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.693198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.701516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.702586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.710371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.106886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:21.122686 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-760863b1-a77d-41d6-b808-5da2ece9e541 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1277 microversion: 2.1 time: 0.481766 Oct 04 18:19:21.123297 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1631/3241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:20 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1277 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:21.130346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f24ed589-d2f8-4c3a-9083-f5593be4ce28 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009bc75e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.230838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f24ed589-d2f8-4c3a-9083-f5593be4ce28 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.104101 Oct 04 18:19:21.231738 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1632/3242] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:21.448263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:21.547363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-604164763", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "a1fb53d1-6610-4c77-81f7-31f159f51afe"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:21.654577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] validate_networks() for [('a1fb53d1-6610-4c77-81f7-31f159f51afe', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:21.784997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:21.822306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55b44529-8c20-47c3-b828-6246f1f6d7fa tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 1.128103 Oct 04 18:19:21.822306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1611/3243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:20 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:21.829824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.841848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.860596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.861788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.863074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.864268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.866267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.867091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.621701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.630471 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0921aef5-6fb0-4755-887e-9e279c2d64d8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.811180 Oct 04 18:19:22.639489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1612/3244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:22.664901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.684441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.694504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.695287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.697219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.701340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.707664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.717122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.842897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:22.846502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:22.847236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:22.847866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:22.848473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:22.848994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:22.868394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=69 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:22.909534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.912262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.918604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.920416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.924590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.926325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.065117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Getting quotas for project 316fe7ff7e9a45689fd08ab5d41a6cfa. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:23.103737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Getting quotas for user 97324096c2ee4146afd05183199c6b7d and project 316fe7ff7e9a45689fd08ab5d41a6cfa. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:23.147173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:23.153594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:23.312417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:23.485043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3718f6dd-e570-499f-af35-797392626992 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072428 Oct 04 18:19:23.496710 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1633/3245] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:23.507202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0c765cf-cb33-47e8-a03f-5f41fad3ca5b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009764a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:23.619295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0c765cf-cb33-47e8-a03f-5f41fad3ca5b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.120623 Oct 04 18:19:23.627301 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1634/3246] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:23 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:23.643096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:23.643096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:23.657626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.658126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.658578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.659302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.664301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.670903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.916344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:23.925591 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df25e8ba-d274-4d7a-a908-95bccb3da3b3 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.297372 Oct 04 18:19:23.931028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1635/3247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:23 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:23.940325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cae421bf-6964-437a-8d77-421c7c1971aa tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:23.941006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cae421bf-6964-437a-8d77-421c7c1971aa tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.079926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cae421bf-6964-437a-8d77-421c7c1971aa tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.108229 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cae421bf-6964-437a-8d77-421c7c1971aa tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1216 microversion: 2.1 time: 0.175969 Oct 04 18:19:24.110761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1636/3248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:23 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.125736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.127459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.141567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.142415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.143430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.144411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.145281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.145963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.348686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.358838 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7b0371a-de96-43a7-8093-a021b5cdc4d3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 1.702192 Oct 04 18:19:24.370495 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1613/3249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.434689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.447158 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d10aa206-157e-4285-ae86-9e594ee80560 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.334998 Oct 04 18:19:24.448333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1637/3250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.635199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9549459-7d41-4afd-9bc9-fe4fde72c889 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d890550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.750973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9549459-7d41-4afd-9bc9-fe4fde72c889 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.120313 Oct 04 18:19:24.753257 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1614/3251] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.953752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.954566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.983727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.984260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.984671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.985396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.985849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.986274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.137940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e00a093-8090-4b56-bc94-e0cd44da2a84 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.139180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e00a093-8090-4b56-bc94-e0cd44da2a84 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.144346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:25.417953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e00a093-8090-4b56-bc94-e0cd44da2a84 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.444420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e00a093-8090-4b56-bc94-e0cd44da2a84 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1216 microversion: 2.1 time: 0.309059 Oct 04 18:19:25.448690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1615/3252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1216 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:25.467723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.488470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.498317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.500960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0325825-97c9-4e19-b9a8-ab94d27276da tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.550732 Oct 04 18:19:25.501602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1638/3253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:25.516913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.517896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.537166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.539174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.540461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.542511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.543148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.544406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.544999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.547430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.550970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.551934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.567391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.577334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.016881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.045400 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d07d0d0d-66cf-460a-be4f-35da5ce6a6ef tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.537297 Oct 04 18:19:26.050866 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1639/3254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:26.078719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e516ac4a-cc45-4605-aea6-f52ae8ddd51e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009753940>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.235654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e516ac4a-cc45-4605-aea6-f52ae8ddd51e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.177735 Oct 04 18:19:26.237778 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1640/3255] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:26.250630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bc6846-0767-418f-9b96-01d81dec03b6", "name": "network-vif-plugged", "status": "completed", "tag": "ad726d0f-bd25-4937-a900-184072180be2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:26.299508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.300362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.300980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.324763 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] Creating event network-vif-plugged:ad726d0f-bd25-4937-a900-184072180be2 for instance b8bc6846-0767-418f-9b96-01d81dec03b6 on n-h2-833090-21 Oct 04 18:19:26.336302 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7fe95815-ff24-4460-8f07-bc2d46a9389c req-4539c951-6710-4554-8cf2-d83acf0d98e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097113 Oct 04 18:19:26.339834 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1641/3256] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:26.360440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e35c19e-c8bc-4983-aca5-1f939605987a", "tag": "dcde7bce-ccef-4154-b310-cfd59f5995b0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:26.395101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.398307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.398796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.464128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] Creating event network-changed:dcde7bce-ccef-4154-b310-cfd59f5995b0 for instance 2e35c19e-c8bc-4983-aca5-1f939605987a on n-h1-833090-21 Oct 04 18:19:26.505233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f2962b32-ad88-4df8-8bfb-72383b454988 req-ad22d1c4-1ae8-422a-833e-51847eec2a57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150491 Oct 04 18:19:26.509085 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1642/3257] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:26.533299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.537176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.552545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.553934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.556867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.557994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.558647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.559090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.777269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.785582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.794689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1cffaf7-e1f8-498f-9b7f-7acc4aa427fc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1212 microversion: 2.1 time: 0.277049 Oct 04 18:19:26.800043 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ddf4fbb-1a09-4fca-b0e1-23b73637d59b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 1.349242 Oct 04 18:19:26.808156 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1616/3258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:26.809156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1643/3259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1212 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:26.827322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.831572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.838002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.838884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.841412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.847659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.848719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.850991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.070580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.071227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.088325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.088837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.092712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.092712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.092712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.092712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.474986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.495896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1f5b673-8d48-4cd6-a5dd-98e96c6bd33e tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.674061 Oct 04 18:19:27.503311 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1617/3260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.508615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e1a6cd4-1436-4d8f-af40-1fbdf0e5f108 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d742dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.586997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.596501 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47061d45-8041-4691-b78c-9a6994966b72 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1322 microversion: 2.1 time: 0.529962 Oct 04 18:19:27.600621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1644/3261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:27.628539 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e1a6cd4-1436-4d8f-af40-1fbdf0e5f108 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.123729 Oct 04 18:19:27.637968 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1618/3262] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.833068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.833986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.834577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.835230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.848007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.848437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.848887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.849634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.850136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.850573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.868550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.873643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.874319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.932061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.933739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.937396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.129470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.139683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2deabcf5-985c-4224-b970-67e5c740610b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1268 microversion: 2.1 time: 0.310549 Oct 04 18:19:28.140294 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1645/3263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1268 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:28.530597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:28.531248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.545201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.545710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.546214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.546937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.547401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.547869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.793280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.807898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5b03ec2-25fd-4986-b7db-956c4f73c9c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 0.977963 Oct 04 18:19:28.817875 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1619/3264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:28.830294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0575f723-f255-43ba-b8d2-96b22e0c8f39", "name": "network-vif-plugged", "status": "completed", "tag": "b8cffbc3-84a8-4723-9497-a307b7bf2d88"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:28.894596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.895376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.895686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.929827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] Creating event network-vif-plugged:b8cffbc3-84a8-4723-9497-a307b7bf2d88 for instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 on n-h1-833090-21 Oct 04 18:19:28.958808 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-125ec4dc-aa9e-4b99-b3a6-b575dd236a89 req-47be2ad7-210f-45d5-90ab-afe341bc56b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138886 Oct 04 18:19:28.963518 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1620/3265] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:28.977475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:28.995162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7dd4fae-5631-46f1-bb4a-1c6a9f85b0ae tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.468773 Oct 04 18:19:28.997520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.001993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.002119 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1646/3266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.009468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e7eae21-3e9c-44db-8e11-037c5eab7793 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009712040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.017991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.019039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.020097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.022349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.043511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.044155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.076817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e7eae21-3e9c-44db-8e11-037c5eab7793 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.074085 Oct 04 18:19:29.077673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1647/3267] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.229016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82add5f-62f5-42fd-a1ae-afa542d1e43f", "tag": "dddfe0fc-09e7-4564-b15e-9b1fc7107bf1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:29.269619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.272969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.273564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.302019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] Creating event network-changed:dddfe0fc-09e7-4564-b15e-9b1fc7107bf1 for instance c82add5f-62f5-42fd-a1ae-afa542d1e43f on n-h2-833090-21 Oct 04 18:19:29.317909 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f718256f-7082-4c4a-a593-97d6bee3ff8b req-14161f5d-cd99-41d5-b454-414d1a6102f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237964 Oct 04 18:19:29.318277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1648/3268] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:29.324939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.325916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.340238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.343897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.352673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.353900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.354951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.355698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.363041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:29.485784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.509027 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5befab31-677c-4a8e-93fa-9daeddebe47a tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1286 microversion: 2.1 time: 0.183095 Oct 04 18:19:29.509523 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1649/3269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.622994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.652683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20408b34-d07e-4992-a3cf-3e25f13a209b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1515 microversion: 2.1 time: 0.687569 Oct 04 18:19:29.653906 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1621/3270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:28 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1515 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.682835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:29.690464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.735645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:29.737224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.737728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.738922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.744410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.745386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.748474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.824622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'flavor' on Instance uuid b8bc6846-0767-418f-9b96-01d81dec03b6 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:29.838901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.840221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.856509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.859721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.860375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.861981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.863498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.865805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.322519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77d704de-d5f9-42af-b1c8-547030157428 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action" status: 200 len: 32 microversion: 2.1 time: 0.644145 Oct 04 18:19:30.323335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1650/3271] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:29 2022] POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action => generated 32 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:19:30.342964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.344392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.360844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.365540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.368719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.369981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.374771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.375561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.097129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.113952 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-597393fe-0d66-44c4-bd8a-251b20b151c4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 1.284444 Oct 04 18:19:31.130581 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1622/3272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:31.146636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67d7f4c9-2650-49de-8090-4c0316df874e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d48a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.276204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67d7f4c9-2650-49de-8090-4c0316df874e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.143668 Oct 04 18:19:31.287247 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1623/3273] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:31.287247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.287247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.293103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.293606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.294117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.294892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.295349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.295847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.911583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.924785 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a79f978f-f8bd-497f-b5b9-6acb287cf66e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.643019 Oct 04 18:19:31.925698 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1624/3274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:31.939282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.940194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.949739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.950920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.951666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.952258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.953200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.953819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.954407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.961218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2158f9b8-32a0-4ef2-b4f0-11066d88aee6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 1.634034 Oct 04 18:19:31.975933 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1651/3275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.155694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.156376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.169913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.170765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.171236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.173676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.175913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.177538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.316337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.332809 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aec588c3-3514-4e83-87e5-95305e045028 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.403597 Oct 04 18:19:32.335124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1625/3276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.346614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6e372bc-92ae-4562-b39d-6b827b9a0c36 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008dcc310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.448517 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6e372bc-92ae-4562-b39d-6b827b9a0c36 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.112212 Oct 04 18:19:32.449854 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1626/3277] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.507255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.532774 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9537b3ee-d68c-4a64-a5cb-7827a1ab0a71 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 0.380360 Oct 04 18:19:32.551616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1652/3278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:32.967175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.972503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.988164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.994269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.995602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:33.001133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.001960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.006084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.010193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.010891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.011527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.022340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.022850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.023297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.024627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.025091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.025521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.298393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.321567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-445a7ea5-ef88-407b-a25b-ca42790d3405 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.371287 Oct 04 18:19:33.326547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1627/3279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:33.370542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.370930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.392521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.395445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.395445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.396771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.397599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.407546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.514394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.525388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae83c7b1-bf23-4b75-8e91-1ce9591d03f7 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1313 microversion: 2.1 time: 0.541020 Oct 04 18:19:33.532277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1653/3280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:33.548714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0ba299ac-23f2-4a80-9d2a-c3b9a404aa2f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097535e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.672221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0ba299ac-23f2-4a80-9d2a-c3b9a404aa2f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.135081 Oct 04 18:19:33.675620 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1654/3281] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:33.685939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.686775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.691321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.693812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.694835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.698909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.699995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.700758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.701666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.705396 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74bafc13-026f-4aca-8f5c-c2f6f2097ab5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.345652 Oct 04 18:19:33.706533 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1628/3282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:34.047237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.058356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-853c5733-26a5-4978-a04e-d44d0c402d6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 0.381386 Oct 04 18:19:34.075493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1655/3283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:34.350126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.352577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:34.362616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.374339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:34.558609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.559505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:34.568830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=7 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:34.578001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.578845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.578984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.579855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.580321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.580746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.745530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.762254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-533c12ae-0746-42af-85d0-399854afca32 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.416494 Oct 04 18:19:34.774773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1629/3284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:34.780416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-676f538f-59e2-4c53-ba99-f0bd6ec1e3c4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c79040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.953861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-676f538f-59e2-4c53-ba99-f0bd6ec1e3c4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.174708 Oct 04 18:19:34.956506 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1630/3285] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:34.965380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.966671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:34.975514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.976522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.977514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.978683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.979989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.981107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.151406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:35.182682 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92b74a50-6042-4134-aab0-7c00a67de16b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1499 microversion: 2.1 time: 0.628077 Oct 04 18:19:35.190749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1656/3286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1499 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:35.224637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e35c19e-c8bc-4983-aca5-1f939605987a", "name": "network-vif-plugged", "status": "completed", "tag": "dcde7bce-ccef-4154-b310-cfd59f5995b0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:35.287778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.288967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.289739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.355271 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] Creating event network-vif-plugged:dcde7bce-ccef-4154-b310-cfd59f5995b0 for instance 2e35c19e-c8bc-4983-aca5-1f939605987a on n-h1-833090-21 Oct 04 18:19:35.386915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6632461c-dbd1-4629-bc04-fa567e6ab993 req-8b10af0a-fa95-45e2-9d77-01a7935d7212 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183960 Oct 04 18:19:35.391542 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1657/3287] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:35.417975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.420505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:35.436105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:35.474108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.475126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.479640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.483700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.488056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.488872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:35.489394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.513468 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e6990d5-380e-4155-84ae-7270389f10f3 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.554783 Oct 04 18:19:35.521597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1631/3288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:35.537650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.578744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_groups [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Querying cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) for 1 instances {{(pid=123886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:19:35.581721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.583670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.584136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.664246 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95f9cd2f-5e11-4c6a-8d0f-b56712aad5b0 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0" status: 200 len: 221 microversion: 2.1 time: 0.140376 Oct 04 18:19:35.674237 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1632/3289] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:35 2022] GET /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0 => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:35.683274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.684498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:35.692837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.693599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.694207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.695246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.696170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.696855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.814063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:36.570662 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15d846e6-363f-41a0-b398-5be9c69b9a92 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 204 len: 0 microversion: 2.1 time: 0.894334 Oct 04 18:19:36.579205 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1633/3290] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:35 2022] DELETE /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:36.590181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:36.601001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:36.611217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.612016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.612848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.613785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.614435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.615348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.090486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.100057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0e9976a-0e85-4544-9a96-6a96990792b0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.518879 Oct 04 18:19:37.101232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1634/3291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:36 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.108349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23545b66-9b50-444d-91c3-bff090448c75 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d92d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.152827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.165190 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f2c6214-66ce-41a8-9a77-aafaccd557ba tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 1.765506 Oct 04 18:19:37.180064 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23545b66-9b50-444d-91c3-bff090448c75 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.068816 Oct 04 18:19:37.181175 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1635/3292] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.181800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1658/3293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:35 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.186241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.186878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:37.190292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.191110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:37.193621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.194232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.194555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.195452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.196470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.196905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.198784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.199313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.200986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.202151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.202773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.203356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4336e694-3b87-41cc-9f7e-6633f7241683 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.283791 Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1636/3294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1be398-5aca-4ddb-963c-4ddc554ee22b", "tag": "9ab8000e-da65-47f3-b7c2-ecb6a170b0e9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] Creating event network-changed:9ab8000e-da65-47f3-b7c2-ecb6a170b0e9 for instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b on n-h1-833090-21 Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dc033c92-ea19-40ab-975e-7ea4e62a543b req-e1ab6070-ac7a-4399-9db1-23d28e2d378b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035518 Oct 04 18:19:37.654403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1637/3295] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:37.656565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.656565 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe0f7914-7a12-494a-8cb5-43d2c70a7d77 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1505 microversion: 2.1 time: 0.438898 Oct 04 18:19:37.656565 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1659/3296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.133926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.135052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.166188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.168255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.169587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.171796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.174029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.174664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.189108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-337fe94a-094a-4678-a1fb-f3fc5f5d52a8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900adcec10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.293334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-337fe94a-094a-4678-a1fb-f3fc5f5d52a8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.106062 Oct 04 18:19:38.296343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1660/3297] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.314847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.316056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.327742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.328807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.329447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.330737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.331364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.332037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.655305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.674901 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4bae9de0-2ce9-499d-9a1d-acd1d916f609 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.548036 Oct 04 18:19:38.676118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1638/3298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.717416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.718584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.728507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.730268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.730963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.732001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.732880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.733656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.258372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:39.275158 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fefc47f-479d-46ab-abd6-c807eb10e430 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.591245 Oct 04 18:19:39.279845 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1639/3299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:39.291021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:39.292066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:39.309768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.311180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.312544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.314661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.316073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.318235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.800423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:39.814968 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81a83753-5076-4bfb-9f3d-ee15ac93883d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1505 microversion: 2.1 time: 0.533415 Oct 04 18:19:39.816014 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1640/3300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:39 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:39.830952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78ec847e-b8d1-4e39-8dc6-e8769ee94420 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d8aec10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:39.884259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:39.900226 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7a8f048-d6d2-4712-9db0-da86a6d08dfd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 1.602124 Oct 04 18:19:39.909530 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1661/3301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:39.922270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82add5f-62f5-42fd-a1ae-afa542d1e43f", "name": "network-vif-plugged", "status": "completed", "tag": "dddfe0fc-09e7-4564-b15e-9b1fc7107bf1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:39.962259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.962995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.963439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.968699 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78ec847e-b8d1-4e39-8dc6-e8769ee94420 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.148422 Oct 04 18:19:39.969306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1641/3302] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:39 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:39.990669 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] Creating event network-vif-plugged:dddfe0fc-09e7-4564-b15e-9b1fc7107bf1 for instance c82add5f-62f5-42fd-a1ae-afa542d1e43f on n-h2-833090-21 Oct 04 18:19:39.997222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.003635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.006722 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9a837e39-7746-4880-88e5-6a9e010c666f req-a69e603b-2ad6-41cd-b488-87ff017d1515 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102833 Oct 04 18:19:40.008256 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1662/3303] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:40.033234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.034405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.035512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.040122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.043041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.055259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.308581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.310262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.325361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.325361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.325877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.328381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.328929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.329352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.491231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.553418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f8edc1d5-8dee-4d99-8f0c-200e0da10e7d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.532846 Oct 04 18:19:40.553418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1642/3304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:39 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:40.759998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.771220 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9dc0f83-8f32-46cf-970e-5457d801441b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.467007 Oct 04 18:19:40.783425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1663/3305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:40.873866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.874719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.893742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.898182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.900542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.903522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.906343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.907978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.942205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.942205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.954551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.956897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.958354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.960643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.963160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.965459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.241600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.257175 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10de9031-9a06-4877-955b-d2b9c7ef06de tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1505 microversion: 2.1 time: 0.393459 Oct 04 18:19:41.258578 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1643/3306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:41.272755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab98bc5d-30f8-469d-ac65-903fc2720963 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d744c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.335173 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab98bc5d-30f8-469d-ac65-903fc2720963 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.075551 Oct 04 18:19:41.336225 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1644/3307] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:41.567120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.578896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.582564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:41.616778 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b729db21-2a6c-4e8e-9798-6eff1d0465bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 0.690616 Oct 04 18:19:41.623293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.640604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1664/3308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:41.646655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.647333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.652004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0575f723-f255-43ba-b8d2-96b22e0c8f39", "name": "network-vif-deleted", "tag": "b8cffbc3-84a8-4723-9497-a307b7bf2d88"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:41.656639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.657570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.665659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.666610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.667282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.678096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.681147 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] Creating event network-vif-deleted:b8cffbc3-84a8-4723-9497-a307b7bf2d88 for instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 on n-h1-833090-21 Oct 04 18:19:41.688164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-08910d69-204a-4bde-bbe8-43b74c1a0073 req-b83b837a-d7d0-4c3f-80f4-946a66a1299f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045977 Oct 04 18:19:41.690206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1665/3309] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:41.808269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:41.809349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:41.821464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.838642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.839622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:41.849681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:41.855008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:41.857908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.212274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.243780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5abc0a24-35b9-4aaf-93e6-60f552480850 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.439657 Oct 04 18:19:42.249370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1666/3310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:42.288849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.290121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.302855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.303709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.304341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.305417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.306125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.306781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.364453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.365341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.366123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.366831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lazy-loading 'fault' on Instance uuid 0575f723-f255-43ba-b8d2-96b22e0c8f39 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:42.377067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:42.439190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.456825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b942421-cb78-4d60-9a62-3069172da607 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1303 microversion: 2.1 time: 0.168133 Oct 04 18:19:42.456825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1667/3311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.461364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7f90712-4c71-427b-805c-4440010f2c3d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096d8280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.607011 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7f90712-4c71-427b-805c-4440010f2c3d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.151436 Oct 04 18:19:42.608024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1668/3312] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.658103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.658780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.688572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.689199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.697681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.717087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.717087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.717087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.921017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.929962 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40ec8065-668a-498c-a3f5-606577cb4f9a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 1.394627 Oct 04 18:19:42.944302 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1645/3313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:41 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.970083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:42.993655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c54fa671-a2ee-4d3b-b091-aa93856c2be5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1319 microversion: 2.1 time: 0.341395 Oct 04 18:19:42.995036 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1669/3314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:43.277850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.278507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.289939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.291162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.294288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.295316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.296048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.300377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.495396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.497671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.506538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.507210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.507782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.508743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.509287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.509757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.556736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.557804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.558467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.559184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lazy-loading 'fault' on Instance uuid 0575f723-f255-43ba-b8d2-96b22e0c8f39 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:43.632678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:43.642300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-abf02c01-207c-470d-8d09-e1727ecdca61 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1303 microversion: 2.1 time: 0.163870 Oct 04 18:19:43.653456 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1670/3315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:43.653456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-092e4239-365d-4220-b93f-e32f6e55a6d1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900970cd30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.720153 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-092e4239-365d-4220-b93f-e32f6e55a6d1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.075446 Oct 04 18:19:43.721270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1671/3316] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:43.880273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:43.892577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddf6bb80-7d36-4170-9908-069fcda3171c tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.619399 Oct 04 18:19:43.893414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1646/3317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:43.973186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:43.973811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.986961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.987493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.987966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.988747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.990013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.991660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.037185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.092827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.215359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.229763 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8049da7a-1789-4d1f-b2a4-5ddcfb0a08d6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.254596 Oct 04 18:19:44.229763 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1672/3318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:43 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.356141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.373900 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc68ac54-4228-4903-a98f-23719d94af40 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1469 microversion: 2.1 time: 0.340760 Oct 04 18:19:44.386800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1647/3319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.413399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.414188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.425653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.429140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.436231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.436231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.436231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.436231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.620467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.629209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0fe2b94-52dc-4431-b3d7-88c7f483d2a4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1469 microversion: 2.1 time: 0.220184 Oct 04 18:19:44.629819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1673/3320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.661600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.671751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.673361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Searching by: {'reservation_id': 'r-j0n0j0wp', 'deleted': False, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:19:44.675293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.676487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.681489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.681987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.682438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.683178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.683757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.684195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.687872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.688525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.689378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.690661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.691310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.692092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.741581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.742322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.742900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.743526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lazy-loading 'fault' on Instance uuid 0575f723-f255-43ba-b8d2-96b22e0c8f39 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:44.808142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe8156b7b7749648a99f8074627ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1d9060e7a2420fbdfc7bac1bb10e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.818135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:19:44.826459 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-156f6846-57cc-4c82-8cd9-e915f9f8219b tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 200 len: 1303 microversion: 2.1 time: 0.158264 Oct 04 18:19:44.828001 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1674/3321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 1303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:44.839142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:44.840312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-019df61f-cd68-44e0-8ca6-ed9819e64750 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009785dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.896016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-019df61f-cd68-44e0-8ca6-ed9819e64750 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.060282 Oct 04 18:19:44.896619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1675/3322] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.921442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:44.924886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.925721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.930044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.931018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.931880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.951517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.953621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.954770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.957611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.958638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.959522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.163883 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86b50bbc-24d6-4f91-9d4b-c520a82c3a6e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-j0n0j0wp" status: 200 len: 2931 microversion: 2.1 time: 0.509805 Oct 04 18:19:45.180674 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1648/3323] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-j0n0j0wp => generated 2931 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.192040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.209343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_groups [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Querying cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) for 2 instances {{(pid=123886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:19:45.210537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.211426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.212117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.237096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94b571b1-063e-4af7-a4b0-2c8e3ddc63fe tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/c4660bfc-be0a-43c4-886e-8d64603f422d" status: 200 len: 270 microversion: 2.1 time: 0.049191 Oct 04 18:19:45.244796 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1649/3324] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/os-server-groups/c4660bfc-be0a-43c4-886e-8d64603f422d => generated 270 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:45.252056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.252953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.253132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.260632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.263114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.263114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.263114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.263438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-950711d7-d22d-4c69-b271-af8e23d5fadc tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.348507 Oct 04 18:19:45.263572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.264171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.279499 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1676/3325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.279499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.279499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.287120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.287341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.295065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.295065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.295065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.295065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.455336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20b69469-a4fb-424b-8848-948748c72114 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 200 len: 1622 microversion: 2.1 time: 0.209029 Oct 04 18:19:45.458243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1650/3326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 1622 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.488336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.489490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.506864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.507978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.508697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.509534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.510044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.510478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.681776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.693433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-30e69d2b-5010-4b4f-99cb-24aa5b883116 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.423991 Oct 04 18:19:45.694255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1677/3327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.782022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56ec8d7d-fdbb-41d7-946f-d0be999378fc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1622 microversion: 2.1 time: 0.301073 Oct 04 18:19:45.796509 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1651/3328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1622 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:45.869764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.870469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:45.878166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.878782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.879287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.880097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:45.880645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:45.881135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.907982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 HTTP/1.1 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0575f723-f255-43ba-b8d2-96b22e0c8f39'} Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:45.909845 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:45.917441 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f1cf061-ba4a-4340-8a3f-4fcc19b0fdeb tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 404 len: 111 microversion: 2.1 time: 0.046858 Oct 04 18:19:45.918710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86e25448-fbdf-4647-a2c2-4958c2f5e226 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097e50d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:45.923540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1678/3329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:45.929404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1418939983", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "461c164b-77d5-4f3b-a945-f1cac32068cf"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:46.014256 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86e25448-fbdf-4647-a2c2-4958c2f5e226 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1453 microversion: 2.1 time: 0.101663 Oct 04 18:19:46.015115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1652/3330] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:45 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:46.030814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.043814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:46.049640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_groups [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Querying cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) for 1 instances {{(pid=123886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:19:46.050395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.051212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.051970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.064889 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43c5a3cb-13ba-4d5c-a81e-cd90ff648309 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.048592 Oct 04 18:19:46.065998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1653/3331] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:46.087111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.108951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_groups [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Querying cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) for 1 instances {{(pid=123886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:19:46.109721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.110282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.110787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.129467 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c37f9f3-0dce-4b09-bf9d-06440c60b973 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0" status: 200 len: 183 microversion: 2.1 time: 0.047260 Oct 04 18:19:46.130785 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1654/3332] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0 => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:46.143286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.143979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.157158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.157805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.158252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.159000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.159459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.160972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.188916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 HTTP/1.1 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0575f723-f255-43ba-b8d2-96b22e0c8f39'} Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:46.191286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.196883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.198481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.199713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2b9619b-873b-4ef4-b402-d6e4d50d9cf5 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 404 len: 111 microversion: 2.1 time: 0.060945 Oct 04 18:19:46.200998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1655/3333] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:19:46.214864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.215754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] [instance: 0575f723-f255-43ba-b8d2-96b22e0c8f39] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.223422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.224310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.225757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.227038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.227529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.227966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.248737 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 HTTP/1.1 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0575f723-f255-43ba-b8d2-96b22e0c8f39'} Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.250632 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. Oct 04 18:19:46.257486 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.271668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance 0575f723-f255-43ba-b8d2-96b22e0c8f39 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.272884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55964058-0825-4903-a2bf-5c3eea44d58d tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39" status: 404 len: 111 microversion: 2.1 time: 0.067187 Oct 04 18:19:46.275022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1656/3334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/0575f723-f255-43ba-b8d2-96b22e0c8f39 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:46.285851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d1b80c1-7f40-4d52-86c7-bb751842a617 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.292601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7d1b80c1-7f40-4d52-86c7-bb751842a617 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d1b80c1-7f40-4d52-86c7-bb751842a617 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-server-groups/16fe91e6-a970-45ee-9fc7-276c00aa9c5e HTTP/1.1 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '16fe91e6-a970-45ee-9fc7-276c00aa9c5e'} Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.299862 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d1b80c1-7f40-4d52-86c7-bb751842a617 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance group 16fe91e6-a970-45ee-9fc7-276c00aa9c5e could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d1b80c1-7f40-4d52-86c7-bb751842a617 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/16fe91e6-a970-45ee-9fc7-276c00aa9c5e" status: 404 len: 117 microversion: 2.1 time: 0.019717 Oct 04 18:19:46.304591 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1657/3335] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/os-server-groups/16fe91e6-a970-45ee-9fc7-276c00aa9c5e => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:46.309659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.310511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.319805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.321000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.321550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.322394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.322943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.323536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.365900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:46.367266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:46.368227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:46.368962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:46.369561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:46.381530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.382094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.382461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.383883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.384431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.384937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.406149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:46.412908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:46.428631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:46.431335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:46.576605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:46.589408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f51ee74-3267-4c9c-8468-cf5d1aba28b6 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.285356 Oct 04 18:19:46.590087 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1658/3336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:46.596682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6d687216-555e-4943-8a37-993b414c8f38 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.603941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6d687216-555e-4943-8a37-993b414c8f38 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6d687216-555e-4943-8a37-993b414c8f38 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-server-groups/e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 HTTP/1.1 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e0a44a0e-5542-4ad2-a213-0d2f6ad715b8'} Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.605787 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. Oct 04 18:19:46.610894 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.621440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6d687216-555e-4943-8a37-993b414c8f38 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance group e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.621440 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6d687216-555e-4943-8a37-993b414c8f38 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e0a44a0e-5542-4ad2-a213-0d2f6ad715b8" status: 404 len: 117 microversion: 2.1 time: 0.023477 Oct 04 18:19:46.621440 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1659/3337] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/os-server-groups/e0a44a0e-5542-4ad2-a213-0d2f6ad715b8 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:46.628374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bbe569a-10d9-44f0-8be5-63a4099dfd82 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6bbe569a-10d9-44f0-8be5-63a4099dfd82 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bbe569a-10d9-44f0-8be5-63a4099dfd82 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-server-groups/aa977cdf-989b-473a-ad5e-ceff38bf0da6 HTTP/1.1 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'aa977cdf-989b-473a-ad5e-ceff38bf0da6'} Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.639816 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bbe569a-10d9-44f0-8be5-63a4099dfd82 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance group aa977cdf-989b-473a-ad5e-ceff38bf0da6 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6bbe569a-10d9-44f0-8be5-63a4099dfd82 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/aa977cdf-989b-473a-ad5e-ceff38bf0da6" status: 404 len: 117 microversion: 2.1 time: 0.016680 Oct 04 18:19:46.649660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1660/3338] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/os-server-groups/aa977cdf-989b-473a-ad5e-ceff38bf0da6 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:46.653477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69edea79-5603-44a4-a9e4-a155641bd3c6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.661881 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-69edea79-5603-44a4-a9e4-a155641bd3c6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] HTTP exception thrown: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69edea79-5603-44a4-a9e4-a155641bd3c6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Request method failure captured: Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-server-groups/b2c01751-3ace-4a4f-a537-9675e56581bc HTTP/1.1 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkQC5SYnbg7LF1-cMPnRn-TbzgSab58ANJYqX8yhOCgocJFaQy5YfjJHSC2RdyrJlYh5rvgrMp_isxJyya0vJZDPSFMJJuygC4XWI6AlT9ghg0YAbGhEH_ZuYMdYw8J3-5sSfNAvsxwrPIYL04XYLY-LZx5uZMmzaRPuOA8vgJdivw Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa1d9060e7a2420fbdfc7bac1bb10e6c"}]}] Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fa1d9060e7a2420fbdfc7bac1bb10e6c Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1526291915 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: dbe8156b7b7749648a99f8074627ed40 Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroupTestJSON-1526291915-project Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b2c01751-3ace-4a4f-a537-9675e56581bc'} Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.663822 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69edea79-5603-44a4-a9e4-a155641bd3c6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Returning 404 to user: Instance group b2c01751-3ace-4a4f-a537-9675e56581bc could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:46.669825 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69edea79-5603-44a4-a9e4-a155641bd3c6 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/b2c01751-3ace-4a4f-a537-9675e56581bc" status: 404 len: 117 microversion: 2.1 time: 0.017283 Oct 04 18:19:46.670959 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1661/3339] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/os-server-groups/b2c01751-3ace-4a4f-a537-9675e56581bc => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:46.679437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-803b5c64-e885-4f17-956e-492bc2c5cec8 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.685566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14a948c3-169e-46f5-891b-818fc71ba0f8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760798 Oct 04 18:19:46.687029 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1679/3340] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:19:46.700116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c128baf-7636-4a2d-962c-0084bf5b3411 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.701011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c128baf-7636-4a2d-962c-0084bf5b3411 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.739349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:46.778032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c128baf-7636-4a2d-962c-0084bf5b3411 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:46.795277 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c128baf-7636-4a2d-962c-0084bf5b3411 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1217 microversion: 2.1 time: 0.100132 Oct 04 18:19:46.798931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1680/3341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:46.806287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.806946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.814851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.815310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.815779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.816483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.816933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.817383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.823493 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-803b5c64-e885-4f17-956e-492bc2c5cec8 tempest-ServerGroupTestJSON-1526291915 tempest-ServerGroupTestJSON-1526291915-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0" status: 204 len: 0 microversion: 2.1 time: 0.151668 Oct 04 18:19:46.824403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1662/3342] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:19:46 2022] DELETE /compute/v2.1/os-server-groups/2cb49388-a279-4260-9aa6-867a151dbab0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:47.039905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dda9ebd2-dfb0-4c79-bee3-f23c4e064fd3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900973be50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.099094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dda9ebd2-dfb0-4c79-bee3-f23c4e064fd3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1462 microversion: 2.1 time: 0.064455 Oct 04 18:19:47.109828 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1663/3343] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1462 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.115563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-acc99c9e-dd03-4970-bf2f-e52fc6b4c0e2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c79310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.193841 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-acc99c9e-dd03-4970-bf2f-e52fc6b4c0e2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 200 len: 1462 microversion: 2.1 time: 0.081692 Oct 04 18:19:47.197954 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1664/3344] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:47.216113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.217974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:47.225802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.226399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.227408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.231934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.231934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.231934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.258422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.268116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-898731b4-1536-4deb-b7c3-31cb5bf7d29f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.467297 Oct 04 18:19:47.269662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1681/3345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.481570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.492543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3130d555-f8c2-4882-b217-4ea5f2700003 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1466 microversion: 2.1 time: 0.284665 Oct 04 18:19:47.493142 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1665/3346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1466 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.515393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-391775329"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:47.517951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:47.524744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.525480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.526080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.527067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.527741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.528327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.612981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.613611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:47.627227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.628046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.628678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.631518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:47.632294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:47.633910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.889542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.899868 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17847ca0-5e9d-40ad-bef0-ebd8947b1ee5 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.290467 Oct 04 18:19:47.916957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1666/3347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:47.924544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ac50e86-b848-40cc-81c4-3eadc8eb70ae tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:47.925673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ac50e86-b848-40cc-81c4-3eadc8eb70ae tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.016187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ac50e86-b848-40cc-81c4-3eadc8eb70ae tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.037854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ac50e86-b848-40cc-81c4-3eadc8eb70ae tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1217 microversion: 2.1 time: 0.119107 Oct 04 18:19:48.052533 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1667/3348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:47 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:48.302155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.305707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.317782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.328194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.328719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.329505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.330200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.330649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.371232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40c4a053-b478-42a3-a909-e3a734f4e301 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "POST /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c/action" status: 202 len: 0 microversion: 2.1 time: 0.859445 Oct 04 18:19:48.379430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1682/3349] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:47 2022] POST /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:19:48.393340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7efc3a88-69d5-4eb7-81ff-dae2893a8016 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096d8dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.499139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7efc3a88-69d5-4eb7-81ff-dae2893a8016 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.110075 Oct 04 18:19:48.510342 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1683/3350] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:48.618846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.635016 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69c6769e-ece8-41d1-b5fe-4445e9b31bc7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.341747 Oct 04 18:19:48.637105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1668/3351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:48.884480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1be398-5aca-4ddb-963c-4ddc554ee22b", "name": "network-vif-plugged", "status": "completed", "tag": "9ab8000e-da65-47f3-b7c2-ecb6a170b0e9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.901987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.903152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.904700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.923699 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] Creating event network-vif-plugged:9ab8000e-da65-47f3-b7c2-ecb6a170b0e9 for instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b on n-h1-833090-21 Oct 04 18:19:48.931374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7bb86e9b-616c-4d1e-b120-c443026713f9 req-632a43b5-0a10-428d-a895-da79e45240ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056508 Oct 04 18:19:48.931881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.932595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.940503 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1684/3352] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:48.950729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.951636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.952320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.953670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.954274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.954819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.076465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.077184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.103048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.103640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.104594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.109005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.109797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.110711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.258792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.272038 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7443db9e-c964-4cb9-8d8d-1e9c3cb4bf3e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.346468 Oct 04 18:19:49.276548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1669/3353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:49.305136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.314647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5af75ba8-087e-4988-a655-d455d5971da6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1221 microversion: 2.1 time: 0.253394 Oct 04 18:19:49.319545 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1685/3354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:49.528225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b05b801b-f13b-4201-8645-4e290eb8e555 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d838ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.599706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b05b801b-f13b-4201-8645-4e290eb8e555 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.075922 Oct 04 18:19:49.618686 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1670/3355] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:49.686519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.687699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.704270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.706248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.706248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.707870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.710233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.711521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.301089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.301987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.318718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.321675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.322288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.323458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.324139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.325713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.644577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.657122 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e82e622-1b20-4c52-a3a5-599fa6cdf1d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.980495 Oct 04 18:19:50.667567 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1686/3356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:50.668989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.670961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.691992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.694473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.695319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.696288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.697458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.698117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.853057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.864360 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1793017-187a-4879-8108-fadd84b609f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1277 microversion: 2.1 time: 0.205109 Oct 04 18:19:50.869765 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1687/3357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:50.875250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2afb8048-b35a-4173-adb4-7f8af9e645f6 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90099375e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.953267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:50.954276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2afb8048-b35a-4173-adb4-7f8af9e645f6 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.083127 Oct 04 18:19:50.954854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1688/3358] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:50.979975 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed764c22-f092-4920-9c3d-1be3824e01a0 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1316 microversion: 2.1 time: 0.682584 Oct 04 18:19:50.979975 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1671/3359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:51.133036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-unplugged", "status": "completed", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:51.159965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.161010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.161821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.179771 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] Creating event network-vif-unplugged:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:19:51.202742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-be70a2bb-a2e9-49f4-b193-8cc602a921fd req-9bf1fd1b-7221-4d5a-9242-38c849ce5d11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.233810 Oct 04 18:19:51.204398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1689/3360] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:51.691888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.692879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:51.701115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.702181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.702904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.703930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.704635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.705312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.902716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.903835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:51.912176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.912676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.913167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.913856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.915185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.915723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.006598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.006598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:52.009381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dfa154de-69de-40db-b179-9bef1ed7c032 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1275 microversion: 2.1 time: 0.113575 Oct 04 18:19:52.010755 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1690/3361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:51 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:52.015823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a8db863-b473-47cc-a99c-9ac9414b7da3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d0b1f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.079244 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a8db863-b473-47cc-a99c-9ac9414b7da3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.066281 Oct 04 18:19:52.084025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1691/3362] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.105401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.110605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.118435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.119190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.121526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.123055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.123925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.124527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.316612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.335357 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae15ff6e-c333-436e-9d94-eb22ee68ad63 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.653389 Oct 04 18:19:52.337562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1672/3363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:51 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.480591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.491023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4021a08-8dbc-4763-aabf-84eca4f3de40 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1506 microversion: 2.1 time: 0.390261 Oct 04 18:19:52.491839 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1692/3364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.516818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.517506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.525435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.526068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.526665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.527536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.528074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.528570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.566636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.567770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-387e16f3-d5ce-47e7-9c89-77629dc55621 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/os-instance-actions/req-3718f6dd-e570-499f-af35-797392626992" status: 200 len: 313 microversion: 2.1 time: 0.055511 Oct 04 18:19:52.568459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1673/3365] 10.222.0.40 () {58 vars in 1419 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/os-instance-actions/req-3718f6dd-e570-499f-af35-797392626992 => generated 313 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:52.583145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:52.585516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.591976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.592529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.593055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.593797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.594225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.594652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.939960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01fa879b-eae1-4736-86b9-9fc86b5e7752 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "POST /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/action" status: 202 len: 0 microversion: 2.1 time: 0.360533 Oct 04 18:19:52.951631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.952274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.954828 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1693/3366] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:52 2022] POST /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:19:52.965175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.965659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.966100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.966804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.984393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.990691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.066402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.067447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.094817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.279705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.301666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56fcb7c4-221e-4c16-8bc2-2e6c6f26f35d tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1508 microversion: 2.1 time: 0.342843 Oct 04 18:19:53.314610 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1674/3367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:53.314610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-888ba25e-fc91-4e8d-ae39-76d63fde3777 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097955e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.380601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-888ba25e-fc91-4e8d-ae39-76d63fde3777 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.076571 Oct 04 18:19:53.382866 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1675/3368] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:53.389438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.390067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:53.401425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.402171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.402927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.403906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.404428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.404864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.601526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.621922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e9bc5dfd-1a3e-4fc4-818c-e355186f5a88 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.237857 Oct 04 18:19:53.623172 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1676/3369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:53.726078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:53.737113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c95517e5-083c-4b3a-9525-d27dc8a43346 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.693423 Oct 04 18:19:53.747704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1694/3370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:54.332378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.333581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.343273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.344265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.350622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.350622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.350622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.350622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.405552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e59449a9-5807-467c-a4ff-1c308555fd80 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009937700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.494490 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e59449a9-5807-467c-a4ff-1c308555fd80 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.094934 Oct 04 18:19:54.494675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1695/3371] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:54.571176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.585541 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-056baf03-dced-4ffc-a83e-3463c3c36260 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1508 microversion: 2.1 time: 0.259681 Oct 04 18:19:54.589158 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1677/3372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:54.646423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.647023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.654545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.655025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.655459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.656181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.656628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.657045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.765722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.766447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.773976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:54.776239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.776931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.777659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.778689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.779388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.780011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.909870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.923445 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a2ca3d8-3825-496f-929f-f2f1d0283e20 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.280289 Oct 04 18:19:54.934248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1696/3373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:54.943199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.952183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3e6f108-fedd-42f3-b8fe-1ba87bd61e64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.194529 Oct 04 18:19:54.952833 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1678/3374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:55.510781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e36f110-7748-45b5-a260-8d6fcd7f2f5c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009937280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.595839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e36f110-7748-45b5-a260-8d6fcd7f2f5c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.087832 Oct 04 18:19:55.596668 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1697/3375] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:55.620695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.624798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.658321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.659156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.659766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.664728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.664728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.664728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.683135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:55.874161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.886053 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-242364d3-0624-4491-8e3c-2948a248240b tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1513 microversion: 2.1 time: 0.278006 Oct 04 18:19:55.895810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1679/3376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:55.948486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.949410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.958194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.958965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.959741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.960695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.961737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.962346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.977197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.978219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.987880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.988816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.990314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.990609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.991741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.992376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.203206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.217229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.217743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35ceb65d-07c1-4634-9e30-43a5dc043ad2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.273866 Oct 04 18:19:56.225792 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1698/3377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:56.226081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-604deb05-e90f-4058-9539-0d30210ce012 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.254146 Oct 04 18:19:56.226722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1680/3378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:56.615044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e816af3-3d45-4f42-92c6-d3b2a9f342ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d0b280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.623056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:56.685206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e816af3-3d45-4f42-92c6-d3b2a9f342ca tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.074929 Oct 04 18:19:56.685883 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1699/3379] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:56.905990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0cbbb44-4357-4882-a4fa-4718c88a0f9c", "name": "network-vif-plugged", "status": "completed", "tag": "9acad7a8-f03c-406f-8159-556ecfadc0b2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:56.910070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:56.918960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.922701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:56.934856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:56.944898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.946228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.946686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.947421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.948222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.948897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.949486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.950145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.950568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.981074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] Creating event network-vif-plugged:9acad7a8-f03c-406f-8159-556ecfadc0b2 for instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c on n-h2-833090-21 Oct 04 18:19:56.990827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-92bfa368-5b67-4460-ad42-0f2cfe79d919 req-f0025480-fcd5-45fa-9dbe-a75613def549 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089888 Oct 04 18:19:56.997201 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1681/3380] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:57.184302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.192675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1f60b42-497b-44d3-b5b3-6beaa47dc986 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1506 microversion: 2.1 time: 0.283803 Oct 04 18:19:57.193210 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1700/3381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:57.217408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '.version_select at 0x7f9008dcc1f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.218193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.225097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.227309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.227309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.227542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.227836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.228306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.246586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.247206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.254687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.255899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.256153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.257050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.257762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.258861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.284702 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71b8f2b2-b461-4630-b57e-f46147535dce tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.070803 Oct 04 18:19:57.285703 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1682/3382] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b/os-instance-actions => generated 611 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:57.291451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.298764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.300729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.301771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.302450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.304733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.305579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.306191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.494758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.506047 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-96544d70-4cb0-434b-b988-8a7de96e2990 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.263490 Oct 04 18:19:57.507112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1701/3383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:57.513878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.514551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.521245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.521827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.522325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.523102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.524249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.530956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.560120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:57.564916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.576001 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-134a3722-6224-45c8-89e7-97494e0e411b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.288885 Oct 04 18:19:57.577128 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1683/3384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:57.701855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bf183f7-1ed8-4dc3-9418-5a2b5175f8fb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097b2820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.761179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bf183f7-1ed8-4dc3-9418-5a2b5175f8fb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.063168 Oct 04 18:19:57.770013 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1684/3385] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:58.078259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-832a92ff-6271-4b1f-9202-44754a78c995 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 204 len: 0 microversion: 2.1 time: 0.568390 Oct 04 18:19:58.089532 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1702/3386] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:57 2022] DELETE /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:58.090024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:58.092502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.093352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.105230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.105771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.106458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.107505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.108145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.110572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.332343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.341772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a302af0-1b5c-439d-a590-b088febdf95e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1512 microversion: 2.1 time: 0.257789 Oct 04 18:19:58.342367 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1685/3387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:58.545178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.547331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.563213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.563995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.564434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.565295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.567444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.568080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.600741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.602107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.617404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.623546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.623546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.623546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.623546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.623546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.872861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.883955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4f2a0c94-41cd-4cbf-a6f8-22af38646e2d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.352021 Oct 04 18:19:58.885461 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1703/3388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:58.890935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55a4569a-eacc-4a91-9275-73c6309eadc5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c1b0d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.916879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.924420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c90d7cf-f547-4f26-a4da-077a0f5c10ef tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.327154 Oct 04 18:19:58.925412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1686/3389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:58.960066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55a4569a-eacc-4a91-9275-73c6309eadc5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.073201 Oct 04 18:19:58.961632 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1704/3390] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:59.367779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.368957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.376112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.376903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.377522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.378427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.379063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.379740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.737543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:59.764503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de91fe76-9c96-4ed8-80e7-d1b53e25d519 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1512 microversion: 2.1 time: 0.402019 Oct 04 18:19:59.766411 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1687/3391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:59.768955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fea7f1f-ec85-4666-a060-aef741beed7d", "tag": "c3466cc5-484c-4678-806f-8fca39c9e119"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:59.791625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.792336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.792966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.811247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] Creating event network-changed:c3466cc5-484c-4678-806f-8fca39c9e119 for instance 9fea7f1f-ec85-4666-a060-aef741beed7d on n-h2-833090-21 Oct 04 18:19:59.824059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3a915a41-7482-49c5-b2ae-3b55eae2150b req-e96c9963-5dc1-42cc-9349-d87cc2c76725 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059886 Oct 04 18:19:59.829600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1705/3392] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:59.910265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.911196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.922332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.924063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.925656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.930314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.931051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.931698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.950748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.952112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.965301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.969490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.969490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.971590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.972243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.976813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.247270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.288914 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68f6a964-8d9a-4ba5-bca3-a8b9a0402a8b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.342775 Oct 04 18:20:00.293498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1706/3393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:00.299634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.313762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26655056-cb95-429a-8da2-0a4170950db5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.407651 Oct 04 18:20:00.318030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1688/3394] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:00.320421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f8cc9f1-6dec-41c3-8297-2224f6ff304c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900977c820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:00.424955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f8cc9f1-6dec-41c3-8297-2224f6ff304c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.124942 Oct 04 18:20:00.425564 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1707/3395] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:00 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:00.625876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1be398-5aca-4ddb-963c-4ddc554ee22b", "name": "network-vif-deleted", "tag": "9ab8000e-da65-47f3-b7c2-ecb6a170b0e9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:00.640732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.641227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.641668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.656334 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] Creating event network-vif-deleted:9ab8000e-da65-47f3-b7c2-ecb6a170b0e9 for instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b on n-h1-833090-21 Oct 04 18:20:00.663022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-46cc947b-68f1-4009-a378-57a12a027605 req-9688a781-4f4c-40a5-af75-66d01a3bac2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040881 Oct 04 18:20:00.668013 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1689/3396] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:00.799417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:00.799976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:00.822351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.823559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.830440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.830440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.830440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.830440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.917203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97324096c2ee4146afd05183199c6b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '316fe7ff7e9a45689fd08ab5d41a6cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.943369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d01174aa-f5dc-4d29-a025-30ab2399759e tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 200 len: 1301 microversion: 2.1 time: 0.141461 Oct 04 18:20:00.984620 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1708/3397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:00 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 1301 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:01.327866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.329443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.350809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.352316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.365798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.369268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.371625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.371625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.372148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.372946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.373743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.374673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.375350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.376102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.378785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.385297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.350563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.375198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-419ffef5-a936-44ef-97cf-d8cbc770c123 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 1.031295 Oct 04 18:20:02.381169 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1709/3398] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:02.397034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e90bd97a-67d2-4cf5-98f8-15e3675f7836 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009937d30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:02.418769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.447407 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dc707e5-11c5-4b4f-a8b1-ce6951e21587 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 1.129527 Oct 04 18:20:02.453747 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1690/3399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:02.462123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:02.467021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] [instance: 3c1be398-5aca-4ddb-963c-4ddc554ee22b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:02.475559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.476401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.477541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.478441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.479341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.479979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.498754 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] HTTP exception thrown: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Request method failure captured: Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b HTTP/1.1 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkpi8GiUJA4uNskBPYboNtXcB2aeQXvE3iaZVwOLrMSEshZKgdL2hzJSUEigmre-mNfB0mid5QcSI3acektraHtTO8nMYSTd7_0vkB2sPpDRPgFQPZRkBt9nvDN3BucWrXZCO-MTgykUMkyTT9EmT8c_W0QAyCd_3f-I0_Qea0McDE Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 316fe7ff7e9a45689fd08ab5d41a6cfa Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-InstanceActionsTestJSON-1818962140 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_316fe7ff7e9a45689fd08ab5d41a6cfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/316fe7ff7e9a45689fd08ab5d41a6cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/316fe7ff7e9a45689fd08ab5d41a6cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/316fe7ff7e9a45689fd08ab5d41a6cfa"}]}] Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-InstanceActionsTestJSON-1818962140 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 316fe7ff7e9a45689fd08ab5d41a6cfa Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1818962140 Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-InstanceActionsTestJSON-1818962140-project Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 97324096c2ee4146afd05183199c6b7d Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-InstanceActionsTestJSON-1818962140-project Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3c1be398-5aca-4ddb-963c-4ddc554ee22b'} Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:02.500838 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. Oct 04 18:20:02.506384 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:02.507889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] Returning 404 to user: Instance 3c1be398-5aca-4ddb-963c-4ddc554ee22b could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:02.508958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-569dcbd6-71c8-4204-a2b1-206c1edaf093 tempest-InstanceActionsTestJSON-1818962140 tempest-InstanceActionsTestJSON-1818962140-project] 10.222.0.40 "GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b" status: 404 len: 111 microversion: 2.1 time: 0.058273 Oct 04 18:20:02.510122 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1691/3400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:02 2022] GET /compute/v2.1/servers/3c1be398-5aca-4ddb-963c-4ddc554ee22b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:02.554098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e90bd97a-67d2-4cf5-98f8-15e3675f7836 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.165582 Oct 04 18:20:02.554819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1710/3401] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:02 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:03.401502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.402368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.420200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.421291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.421291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.421971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.422665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.423310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.479797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.480413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.498264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.498723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.510267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.514197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.514197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.514197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.996532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.042029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.049112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8c08e59-6914-4734-9c41-24442eff45d5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.574855 Oct 04 18:20:04.069706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1711/3402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:04.079385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfb0735e-1f1f-4e00-8065-fee9536585f1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900979f280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.086924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-884f50aa-f078-4f65-b8f5-00ca11512a44 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1521 microversion: 2.1 time: 0.687193 Oct 04 18:20:04.087394 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1692/3403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:04.151172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfb0735e-1f1f-4e00-8065-fee9536585f1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.078035 Oct 04 18:20:04.151805 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1712/3404] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:04 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:05.079222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.079985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.105962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.106508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.107548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.108488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.110560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.111204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.112038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.113397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.127091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.132983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.132983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.132983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.132983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.132983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.167899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:05.531319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.541884 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28bae4c8-cef5-40b2-aad2-fac463dc112a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1501 microversion: 2.1 time: 0.435289 Oct 04 18:20:05.545299 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1713/3405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1501 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:05.553126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.560355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-96a6c70b-62a7-4aa8-9d53-073adc9ccf45 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096ba3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.592888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e3c7bd3-ebad-4d27-bf29-400946b857c5 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.519715 Oct 04 18:20:05.594958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1693/3406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:05.600580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.601494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.610527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.611421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.612409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.613593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.614266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.614868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.678370 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-96a6c70b-62a7-4aa8-9d53-073adc9ccf45 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.131798 Oct 04 18:20:05.681591 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1714/3407] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.040595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.052810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3105c0d8-9380-4d37-aaf0-7766ac18e25c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1515 microversion: 2.1 time: 0.456649 Oct 04 18:20:06.053424 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1694/3408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1515 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:06.081862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:06.091441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 5e1defbe-6732-4bf6-909d-3391d45db18e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.113667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/5e1defbe-6732-4bf6-909d-3391d45db18e/action HTTP/1.1 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 14 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: {"rescue": {}} Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5e1defbe-6732-4bf6-909d-3391d45db18e', 'body': {'rescue': {}}} Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:06.128697 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 404 to user: Instance 5e1defbe-6732-4bf6-909d-3391d45db18e could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8dde23c2-fe2f-45fd-b085-567e9e614cb2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/5e1defbe-6732-4bf6-909d-3391d45db18e/action" status: 404 len: 111 microversion: 2.1 time: 0.052694 Oct 04 18:20:06.140550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1715/3409] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:06 2022] POST /compute/v2.1/servers/5e1defbe-6732-4bf6-909d-3391d45db18e/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:06.142602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:06.142602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.161180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.161704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.162163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.163305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.163451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.164385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.443081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a521e8d-bacf-4002-bab0-4e0696e2afab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action" status: 202 len: 0 microversion: 2.1 time: 0.304070 Oct 04 18:20:06.447235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1695/3410] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:06 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:06.454743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.455378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.473586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.474107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.474760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.475696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.476717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.477353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.621970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.623405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.654690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.660158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.661360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.666523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.670396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.671526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.120206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.150506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d50d11a1-27e9-4ed2-abc6-92d8e8e66eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1520 microversion: 2.1 time: 0.700194 Oct 04 18:20:07.160814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1716/3411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1520 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:07.180402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3c63b47-1d5e-44bf-9d85-79f16c6cdfcf tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90096ea670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.210977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.220804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51a6de0d-058b-4a58-8e90-db39664dce0a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.605824 Oct 04 18:20:07.223696 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1696/3412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:07.279674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3c63b47-1d5e-44bf-9d85-79f16c6cdfcf tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.116370 Oct 04 18:20:07.281323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1717/3413] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:07 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:08.194061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.194744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.208127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.214821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.218897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.218897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.218897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.221772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.263516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.264755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.302783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.313553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.314324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.315131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.315679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.323926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.117363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.126426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:09.147319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0800eb8-f90e-415b-88e0-3f394253d8fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1520 microversion: 2.1 time: 0.958972 Oct 04 18:20:09.149160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1697/3414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1520 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.158902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21bf3817-3532-439f-8d52-b7ee125267aa tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d890f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.253718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21bf3817-3532-439f-8d52-b7ee125267aa tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.101461 Oct 04 18:20:09.255147 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1698/3415] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.321257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.336292 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f2e13047-357c-49f0-91d8-bec71fb03c82 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 1.077108 Oct 04 18:20:09.337975 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1718/3416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.712939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-12019734", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:09.870202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:10.180077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.181856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.208832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.210220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.212717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.218627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.218627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.225625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.712607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:10.735429 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6db4e68e-2ea7-44fa-b4cc-87105780f525 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1500 microversion: 2.1 time: 0.562399 Oct 04 18:20:10.754826 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1719/3417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1500 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:10.754826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b86e455-fd67-4d2a-b463-42fbedeebf61 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cc65e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.880187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:10.880768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:10.881469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:10.882279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:10.883496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:10.892696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b86e455-fd67-4d2a-b463-42fbedeebf61 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.154555 Oct 04 18:20:10.895443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1720/3418] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:10.911771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.914937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.917380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.922000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.922000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.937311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.942287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.942444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.942444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.943298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.944426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.946967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.949497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.950980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.014618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:11.031408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:11.081522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:11.091179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:11.528608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2c88a42-fca1-44bc-ad0b-c833aa979aeb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.067399 Oct 04 18:20:11.548587 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1699/3419] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:11.565224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:11.577176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.614654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.670141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.056s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.671266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.678933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.681022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.685215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.795885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'flavor' on Instance uuid 78d41405-e13e-4099-82e3-33a64017e70c {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:11.974303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Cannot 'rescue' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state paused Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action HTTP/1.1 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 14 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: {"rescue": {}} Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot 'rescue' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state paused Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '78d41405-e13e-4099-82e3-33a64017e70c', 'body': {'rescue': {}}} Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 78d41405-e13e-4099-82e3-33a64017e70c in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state paused Oct 04 18:20:11.992157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state paused Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 409 to user: Cannot 'rescue' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state paused {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:11.998051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6af03c8-0646-4753-a181-62a2fa244ed2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action" status: 409 len: 144 microversion: 2.1 time: 0.442496 Oct 04 18:20:12.005102 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1700/3420] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:11 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action => generated 144 bytes in 454 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:20:12.052218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68d2fa3c-7878-485b-9ba6-b1cfadd7a9b3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.052218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68d2fa3c-7878-485b-9ba6-b1cfadd7a9b3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.258939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68d2fa3c-7878-485b-9ba6-b1cfadd7a9b3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:12.285920 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68d2fa3c-7878-485b-9ba6-b1cfadd7a9b3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1191 microversion: 2.1 time: 0.279540 Oct 04 18:20:12.286536 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1701/3421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1191 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:12.328029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-daf63603-b260-492b-b629-1488da5b3038 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009733310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.469833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-daf63603-b260-492b-b629-1488da5b3038 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.163456 Oct 04 18:20:12.483850 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1702/3422] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:12.496664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:12.512775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.565086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.565711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.566168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.566918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.567370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.579834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.279587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2fa41a06-3efa-4463-be12-043f896625ee tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action" status: 202 len: 0 microversion: 2.1 time: 0.793547 Oct 04 18:20:13.281041 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1703/3423] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:12 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:13.301050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:13.307286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:13.327454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:13.330011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:13.331098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.336267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:13.337802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:13.338577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.751970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.760821 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0cb20b1-6f7c-4827-b355-671b781fe1c3 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 2.863761 Oct 04 18:20:13.761425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1721/3424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 2865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:13.800335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25659c99-be96-410e-bdbd-475aa5e16500 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:13.801034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25659c99-be96-410e-bdbd-475aa5e16500 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.154767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-25659c99-be96-410e-bdbd-475aa5e16500 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.156729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.165939 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25659c99-be96-410e-bdbd-475aa5e16500 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1191 microversion: 2.1 time: 0.403417 Oct 04 18:20:14.181076 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1722/3425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:13 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1191 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.185905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7513dbce-f5ec-430f-9405-b37d60ec4809 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1507 microversion: 2.1 time: 0.891070 Oct 04 18:20:14.189990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54667b65-71b4-4f3f-9449-f9aeb63fa8bd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087afd30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.191079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1704/3426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:13 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.261887 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54667b65-71b4-4f3f-9449-f9aeb63fa8bd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.079511 Oct 04 18:20:14.263287 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1723/3427] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.786996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.787646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.803112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.803647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.808277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.813221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.814885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.818129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.165662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.175637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2fad27a-e885-4974-8b3f-e8e25bc231a9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.391968 Oct 04 18:20:15.176828 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1705/3428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:15.198195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:15.199435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:15.219950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:15.221368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:15.238071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.238580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.239023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.266148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.266148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.266148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.269726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.270473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.271128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.273847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.274527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.275132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.757120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.770875 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cda2c2d4-a959-4963-aea4-170e843b74c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1243 microversion: 2.1 time: 0.578902 Oct 04 18:20:15.787858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.808516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1724/3429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:15 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1243 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:15.825366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bcc62266-7a63-4def-a1a0-216a2838c48e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900880cb80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:15.825994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cdb1230b-716a-4471-8c5d-e60cc23fc21a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1515 microversion: 2.1 time: 0.596611 Oct 04 18:20:15.826897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1706/3430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:15 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1515 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:15.853084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fea7f1f-ec85-4666-a060-aef741beed7d", "name": "network-vif-plugged", "status": "completed", "tag": "c3466cc5-484c-4678-806f-8fca39c9e119"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:15.933151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bcc62266-7a63-4def-a1a0-216a2838c48e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.117886 Oct 04 18:20:15.934099 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1725/3431] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:15 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:15.935746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.941779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.942311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.997439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] Creating event network-vif-plugged:c3466cc5-484c-4678-806f-8fca39c9e119 for instance 9fea7f1f-ec85-4666-a060-aef741beed7d on n-h2-833090-21 Oct 04 18:20:16.007750 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-240140e3-2f66-4b8a-be04-e7bd4352fa7a req-bdc79d2e-138b-41ad-812a-1bcd4c72d24f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176324 Oct 04 18:20:16.016063 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1707/3432] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:16.112027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.113752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.136830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.136830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.136830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.138461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.139004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.142385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.208492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.211963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.232004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.233156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.233798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.234685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.235315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.235967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.706012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.733529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cb366e9-5f52-4444-a179-9a55be714a97 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.531842 Oct 04 18:20:16.739873 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1708/3433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:16.804774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.806911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.816883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.826061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.831489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.833853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.834255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.837273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.837772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.221978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.257454 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82197600-504d-4cc4-bc99-7697a4525a52 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1251 microversion: 2.1 time: 0.458354 Oct 04 18:20:17.275360 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1709/3434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1251 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:17.285292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd35ba6e-bf22-4ac9-b93a-06badf0eed77 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009730ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.401885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd35ba6e-bf22-4ac9-b93a-06badf0eed77 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.124172 Oct 04 18:20:17.404265 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1710/3435] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:17.449869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.471817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:17.493447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17cccdc1-ceac-46da-be3d-1451b28169c9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2954 microversion: 2.42 time: 1.381628 Oct 04 18:20:17.499801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1726/3436] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2954 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:17.549211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.551281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.573431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.579898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.582814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.584778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.586691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.589783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.826566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-402946843", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bdd2f0d6-3a97-422c-a1ef-de947a2ad8d3"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:17.939289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] validate_networks() for [('bdd2f0d6-3a97-422c-a1ef-de947a2ad8d3', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:18.467505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29436a04-41b9-4d92-b7d4-511836326954 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.939619 Oct 04 18:20:18.468227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1727/3437] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335/os-interface => generated 1830 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:18.473459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:18.474250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:18.499672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.502708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.510439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.532444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:18.534180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:18.537744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.225403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:19.226562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:19.228968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:19.229522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:19.230049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:19.243632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.244283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.245468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.247103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.247735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.250918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.274278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Getting quotas for project acfc06d6e4774874b950dab58aa79566. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:19.281881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Getting quotas for user 0ef21c75d5ee426f92457231792bc357 and project acfc06d6e4774874b950dab58aa79566. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:19.312014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:19.314911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:19.418040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.431662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49c40bf6-8721-4082-a490-4941af05cf56 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1317 microversion: 2.1 time: 0.961966 Oct 04 18:20:19.439400 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1728/3438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:18 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.451877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.453552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.470241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.475679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.475679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.475679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.475679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.475679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.528821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c3d3371-90d5-4e6a-bf15-b386826b7d21 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.104547 Oct 04 18:20:19.529564 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1711/3439] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:19.543247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4eb85fa-91ed-4b64-8d8a-172818070d22 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90098e7af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.677710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4eb85fa-91ed-4b64-8d8a-172818070d22 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.139724 Oct 04 18:20:19.678551 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1712/3440] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.686217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9c1068c-a7ee-4d2a-b541-b19611cba487 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.686765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9c1068c-a7ee-4d2a-b541-b19611cba487 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.804962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b9c1068c-a7ee-4d2a-b541-b19611cba487 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.818299 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9c1068c-a7ee-4d2a-b541-b19611cba487 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1224 microversion: 2.1 time: 0.133716 Oct 04 18:20:19.829747 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1713/3441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.914175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:19.928698 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f180a67e-30ad-4842-88b7-75ef068765fe tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1249 microversion: 2.1 time: 0.487562 Oct 04 18:20:19.933549 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1729/3442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1249 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:20.190360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-572448083", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:20.303032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:20.303032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:20.303032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:20.303032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:20.304983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:20.331126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.332754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.337520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.337520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.337520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.337520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.373653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Getting quotas for project c7832866084d4320a310e7c3745920f7. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:20.384520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Getting quotas for user f8937eb9217e4dffada04fc86b1b7d59 and project c7832866084d4320a310e7c3745920f7. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:20.460865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:20.464101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:20.467449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.468244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:20.489584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.492630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.505758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.505758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.505758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.505758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.747257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d548c28b-0334-42eb-af8d-653ba6420795 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.923618 Oct 04 18:20:20.754341 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1714/3443] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:20:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:20:20.763336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d50592b-8d4b-4489-bdb4-4aab6448d78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009a7a160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.921074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d50592b-8d4b-4489-bdb4-4aab6448d78e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.135386 Oct 04 18:20:20.921074 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1715/3444] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:20.921074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.924859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.039431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.043229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.052973 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3c4df9a-dbdb-4fd4-a169-639342130144 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1467 microversion: 2.1 time: 0.586883 Oct 04 18:20:21.055336 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1730/3445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1467 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.072868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9264656-b370-4817-9bfc-b647c8e3026f tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.076184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9264656-b370-4817-9bfc-b647c8e3026f tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.080609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.084278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.085653 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5a0baa6-1464-4711-a69e-ad97d1dbeb52 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1280 microversion: 2.47 time: 0.196184 Oct 04 18:20:21.089660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1716/3446] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:21.095059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.108592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.115896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.117107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.117614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.119202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.119756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.137152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.322854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9264656-b370-4817-9bfc-b647c8e3026f tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.331201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9264656-b370-4817-9bfc-b647c8e3026f tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1224 microversion: 2.1 time: 0.273682 Oct 04 18:20:21.340084 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1731/3447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1224 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.359593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.360395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.375033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.378512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.379152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.379922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.384278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.388285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.434938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.450913 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e93d8aac-4ad9-499a-9d8d-2481ef8e69df tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.360023 Oct 04 18:20:21.454210 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1717/3448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.471286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:21.489393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.508810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.508810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.509310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.510056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.512505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.513032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.584827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'flavor' on Instance uuid 78d41405-e13e-4099-82e3-33a64017e70c {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:21.851677 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0496238-30cc-4579-9403-df70dc3a9eb7 tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1620 microversion: 2.1 time: 0.508169 Oct 04 18:20:21.856508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1732/3449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1620 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.929769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58c563fa-1a6e-4b01-bee9-d4b18ae8f22d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cc6430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.018820 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb8776f4-7076-44c9-8ef4-4ca968bf2e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action" status: 200 len: 32 microversion: 2.1 time: 0.555950 Oct 04 18:20:22.018820 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1718/3450] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:21 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action => generated 32 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:20:22.036901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.037623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.045674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58c563fa-1a6e-4b01-bee9-d4b18ae8f22d tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.121220 Oct 04 18:20:22.059604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1733/3451] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:22.074425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.074935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.075380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.117183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-7609307", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["461c164b-77d5-4f3b-a945-f1cac32068cf"]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:22.117342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.117342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.117342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.225975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:22.799299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.809207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a33b977b-6da9-46c2-a031-847449743aa6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.776571 Oct 04 18:20:22.823006 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1719/3452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.823006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.823006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.863545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.868697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.868697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.868697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.868697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.871272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.933081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:22.944373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:22.944373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:22.944373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:22.944373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:22.971986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.001389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.003367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.005574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.037089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.042443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.136502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:23.139016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.169030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.174313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.176501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:23.176624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0b7db27-5caa-4911-b618-5748a9af8e9c tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1284 microversion: 2.47 time: 0.362618 Oct 04 18:20:23.182686 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1720/3453] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1284 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:23.198815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.208812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.224654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.228157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.229226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.230235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.230891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.239133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.247245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:23.261284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:23.418338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.434248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c298845d-8ff7-4576-af41-fa611709dc42 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1276 microversion: 2.1 time: 0.248329 Oct 04 18:20:23.435770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1721/3454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.447180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.448188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.463991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.466251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.467197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.483962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.486284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.488331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.501123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:23.511940 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef962e79-8405-431b-ab5e-222ab75312fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420532 Oct 04 18:20:23.516596 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1734/3455] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:23.546012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f71bb03b-23f8-434d-8558-fa185fb88fb5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097534c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.671202 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f71bb03b-23f8-434d-8558-fa185fb88fb5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.153307 Oct 04 18:20:23.679393 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1735/3456] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:23.685042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f1537ae-59ab-4c19-8c16-82a26691bca7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.687802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f1537ae-59ab-4c19-8c16-82a26691bca7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.021993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f1537ae-59ab-4c19-8c16-82a26691bca7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.027854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f1537ae-59ab-4c19-8c16-82a26691bca7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1214 microversion: 2.1 time: 0.354008 Oct 04 18:20:24.029985 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1736/3457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:24.358637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67495e92-6504-4244-89d3-a13399c06c06", "tag": "5d9927d8-79c1-4ba0-a310-475cd52c9283"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:24.416352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.424220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.430635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.538266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] Creating event network-changed:5d9927d8-79c1-4ba0-a310-475cd52c9283 for instance 67495e92-6504-4244-89d3-a13399c06c06 on n-h1-833090-21 Oct 04 18:20:24.550951 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-78780a6e-335e-4728-a2e3-6ed215d970ad req-8836901b-6197-4bed-aa0e-96c6dd3cf3c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.518352 Oct 04 18:20:24.554907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1737/3458] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:24.561776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.572544 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef0a53d6-a01e-4373-bda0-4e300f776c2f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 1.135234 Oct 04 18:20:24.573151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1722/3459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:24.578216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.583331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.591165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.592768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.604958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.606050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.606751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.607729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.608400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.612070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.637250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.640465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.641715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.644963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.645663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.646298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.786888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.816762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.823585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.827193 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bd4cab75-5f73-4f9b-8dd7-b307b09d3529 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1332 microversion: 2.47 time: 0.252101 Oct 04 18:20:24.836772 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1723/3460] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:24.841984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.843596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.860224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.861731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.862278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:24.864341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:24.874922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:24.884511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.091525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.100367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.110687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97cb228f-b2d4-4b23-870c-7ab0f03750a5 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1294 microversion: 2.1 time: 0.278526 Oct 04 18:20:25.123490 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1724/3461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1294 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.123890 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea1f096b-e782-47c5-a243-928cee534e13 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.556506 Oct 04 18:20:25.123890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1738/3462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.136340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b7fc458-2e0e-4ba3-8423-63ef3729e39f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900973b670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.138234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17f0957a-09f7-4f58-9dd8-ed3233b94c91 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.139069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17f0957a-09f7-4f58-9dd8-ed3233b94c91 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.227439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b7fc458-2e0e-4ba3-8423-63ef3729e39f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.114308 Oct 04 18:20:25.245211 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1725/3463] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.277214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17f0957a-09f7-4f58-9dd8-ed3233b94c91 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.288083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17f0957a-09f7-4f58-9dd8-ed3233b94c91 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1214 microversion: 2.1 time: 0.170695 Oct 04 18:20:25.290915 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1739/3464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.601022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.602428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.620500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.621083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.621953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.622722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.623183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.623737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.868899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.870080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.879279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.880140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.880822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.881710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.883024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.883538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.909202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:25.934640 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64629e88-93b7-453e-9d02-db6d3a955e6c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.338377 Oct 04 18:20:25.937009 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1726/3465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.080656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.096358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.097944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.099246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83dc7610-0ec5-4bd0-bab6-217dcfdd131d tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1340 microversion: 2.47 time: 0.236518 Oct 04 18:20:26.104008 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1740/3466] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1340 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:26.142036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.142497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.143213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.143545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.159817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.159817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.159817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.164448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.165803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.166685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.170303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.170870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.171252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.174275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.174755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.175195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.282544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.294548 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29ca33aa-18f5-4352-be16-05c190e4ad9d tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1282 microversion: 2.1 time: 0.158812 Oct 04 18:20:26.295435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1727/3467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.301226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ccd0c9b-baf7-4fe9-8367-b0811b7f50ee tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90097a7a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.361817 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ccd0c9b-baf7-4fe9-8367-b0811b7f50ee tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.064431 Oct 04 18:20:26.362645 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1728/3468] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.368842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.370021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.380910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.382209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.382712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.383432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.383925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.384553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.434980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.446195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a233d96-c592-4d60-ac3d-ee8a055a641b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.307837 Oct 04 18:20:26.466444 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1741/3469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:26.489838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.499605 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f08c9c32-de0e-444a-a351-e9346108a613 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1210 microversion: 2.1 time: 0.135402 Oct 04 18:20:26.512277 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1729/3470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:26.959980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.960573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.973919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.980280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.981555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.983972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.986577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.001348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.137748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.139847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.166227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.166749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.167416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.168877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.169619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.170432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.263300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.287587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.289361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.291049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a06f1bd-f06e-4b7f-8e7d-534c30ec0e98 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1338 microversion: 2.47 time: 0.157804 Oct 04 18:20:27.311252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1730/3471] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:27.335058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.337042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.345481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.346257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.347033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.347988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.348714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.349325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.417392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.445745 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-98cd35eb-ffc2-4fd8-a247-3ee760059397 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.486617 Oct 04 18:20:27.450815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1742/3472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.459445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e752a919-d6d4-4ebd-a0b0-06e3fae88ee3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cb4a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.559414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e752a919-d6d4-4ebd-a0b0-06e3fae88ee3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.107008 Oct 04 18:20:27.570865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1743/3473] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.605200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.607265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.624545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.633936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.637542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5108ce8f-96fa-41bb-ac02-8af713129ee8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.314071 Oct 04 18:20:27.640221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.643690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.644535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.645030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.645482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.647007 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1731/3474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.664996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.665875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.673846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.675086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.675849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.676849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.677548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.678186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.777812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.788029 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-011fa618-bf44-4b7e-986c-67d0b6670d01 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1266 microversion: 2.1 time: 0.139823 Oct 04 18:20:27.791227 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1732/3475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.913015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.917219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:27.927519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd6813a5-63e8-4c11-bcf2-02728363daf7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.343434 Oct 04 18:20:27.928633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1744/3476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.322688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.324310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.347254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.352160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.352703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.353766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.354498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.355129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.490159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.490795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.519432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.520311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.526027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.528426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.530283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.531151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.606361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.622207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.624077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.625628 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba8db279-c0d9-41a3-9030-4d7f38ddcb89 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1338 microversion: 2.47 time: 0.308012 Oct 04 18:20:28.626590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1733/3477] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:28.634035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8275a22a-3e66-4c73-b0ba-6e12a30398ab tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009a7af70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.690327 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8275a22a-3e66-4c73-b0ba-6e12a30398ab tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.062424 Oct 04 18:20:28.691819 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1734/3478] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.697654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.698875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.707032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.708740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.709758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.711224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.711894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.713092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.906049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.924084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25e42175-1273-4fa0-bdd1-5b87b15e7577 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.447006 Oct 04 18:20:28.925926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1745/3479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:28.934186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.934999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.939026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:28.946798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.947541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.949782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.950710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.952384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.952384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.959093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.966677 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6bbc2102-7b8b-48f7-988b-d72b7c6fe018 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.273415 Oct 04 18:20:28.983911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1735/3480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.222637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.223791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.223791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea7ecda6-6783-4d8d-ad81-71e8e79723e4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1272 microversion: 2.1 time: 0.155060 Oct 04 18:20:29.223791 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1746/3481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.224368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.224368 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c509eece-e4fd-408d-b8b3-793da084091d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.174866 Oct 04 18:20:29.224368 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1736/3482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.657370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.658950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.677762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.678288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.682125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.682870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.686667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.687122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.713868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-663c10ba-4c67-4398-bc67-e29f99f99fe3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009730d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.833754 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-663c10ba-4c67-4398-bc67-e29f99f99fe3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.127822 Oct 04 18:20:29.837988 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1737/3483] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:29.897602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.920587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.924566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.929704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19391cbd-2e5d-4081-9c7d-73d609d492b6 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1338 microversion: 2.47 time: 0.273875 Oct 04 18:20:29.934775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1747/3484] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1338 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:29.951626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.952256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.971027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.974557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.975078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.980367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.982858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.986254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.010919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.012306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.054304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.055159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.057740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.059783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.061029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.063098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.352085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:30.484727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.489894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.500981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e227844-7200-47e9-a7d7-817717616d9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.553347 Oct 04 18:20:30.503364 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1738/3485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.503585 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8cdf7a7-a35a-44bc-a38e-e6f26452cc9a tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.512340 Oct 04 18:20:30.504784 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1748/3486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:30.511562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.513319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.521312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.524233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.524233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.525164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.526201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.526875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.535827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.536560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.549391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.552074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.554230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.556652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.559723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.560410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.847901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.861634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fb7fa7d-a902-471c-906e-de113b45b9b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.356795 Oct 04 18:20:30.863889 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1739/3487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.888771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.899195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e", "tag": "75c01ad1-ad53-4c9a-96a8-080bd0093711"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:30.903485 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1e86391-2d44-43a4-b71c-e47bef37d006 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.396424 Oct 04 18:20:30.908101 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1749/3488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.913623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.914323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.914913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.933051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff058638-dff6-45e0-a397-7a3fef4fd34b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900880cee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.942850 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] Creating event network-changed:75c01ad1-ad53-4c9a-96a8-080bd0093711 for instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e on n-h1-833090-21 Oct 04 18:20:30.956936 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9e8bddaa-dfda-40b0-a0d4-6fd6e829dc2b req-9697d8ee-7d00-45b1-9ab9-32318d17754d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067248 Oct 04 18:20:30.959600 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1740/3489] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:30.977411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.978403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.995756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.996524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.997140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.998064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.998699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.999771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.039204 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff058638-dff6-45e0-a397-7a3fef4fd34b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.119143 Oct 04 18:20:31.040829 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1750/3490] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:31.058042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:31.174952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.186690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.193803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.196097 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fea9ac3a-82a8-40f4-bccd-8cabb1e6ed8e tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1359 microversion: 2.47 time: 0.233618 Oct 04 18:20:31.196687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1741/3491] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:31.229746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2965261"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:31.232949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.241998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.242890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.243625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.244571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.245273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.245918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.529043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.530353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.540300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.541879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.542555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.543544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.544259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.544939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.932717 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4eedafa-5a64-4202-9b1d-c50dab56b489 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "POST /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd/action" status: 202 len: 52 microversion: 2.47 time: 0.706197 Oct 04 18:20:31.933379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1751/3492] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:20:31 2022] POST /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd/action => generated 52 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:20:31.956309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.959784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.985421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.985421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.985421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.986978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.987728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.994194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.037992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.055089 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cbff96a0-e92e-4562-9d51-4584df670d9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.528732 Oct 04 18:20:32.077464 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1742/3493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.083050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.083987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.098655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.100036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.101482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.104584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.105944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.106577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.172937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:32.310928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.324312 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc48b6c6-957d-4430-821f-c32ae6e634bc tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.384729 Oct 04 18:20:32.326789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1752/3494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.337958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.339590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.356375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.356898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.358704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.360754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.368729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.368729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.431723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.449871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a94ac5d-8ac9-41e4-9d77-7a509660e01e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.370723 Oct 04 18:20:32.450991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1743/3495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.459798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f25351-a7ca-4b73-9fb7-cb69ba959b6f", "tag": "829735b0-6cbe-46a0-9122-a7357d8c121b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:32.486929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.487819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.488470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.511341 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] Creating event network-changed:829735b0-6cbe-46a0-9122-a7357d8c121b for instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f on n-h2-833090-21 Oct 04 18:20:32.518144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c99d492a-6188-41a7-aa16-c1a9af408ae7 req-03de4e4e-2190-4cdf-b4a4-36f914df1d3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064916 Oct 04 18:20:32.519443 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1744/3496] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:32.525475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.526715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.541714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.542779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.544609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.545694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.546397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.547166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.583074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:32.625315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.637647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b365146-7f0b-4d53-a2e7-e2aa4200d60a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.309686 Oct 04 18:20:32.639225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1753/3497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.644755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cafa19f2-9129-48ba-883b-d84782b56ee8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c1b310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.721236 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cafa19f2-9129-48ba-883b-d84782b56ee8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.080582 Oct 04 18:20:32.722287 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1754/3498] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.040316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f51f2e54-e13c-4b53-9853-2557a099de26 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 204 len: 0 microversion: 2.47 time: 0.519020 Oct 04 18:20:33.045418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1745/3499] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:20:32 2022] DELETE /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:20:33.061625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.062979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.072074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.072936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.073600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.074657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.075339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.076039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.089402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.091578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.097802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.116480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.119625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.124515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.126075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.129229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.134218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.351624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.367447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.374340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.376058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f17840a-926c-4ae7-8fe4-49230d3440bc tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1365 microversion: 2.47 time: 0.318745 Oct 04 18:20:33.393176 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1755/3500] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:33.404140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67495e92-6504-4244-89d3-a13399c06c06", "name": "network-vif-plugged", "status": "completed", "tag": "5d9927d8-79c1-4ba0-a310-475cd52c9283"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:33.415607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.416087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.417405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.431616 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] Creating event network-vif-plugged:5d9927d8-79c1-4ba0-a310-475cd52c9283 for instance 67495e92-6504-4244-89d3-a13399c06c06 on n-h1-833090-21 Oct 04 18:20:33.436591 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7bc97d79-67d8-45ae-ac6b-bbc76cd5ba44 req-0883e6dc-bfaa-441e-92c1-e59eae5e2ecc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042214 Oct 04 18:20:33.437577 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1756/3501] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:33.443775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.445164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.453922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.454401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.454835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.455578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.456184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.457201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.830043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.842749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd5248bc-5427-431a-ac24-5eb159a1a40f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.762019 Oct 04 18:20:33.856344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1746/3502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:33.872713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.875554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.880413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.882542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.883261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.883928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.885158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.885890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.886628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.128614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.142242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3f62933-d20a-472c-a53b-793e57f8e569 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.284546 Oct 04 18:20:34.143408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1747/3503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.150645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.151841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.159835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.160557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.161174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.162052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.162800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.163424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.201862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.209938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-593c3e15-d64d-4712-a45d-7dba320de65e tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.771081 Oct 04 18:20:34.212974 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1757/3504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.234393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97ab6855-32c3-4b98-ade8-c25f05f95ee4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009753040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.354604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.363352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-47b03771-8fdd-4f50-9837-112ab4427fb1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.218676 Oct 04 18:20:34.379236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1748/3505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.407972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.409059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.418270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.420118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.420945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.424993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.424993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.425276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.535691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.547874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.552919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.559678 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6982d2a0-945c-4c18-bddd-26ceba56ae84 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1365 microversion: 2.47 time: 0.150914 Oct 04 18:20:34.559678 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1749/3506] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:34.586577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97ab6855-32c3-4b98-ade8-c25f05f95ee4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.365774 Oct 04 18:20:34.594925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1758/3507] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.871127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.872021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.880838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.881671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.882837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.884457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.885281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.885793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.037584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.045876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c181961-a2cb-430b-a89b-c09bcb099eaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.179201 Oct 04 18:20:35.047800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1750/3508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.171845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.172463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.179321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.179850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.180290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.180988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.181461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.181867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.244526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.246087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.253021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.253799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.254888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.256193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.257465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.258201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.290705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:35.390261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.399295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80cd3d17-38f2-47c5-8168-759c7554bb33 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.233059 Oct 04 18:20:35.414401 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1759/3509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.414401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.414401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.414858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.415052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.416379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.417963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.418679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.419336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.438394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.452883 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f7acea3-b05c-46e6-aee1-7e049bdc3b86 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.216398 Oct 04 18:20:35.468554 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1751/3510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.585667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.586409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.594399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.595398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.595950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.596776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.597245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.597678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.621529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.636980 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9f16baa-5510-4e0d-8eac-b4e9347772f1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.233957 Oct 04 18:20:35.656490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1760/3511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.666053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5bdc8e34-c078-41d9-b6c6-b3faf50a2a47 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900880c790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.690580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.701183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.702735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.704122 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eba7517c-3f88-4cd1-8f09-48f74dce6cde tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1365 microversion: 2.47 time: 0.123038 Oct 04 18:20:35.705433 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1752/3512] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:35.734948 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5bdc8e34-c078-41d9-b6c6-b3faf50a2a47 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.074417 Oct 04 18:20:35.735586 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1761/3513] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.070016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.070972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.084305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.084806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.085731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.086441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.086902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.087439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.323124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.333980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95cbc56c-0209-4a85-813d-2292cbd7fc21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1291 microversion: 2.1 time: 0.268875 Oct 04 18:20:36.347868 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1753/3514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1291 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.429318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.430597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.443143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.446438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.448084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.449118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.452248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.452931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.477568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.478291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.490817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.493920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.494465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.495203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.497834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.499685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.729639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.749611 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c51745a1-f8ba-484e-afd3-a82f7ad3b84a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.325328 Oct 04 18:20:36.752848 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1762/3515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.768672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.770854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.787116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.792064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.793414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.794286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.796553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.798151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.799662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.809928 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a591c92c-5b6b-404f-814e-88d9b466022c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.337184 Oct 04 18:20:36.819684 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1754/3516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.827377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.828339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.840109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.840937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.841648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.842771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.843511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.844169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.894095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.894587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.895031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.895497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lazy-loading 'fault' on Instance uuid 5ca94c88-788c-4422-8269-ad5cc49fc1bd {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:36.959954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.969421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.975983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8937eb9217e4dffada04fc86b1b7d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7832866084d4320a310e7c3745920f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.998026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0716ef24-5520-48bd-ae92-88e71203a726 tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 200 len: 1370 microversion: 2.47 time: 0.174151 Oct 04 18:20:37.024956 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1755/3517] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:37.024956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc3871ce-5e7a-4b6a-b1c1-447041436a3c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009a7a790>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.080979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.088959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc66b2dd-223b-4a35-9921-80696823e524 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.332570 Oct 04 18:20:37.089618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1763/3518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.107819 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc3871ce-5e7a-4b6a-b1c1-447041436a3c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1452 microversion: 2.1 time: 0.107739 Oct 04 18:20:37.108894 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1756/3519] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.371988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.372718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.385770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.390450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.391046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.392308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.396575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.398137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.563833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.566484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:37.573089 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed177615-31f9-429f-ad0c-20e885d4d0f6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1471 microversion: 2.1 time: 0.205538 Oct 04 18:20:37.573679 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1764/3520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.726479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-593174512", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:37.780241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.781021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.789203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.790000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.790699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.791650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.792723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.793359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.797201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:37.962473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.977062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7099ba6-d2b7-433f-a34f-2364e7c75264 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.201219 Oct 04 18:20:37.979527 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1765/3521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.985341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.986737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.994449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.994946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.995649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.996725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.997742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.998188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.199000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.210744 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3f11fcd-55de-4e24-b4e0-8070b2c2f9ba tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.228618 Oct 04 18:20:38.221134 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1766/3522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.228220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.229514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] [instance: 5ca94c88-788c-4422-8269-ad5cc49fc1bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.237634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.238757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.239741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.240609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.241097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.241505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.257644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] HTTP exception thrown: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Request method failure captured: Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd HTTP/1.1 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHljh4PCFJegk79mjWuoSO7cfpjx8OSdDeld2JmAHjM-4h5Wyl4uJthOZ6sR0iYN4gCGcWABzlFaxO6Op-AbynrqHWS2SQTjWE6nEwRzXjuxWI4O-7G_EogfvmphleqCGkIdmcWA7ssABPIko3DWUbcYz4LVBUf1eweBtJhPvj1E6EI Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c7832866084d4320a310e7c3745920f7 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAaction247Test-235080658 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c7832866084d4320a310e7c3745920f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7832866084d4320a310e7c3745920f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c7832866084d4320a310e7c3745920f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c7832866084d4320a310e7c3745920f7"}]}] Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAaction247Test-235080658 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c7832866084d4320a310e7c3745920f7 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAaction247Test-235080658 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAaction247Test-235080658-project Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f8937eb9217e4dffada04fc86b1b7d59 Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAaction247Test-235080658-project Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '5ca94c88-788c-4422-8269-ad5cc49fc1bd'} Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:38.259308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] Returning 404 to user: Instance 5ca94c88-788c-4422-8269-ad5cc49fc1bd could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e63bda2c-eaf1-46e2-b717-45fb2577c7aa tempest-ServersAaction247Test-235080658 tempest-ServersAaction247Test-235080658-project] 10.222.0.40 "GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd" status: 404 len: 111 microversion: 2.47 time: 0.047855 Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1767/3523] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/5ca94c88-788c-4422-8269-ad5cc49fc1bd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:20:38.270153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8e6e304-6fe4-40db-91bf-fee31f129e2b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008cc6700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.300847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:38.300847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:38.300847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:38.302283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:38.302874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:38.314173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.314665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.315157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.315930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.316382 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8e6e304-6fe4-40db-91bf-fee31f129e2b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1461 microversion: 2.1 time: 0.054111 Oct 04 18:20:38.316507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.316809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.317662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1768/3524] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1461 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.323976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.324580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.331261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.331838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.332274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.332977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.333425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.333846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.349596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:38.356289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:38.370927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:38.373793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:38.494685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.503066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2157d800-b357-495f-9a67-3d8a34d3efdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.183836 Oct 04 18:20:38.504000 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1769/3525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.524954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3edad09c-ffd3-48a0-9ce4-1ac85d756b33 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d0b160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.571009 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78d7254f-25c8-4543-8605-6857ba7a2a5c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850094 Oct 04 18:20:38.571934 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1757/3526] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:38.573238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3edad09c-ffd3-48a0-9ce4-1ac85d756b33 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 200 len: 1461 microversion: 2.1 time: 0.052276 Oct 04 18:20:38.574730 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1770/3527] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 1461 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.582920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.583426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.591196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.591838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.598807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.599304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.608383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.608383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.608383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.608383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.609981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:38.800947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.813684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f88f18d2-7253-467f-be7b-db76764d5e3b tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1480 microversion: 2.1 time: 0.225116 Oct 04 18:20:38.820093 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1771/3528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1480 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.002286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.002886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.009546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.010558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.011004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.011733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.012407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.012947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.227583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.242171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9997d61b-c8c4-4217-ba76-f53ded8dc377 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.243843 Oct 04 18:20:39.244261 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1772/3529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:39.259609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e", "name": "network-vif-plugged", "status": "completed", "tag": "75c01ad1-ad53-4c9a-96a8-080bd0093711"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:39.270286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.277027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.277027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.283423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] Creating event network-vif-plugged:75c01ad1-ad53-4c9a-96a8-080bd0093711 for instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e on n-h1-833090-21 Oct 04 18:20:39.289052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c0494820-516a-4298-87ec-080536062a05 req-529c4db4-2c87-4085-a607-7d8adc2abb8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041164 Oct 04 18:20:39.289648 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1773/3530] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:39.294792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.295409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.301856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.302346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.302847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.303572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.304058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.304486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.521916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.scheduler.client.report [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Deleted allocations for instance 23892c70-75a7-48e8-aae8-3bcce4832b8a Oct 04 18:20:39.530005 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:20:39.531556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2e43cf9-b1aa-44b8-9029-945c7fd62e2a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a" status: 204 len: 0 microversion: 2.1 time: 0.952392 Oct 04 18:20:39.532256 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1758/3531] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:38 2022] DELETE /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a => generated 0 bytes in 954 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:39.537819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.543265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.549765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.550259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.550884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.551803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.552394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.553039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.573269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.581901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-870f5723-2a4e-455f-9c2f-8bde182b17ad tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.290992 Oct 04 18:20:39.594403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1774/3532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.594403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.594403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.600084 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a HTTP/1.1 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '23892c70-75a7-48e8-aae8-3bcce4832b8a'} Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:39.601813 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41e74b87-3321-402e-a857-106ba3ad6d86 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a" status: 404 len: 111 microversion: 2.1 time: 0.021194 Oct 04 18:20:39.608456 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1775/3533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:39.729749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-465878259", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:39.751347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.763308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a97767f-94ec-40b6-b165-8ec1e230120d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.228457 Oct 04 18:20:39.764622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1759/3534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.791911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:39.839160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.839898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.849258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.850122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.851415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.852410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.853118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.854039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.008927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.017316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d9b71d8-a1a8-4419-9dff-481224863324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1480 microversion: 2.1 time: 0.182404 Oct 04 18:20:40.017902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1760/3535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1480 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:40.269966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.271545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.279533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.280157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.280736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.281743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.282380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.283486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.304077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:40.457447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:40.457970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:40.458805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:40.459367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:40.460826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.479022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.501460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:40.509800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:40.525864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:40.529130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:40.561819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.570273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20d6f83f-c6f8-4994-8eab-678f070b6f9f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.304855 Oct 04 18:20:40.570852 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1761/3536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:40.619983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.620667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.628183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.628925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.635047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.638102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.638621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.639071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.655992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c61ac9a-b75f-44b6-8731-8510a6fff026 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930184 Oct 04 18:20:40.658133 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1776/3537] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:20:40.690264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3f1dc36-3144-421d-b3be-a644d3c5e837 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.691950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3f1dc36-3144-421d-b3be-a644d3c5e837 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.773012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f3f1dc36-3144-421d-b3be-a644d3c5e837 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.786367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3f1dc36-3144-421d-b3be-a644d3c5e837 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1220 microversion: 2.1 time: 0.113447 Oct 04 18:20:40.786367 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1777/3538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:40.807632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.809279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.821799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.823026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.823775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.825345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.826027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.827253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.886284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.894967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d3ddfee-9a78-43c2-86e4-e83580f1a3b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1324 microversion: 2.1 time: 0.279484 Oct 04 18:20:40.896058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1762/3539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:41.042241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.047055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.054702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.058019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.058567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.060369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.062735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.063922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.065462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.083158 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21697687-02ca-4a29-878d-15e78530baa8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.283264 Oct 04 18:20:41.084053 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1778/3540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.259163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.267125 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68d0cea9-bab4-450a-8e4d-ddd9d3ace0d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1467 microversion: 2.1 time: 0.229145 Oct 04 18:20:41.267881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1763/3541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.290752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-454531162"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:41.293325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.299870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.300368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.300817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.301530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.302012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.302522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.595097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.595739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.603055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.604280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.605171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.606830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.607502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.608043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.770023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.782882 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56486a19-2082-49e5-9211-07d02656caba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.192528 Oct 04 18:20:41.787534 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1764/3542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.808766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a701a54-a391-48cb-88db-d24c47d8bb89 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.809392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a701a54-a391-48cb-88db-d24c47d8bb89 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.848924 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94a98f99-9d17-4087-a506-05d5be55ba55 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "POST /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac/action" status: 202 len: 0 microversion: 2.1 time: 0.562053 Oct 04 18:20:41.855020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1779/3543] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:41 2022] POST /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:20:41.861891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f763c59a-c594-485b-89b5-b728bd1bd736 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087d4550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.864429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a701a54-a391-48cb-88db-d24c47d8bb89 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.874384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a701a54-a391-48cb-88db-d24c47d8bb89 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1220 microversion: 2.1 time: 0.069347 Oct 04 18:20:41.875181 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1765/3544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:41.911292 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f763c59a-c594-485b-89b5-b728bd1bd736 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.053908 Oct 04 18:20:41.911918 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1780/3545] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:41.922909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.923800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.935448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.936165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.936605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.937480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.938263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.939906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.091283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.100265 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d27ab862-fa93-4e90-8964-f3220c6e0e56 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1522 microversion: 2.1 time: 0.182768 Oct 04 18:20:42.102034 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1766/3546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.107285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.108113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.115978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.116906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.117572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.118736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.124630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.125469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.130434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.131209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.134641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.136106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.136719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.137536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.138067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.138714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.174829 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Request method failure captured: Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e/ips/invalid HTTP/1.1 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlgA-vsO15kwKGlTeivytob1wTXH3uFnQVEDBj2FUHffDcLZ39fEFY-rUv7mRfPrYNkhX-O6cEgoqm5rcSPp8QBNrnQflvr3oLVGpiNWaGAxKYej4rq-y-pNLCC6ES0CJaFxPlvDicy1h8tRx3YeRrGWSVHVeJvCUcmQFxlPDmpgxc Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acfc06d6e4774874b950dab58aa79566"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acfc06d6e4774874b950dab58aa79566"}]}] Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef21c75d5ee426f92457231792bc357 Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance is not a member of specified network Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': 'af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e', 'id': 'invalid'} Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 18:20:42.190170 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.194920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Returning 404 to user: Instance is not a member of specified network {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:42.194920 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cb367fe-9adb-46ac-a351-d7f1ebd4ac5c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.071219 Oct 04 18:20:42.194920 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1767/3547] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e/ips/invalid => generated 91 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:20:42.211256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.211760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Failed to fetch instance by id 999 {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:20:42.212257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Request method failure captured: Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlgA-vsO15kwKGlTeivytob1wTXH3uFnQVEDBj2FUHffDcLZ39fEFY-rUv7mRfPrYNkhX-O6cEgoqm5rcSPp8QBNrnQflvr3oLVGpiNWaGAxKYej4rq-y-pNLCC6ES0CJaFxPlvDicy1h8tRx3YeRrGWSVHVeJvCUcmQFxlPDmpgxc Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acfc06d6e4774874b950dab58aa79566"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acfc06d6e4774874b950dab58aa79566"}]}] Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef21c75d5ee426f92457231792bc357 Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 999 could not be found. Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': '999'} Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:20:42.213809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:20:42.218887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Returning 404 to user: Instance 999 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:42.218887 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1d7fcc5-1701-48a9-b54d-90f88a4ea55c tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008644 Oct 04 18:20:42.230086 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1768/3548] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:20:42.242835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.243263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.275804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.304074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:42.377646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.390710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6c3bccc-a876-4892-8df6-84d7e3bdf296 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.287140 Oct 04 18:20:42.392267 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1781/3549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:42.713081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ee17041-830d-47b5-8420-b1d3585d6657 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "DELETE /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 204 len: 0 microversion: 2.1 time: 0.481227 Oct 04 18:20:42.718713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1769/3550] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:42 2022] DELETE /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:42.724689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.725589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.734210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.734704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.735144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.735900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.736708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.737422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.812663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.813751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.823650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.824393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.825440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.826477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.827086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.827548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.899795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.907934 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2bb7890-2617-4397-b7d2-6089cca8b6b8 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1528 microversion: 2.1 time: 0.188912 Oct 04 18:20:42.920585 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1782/3551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1528 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.920585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.920585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.922208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.922908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.923383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.924147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.924863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.925293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.994184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.014072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-65a027dc-908b-4e95-978f-b825cbaf0e17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1501 microversion: 2.1 time: 0.208095 Oct 04 18:20:43.023503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1770/3552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:43.023503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-423aa9cd-e0bd-4b8d-887b-1fbfdfcd6309 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009f255e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.025487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.049793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17c152f7-96c4-4455-a346-b95a0425f076 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1272 microversion: 2.1 time: 0.139042 Oct 04 18:20:43.050386 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1783/3553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.062705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c00a4e57-31bf-43e4-8c2d-35c317f7149f"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:43.065728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.073752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.074352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.074784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.075585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.076037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.077097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.117886 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Cannot 'attach_volume' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state rescued Oct 04 18:20:43.119404 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-423aa9cd-e0bd-4b8d-887b-1fbfdfcd6309 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.103119 Oct 04 18:20:43.120253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1771/3554] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/os-volume_attachments HTTP/1.1 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 74 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: {"volumeAttachment": {"volumeId": "c00a4e57-31bf-43e4-8c2d-35c317f7149f"}} Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'attach_volume' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state rescued Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '78d41405-e13e-4099-82e3-33a64017e70c', 'body': {'volumeAttachment': {'volumeId': 'c00a4e57-31bf-43e4-8c2d-35c317f7149f'}}} Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 78d41405-e13e-4099-82e3-33a64017e70c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:20:43.126479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state rescued Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state rescued Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 409 to user: Cannot 'attach_volume' instance 78d41405-e13e-4099-82e3-33a64017e70c while it is in vm_state rescued {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ba6e63d-65d2-4819-a58e-989ce2cd4912 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072964 Oct 04 18:20:43.131177 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1784/3555] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:20:43 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:20:43.140633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:43.141433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.152249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.152249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.152249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.152249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.152249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.152927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.159337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f25351-a7ca-4b73-9fb7-cb69ba959b6f", "name": "network-vif-plugged", "status": "completed", "tag": "829735b0-6cbe-46a0-9122-a7357d8c121b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:43.169385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.170322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.170950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.183458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] Creating event network-vif-plugged:829735b0-6cbe-46a0-9122-a7357d8c121b for instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f on n-h2-833090-21 Oct 04 18:20:43.189447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6b8bb26a-681b-48df-a290-444420035f64 req-bcd1e749-dba9-4121-bb0f-3437272be490 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Oct 04 18:20:43.190097 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1785/3556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:43.418951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.419750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.427948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.428732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.429167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.430143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.430835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.431315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.483318 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd3a21a3-634c-44ed-aeea-67659a419d17 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action" status: 202 len: 0 microversion: 2.1 time: 0.345758 Oct 04 18:20:43.484189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1772/3557] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:43 2022] POST /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:43.493119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.494164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.500636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.501127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.501566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.502269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.502769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.508866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.623659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.636332 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16ec1c31-2fb3-4ace-a67e-191e2d5ceb59 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.222929 Oct 04 18:20:43.638868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1786/3558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:43.765753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.773668 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b802767-3a28-49f0-8dee-36a669c220a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.285007 Oct 04 18:20:43.774248 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1773/3559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.936744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.937391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.945696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.946508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.947267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.957830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.957830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.957830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.083022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.084704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.092763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.093261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.093700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.094787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.095586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.096062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.207347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.224327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d34fe0e-c751-4fcc-aaad-2540fb49b6f9 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1528 microversion: 2.1 time: 0.291668 Oct 04 18:20:44.226745 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1787/3560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:44.228640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.242219 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c151a80-8133-4222-b698-1046bedad99e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1272 microversion: 2.1 time: 0.162980 Oct 04 18:20:44.244470 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1774/3561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:44.260191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03f31252-9188-437d-bda7-b39dd8ea6661 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087d4a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.334354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03f31252-9188-437d-bda7-b39dd8ea6661 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.103466 Oct 04 18:20:44.335138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1788/3562] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.662175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.663752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.672243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.675900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.675900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.676712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.676712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.676903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.800149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.800755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.824458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.825309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.825932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.826839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.827524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.828119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.832014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:45.197533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.212978 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d2f8e24-f8e8-4727-8cf1-1439491cc40d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1314 microversion: 2.1 time: 0.554554 Oct 04 18:20:45.214191 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1775/3563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.228618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e", "name": "network-vif-deleted", "tag": "75c01ad1-ad53-4c9a-96a8-080bd0093711"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:45.252146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.252992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.255038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.272950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] Creating event network-vif-deleted:75c01ad1-ad53-4c9a-96a8-080bd0093711 for instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e on n-h1-833090-21 Oct 04 18:20:45.309014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e382ef20-1880-46a5-a0d2-5bd0f12284e3 req-38bacde7-a586-4892-ada5-bddfba71f189 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090945 Oct 04 18:20:45.311261 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1776/3564] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:45.327197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0cbbb44-4357-4882-a4fa-4718c88a0f9c", "name": "network-vif-unplugged", "status": "completed", "tag": "9acad7a8-f03c-406f-8159-556ecfadc0b2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:45.342392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.343163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.343788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.365139 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] Creating event network-vif-unplugged:9acad7a8-f03c-406f-8159-556ecfadc0b2 for instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c on n-h2-833090-21 Oct 04 18:20:45.367684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.378120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df42f628-ea23-4b5b-9508-2f418d7601de tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.584777 Oct 04 18:20:45.380965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1789/3565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.381218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2f897f86-218e-4a7d-8566-9771ab250f5e req-dbc8a1ba-41da-4317-8f43-edf7e19e787b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057909 Oct 04 18:20:45.389368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.393609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1777/3566] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:45.393786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.406546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.406817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.407240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.408856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.409908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.410392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.410935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.411748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.427300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.427300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.430725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.431589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.432090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.432535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.540140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.550457 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c70ce198-4dbf-47cb-828b-309f043b2716 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1309 microversion: 2.1 time: 0.167183 Oct 04 18:20:45.555142 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1790/3567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.565138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47ae9f4d-8a25-4508-a330-aa7ccaca9eea tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008d0bee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.598864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.609496 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-005b4936-9922-4cff-b9a2-57f60dda43eb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1278 microversion: 2.1 time: 0.217357 Oct 04 18:20:45.610009 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1778/3568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.665386 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47ae9f4d-8a25-4508-a330-aa7ccaca9eea tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.108806 Oct 04 18:20:45.666525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1791/3569] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.242896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.243853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.254460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.259845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.260720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.261707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.262562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.264793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.408167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.408906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.419682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.420579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.421300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.422301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.423003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.423711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.649738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.660023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-947352f5-5980-43ff-b298-2f1c90165622 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.256775 Oct 04 18:20:46.661294 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1792/3570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.685066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.685857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.692756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.693597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.694437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.697404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.697404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.697404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.749357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.750102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.750721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.751178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lazy-loading 'fault' on Instance uuid af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:46.828884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef21c75d5ee426f92457231792bc357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfc06d6e4774874b950dab58aa79566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.840638 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-889b6e2b-ef44-48c5-b327-f3559ebc0358 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 200 len: 1314 microversion: 2.1 time: 0.161334 Oct 04 18:20:46.842112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1793/3571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.847384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.848336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.855766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.857214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.861909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.861909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.861909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.861909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.952526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.965095 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5b2774f-ddab-4f6b-af4e-d1453cebd702 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1464 microversion: 2.1 time: 0.728228 Oct 04 18:20:46.986821 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1779/3572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1464 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.992245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ce66573-b254-4017-9815-1a1c7a018e48 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90099ca280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.069900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.082850 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c036a8d5-f70b-4f3f-ad9d-025d92244b16 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.239155 Oct 04 18:20:47.093556 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1794/3573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.094346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ce66573-b254-4017-9815-1a1c7a018e48 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.105948 Oct 04 18:20:47.095120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1780/3574] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.106689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.110685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.116926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.117794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.119138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.120555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.121455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.122761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.349536 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b15c9955-7598-412a-9209-d7a416023bcc tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1617 microversion: 2.1 time: 0.251355 Oct 04 18:20:47.367504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1795/3575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1617 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.515725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-567173424", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "461c164b-77d5-4f3b-a945-f1cac32068cf"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:47.588158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:47.689316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.690181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.693619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:47.706694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.710734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.711494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.713199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.715036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.715875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.973901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:47.974271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:47.974741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:47.975149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:47.976158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:47.996041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.999545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.000040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.001886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.001886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.003135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.010534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.017363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:48.057959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e4c3cc2-890c-4a60-8371-7eea83367cdd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.372915 Oct 04 18:20:48.074225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:48.074454 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1796/3576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.074551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:48.074551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Getting quotas for user acce90eaa6974937bde6fcbff439564e and project 0a2d1f7ec8ed4c0a9f2cfad334c46fcc. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:48.081260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492dd343-27af-4724-b63d-b09659d0aab2", "tag": "d4f67e09-02f3-4766-9940-f08bd3f7bc25"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:48.093626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.094110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.094746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.096851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:48.102301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:48.110388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] Creating event network-changed:d4f67e09-02f3-4766-9940-f08bd3f7bc25 for instance 492dd343-27af-4724-b63d-b09659d0aab2 on n-h1-833090-21 Oct 04 18:20:48.117298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ac9e353b-0a73-41f4-9451-cee6b1dc3114 req-0b6c8309-2e38-4dcb-8808-9a830580c7b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051517 Oct 04 18:20:48.118706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1797/3577] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:48.127460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.128433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] [instance: af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.141099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.141602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.142047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.143112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.143842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.144113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.162351 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] HTTP exception thrown: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Request method failure captured: Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e HTTP/1.1 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlgA-vsO15kwKGlTeivytob1wTXH3uFnQVEDBj2FUHffDcLZ39fEFY-rUv7mRfPrYNkhX-O6cEgoqm5rcSPp8QBNrnQflvr3oLVGpiNWaGAxKYej4rq-y-pNLCC6ES0CJaFxPlvDicy1h8tRx3YeRrGWSVHVeJvCUcmQFxlPDmpgxc Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acfc06d6e4774874b950dab58aa79566"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfc06d6e4774874b950dab58aa79566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acfc06d6e4774874b950dab58aa79566"}]}] Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: acfc06d6e4774874b950dab58aa79566 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1953160626 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef21c75d5ee426f92457231792bc357 Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1953160626-project Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e'} Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:48.164761 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] Returning 404 to user: Instance af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5301bdff-0b86-4269-bb96-bc0071c241d7 tempest-ServerAddressesNegativeTestJSON-1953160626 tempest-ServerAddressesNegativeTestJSON-1953160626-project] 10.222.0.40 "GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e" status: 404 len: 111 microversion: 2.1 time: 0.045982 Oct 04 18:20:48.170724 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1798/3578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/af8d84cb-c6a9-41c0-86d1-e5c972c0fa2e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:48.179955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecdfe231-5d84-44d3-a1a9-e9f9d8623249 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008759820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.243452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecdfe231-5d84-44d3-a1a9-e9f9d8623249 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.075547 Oct 04 18:20:48.244918 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1799/3579] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.256348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.258109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.276781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.277630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.278662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.281949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.282750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.283836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.362558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1244d449-1131-4f3c-978a-60d6979008f9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854003 Oct 04 18:20:48.363363 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1781/3580] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:48.381578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e09e1c36-83e9-424b-a3f1-dfb1eb706fdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.383918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e09e1c36-83e9-424b-a3f1-dfb1eb706fdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.493127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e09e1c36-83e9-424b-a3f1-dfb1eb706fdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.503083 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e09e1c36-83e9-424b-a3f1-dfb1eb706fdf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1216 microversion: 2.1 time: 0.131460 Oct 04 18:20:48.505942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1782/3581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.089542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.090284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.103776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.106906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.107677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.110133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.113417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.116770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.395800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.423870 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1ad647d-fdcd-4d1b-915a-e5e0fc48648d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 1.158710 Oct 04 18:20:49.423870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1800/3582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.423870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72e44f33-5e00-4a5c-8839-b9b93bfdb11f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087b0ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.424730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.440895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c6cc308b-d80d-4e44-8a9d-158fd1335ba0 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.359623 Oct 04 18:20:49.443374 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1783/3583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.497953 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72e44f33-5e00-4a5c-8839-b9b93bfdb11f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.082918 Oct 04 18:20:49.505997 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1801/3584] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.536776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.538814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.545663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.546175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.546776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.548877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.549350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.550008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.668695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.693340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68c4df1c-b0dd-48be-bf39-06a87416be64 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1220 microversion: 2.1 time: 0.163141 Oct 04 18:20:49.693943 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1784/3585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.440936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.442242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.464890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.465510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.466058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.466892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.467456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.467456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.475448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.476165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.499396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.502997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.504629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.509027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.513300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.515707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.531780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:50.758475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.774647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f746c054-1b3c-4a84-b4e5-a78ea284a12f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1509 microversion: 2.1 time: 0.303932 Oct 04 18:20:50.781324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:50.783416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1785/3586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.789464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5bef0cfb-d5d3-4f74-8f2c-82ad80742703 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009c188b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.796815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.814370 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-921c8b4f-e725-4688-945b-b76de043c774 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.379097 Oct 04 18:20:50.817939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1802/3587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.833185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.834413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.848504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.851822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.851822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.851822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.851822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.852199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.919283 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5bef0cfb-d5d3-4f74-8f2c-82ad80742703 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.134529 Oct 04 18:20:50.922961 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1786/3588] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:51.111643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.142765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0c7c117-bd97-4a00-8376-95a50d0ddf37 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1212 microversion: 2.1 time: 0.318890 Oct 04 18:20:51.146820 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1803/3589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1212 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:51.246954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1148075371", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "9f81a378-35b6-483b-95b0-a587f9b77abd"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:51.324835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] validate_networks() for [('9f81a378-35b6-483b-95b0-a587f9b77abd', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:51.810348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.814998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.821116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.824194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.825170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.826185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.826861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.827646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.884509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:51.884936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:51.885417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:51.885918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:51.886343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:51.898806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.900932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.901431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.902662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.903155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.903950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.926894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Getting quotas for project 5ae163af8ad3470291139cb11b2f1bd6. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:51.932884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Getting quotas for user 6d9ca64aafe9458f89214253efcd0cf1 and project 5ae163af8ad3470291139cb11b2f1bd6. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:51.954025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:51.958462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:52.133254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6477807d-1213-410c-8ec1-aa087b87d60c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209006 Oct 04 18:20:52.133913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1787/3590] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:52.143172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-plugged", "status": "completed", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:52.157389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.159927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.160958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.184486 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] Creating event network-vif-plugged:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:20:52.191694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1b599357-a0af-47c5-9ef9-78c0fed8fdbb req-e745a611-ac37-4a54-8d1b-5d8757f33cda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055909 Oct 04 18:20:52.202549 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1788/3591] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:52.202549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.202549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.219742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.221566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.222124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.223297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.224583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.225165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.252774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.266397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d62fcc3-ba87-4287-88e6-9a1682798214 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1515 microversion: 2.1 time: 0.461218 Oct 04 18:20:52.271790 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1804/3592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:52.280233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e00f1b3c-37b8-435d-9247-a2785fdd67d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087729d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.368218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e00f1b3c-37b8-435d-9247-a2785fdd67d0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.094035 Oct 04 18:20:52.371837 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1805/3593] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.386244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3eceda9-465c-485c-9ba8-759c2b948e8f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.387311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3eceda9-465c-485c-9ba8-759c2b948e8f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.529784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c3eceda9-465c-485c-9ba8-759c2b948e8f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.539945 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3eceda9-465c-485c-9ba8-759c2b948e8f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1216 microversion: 2.1 time: 0.165717 Oct 04 18:20:52.542622 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1806/3594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.559893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.564562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.581615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.581615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.581615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.581615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.582019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.582180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.621575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.634247 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21209dae-0482-4383-b70d-255c3e77e96a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.440578 Oct 04 18:20:52.646445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1789/3595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.757843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.770201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e18ca0f7-5663-4b05-9329-49ac9a66fe41 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1276 microversion: 2.1 time: 0.226220 Oct 04 18:20:52.791523 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1807/3596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.389460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92c5a1b3-992e-4548-a0f8-df5c4dd59c8c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008fe4310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.462265 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92c5a1b3-992e-4548-a0f8-df5c4dd59c8c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.077033 Oct 04 18:20:53.463851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1790/3597] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.573179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78560d10-b395-47a4-93ba-90cac1325c45 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.575604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78560d10-b395-47a4-93ba-90cac1325c45 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.664884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.668453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.688474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.688474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.688474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.688474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.691881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.692725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.712914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78560d10-b395-47a4-93ba-90cac1325c45 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:53.723872 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78560d10-b395-47a4-93ba-90cac1325c45 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1216 microversion: 2.1 time: 0.161319 Oct 04 18:20:53.741318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1808/3598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.794293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.794916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.805016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.808374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.810753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.810753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.810753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.815394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.537157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.549469 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60f9f7c6-0762-4bc4-ad8f-a4babcf2c9c9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.760148 Oct 04 18:20:54.550422 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1809/3599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:54.562580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1dd0e981-53b4-4ea1-8391-81a587794e65 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900880c790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.590891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.609784 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d2988784-5a5a-4625-bf40-e534f35bf260 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.953437 Oct 04 18:20:54.611116 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1791/3600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:54.676203 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1dd0e981-53b4-4ea1-8391-81a587794e65 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.118613 Oct 04 18:20:54.683227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1810/3601] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:54.754376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.755366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.764158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.770231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.770231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.770231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.770231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.770231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.930455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.957567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c98e140f-e462-4afd-bd18-2289420de50e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1212 microversion: 2.1 time: 0.204091 Oct 04 18:20:54.988844 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1792/3602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:55.578794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.579649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.597808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.600152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.600152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.603698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.604612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.610270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.636432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.636898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.650773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.652788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.653301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.657028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.657960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.661225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.025779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.040910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3dab5f1-c5b8-4709-82c2-4273c33edd7a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.410452 Oct 04 18:20:56.047849 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1793/3603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.065785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-737acd79-a037-4093-b34d-3e07b37923ad tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008ee1670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.078819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.089865 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1acae781-912e-4746-b9e0-d6cdf18ad58f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.516500 Oct 04 18:20:56.095930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1811/3604] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.122411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.125065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.143291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.144734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.145204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.145935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.146406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.149895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.182023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-737acd79-a037-4093-b34d-3e07b37923ad tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.131149 Oct 04 18:20:56.183808 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1794/3605] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.250102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcdbc738-1100-47f1-ba35-a67f2e71fdaa", "tag": "967e6512-57de-458a-8ef2-5ca3aa9ebfab"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:56.273901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.274797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.275511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.290955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] Creating event network-changed:967e6512-57de-458a-8ef2-5ca3aa9ebfab for instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa on n-h1-833090-21 Oct 04 18:20:56.300836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c89d9491-1ecc-4793-ba2f-897027f39706 req-f639eb88-9aef-4cfe-bff0-63af3ff9aa5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056457 Oct 04 18:20:56.305485 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1795/3606] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:56.355620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.371785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a65e9005-9d9c-4a09-ac96-0b19dd7c7e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1268 microversion: 2.1 time: 0.274118 Oct 04 18:20:56.372223 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1812/3607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.657179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f1c34fb-87c8-49f1-9545-03029f55e0ab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: .version_select at 0x7f90098e7700>, body: {"keypair": {"name": "tempest-keypair-1876516155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV6YPqoDlOM/nyojiykdH8KghYlwxKX7MiaXILQcunqXnPJLlOFxyhTRJ9ZTslg5zuZWIryTNWpxUCDvGuHFhOQ/+RQz1a4EvPjEaq2bCIRPjB0a7WfXdQe1QwwjtE/xA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:56.685083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3f1c34fb-87c8-49f1-9545-03029f55e0ab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for project 00ddc78218054468aad4028cc79a2c4d. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:56.701615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3f1c34fb-87c8-49f1-9545-03029f55e0ab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for user 12e550a02a79411a9e202c7d952d32bb and project 00ddc78218054468aad4028cc79a2c4d. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:56.840591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f1c34fb-87c8-49f1-9545-03029f55e0ab tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186141 Oct 04 18:20:56.840591 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1796/3608] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:20:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:57.079330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.080272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.090384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.090384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.090384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.090384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.090875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.091294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.121579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.122307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.140691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.141194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.156387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.157305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.162245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.163180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.718002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:57.727524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e20d37e7-71f5-4197-8493-2cc43cb7abb4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.609775 Oct 04 18:20:57.733735 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1797/3609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:57.739117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-769e3489-0c19-495c-863a-cc9455fe17ad tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90098e7700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.865759 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-769e3489-0c19-495c-863a-cc9455fe17ad tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.130213 Oct 04 18:20:57.867973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1798/3610] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.882573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.887426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.902536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.903423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.907218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.926467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.926467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.926467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.106725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.119208 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee12ea43-d2b2-4dd2-83ff-60d5bb206069 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1274 microversion: 2.1 time: 0.248961 Oct 04 18:20:58.125133 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1799/3611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:58.284025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.288327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:58.305067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ed5f1c0-14bc-43a0-a8bd-1dc5bd5399a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 1.229554 Oct 04 18:20:58.308207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1813/3612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:58.430394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492dd343-27af-4724-b63d-b09659d0aab2", "name": "network-vif-plugged", "status": "completed", "tag": "d4f67e09-02f3-4766-9940-f08bd3f7bc25"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:58.453668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.455947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.457148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.487168 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] Creating event network-vif-plugged:d4f67e09-02f3-4766-9940-f08bd3f7bc25 for instance 492dd343-27af-4724-b63d-b09659d0aab2 on n-h1-833090-21 Oct 04 18:20:58.498088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1b0631d4-c163-414f-ad81-f76d91376100 req-1e004456-e2a4-412d-8ee4-6588ac316169 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072705 Oct 04 18:20:58.498998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1800/3613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:58.768546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.772109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.788327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.789810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.790914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.792865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.793608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.807821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.887108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2fe8f81e-e98b-4e35-a979-7efb776c69ba tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f00550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.981694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2fe8f81e-e98b-4e35-a979-7efb776c69ba tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.101832 Oct 04 18:20:58.984022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1801/3614] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.149931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.150954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.171641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.187261 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab859cfc-2031-4d0a-97cb-2b9cde173cc8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.428926 Oct 04 18:20:59.187952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.188509 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1814/3615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.205632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.205632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.205632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.205632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.205632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.334491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.335273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.347710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.371134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.374553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.391899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.393418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.402783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.547234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.558272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fe57136-7b8b-4eae-8b38-7f473638151c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.413685 Oct 04 18:20:59.570164 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1802/3616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.821694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.832878 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4efa4104-1c48-41d0-a86e-bc997f0ed76d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.503922 Oct 04 18:20:59.833736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1815/3617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.004173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01c59dad-2159-4615-8c89-1bb9ed810114 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009d97550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.062905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01c59dad-2159-4615-8c89-1bb9ed810114 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.067242 Oct 04 18:21:00.064753 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1803/3618] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.219283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.220167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.260367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.262895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.263628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.266075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.267860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.270216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.471428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.484329 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c393f672-580c-4330-b18e-7eb2bf4d5281 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.269446 Oct 04 18:21:00.487599 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1816/3619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.633129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.633934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.642636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.644080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.644716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.645817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.646447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.647130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.857519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.858480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.868402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.869957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.871723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.874033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.875339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.877567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.125265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.134667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83eca39b-bda5-4add-bcc7-35a6c696ade2 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.508262 Oct 04 18:21:01.153258 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1804/3620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.159353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9", "tag": "d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:01.173568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.174485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.175321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.212483 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] Creating event network-changed:d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9 for instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 on n-h2-833090-21 Oct 04 18:21:01.223860 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-947e54c3-fed6-426e-9881-b1f21bf33a25 req-9fa66968-ac1f-4ce7-bad3-8e508dca542d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067849 Oct 04 18:21:01.228640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1805/3621] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:01.239540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-499c5def-eaad-457a-98a9-b2475fc87d67 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f00430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.325063 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-499c5def-eaad-457a-98a9-b2475fc87d67 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.094860 Oct 04 18:21:01.331243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1806/3622] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.450944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.468097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3648f0c8-5b3e-4e81-9daf-2dea233cd31a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1320 microversion: 2.1 time: 0.610047 Oct 04 18:21:01.469610 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1817/3623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.513257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.514184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.534748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.542638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.544520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.546565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.547229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.553921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.916160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:02.012003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.049552 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d029a1a-3664-47d5-821c-60ef44009523 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.541075 Oct 04 18:21:02.070759 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1807/3624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.158187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1668420095", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "595e95a8-b241-44a6-9552-73f26a78a6e1"}], "security_groups": [{"name": "tempest-securitygroup--1836167810"}], "key_name": "tempest-keypair-1876516155", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:02.160998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.161759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.173060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.175079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.175703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.177065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.177608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.178110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.333543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] validate_networks() for [('595e95a8-b241-44a6-9552-73f26a78a6e1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:02.443438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.464105 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cbe934d5-5d3a-4024-9962-47286a3566e7 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.307670 Oct 04 18:21:02.469129 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1808/3625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:02.501439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06993f52-5566-485c-af00-a7ca339ff1e8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c79310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.571624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06993f52-5566-485c-af00-a7ca339ff1e8 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.099190 Oct 04 18:21:02.573462 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1809/3626] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.586860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.587942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.594899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.595810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.596483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.597470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.598160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.598821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.821928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.834154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06bb07e2-58dd-4995-b128-4eb77b4ba045 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1501 microversion: 2.1 time: 0.259393 Oct 04 18:21:02.837336 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1810/3627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.865092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.866667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.878576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.879402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.880123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.881093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.882407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.883101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.074092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:03.074785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:03.077743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:03.078231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:03.078671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:03.089939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.090705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.091319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.092303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.093576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.094242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.128087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:03.134639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Getting quotas for user 12e550a02a79411a9e202c7d952d32bb and project 00ddc78218054468aad4028cc79a2c4d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:03.155773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:03.156334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.158512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:03.158660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:03.168643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ef0a160-6de4-406e-8740-e13099cd805c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1501 microversion: 2.1 time: 0.308695 Oct 04 18:21:03.182949 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1811/3628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:03.182949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.182949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.190230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.190230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.190230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.190230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.190230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.195364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.320443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-956c9f98-1a05-464e-88a8-03856e1b135f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.168286 Oct 04 18:21:03.321730 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1818/3629] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:03.327394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.328347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.360076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.421510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:03.438181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.447853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab5fcc45-f1af-409f-a4b0-87e774f1a50f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.275943 Oct 04 18:21:03.463056 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1812/3630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.463056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dafff2e-290c-47af-b97b-722882445dd9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.463056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dafff2e-290c-47af-b97b-722882445dd9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.545135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0dafff2e-290c-47af-b97b-722882445dd9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.545135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=29 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:03.551678 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dafff2e-290c-47af-b97b-722882445dd9 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1246 microversion: 2.1 time: 0.101319 Oct 04 18:21:03.564963 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1813/3631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.574377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.574936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.586790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.587489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.588095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.589410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.589537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.590058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.745630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.754306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-533a4b3c-196c-4066-af67-d33a0c427a65 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.188862 Oct 04 18:21:03.754921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1814/3632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.759523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62a1f044-9d21-466d-adce-c96c1936becb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900ae493a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.806110 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62a1f044-9d21-466d-adce-c96c1936becb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.050131 Oct 04 18:21:03.806869 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1815/3633] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.074727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdbc738-1100-47f1-ba35-a67f2e71fdaa", "name": "network-vif-plugged", "status": "completed", "tag": "967e6512-57de-458a-8ef2-5ca3aa9ebfab"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:04.092075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.096899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.097747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.112646 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-784f3231-067b-40a0-b6f6-7d471dee5ba5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 204 len: 0 microversion: 2.1 time: 0.789218 Oct 04 18:21:04.113544 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1819/3634] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:03 2022] DELETE /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:04.122744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.123626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.133945 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] Creating event network-vif-plugged:967e6512-57de-458a-8ef2-5ca3aa9ebfab for instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa on n-h1-833090-21 Oct 04 18:21:04.138037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.138859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.139501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.140442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.141470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.142170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.150117 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-460f1e1f-b6b6-4547-bb28-3ed1d62101a2 req-b8bc9398-627a-48d4-8b39-b6d516729e07 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083134 Oct 04 18:21:04.154354 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1816/3635] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:04.452178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.461099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-831da045-7656-4e0e-805e-98980e38e4a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1507 microversion: 2.1 time: 0.342805 Oct 04 18:21:04.461684 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1820/3636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:04.483901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.485222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.495183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.498928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.499393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.500174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.500637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.504775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.579422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbb42863-a0ee-411a-91fb-4cf9832ce5b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.580177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbb42863-a0ee-411a-91fb-4cf9832ce5b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.658869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbb42863-a0ee-411a-91fb-4cf9832ce5b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.667866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbb42863-a0ee-411a-91fb-4cf9832ce5b2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1246 microversion: 2.1 time: 0.092224 Oct 04 18:21:04.677052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1821/3637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.767959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.778357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.780037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.780726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3625162c-d290-48cb-bf04-b331d6b32a33 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 0.302791 Oct 04 18:21:04.799548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1817/3638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.801750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.802244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.802702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.805975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.806440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.810083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.822501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4f620e9-683d-40bc-9032-3d74bc1e3164 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009043c10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.917058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4f620e9-683d-40bc-9032-3d74bc1e3164 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.098845 Oct 04 18:21:04.919375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1818/3639] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.036961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.050033 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f40b688-3e4b-4d32-85cb-70a26d73fd4b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.275925 Oct 04 18:21:05.051540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1822/3640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:05.495448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.496080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.505840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.506379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.507506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.508448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.509113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.510014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.695077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.695774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.711827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.712363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.719929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.726432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.727129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.727642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.819930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.828590 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4712c8e-42c0-47b5-9f2d-a415a686c927 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1507 microversion: 2.1 time: 0.340622 Oct 04 18:21:05.829895 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1819/3641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.835018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.839950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.862636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.872248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.872751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.873194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.873906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.874437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.874862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.877789 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7242f1f4-996e-41ee-9c9c-6513ae207c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1242 microversion: 2.1 time: 0.186942 Oct 04 18:21:05.878866 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1823/3642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1242 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:05.934338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ddcd53b-9a24-49c7-ae70-9771438d0189 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008c9b820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.063905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ddcd53b-9a24-49c7-ae70-9771438d0189 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.135438 Oct 04 18:21:06.065659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1824/3643] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:06.080908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.081541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.109427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.109927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.110587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.112362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.114062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.115805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.794286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.815860 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00ac89a7-be88-4840-a17e-6d4a24f87868 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.741022 Oct 04 18:21:06.822848 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1825/3644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:06.858720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.860864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.926106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.948375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.949247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.955366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.958426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.967604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.327328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.343123 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d02aa46a-6a78-49f9-8f49-1c46a22209fb tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1316 microversion: 2.1 time: 1.511856 Oct 04 18:21:07.349830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1820/3645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1316 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.380433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.381055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.400275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.401255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.403289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.404754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.405408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.406021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.527757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.541966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db693388-f8d3-4094-b62f-21028e234977 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1507 microversion: 2.1 time: 0.692829 Oct 04 18:21:07.543409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1826/3646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1507 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.550649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9449005c-11a6-4c4f-81d1-68f882177011 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900875fdc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.650720 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9449005c-11a6-4c4f-81d1-68f882177011 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.105915 Oct 04 18:21:07.653049 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1827/3647] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.666338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492dd343-27af-4724-b63d-b09659d0aab2", "name": "network-vif-deleted", "tag": "d4f67e09-02f3-4766-9940-f08bd3f7bc25"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:07.696205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.697002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.699913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.721893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.739664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67b26361-a8c0-4187-be91-75bc296730bd tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1298 microversion: 2.1 time: 0.360808 Oct 04 18:21:07.741776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1821/3648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.758738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] Creating event network-vif-deleted:d4f67e09-02f3-4766-9940-f08bd3f7bc25 for instance 492dd343-27af-4724-b63d-b09659d0aab2 on n-h1-833090-21 Oct 04 18:21:07.768317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-856fdf19-c31b-4ee9-b628-7640ffc21a91 req-9de14fc2-dc74-4e1f-b9df-bdef44748c2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112238 Oct 04 18:21:07.770363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1828/3649] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:07.848519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.849308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.858506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.863523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.864097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.864937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.865512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.867215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.377409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.378306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.402933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.402933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.402933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.405517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.407716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.410360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.575539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.595972 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cc558dc-26a7-4d16-87fb-7610954cc855 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.751416 Oct 04 18:21:08.622848 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1822/3650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.640366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.640366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.661537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:08.667634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.680527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.685886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.685886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.685886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.685886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.766055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.767263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.767939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.768623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 492dd343-27af-4724-b63d-b09659d0aab2 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:08.894157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.925338 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99c2a677-8d66-48f7-a917-7ae06f109fb3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 200 len: 1310 microversion: 2.1 time: 0.279525 Oct 04 18:21:08.930873 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1823/3651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.946457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fdb95fa-a8e1-49d9-a417-b9cd2234e24f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008fe4ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.067195 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fdb95fa-a8e1-49d9-a417-b9cd2234e24f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.131951 Oct 04 18:21:09.077201 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1824/3652] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.083753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.085708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.095669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.096353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.096998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.098275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.099589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.102713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.192100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.211328 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-775130aa-fef5-40d7-85de-cffbfc9868ea tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1465 microversion: 2.1 time: 0.841911 Oct 04 18:21:09.213186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1829/3653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1465 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.238506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.239396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.251062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.252382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.252808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.253241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.254315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.255573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.257494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.262140 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8b8ade2-daa2-4c0c-ad09-f2821bc458fc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1304 microversion: 2.1 time: 0.187057 Oct 04 18:21:09.267439 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1825/3654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1304 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.629308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.629944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.650505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.653106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.655698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.655698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.658711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.659272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.699223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e73a0e64-21b8-4716-896c-95362e4b65fe tempest-ServersOnMultiNodesTest-1944170662 tempest-ServersOnMultiNodesTest-1944170662-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1618 microversion: 2.1 time: 0.464469 Oct 04 18:21:09.702571 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1830/3655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1618 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.733430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.734225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.746255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.747172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.747809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.753408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.753408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.753408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.784468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:09.918649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:10.065044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.087994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-676cafbb-6553-4e8a-b6b6-fe6659b82492 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.462938 Oct 04 18:21:10.088594 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1826/3656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:10.109062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.111055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.127663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.128293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.128753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.131887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.132412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.132855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.179034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 HTTP/1.1 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '492dd343-27af-4724-b63d-b09659d0aab2'} Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:10.181836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:21:10.189863 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:10.190464 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3593e67f-4226-4796-b1d8-a4d331a8131c tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 204 len: 0 microversion: 2.1 time: 0.452185 Oct 04 18:21:10.190464 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1831/3657] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:09 2022] DELETE /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:21:10.190464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa25589e-c3bd-410a-8203-1501dd8a719e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90088c6af0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.195152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:10.196317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc05da15-9b21-4a4e-b9e2-38ca3e7a2ac9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 404 len: 111 microversion: 2.1 time: 0.100485 Oct 04 18:21:10.199606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1827/3658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:10.228639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.247116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.275982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.276504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.276949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.281644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.282170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.285935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.299861 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa25589e-c3bd-410a-8203-1501dd8a719e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.115838 Oct 04 18:21:10.300847 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1832/3659] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.318116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6003050-29cf-45e6-9100-eea155191548 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: .version_select at 0x7f900875f280>, body: {"keypair": {"name": "tempest-key-1446658934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrJ1BRhBcNAPkOr0tdaRgiz4Jd3NR2mpKa0WNZDkQGZyKsQID5M+GqVoeChthHFQfCa2zVtXtdcOItLim8MEF7uAX7tarILve0+DGuxMKpd5VObwmflydftNNvfMRaxhA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:10.394814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a6003050-29cf-45e6-9100-eea155191548 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:10.400663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a6003050-29cf-45e6-9100-eea155191548 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:10.402381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:10.593022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6003050-29cf-45e6-9100-eea155191548 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.290200 Oct 04 18:21:10.594323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1833/3660] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:10 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:10.599330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.600748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.619209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.622978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.623155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.623155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.623155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.623155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.623155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.639930 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad2fbbe3-609c-40a5-b0ed-b3d2b1742290 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1471 microversion: 2.1 time: 0.438284 Oct 04 18:21:10.641426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1828/3661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.650876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2c5030e-2803-45d2-98de-8c48efecd915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '.version_select at 0x7f9008fe4310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.654147 n-d-833090-21 devstack@n-api.service[123886]: WARNING oslo_db.sqlalchemy.utils [None req-f2c5030e-2803-45d2-98de-8c48efecd915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:21:10.669298 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2c5030e-2803-45d2-98de-8c48efecd915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024763 Oct 04 18:21:10.702898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1829/3662] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:10.874520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-618815550", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-key-1446658934", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:10.922368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.944938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d459eec2-6557-4368-9053-111858d4210a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.349258 Oct 04 18:21:10.946358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1834/3663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.988140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:11.115915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.120027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.139667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.140986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.141716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.142726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.144922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.145663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.711925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.754551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68c73aff-ba53-431c-a063-b406c1ffbf1f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.644593 Oct 04 18:21:11.757346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1835/3664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.774164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb401113-a959-45dd-86d7-1396ddf26724 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087b01f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.876199 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb401113-a959-45dd-86d7-1396ddf26724 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.117464 Oct 04 18:21:11.878366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1836/3665] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:11.905188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9", "name": "network-vif-plugged", "status": "completed", "tag": "d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:11.943257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.945091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.946229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.962590 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] Creating event network-vif-plugged:d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9 for instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 on n-h2-833090-21 Oct 04 18:21:11.969484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-441208f1-00d8-469a-9613-e7938cd4b692 req-ca8f5855-98c0-4668-8fff-9377657a4503 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088960 Oct 04 18:21:11.971819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1837/3666] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:11.977839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.979658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.987813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.993102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.994706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.995758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.997118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.997811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.306464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:12.307027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:12.307268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:12.308053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:12.308645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:12.325980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.328567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.335155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.349488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.349488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.349488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.419016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:12.433457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:12.473018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:12.480791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:12.582502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.611194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52d5c32e-3222-4314-aaf2-677c5b52edc1 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1471 microversion: 2.1 time: 0.632405 Oct 04 18:21:12.612887 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1838/3667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1471 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.989631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bdf0b885-2df2-46b5-b7e7-66f97c730ac6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120638 Oct 04 18:21:12.994363 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1830/3668] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:21:13.010533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.011305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.018975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.019529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.019999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.020722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.021392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.022953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.112107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:13.458314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.466888 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a27828ef-f919-4ff3-ba9f-7f696caf9634 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.852621 Oct 04 18:21:13.472972 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1839/3669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.489083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c528ab4-05eb-4b02-938e-54ff4db5b2f1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087c1b80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.519068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.533048 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aab451be-3cfa-470b-86d1-ff6781af1ed4 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.527750 Oct 04 18:21:13.533647 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1831/3670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.565892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a3ba5d3-8e64-41f8-b315-ba6ee6c9b08b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.566518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a3ba5d3-8e64-41f8-b315-ba6ee6c9b08b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.602530 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c528ab4-05eb-4b02-938e-54ff4db5b2f1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.123688 Oct 04 18:21:13.602530 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1840/3671] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.638056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.642787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.648825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.651319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.654083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.659671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.660537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.668220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.805492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a3ba5d3-8e64-41f8-b315-ba6ee6c9b08b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.813944 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a3ba5d3-8e64-41f8-b315-ba6ee6c9b08b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1228 microversion: 2.1 time: 0.265132 Oct 04 18:21:13.818058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1832/3672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1228 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.901613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.911816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70738be5-32c5-4502-986e-669c230f5477 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1429 microversion: 2.1 time: 0.278009 Oct 04 18:21:13.918760 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1841/3673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1429 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.962980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdbc738-1100-47f1-ba35-a67f2e71fdaa", "name": "network-vif-deleted", "tag": "967e6512-57de-458a-8ef2-5ca3aa9ebfab"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:13.998245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.003421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.007267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.074558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] Creating event network-vif-deleted:967e6512-57de-458a-8ef2-5ca3aa9ebfab for instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa on n-h1-833090-21 Oct 04 18:21:14.126625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4ca4afda-202f-486b-ac24-389ccdbd8a91 req-1217c998-5c26-4509-a210-91e8a6122e02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150658 Oct 04 18:21:14.127343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1833/3674] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:14.501639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.502380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.520343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.521255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.521988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.523612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.524462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.525571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.564975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.566393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.584258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.589546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.590232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.607959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.611765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.613061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.132342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.141130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b8b8900-7f9a-433f-b8ef-70b789fb4e0b tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1316 microversion: 2.1 time: 0.582362 Oct 04 18:21:15.168001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1834/3675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.173199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dc6eea6-400d-4c05-af52-07008379ae91 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008ee1820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.184306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.192612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8623f88-8243-483d-b436-171a2e9a6884 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.698436 Oct 04 18:21:15.193195 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1842/3676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.198609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.199443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.210814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.282314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dc6eea6-400d-4c05-af52-07008379ae91 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.113081 Oct 04 18:21:15.291181 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1835/3677] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.292692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.293337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.327932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.328432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.328876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.329611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.330063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.330740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.342783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.351880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1224 microversion: 2.1 time: 0.156753 Oct 04 18:21:15.367986 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1843/3678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1224 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.369205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.370189 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45139884-30cf-4353-9e4c-98844bcc1df2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001335 Oct 04 18:21:15.370520 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1844/3679] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:21:15.463713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.464201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.469658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.473612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid bcdbc738-1100-47f1-ba35-a67f2e71fdaa {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:15.594774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.610317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db035586-3754-4244-9e95-72f561cb747e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 200 len: 1306 microversion: 2.1 time: 0.321990 Oct 04 18:21:15.611089 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1836/3680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.166758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.168075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.181384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.183377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.189655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.189655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.199248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.200009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.224203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.224203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.242852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.259196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.262158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.263075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.263998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.265771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.325986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:16.521362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.533648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d3acb504-dc20-421b-866b-f1328309f358 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1504 microversion: 2.1 time: 0.372092 Oct 04 18:21:16.543536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1845/3681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.549052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:16.601723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.602518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.603425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.635743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] Creating event network-changed:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:21:16.642691 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-86a79aa3-8b10-4919-a9a1-21d830f80b37 req-170d4761-21de-49c2-ba59-372a8d300f14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097428 Oct 04 18:21:16.644088 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1846/3682] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:16.651087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e2e193c-b6be-4814-b7f7-8ba85530fa63 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900877a8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.727716 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e2e193c-b6be-4814-b7f7-8ba85530fa63 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.082151 Oct 04 18:21:16.738544 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1847/3683] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.750989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.751813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.780186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.780756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.784042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.784944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.785430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.785877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.977033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.994884 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a41fcb6-2164-479c-a0cf-93a69dfbe1e6 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1280 microversion: 2.1 time: 0.253532 Oct 04 18:21:16.996305 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1848/3684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.002663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.003493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.012076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.012931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.013547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.014720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.015728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.016400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.113455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:17.122113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8e588f0-a528-4a02-ae79-1da9a10d3561 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.906311 Oct 04 18:21:17.127094 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1837/3685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:17.140487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.145023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: bcdbc738-1100-47f1-ba35-a67f2e71fdaa] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.166304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.166863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.168931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.169939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.174394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.178757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.218623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa HTTP/1.1 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'bcdbc738-1100-47f1-ba35-a67f2e71fdaa'} Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:17.226019 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. Oct 04 18:21:17.233286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:17.237413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance bcdbc738-1100-47f1-ba35-a67f2e71fdaa could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:17.240503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-730ed935-494f-4971-b572-a03dcd7f28f7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa" status: 404 len: 111 microversion: 2.1 time: 0.112056 Oct 04 18:21:17.241635 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1838/3686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/bcdbc738-1100-47f1-ba35-a67f2e71fdaa => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:17.256647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.257483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.275384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7037c32-8b0d-4041-acab-379b07073e7c tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.273271 Oct 04 18:21:17.281983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.282781 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1849/3687] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 4 18:21:16 2022] DELETE /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9/os-server-password => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:17.289979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.290757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.291765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.292432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.293062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.294327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.294818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.353936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.355555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.355942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.357353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:17.357900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.360367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.360840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.403825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e756f12-6685-4ca3-9c67-2430bfb63b8e tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.115187 Oct 04 18:21:17.411417 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1850/3688] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9/os-server-password => generated 16 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:21:17.417608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.422956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.426657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.427377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.428635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.429630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.430265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.431673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.486396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:17.868663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13775eb7-e2b0-4f6b-b31d-e39abc704ae8 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 204 len: 0 microversion: 2.1 time: 0.621001 Oct 04 18:21:17.873810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1839/3689] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:17 2022] DELETE /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:17.884066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99db2ca8-9325-4533-80de-84d4f8069311 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d7ad0d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.975606 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99db2ca8-9325-4533-80de-84d4f8069311 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.102115 Oct 04 18:21:17.978279 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1840/3690] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.986459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.994152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.015871 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bae3edda-82ef-40f2-80c8-7a2ad0220c06 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 204 len: 0 microversion: 2.1 time: 0.602651 Oct 04 18:21:18.020584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1851/3691] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:17 2022] DELETE /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:18.022470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.023324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.024051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.024428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.025149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.026039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.046258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.047507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=6,nova_cell1:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18993409-9627-476e-92d5-7a736f4f4b23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1288 microversion: 2.1 time: 0.253975 Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1852/3692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1288 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.320704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.323085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.323085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.323085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.323085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.323085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.606185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.620401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e938599-1a7d-4c12-9101-51bce5a69b8a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1470 microversion: 2.1 time: 0.640719 Oct 04 18:21:18.623672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1841/3693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1470 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.636407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.637597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.656021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.656523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.657040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.662518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.664627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.665099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.899743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.914544 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf22da5b-da36-4abd-864e-bf5a03f98017 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1510 microversion: 2.1 time: 0.639289 Oct 04 18:21:18.918839 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1853/3694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.993490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be08e521-c786-4a04-8190-f68b9e46535f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900871e4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.134452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be08e521-c786-4a04-8190-f68b9e46535f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.139320 Oct 04 18:21:19.135408 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1854/3695] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:19.306676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.308164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.329363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.330076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.330590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.334297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.335389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.337736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.385660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.399885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f074b1f1-7238-473f-890d-e8e221e325a3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.774999 Oct 04 18:21:19.402740 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1842/3696] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.536663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.549156 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc78bdde-24e3-43b8-bb7d-9f240086a06a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1286 microversion: 2.1 time: 0.250161 Oct 04 18:21:19.567025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1855/3697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1286 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.648466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.650015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.665769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.668292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.669080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.670273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.672771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.673469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.948658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.949467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.960861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.961366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.961815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.964913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.965444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.965890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.974327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.983341 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63af3976-4618-4d0b-8bba-64b87149a562 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1470 microversion: 2.1 time: 0.339882 Oct 04 18:21:20.005670 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1843/3698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.150157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2542047-d0b2-4621-b00d-cff8860a813e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f58700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.204997 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2542047-d0b2-4621-b00d-cff8860a813e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.058707 Oct 04 18:21:20.213640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1844/3699] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:20.424070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:20.427660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.429165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.440156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.446145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.446145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.446145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.446145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.458424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.477611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.496701 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0759c8c3-7783-4eba-a5d9-350dbada6235 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1510 microversion: 2.1 time: 0.553142 Oct 04 18:21:20.512309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1856/3700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:20.574809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.575863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.592042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.596243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.597848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.602207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.607711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.608828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.792638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.810756 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06ece325-7179-4ff8-891a-1f1f4148cad8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.387012 Oct 04 18:21:20.832148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1845/3701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.936440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.945549 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b80e72e2-211f-41ea-ad1b-a8399c7f5706 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.374727 Oct 04 18:21:20.948622 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1857/3702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:21.009363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.011521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.026871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.032942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.032942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.032942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.032942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.032942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.221189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3b37e2bd-fe12-4b9e-87c2-2bcb88960115 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900875f4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.283733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3b37e2bd-fe12-4b9e-87c2-2bcb88960115 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.066597 Oct 04 18:21:21.284458 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1858/3703] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:21.524579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.526071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.549203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.554381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.555361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.556419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.557174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.557920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.919131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:21.949723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8efcc263-711b-46bd-a3c1-b901dcc3e405 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1470 microversion: 2.1 time: 0.944139 Oct 04 18:21:21.951670 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1846/3704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1470 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:21.980912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.981655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.992385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.992983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.993685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.996305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.997301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.997920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.227737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.241667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23469633-cb5e-4d3e-94c1-5f253e047eeb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.286937 Oct 04 18:21:22.242478 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1847/3705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.251004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.256005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.272664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.273434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.274287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.275260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.275983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.276657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.386487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:22.658876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.672908 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b48fc3a4-477f-4c07-ad42-c909dcb5ce9f tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1510 microversion: 2.1 time: 1.154906 Oct 04 18:21:22.691555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1859/3706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1510 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:22.691555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28780c06-effb-4b4f-8e3f-ac2201d28118 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900875fe50>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.798837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28780c06-effb-4b4f-8e3f-ac2201d28118 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.116653 Oct 04 18:21:22.805225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1860/3707] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.863517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.877959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d25891b6-6854-41ab-bc7c-8b7726333f90 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.633058 Oct 04 18:21:22.878813 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1848/3708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.899798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9", "name": "network-vif-deleted", "tag": "d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:22.922217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.922767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.932548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.974440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] Creating event network-vif-deleted:d7725ffe-02bc-45dc-aa7c-e3c767b8e8d9 for instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 on n-h2-833090-21 Oct 04 18:21:22.980368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.980989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.000900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bf5374ed-02a8-4983-a562-58cc55a8c24b req-be11c513-f056-4655-b5ae-55c0fc6947b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104931 Oct 04 18:21:23.004673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.005185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.006879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1861/3709] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:23.010125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.010903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.011391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.017104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.276577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.277580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.294771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.297317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.297771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.304229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.305050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.308585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.313374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.324480 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90f0e403-209c-47dc-9351-b446df939ce0 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1428 microversion: 2.1 time: 0.349337 Oct 04 18:21:23.356182 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1849/3710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1428 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:23.508902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f25351-a7ca-4b73-9fb7-cb69ba959b6f", "name": "network-vif-deleted", "tag": "829735b0-6cbe-46a0-9122-a7357d8c121b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:23.548096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.549587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.550708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.580736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] Creating event network-vif-deleted:829735b0-6cbe-46a0-9122-a7357d8c121b for instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f on n-h2-833090-21 Oct 04 18:21:23.588859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e908b7c4-705e-4a21-bc94-1c071b85661b req-97895131-537f-4677-9f90-352f06a2fa3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084019 Oct 04 18:21:23.591216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1850/3711] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:23.714852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.719403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.742374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.743211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.743916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.744655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.747188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.749118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.749740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.752769 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4bfe3822-3002-4b5c-b6b3-0bdc8b9f7d77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.486629 Oct 04 18:21:23.758955 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1862/3712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:23.817590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1d981bd0-14e2-4db6-b248-05df16076240 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008772790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.839758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:23.871243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.876600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.877073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.879591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lazy-loading 'fault' on Instance uuid 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:23.903141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1d981bd0-14e2-4db6-b248-05df16076240 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.091614 Oct 04 18:21:23.904191 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1863/3713] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:23.917899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.920186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.946216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.946863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.947421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.949380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.951058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.952267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.147571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.168391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08b56090-92a5-495e-a074-4acf54ee39f5 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1306 microversion: 2.1 time: 0.456182 Oct 04 18:21:24.173249 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1851/3714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1306 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.362370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.364938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.386278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.386937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.387491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.388326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.388895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.389429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.455436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.457722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.461146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.461763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid 25f25351-a7ca-4b73-9fb7-cb69ba959b6f {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:24.462084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.475856 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f03336de-28de-492e-85cd-e6ac7b00ce21 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.564798 Oct 04 18:21:24.475856 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1864/3715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.567075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.575938 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bde1d9e3-4a4c-4da7-9931-a73658601334 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1304 microversion: 2.1 time: 0.219754 Oct 04 18:21:24.581515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1852/3716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.790041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.790041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.807699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.808487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.811419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.812658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.815264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.815884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.844354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "name": "network-vif-plugged", "status": "completed", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:24.877689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.878109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.878546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.919003 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] Creating event network-vif-plugged:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:21:24.935413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-43d1424e-d5e1-4d6c-abea-976a3a3972af req-82cc2e5e-9ae6-4e30-b6b8-a2105f6227d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095926 Oct 04 18:21:24.938419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1853/3717] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:24.961435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ac4383f-b097-45f6-8cb3-451a62416dfc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90099ca430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.098803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ac4383f-b097-45f6-8cb3-451a62416dfc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1452 microversion: 2.1 time: 0.158569 Oct 04 18:21:25.112022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1854/3718] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.186512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf11fc0-b276-405f-8afd-a242fbdf041c", "tag": "22b93709-29dd-41b3-84c4-57a1745c154c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:25.223512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.228416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.228956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.260515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] Creating event network-changed:22b93709-29dd-41b3-84c4-57a1745c154c for instance 0bf11fc0-b276-405f-8afd-a242fbdf041c on n-h1-833090-21 Oct 04 18:21:25.270521 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b58eae91-b4ea-4e5b-8aa3-bec41f54000f req-5bc906d2-e031-49e1-9a75-e55ce2087800 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088463 Oct 04 18:21:25.272184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1855/3719] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:25.278957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.280447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.288160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.288894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.289519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.290581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.291309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.292000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.337456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.338372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.339111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.339835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lazy-loading 'fault' on Instance uuid 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:25.440714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.456090 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f394018-8534-40d8-9a31-45c0e65552ca tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.674823 Oct 04 18:21:25.460812 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1865/3720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.462068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9ca64aafe9458f89214253efcd0cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ae163af8ad3470291139cb11b2f1bd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.480254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff16921f-f0a7-48ee-9a6b-3b5e1f0695ea tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 200 len: 1306 microversion: 2.1 time: 0.206376 Oct 04 18:21:25.481106 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1856/3721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.500606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.502322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.510496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.511396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.512033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.513136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.514627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.515319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.611099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.612101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.625611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.627892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.636120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.636978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.637536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.638036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.679121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:25.726841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.727378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.727859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.728520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.732433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid 25f25351-a7ca-4b73-9fb7-cb69ba959b6f {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:25.739742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9aa51ddf-437a-4624-a9bc-09eecc51442b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.243339 Oct 04 18:21:25.741825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1866/3722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.886762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.895748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e65194a-077b-4364-a99c-630a83686069 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 200 len: 1304 microversion: 2.1 time: 0.289793 Oct 04 18:21:25.899060 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1857/3723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 1304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.118898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-947f2529-4c2d-41c5-95a3-507349ad7cc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900873dc10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.212401 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-947f2529-4c2d-41c5-95a3-507349ad7cc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1461 microversion: 2.1 time: 0.097821 Oct 04 18:21:26.215800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1867/3724] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.232382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06457822-c82f-4932-93be-94fe813adfd5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f3c040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.281748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06457822-c82f-4932-93be-94fe813adfd5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 200 len: 1461 microversion: 2.1 time: 0.054131 Oct 04 18:21:26.282550 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1858/3725] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 1461 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.297645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.298742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.305644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.306302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.307015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.308754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.309521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.310182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.491174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.492182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.517802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.518874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.521015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.522556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.525277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.528104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.725646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.735356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c717818-e07e-4c6e-8f75-73c9500c1486 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.250739 Oct 04 18:21:26.736018 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1859/3726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.741733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.742572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] [instance: 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.749355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.750710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.750896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.751843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.752477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.753072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.768727 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] HTTP exception thrown: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Request method failure captured: Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 HTTP/1.1 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHmCZyuw1WTOwcxwUnLPVIHAyeiY_v-waWILDR0taLFXwFGT2juZE7XMojwKeV5OppfmIdLM3o_ArJXpKR4bKXOXsJU7z0xqpXSyDGFWY1HWn6sUCRWOf3_5-GrCuQRxOICuhsT_kEve0SrhRnNAXdhdG-7jzENm3WVYTpmR4_89Ad4 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 5ae163af8ad3470291139cb11b2f1bd6 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerPasswordTestJSON-96770208 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ae163af8ad3470291139cb11b2f1bd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ae163af8ad3470291139cb11b2f1bd6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ae163af8ad3470291139cb11b2f1bd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ae163af8ad3470291139cb11b2f1bd6"}]}] Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerPasswordTestJSON-96770208 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 5ae163af8ad3470291139cb11b2f1bd6 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerPasswordTestJSON-96770208 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerPasswordTestJSON-96770208-project Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6d9ca64aafe9458f89214253efcd0cf1 Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerPasswordTestJSON-96770208-project Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9'} Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:26.770411 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] Returning 404 to user: Instance 4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:26.777163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d08bfbc-e9a0-4101-bfdb-ae9d5ce3b749 tempest-ServerPasswordTestJSON-96770208 tempest-ServerPasswordTestJSON-96770208-project] 10.222.0.40 "GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9" status: 404 len: 111 microversion: 2.1 time: 0.034880 Oct 04 18:21:26.783343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1860/3727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/4877c0b3-6c49-4dce-aa31-b4dc61cc9bf9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:26.785303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.786470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.792977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:26.794702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.795590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.796286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.797172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.797829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.798420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.896005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.908053 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0987a956-a2a1-4da3-bf9b-e06403bd7bc2 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1466 microversion: 2.1 time: 0.614752 Oct 04 18:21:26.909426 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1868/3728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1466 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.934021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2dbd4e1c-812c-42b0-89fb-279880a8b59e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008782280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.073693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.083118 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88b68729-81ed-4f82-8c50-b49c9a2a6d3a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.302174 Oct 04 18:21:27.083738 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1861/3729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.085006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2dbd4e1c-812c-42b0-89fb-279880a8b59e tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?changes-since=2022-10-04T18%3A18%3A26Z" status: 200 len: 2373 microversion: 2.1 time: 0.154779 Oct 04 18:21:27.087558 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1869/3730] 10.222.0.40 () {58 vars in 1199 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/images?changes-since=2022-10-04T18%3A18%3A26Z => generated 2373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.100166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d6d2370-ddb1-4200-a7bd-0e1ffcf6a177 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90086d7ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.100281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.100892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 25f25351-a7ca-4b73-9fb7-cb69ba959b6f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.108029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.108293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.109440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.110496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.111129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.111785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.127102 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f HTTP/1.1 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '25f25351-a7ca-4b73-9fb7-cb69ba959b6f'} Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:27.129308 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 25f25351-a7ca-4b73-9fb7-cb69ba959b6f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef7a8065-6ae9-4c64-ab53-2c88501baba2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f" status: 404 len: 111 microversion: 2.1 time: 0.045201 Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1862/3731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/25f25351-a7ca-4b73-9fb7-cb69ba959b6f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.145148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.149921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.150426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.150994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.151783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.152431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.153705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.174163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d6d2370-ddb1-4200-a7bd-0e1ffcf6a177 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-204133108" status: 200 len: 484 microversion: 2.1 time: 0.073527 Oct 04 18:21:27.174163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1870/3732] 10.222.0.40 () {58 vars in 1229 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-204133108 => generated 484 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:27.187341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:27.195881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b223743e-d616-4a87-acde-9fdaa541e440 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900873dca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.311164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b223743e-d616-4a87-acde-9fdaa541e440 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?server=6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 957 microversion: 2.1 time: 0.126351 Oct 04 18:21:27.312140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1871/3733] 10.222.0.40 () {58 vars in 1209 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?server=6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 957 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:27.327545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f61c7a8b-0d71-452e-89b4-607d14da01fd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90086d70d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.381366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f61c7a8b-0d71-452e-89b4-607d14da01fd tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 484 microversion: 2.1 time: 0.057348 Oct 04 18:21:27.388560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1872/3734] 10.222.0.40 () {58 vars in 1317 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 484 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:27.394079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f916aa2b-a375-4040-a4b5-15ed60a084de tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900871e310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.450403 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f916aa2b-a375-4040-a4b5-15ed60a084de tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 484 microversion: 2.1 time: 0.060040 Oct 04 18:21:27.451046 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1873/3735] 10.222.0.40 () {58 vars in 1303 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 484 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:27.464807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d644d412-54c7-4da2-ba42-936dccba6317 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900871e820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.586029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d644d412-54c7-4da2-ba42-936dccba6317 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.124932 Oct 04 18:21:27.586833 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1874/3736] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:27.611808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f06312f-dba0-4fa5-b5cb-4c33fac98e4f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008782280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.745426 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f06312f-dba0-4fa5-b5cb-4c33fac98e4f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.139091 Oct 04 18:21:27.746335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1875/3737] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:27.764272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.765112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.785759 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6b743d1-52f6-4fb9-ac04-47c33a90609f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 204 len: 0 microversion: 2.1 time: 0.644219 Oct 04 18:21:27.785759 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1863/3738] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:27 2022] DELETE /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:27.786533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67ea18cd-5dd8-4533-8425-f09ff129dfb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f58c10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.794411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.794933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.795376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.796178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.796567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.796992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.887913 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67ea18cd-5dd8-4533-8425-f09ff129dfb4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.105986 Oct 04 18:21:27.891305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1864/3739] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:27.897795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.901018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.915193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.918528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.934552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.934552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.934552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.934552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.065931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.097032 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55eb1d50-6afc-4479-bec4-23d2768ed28b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1372 microversion: 2.1 time: 0.338718 Oct 04 18:21:28.098187 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1876/3740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:28.103858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea4e7db1-d048-4267-b723-50332ddcffbc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008782310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.179735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.188519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a033ee37-8a04-4fb8-8961-c27a4f08fadf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1473 microversion: 2.1 time: 0.294405 Oct 04 18:21:28.189719 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1865/3741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.194821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.195490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.202325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.203231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.204187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.205097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.205751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.206354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.234788 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea4e7db1-d048-4267-b723-50332ddcffbc tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A18%3A21Z" status: 200 len: 6325 microversion: 2.1 time: 0.135111 Oct 04 18:21:28.235376 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1877/3742] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A18%3A21Z => generated 6325 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.257149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4356545b-1285-4a52-b600-b349dee6dd91 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90086d7ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.336502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4356545b-1285-4a52-b600-b349dee6dd91 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-204133108" status: 200 len: 664 microversion: 2.1 time: 0.083124 Oct 04 18:21:28.337095 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1878/3743] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-204133108 => generated 664 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:28.354037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c89926c-125e-44cd-8128-714d13c94bb1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087820d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.419647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c89926c-125e-44cd-8128-714d13c94bb1 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1464 microversion: 2.1 time: 0.070269 Oct 04 18:21:28.426492 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1879/3744] 10.222.0.40 () {58 vars in 1338 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.437098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95622572-df35-44c2-9fba-748a37176b93 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900871e040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.440376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.467183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a300835-c72e-4bd8-9baf-b9ce9cc09949 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.271707 Oct 04 18:21:28.486130 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1866/3745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.512253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95622572-df35-44c2-9fba-748a37176b93 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1464 microversion: 2.1 time: 0.079839 Oct 04 18:21:28.513028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1880/3746] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1464 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:28.530749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6d4c03d9-d887-45f9-9136-a7086e4e652f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900d8a6f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.690393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6d4c03d9-d887-45f9-9136-a7086e4e652f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.163126 Oct 04 18:21:28.691253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1867/3747] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.713302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b06b211-c3ef-4e59-ad93-f1e0e14d01a3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900877a430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.793839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b06b211-c3ef-4e59-ad93-f1e0e14d01a3 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.085490 Oct 04 18:21:28.795063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1881/3748] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.813993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ab82a0e-72f7-433a-bfe9-deab569c7563 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008f0edc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.887283 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ab82a0e-72f7-433a-bfe9-deab569c7563 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6" status: 200 len: 784 microversion: 2.1 time: 0.078187 Oct 04 18:21:28.888799 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1868/3749] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/60bf0052-3cfd-47a4-b26a-71b79179cfa6 => generated 784 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.906002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e3fa1b1-cfb8-4b5e-814a-98bf0f932ce9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90086d7a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.958564 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e3fa1b1-cfb8-4b5e-814a-98bf0f932ce9 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.056499 Oct 04 18:21:28.966788 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1882/3750] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.977519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d006cde-0f42-4dad-b451-b53dc2a87324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9008fe4d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.138359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.139183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.156428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.158084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.158543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.160765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.161253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.161681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.423850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.437338 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8147ed8-b36b-4e50-9af7-c2363925764b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1566 microversion: 2.1 time: 0.308544 Oct 04 18:21:29.438732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1883/3751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1566 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:29.444776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.446360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.457113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.457113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.457113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.460962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.461690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.463522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.687794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.708797 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7228a744-732f-40a2-9b2f-a08410d057e6 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1473 microversion: 2.1 time: 0.268439 Oct 04 18:21:29.717580 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1884/3752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:29.725357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.730518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.744687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.745075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.751429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.751429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.751429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.751429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.901779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca732037-0122-4ddb-85cf-9bf0e5117156 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183976 Oct 04 18:21:29.902386 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1885/3753] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:29.908340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.908925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.916687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.917788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.918422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.919317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.919803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.920412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.214629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.232115 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08e81d84-6720-4319-96b4-791159b2c9fc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.328634 Oct 04 18:21:30.243499 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1886/3754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.316898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf11fc0-b276-405f-8afd-a242fbdf041c", "name": "network-vif-plugged", "status": "completed", "tag": "22b93709-29dd-41b3-84c4-57a1745c154c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:30.330343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.331104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.331636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.347508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] Creating event network-vif-plugged:22b93709-29dd-41b3-84c4-57a1745c154c for instance 0bf11fc0-b276-405f-8afd-a242fbdf041c on n-h1-833090-21 Oct 04 18:21:30.353202 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7c109fa4-cf81-41af-81bb-755fa69cb245 req-1e28dc93-6936-480e-a9b8-dd8b431310e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040884 Oct 04 18:21:30.354027 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1887/3755] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:30.751275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.752172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.763233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.764570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.769178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.770076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.770656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.771780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.984996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.995787 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33a0c966-389c-4e5c-a663-1c8317ed88af tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1473 microversion: 2.1 time: 0.249919 Oct 04 18:21:31.024880 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1888/3756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:31.202748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d006cde-0f42-4dad-b451-b53dc2a87324 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8" status: 204 len: 0 microversion: 2.1 time: 2.229144 Oct 04 18:21:31.203399 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1869/3757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] DELETE /compute/v2.1/images/f5b13e3b-c428-433e-951c-06474303a4e8 => generated 0 bytes in 2231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:31.213598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bf86dbe-031c-421d-9527-6ffd18ef14a5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90087473a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.258489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.259869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.267316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.268211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.268882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.270583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.271943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.272850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.729876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:31.747322 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec38d7e2-e316-424e-8981-58037d53b5c7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1328 microversion: 2.1 time: 0.494402 Oct 04 18:21:31.748008 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1870/3758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:31.831685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fea7f1f-ec85-4666-a060-aef741beed7d", "name": "network-vif-deleted", "tag": "c3466cc5-484c-4678-806f-8fca39c9e119"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:31.846883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.847357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.847844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.875710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] Creating event network-vif-deleted:c3466cc5-484c-4678-806f-8fca39c9e119 for instance 9fea7f1f-ec85-4666-a060-aef741beed7d on n-h2-833090-21 Oct 04 18:21:31.895050 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d64f77f8-4f95-4a32-a45f-97f3432083c7 req-40ea8368-3ad5-431c-9094-5f408c9ce5ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061287 Oct 04 18:21:31.897384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1871/3759] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:32.046671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.047668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.060930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.061583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.062284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.063294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.064665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.065413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.266984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.300138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8638784-4042-4aa4-9799-8985c079418a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 200 len: 1302 microversion: 2.1 time: 0.271239 Oct 04 18:21:32.300750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1872/3760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 1302 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:32.372551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-unplugged", "status": "completed", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:32.387748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.388376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.388820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.409726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] Creating event network-vif-unplugged:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:21:32.417884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-47f1fe87-e75f-42a3-bda8-35e7855d7c09 req-b4d872b1-9f1e-4a90-ad5f-3c9ec90fcd09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050022 Oct 04 18:21:32.419191 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1873/3761] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:32.771924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.772312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.787423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.787957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.788402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.789464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.789777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.790271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.136209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.144894 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70072c06-1285-428d-8ab7-97fd4d4dd8c5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1508 microversion: 2.1 time: 0.378417 Oct 04 18:21:33.145486 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1874/3762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:33.170893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.171559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.192202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.193537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.193537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.194102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.194558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.194994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.302866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bf86dbe-031c-421d-9527-6ffd18ef14a5 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7" status: 204 len: 0 microversion: 2.1 time: 2.093724 Oct 04 18:21:33.307088 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1889/3763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] DELETE /compute/v2.1/images/bfbfd156-9948-4a7f-9942-85476ff5dde7 => generated 0 bytes in 2096 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:33.314414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20819221-1e5a-42d0-965a-3fada938e2b0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900873db80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.589790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.609820 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fbad912-6792-41b1-b3f6-9b3e730482f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1508 microversion: 2.1 time: 0.442825 Oct 04 18:21:33.620380 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1875/3764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:33.630002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.637653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9fea7f1f-ec85-4666-a060-aef741beed7d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.661541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.662568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.665072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.666158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.666491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.675168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.719976 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d HTTP/1.1 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9fea7f1f-ec85-4666-a060-aef741beed7d'} Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:33.726321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 9fea7f1f-ec85-4666-a060-aef741beed7d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:33.731836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-616383b5-984c-44d5-811f-a62c0a37217f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d" status: 404 len: 111 microversion: 2.1 time: 0.105595 Oct 04 18:21:33.733222 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1876/3765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/9fea7f1f-ec85-4666-a060-aef741beed7d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:33.742941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.750300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.761198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.761710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.762162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.762890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.763355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.763819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.874210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:34.320841 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a417d32-0376-47ee-b5af-027dc9a025bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 204 len: 0 microversion: 2.1 time: 0.583995 Oct 04 18:21:34.322243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1877/3766] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:33 2022] DELETE /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:34.331178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.332029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.342154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.342154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.342154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.343375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.344089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.345028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.381380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:34.393613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:34.828742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c423309-fb10-40c3-a9f3-5b2c4f7ce06a tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 204 len: 0 microversion: 2.1 time: 0.503665 Oct 04 18:21:34.831906 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1878/3767] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:34 2022] DELETE /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:34.840243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:34.853567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.854764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.857383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.876369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] Creating event network-changed:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:21:34.885092 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6eebf983-d11a-4d2d-9f8f-21afd07ecc3c req-7ca8760b-1f6b-4bd4-a253-627f66849a1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048809 Oct 04 18:21:34.885519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1879/3768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:34.896583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.897384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.905786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.906288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.906732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.907785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.912225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.912687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.129380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20819221-1e5a-42d0-965a-3fada938e2b0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05" status: 204 len: 0 microversion: 2.1 time: 1.818215 Oct 04 18:21:35.129380 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1890/3769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] DELETE /compute/v2.1/images/c41e0e38-1c56-4827-bee9-527f1831ce05 => generated 0 bytes in 1820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:35.134315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.135022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.157852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.160900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.160900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.160900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.160900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.162140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.168680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:35.205246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:35.207919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.217019 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-283b73e2-8246-40cd-b595-9640b75397de tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1514 microversion: 2.1 time: 0.325585 Oct 04 18:21:35.217606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1880/3770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:35.222909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.223662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.230341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.231131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.231786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.232678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.233303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.233898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.271747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:35.658268 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02e5a1a7-a326-4580-9804-b654b03a8326 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 204 len: 0 microversion: 2.1 time: 0.529174 Oct 04 18:21:35.662776 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1891/3771] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:35 2022] DELETE /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:35.672462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.679690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.692499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.768467 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe56e537-ba6e-4741-be2e-1c2a2b78e29f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 204 len: 0 microversion: 2.1 time: 0.549491 Oct 04 18:21:35.768967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1881/3772] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:35 2022] DELETE /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:35.780811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.781523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.789934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.795746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.795746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.795746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.795746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.795746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.020436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.032568 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc75dcdc-2218-4efc-b5f7-e9bdc57b8187 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1473 microversion: 2.1 time: 0.259217 Oct 04 18:21:36.033157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1882/3773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:36.084905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.093569 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2eeb41e-3c61-4348-bdd0-70025ad5f6fd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1475 microversion: 2.1 time: 0.426572 Oct 04 18:21:36.094479 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1892/3774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:36.244798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.245429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.258547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.259052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.259586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.260578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.261048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.262126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.530038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.542107 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2458cc02-8c8b-4c18-990a-48cf48f18309 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1514 microversion: 2.1 time: 0.300837 Oct 04 18:21:36.543800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1883/3775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:37.057741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.059717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.068584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.069557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.070190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.071242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.071941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.072781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.128609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.130728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.148479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.151755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.151755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.151755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.151755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.151755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.555975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:37.569859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23507ba9-35cc-4586-92ac-82f8f8860fbc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1475 microversion: 2.1 time: 0.453029 Oct 04 18:21:37.573628 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1884/3776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:37.594342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.595546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.603301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.604423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.605119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.606059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.606987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.607695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.684878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:37.701386 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-059d7441-e2d8-49b9-a7e5-ea1b6f0221bb tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1473 microversion: 2.1 time: 0.645425 Oct 04 18:21:37.702645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1893/3777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1473 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.026472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.047953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80fc2f2c-2ce0-43b1-8bcd-dce86d41dc85 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1514 microversion: 2.1 time: 0.457276 Oct 04 18:21:38.050184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1885/3778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1514 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.200444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf11fc0-b276-405f-8afd-a242fbdf041c", "name": "network-vif-deleted", "tag": "22b93709-29dd-41b3-84c4-57a1745c154c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:38.213571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.233559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.234533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.249749 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] Creating event network-vif-deleted:22b93709-29dd-41b3-84c4-57a1745c154c for instance 0bf11fc0-b276-405f-8afd-a242fbdf041c on n-h1-833090-21 Oct 04 18:21:38.255838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3fff16b1-ff72-4a84-ad9a-853e911ca428 req-d030a494-ad75-4637-84bb-5c2a2227566e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059316 Oct 04 18:21:38.257142 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1894/3779] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:38.596915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.598339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.619244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.619772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.622060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.622060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.622060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.622060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.717102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.728715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09688b6a-b24c-43dc-b0cc-03a7fc10d63b tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1433 microversion: 2.1 time: 0.135842 Oct 04 18:21:38.729311 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1886/3780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1433 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.729944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.731576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.792524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.795111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.797210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.803039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.806764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.809991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.881602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e35c19e-c8bc-4983-aca5-1f939605987a", "name": "network-vif-deleted", "tag": "dcde7bce-ccef-4154-b310-cfd59f5995b0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:38.903687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.904429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.905043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.924281 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] Creating event network-vif-deleted:dcde7bce-ccef-4154-b310-cfd59f5995b0 for instance 2e35c19e-c8bc-4983-aca5-1f939605987a on n-h1-833090-21 Oct 04 18:21:38.954718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fc084035-3f44-44ed-bfdd-48658526f790 req-7a3b31e7-7260-4ed3-a82e-49da01a1c0b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077525 Oct 04 18:21:38.957797 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1887/3781] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:39.075107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.075855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.084585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.085008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.089298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.090451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.091131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.092326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.157828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.158530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.159422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.160106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 0bf11fc0-b276-405f-8afd-a242fbdf041c {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:39.286619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:39.322327 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e74f2270-ea7b-4f84-aa3c-bc7614ab560d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 200 len: 1318 microversion: 2.1 time: 0.251765 Oct 04 18:21:39.329734 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1888/3782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:39.756255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.757638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.769407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.769407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.769407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.772674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.774069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.774610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.942344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.951637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.953449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.995932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid 2e35c19e-c8bc-4983-aca5-1f939605987a {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:40.085618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.103583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a108787f-855b-40f9-9274-3d78f59dad50 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1473 microversion: 2.1 time: 1.377114 Oct 04 18:21:40.115194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1895/3783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1473 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:40.115630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.127648 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97c1cb4b-7f8d-4c27-a49f-2d852987b8b9 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 200 len: 1309 microversion: 2.1 time: 0.376948 Oct 04 18:21:40.130888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1889/3784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:40.280414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82add5f-62f5-42fd-a1ae-afa542d1e43f", "name": "network-vif-deleted", "tag": "dddfe0fc-09e7-4564-b15e-9b1fc7107bf1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:40.319781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.321100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.321780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.357139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] Creating event network-vif-deleted:dddfe0fc-09e7-4564-b15e-9b1fc7107bf1 for instance c82add5f-62f5-42fd-a1ae-afa542d1e43f on n-h2-833090-21 Oct 04 18:21:40.357582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.358205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.376752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.378331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.378980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.380687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.381984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.382704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.392023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-406bad11-1cb8-41a1-a9aa-c89764b31ed9 req-a8ff2533-542e-4ac1-b5ac-cbadaa06e6ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101100 Oct 04 18:21:40.404652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1896/3785] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:40.430345 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c HTTP/1.1 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0bf11fc0-b276-405f-8afd-a242fbdf041c'} Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:40.434564 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:21:40.439991 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:40.445775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:40.450257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63dff8e0-bde7-4926-947c-6437a884dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 404 len: 111 microversion: 2.1 time: 0.097335 Oct 04 18:21:40.451765 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1890/3786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:40.463629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c04cc650-de5b-40e7-a377-eb1ec7287ab4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '.version_select at 0x7f900875f4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.652695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c04cc650-de5b-40e7-a377-eb1ec7287ab4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-key-1446658934" status: 202 len: 0 microversion: 2.1 time: 0.194858 Oct 04 18:21:40.673194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1897/3787] 10.222.0.40 () {58 vars in 1209 bytes} [Tue Oct 4 18:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1446658934 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:40.783131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1243788529", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:40.850612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:41.133766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.134526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:41.141861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:41.152468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.154404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.157074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.158843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.163016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.163743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.652307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:41.652973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:41.654743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:41.656173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:41.656599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:41.673194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.673912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.679493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.685302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.686992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.688385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.688534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:41.708999 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-549309b5-44ad-46be-86b9-db8a899f8854 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1473 microversion: 2.1 time: 0.580988 Oct 04 18:21:41.713270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1898/3788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1473 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:41.726664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.733643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 2e35c19e-c8bc-4983-aca5-1f939605987a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:41.735177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:41.751077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.751615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.752069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.752788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.753245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.753669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.753949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:41.795338 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. Oct 04 18:21:41.800915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:41.804304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a HTTP/1.1 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2e35c19e-c8bc-4983-aca5-1f939605987a'} Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:41.818069 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 2e35c19e-c8bc-4983-aca5-1f939605987a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:41.824336 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1dbb967e-ddfe-4326-a7a8-99b6b4788a70 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a" status: 404 len: 111 microversion: 2.1 time: 0.106970 Oct 04 18:21:41.825540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1899/3789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/2e35c19e-c8bc-4983-aca5-1f939605987a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:41.838332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.838971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: c82add5f-62f5-42fd-a1ae-afa542d1e43f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:41.860317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.863292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.863905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.866789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.867369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.867839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.913645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f HTTP/1.1 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c82add5f-62f5-42fd-a1ae-afa542d1e43f'} Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:41.917058 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. Oct 04 18:21:41.923382 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:41.929767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance c82add5f-62f5-42fd-a1ae-afa542d1e43f could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:41.929767 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-134409bd-cbb4-4546-8792-cee5867a8dc2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f" status: 404 len: 111 microversion: 2.1 time: 0.096783 Oct 04 18:21:41.929767 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1900/3790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/c82add5f-62f5-42fd-a1ae-afa542d1e43f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:41.935784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0cbbb44-4357-4882-a4fa-4718c88a0f9c", "name": "network-vif-deleted", "tag": "9acad7a8-f03c-406f-8159-556ecfadc0b2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:41.952269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.958536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.958536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.970883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] Creating event network-vif-deleted:9acad7a8-f03c-406f-8159-556ecfadc0b2 for instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c on n-h2-833090-21 Oct 04 18:21:41.983148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2c4e57d0-35a4-4a13-98eb-7bd6904ae185 req-c03d9421-6f88-47c8-ab77-112f858eafee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054255 Oct 04 18:21:41.983874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1901/3791] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:41.991986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6961fb17-711e-4fda-87f0-0c3091053ebf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.045188 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-772e1a23-64ba-4e8b-95f9-30176103dfd1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265751 Oct 04 18:21:42.045869 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1891/3792] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:42.065544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aca32708-995f-4e61-b1a9-31d04f8d2409 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.067005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aca32708-995f-4e61-b1a9-31d04f8d2409 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.155793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6961fb17-711e-4fda-87f0-0c3091053ebf tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c4660bfc-be0a-43c4-886e-8d64603f422d" status: 204 len: 0 microversion: 2.1 time: 0.170535 Oct 04 18:21:42.159448 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1902/3793] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:21:41 2022] DELETE /compute/v2.1/os-server-groups/c4660bfc-be0a-43c4-886e-8d64603f422d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:42.167882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.168503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.200288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.200806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.203506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.205987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.208272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.209006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.210594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aca32708-995f-4e61-b1a9-31d04f8d2409 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:42.219110 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aca32708-995f-4e61-b1a9-31d04f8d2409 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1209 microversion: 2.1 time: 0.164524 Oct 04 18:21:42.232178 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1892/3794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:42 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:42.290854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:42.739104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-685e8d59-620b-46ff-b1ec-bf7945ebfcf4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 204 len: 0 microversion: 2.1 time: 0.576115 Oct 04 18:21:42.742941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1903/3795] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:42 2022] DELETE /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:42.746874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.747846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.752018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.758182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.766959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:42.768882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.769580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.770182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.771675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.772296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.772884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.780483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.782900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.782900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.782900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.783379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.784226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.823193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.823193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.823193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.823193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lazy-loading 'fault' on Instance uuid e0cbbb44-4357-4882-a4fa-4718c88a0f9c {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:42.841283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:42.872802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:42.892172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33959d4f-9b5d-47be-aa03-e8f286b0af52 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 200 len: 1308 microversion: 2.1 time: 0.157633 Oct 04 18:21:42.909096 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1893/3796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:42 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:43.245095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45573201-6ca9-466b-a215-ae2248b891cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.245724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45573201-6ca9-466b-a215-ae2248b891cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.394544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-45573201-6ca9-466b-a215-ae2248b891cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:43.403191 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45573201-6ca9-466b-a215-ae2248b891cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1209 microversion: 2.1 time: 0.162843 Oct 04 18:21:43.404812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1894/3797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:43.521433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea90e9d1-afae-4b55-88eb-bd54fd4ec265 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 204 len: 0 microversion: 2.1 time: 0.776063 Oct 04 18:21:43.540133 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1904/3798] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:42 2022] DELETE /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 0 bytes in 779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:43.540600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.540600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.548694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.549528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.550146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.551095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.551627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.552063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.573526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:43.920664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.921426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: e0cbbb44-4357-4882-a4fa-4718c88a0f9c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.945970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.946756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.949776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.950798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.951518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.952162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.983055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] HTTP exception thrown: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Request method failure captured: Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c HTTP/1.1 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjskmOyFJBOBHC-J5g7dbgF5NYna-68hHZ22Iknbhwvj2rbE25xQ8eIg5ssrcRNSsORhxeUopb_qBp8CfoTxmpn_hTZyzivxS6BI-leEiGOEwFY1TbFu2ng8oT-xoidgBdPZz9xErxiCHwG_-h8isFq3wkqjYdg-qxhFNvND2Bp5Ug Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: e56daf161e674685a97c23130e286753 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e56daf161e674685a97c23130e286753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e56daf161e674685a97c23130e286753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e56daf161e674685a97c23130e286753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e56daf161e674685a97c23130e286753"}]}] Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: e56daf161e674685a97c23130e286753 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListImageFiltersTestJSON-851459913-project Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 948471454a124638b8c4a3ee800c21de Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListImageFiltersTestJSON-851459913-project Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e0cbbb44-4357-4882-a4fa-4718c88a0f9c'} Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:43.984940 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Returning 404 to user: Instance e0cbbb44-4357-4882-a4fa-4718c88a0f9c could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-470e5e61-368a-437a-8c6c-ec5ee1a3b835 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c" status: 404 len: 111 microversion: 2.1 time: 0.075371 Oct 04 18:21:43.996428 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1905/3799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/e0cbbb44-4357-4882-a4fa-4718c88a0f9c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:44.002936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.003748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.016703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.022784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.022784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.022784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.022784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.022784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.077419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:44.208656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.219818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30bab48d-7286-412c-b2e8-c0d190ac48cc tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1473 microversion: 2.1 time: 0.693162 Oct 04 18:21:44.236539 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1895/3800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1473 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:44.446125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d555e7c8-89cb-4cbf-8da3-b1423f6aad80 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: .version_select at 0x7f9008cbc040>, body: {"keypair": {"name": "tempest-keypair-1844612408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/iJNwmcUGjNcnfYuypPJlfUWJqVRjfZKw9txzMKoVY6GlHtNuky7je7o3rQU0YP8v4Z3NYUz+UvoWvv/tET0TeOllaEBtEd0ZBNXPNnmn2igN5pqXMISwVbmVdcSLtTw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:44.461542 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20ebcc2b-5ac0-472c-bc39-10dbe3c6bc46 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 204 len: 0 microversion: 2.1 time: 0.462646 Oct 04 18:21:44.463283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1906/3801] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:43 2022] DELETE /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:44.467527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d555e7c8-89cb-4cbf-8da3-b1423f6aad80 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:44.470673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.471619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.474440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d555e7c8-89cb-4cbf-8da3-b1423f6aad80 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for user 61ba22151375420182b815277e8bd12c and project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:44.484240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.487648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.488282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.492711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.493433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.494040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.528262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:44.571344 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d555e7c8-89cb-4cbf-8da3-b1423f6aad80 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.333545 Oct 04 18:21:44.572577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1896/3802] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:44.586449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.587678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.595519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.596434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.597068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.597993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.598681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.599526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.632210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.643667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb60eab3-3ac2-41df-8455-d66302c33f24 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1205 microversion: 2.1 time: 0.176857 Oct 04 18:21:44.646616 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1907/3803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1205 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.929322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.946102 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2503934-2508-4003-a3b8-af86c232bf41 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1472 microversion: 2.1 time: 0.372267 Oct 04 18:21:44.946760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1897/3804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:45.244093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.245670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.271893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.271893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.271893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.273979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.276215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.280506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.620186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:45.632972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43d59a1e-bda9-4d80-a857-8856dd1ea65f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1473 microversion: 2.1 time: 0.393140 Oct 04 18:21:45.636255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1908/3805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1473 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:45.670540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.671165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.688312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.692511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.697733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.701949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.703132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.703856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.883685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:45.898228 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2dafa0a-8b5f-4724-bbdd-e02f8deb28f7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1261 microversion: 2.1 time: 0.232851 Oct 04 18:21:45.911493 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1898/3806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:45.980220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.982159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.005852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.010668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.012590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.014022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.018535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.048068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.744438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:46.744438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f423a17f-738c-4fe8-9e07-74a1098e1f9c tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1472 microversion: 2.1 time: 0.613651 Oct 04 18:21:46.744438 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1909/3807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.747346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.831375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:46.842264 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-803c656c-4526-4125-81d0-16aee0ebcf53 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1473 microversion: 2.1 time: 0.179287 Oct 04 18:21:46.852978 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1899/3808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:46 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1473 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.927436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:46.928368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.951527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.957009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.957911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.959002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.977842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.981523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.141964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:47.152285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-738a1515-d58b-4cf2-a963-4974c1452b9f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1261 microversion: 2.1 time: 0.229212 Oct 04 18:21:47.165633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1910/3809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:46 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:47.607845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.613169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.628234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.630240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.630931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.632042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.633691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.637209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.869481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.870089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.893622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.894560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.894560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.895889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.896349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.896771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.241851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.255111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72e2a5e9-0b54-4c52-8e98-90e45e50de35 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1431 microversion: 2.1 time: 0.389967 Oct 04 18:21:48.292906 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1911/3810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1431 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:48.307672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:48.309528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:48.323608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.325997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.328064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.329110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.331258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.331925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.507419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.517860 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14d31dc6-c5f0-4eb3-afc1-67400533dcf0 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1472 microversion: 2.1 time: 0.916357 Oct 04 18:21:48.551988 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1900/3811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1472 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:48.558582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9706fcc5-1764-47bf-8ffe-ffcd06f05fb9", "name": "network-vif-deleted", "tag": "e9ed0ae1-7889-47fd-814b-4d715f149b7e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:48.575955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.576944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.577642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.636821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] Creating event network-vif-deleted:e9ed0ae1-7889-47fd-814b-4d715f149b7e for instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 on n-h1-833090-21 Oct 04 18:21:48.647506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.672065 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae579ee3-10ae-4890-822b-1cbf078430cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1267 microversion: 2.1 time: 0.361611 Oct 04 18:21:48.672065 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1912/3812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:48 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:48.672251 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7bcc17ba-c4c4-498e-be1e-109175220f8f req-b892d1ca-b986-4311-a2e7-69eeba116119 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109946 Oct 04 18:21:48.672251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1901/3813] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:49.300099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.307870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.364241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.364797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.365170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.374553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.375076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.377529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.479283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1200835476", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:49.534227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.537169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.540674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.541537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:49.616262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] validate_networks() for [('1abbd6cd-5909-46c7-b305-5a3f044ecc9d', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:49.653446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:49.678967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8764e7a-2cf2-48e1-bd6e-e1df63056f89 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 200 len: 1308 microversion: 2.1 time: 0.377315 Oct 04 18:21:49.683736 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1902/3814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:49.697826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.701585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.719644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.751558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.751558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.751558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.751558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.751558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.793352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.796950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.797781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.810943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lazy-loading 'fault' on Instance uuid 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:49.885647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948471454a124638b8c4a3ee800c21de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56daf161e674685a97c23130e286753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:49.897288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6e6ed29-9633-47d6-9926-4b01422af156 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 200 len: 1307 microversion: 2.1 time: 0.212002 Oct 04 18:21:49.913039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1903/3815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:49.918840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.919806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.928660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.930093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.930093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.930456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.930922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.931350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.016519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.041115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d34ccfd-3387-45eb-a546-eddfe2888bdc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1267 microversion: 2.1 time: 0.125929 Oct 04 18:21:50.042509 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1904/3816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:50.538712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:50.539212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:50.539724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:50.540201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:50.540798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:50.554527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.555304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.555943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.557056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.557676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.558270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.584228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Getting quotas for project 166adde709d4401786b61bc60cf36cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:50.590574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Getting quotas for user acc8569ee17146e7ad21d3854be0a780 and project 166adde709d4401786b61bc60cf36cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:50.628551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:50.635411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:50.694337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a75ed92-6414-49d9-8d56-0520cfbdb72a", "name": "network-vif-deleted", "tag": "c2544d21-ee20-40ed-9a4c-4f96354638b4"}, {"server_uuid": "6b2221dd-f92f-45c4-b4e5-4b54dcb056ac", "name": "network-vif-deleted", "tag": "34af094d-4304-4c83-a80b-0d62b7c6a7d2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:50.710997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.714360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.714360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.743580 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Creating event network-vif-deleted:c2544d21-ee20-40ed-9a4c-4f96354638b4 for instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a on n-h1-833090-21 Oct 04 18:21:50.743580 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] Creating event network-vif-deleted:34af094d-4304-4c83-a80b-0d62b7c6a7d2 for instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac on n-h2-833090-21 Oct 04 18:21:50.751978 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dacf9698-a8ce-4a0a-8b3a-e2fd2c170661 req-d223aa4c-0bdb-463a-b057-b05b854af51d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061472 Oct 04 18:21:50.753520 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1905/3817] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:50.762003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:50.763046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.770549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.771949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.772321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.776256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49e5585d-d320-4c22-b7af-5274ba208824 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.521862 Oct 04 18:21:50.783707 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1913/3818] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:50.785105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.787261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.790793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.793226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-389b0fea-80c4-4235-a4a7-3c55ad38bae4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:50.798739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-389b0fea-80c4-4235-a4a7-3c55ad38bae4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.837439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 HTTP/1.1 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9706fcc5-1764-47bf-8ffe-ffcd06f05fb9'} Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:50.839227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:50.845031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fb33069-7ab9-41b1-9df4-7f0aa523a46e tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9" status: 404 len: 111 microversion: 2.1 time: 0.089246 Oct 04 18:21:50.847517 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1906/3819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:50 2022] GET /compute/v2.1/servers/9706fcc5-1764-47bf-8ffe-ffcd06f05fb9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:50.855213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:50.856093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.863376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.864633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.865234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.866082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.866656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.868631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.911403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.912169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.912718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.913306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lazy-loading 'fault' on Instance uuid 4a75ed92-6414-49d9-8d56-0520cfbdb72a {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:50.940760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-389b0fea-80c4-4235-a4a7-3c55ad38bae4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.952199 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-389b0fea-80c4-4235-a4a7-3c55ad38bae4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1214 microversion: 2.1 time: 0.166752 Oct 04 18:21:50.971380 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1914/3820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:50 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:50.978768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:50.979506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] [instance: 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.986715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.987998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.998242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.999035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.002231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.002901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.043458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] HTTP exception thrown: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Request method failure captured: Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac HTTP/1.1 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjskmOyFJBOBHC-J5g7dbgF5NYna-68hHZ22Iknbhwvj2rbE25xQ8eIg5ssrcRNSsORhxeUopb_qBp8CfoTxmpn_hTZyzivxS6BI-leEiGOEwFY1TbFu2ng8oT-xoidgBdPZz9xErxiCHwG_-h8isFq3wkqjYdg-qxhFNvND2Bp5Ug Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: e56daf161e674685a97c23130e286753 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e56daf161e674685a97c23130e286753"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e56daf161e674685a97c23130e286753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e56daf161e674685a97c23130e286753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e56daf161e674685a97c23130e286753"}]}] Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: e56daf161e674685a97c23130e286753 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-851459913 Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListImageFiltersTestJSON-851459913-project Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 948471454a124638b8c4a3ee800c21de Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListImageFiltersTestJSON-851459913-project Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6b2221dd-f92f-45c4-b4e5-4b54dcb056ac'} Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:51.045616 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:51.051226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Returning 404 to user: Instance 6b2221dd-f92f-45c4-b4e5-4b54dcb056ac could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:51.054324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39999e78-106b-435d-8aee-0264762ea720 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac" status: 404 len: 111 microversion: 2.1 time: 0.080257 Oct 04 18:21:51.055919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:51.058646 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1915/3821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:50 2022] GET /compute/v2.1/servers/6b2221dd-f92f-45c4-b4e5-4b54dcb056ac => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:51.072644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4849e874-fba2-4c78-beac-7664ca0746d2 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 200 len: 1308 microversion: 2.1 time: 0.216538 Oct 04 18:21:51.072644 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1907/3822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:50 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:51.072925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8881dad8-bd77-40a5-8fbc-b446ea489cf4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f900875f0d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:51.080995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:51.083983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:51.102779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.104869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.106037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.108485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.110393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.111011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.639125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:51.654182 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb37b4d7-c16b-40dc-b64c-294a53ee7fda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.576754 Oct 04 18:21:51.654182 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1908/3823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:51 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:51.866685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-292497965", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb367ab0-1b84-4e69-9b25-7e0823b31694"}], "security_groups": [{"name": "tempest-securitygroup--754664584"}], "key_name": "tempest-keypair-1844612408", "user_data": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:51.900332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:52.158460 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8881dad8-bd77-40a5-8fbc-b446ea489cf4 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290" status: 204 len: 0 microversion: 2.1 time: 1.093257 Oct 04 18:21:52.158460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1916/3824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:51 2022] DELETE /compute/v2.1/images/fccc0a35-cc72-4ca0-8410-f30ef3056290 => generated 0 bytes in 1097 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:52.166823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dec5d2ef-12f5-4101-8c97-549d34acc66b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.171605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dec5d2ef-12f5-4101-8c97-549d34acc66b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:52.242457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dec5d2ef-12f5-4101-8c97-549d34acc66b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:52.255214 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dec5d2ef-12f5-4101-8c97-549d34acc66b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1214 microversion: 2.1 time: 0.098401 Oct 04 18:21:52.259983 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1917/3825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:52.266329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f1b2cf-6216-4d92-a17c-d32de299cfed", "tag": "6cd792f8-cc02-46bf-a6c8-afe4d17d74eb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:52.281592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.282455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.282917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.306825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] Creating event network-changed:6cd792f8-cc02-46bf-a6c8-afe4d17d74eb for instance 99f1b2cf-6216-4d92-a17c-d32de299cfed on n-h2-833090-21 Oct 04 18:21:52.312564 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-87a54bf3-3d94-496b-9db8-ef2b15e4ce18 req-1d6b91c4-936a-4a39-8582-e2c3edecc30a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051246 Oct 04 18:21:52.313471 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1918/3826] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:52.321072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.323688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 4a75ed92-6414-49d9-8d56-0520cfbdb72a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:52.334728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.336265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.339798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.339798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.339798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.339798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.365517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] validate_networks() for [('fb367ab0-1b84-4e69-9b25-7e0823b31694', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:52.373129 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a HTTP/1.1 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4a75ed92-6414-49d9-8d56-0520cfbdb72a'} Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:52.379901 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. Oct 04 18:21:52.384954 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:52.386960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 4a75ed92-6414-49d9-8d56-0520cfbdb72a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:52.388077 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4092663-924e-4da1-a8ad-fd593be088bd tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a" status: 404 len: 111 microversion: 2.1 time: 0.073333 Oct 04 18:21:52.389194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1919/3827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1/servers/4a75ed92-6414-49d9-8d56-0520cfbdb72a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:52.394550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ebd739b-50f0-4b24-9152-f96829eca72f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f90086b0ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:53.041220 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ebd739b-50f0-4b24-9152-f96829eca72f tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84" status: 204 len: 0 microversion: 2.1 time: 0.650655 Oct 04 18:21:53.043360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1920/3828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] DELETE /compute/v2.1/images/3ac93802-febf-41b4-872a-76153806da84 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:53.048547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e37468ce-9ccc-4efe-9634-5c0850abe79d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:53.076742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:53.078307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:53.078307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:53.078307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:53.078633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:53.090788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.091558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.091945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.092803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.093382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.093940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.152952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:53.162498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for user 61ba22151375420182b815277e8bd12c and project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:53.181577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:53.184139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:54.250052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e37468ce-9ccc-4efe-9634-5c0850abe79d tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/38c4bafe-8ec8-432a-ac46-85e4ae613811" status: 204 len: 0 microversion: 2.1 time: 1.205295 Oct 04 18:21:54.251677 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1921/3829] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:21:53 2022] DELETE /compute/v2.1/os-server-groups/38c4bafe-8ec8-432a-ac46-85e4ae613811 => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:54.258707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.268756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.268756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.268756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.270480 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b562cfc-ea68-44f3-a3ab-655f4f4086a7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.405697 Oct 04 18:21:54.270860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.270860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.271051 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1909/3830] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:21:54.271827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.272638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.275601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74d49b38-a38b-43c4-8223-c1d46e7f0277 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] Calling method '.version_select at 0x7f9009043e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.446820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.458923 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04e233a7-c01a-4fe5-b41f-60371fc87eae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.205757 Oct 04 18:21:54.472326 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1922/3831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.484234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.485422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.493482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.499852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.499852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.499852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.499852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.499852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.580912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.593465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7293292-ce63-478a-ae45-b5972cc36f75 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1266 microversion: 2.1 time: 0.119033 Oct 04 18:21:54.594434 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1923/3832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.600226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.600951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.609163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.609879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.610644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.612012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.612910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.613711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.666613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:54.906471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:55.003000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39833f4d-7546-4948-9f58-3b47fc763b0f tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "DELETE /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 204 len: 0 microversion: 2.1 time: 0.406728 Oct 04 18:21:55.004019 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1924/3833] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:54 2022] DELETE /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:55.012728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3dd3f516-1c16-47df-b920-1a7e7d0f1278 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.013708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3dd3f516-1c16-47df-b920-1a7e7d0f1278 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.015591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74d49b38-a38b-43c4-8223-c1d46e7f0277 tempest-ListImageFiltersTestJSON-851459913 tempest-ListImageFiltersTestJSON-851459913-project] 10.222.0.40 "DELETE /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7" status: 204 len: 0 microversion: 2.1 time: 0.744171 Oct 04 18:21:55.017484 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1910/3834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] DELETE /compute/v2.1/images/36fbe926-853c-4131-896a-4d40e92880d7 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:55.023984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.024750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.041202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.041706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.042156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.042876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.043410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.043868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.118309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3dd3f516-1c16-47df-b920-1a7e7d0f1278 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.127814 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3dd3f516-1c16-47df-b920-1a7e7d0f1278 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1237 microversion: 2.1 time: 0.121447 Oct 04 18:21:55.129956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1925/3835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.257290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.266524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3518986-f5a5-4ed9-8281-3a5a18baaf17 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1471 microversion: 2.1 time: 0.247632 Oct 04 18:21:55.267194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1911/3836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.485567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.486174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.504981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.505944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.506538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.507434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.508086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.508672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.623809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.623809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.633930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.635188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.635696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.638919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.639689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.640413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.674882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.684071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ddb8de51-6f96-435a-a13b-c4c3a3bc123c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.202336 Oct 04 18:21:55.685227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1926/3837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.783033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:55.820353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d4e3c55-703e-419d-947c-26115336c401 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1274 microversion: 2.1 time: 0.206128 Oct 04 18:21:55.824399 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1912/3838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:56.152023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.152543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.159777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.160254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.160682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.161360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.161806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.162221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.249151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.266217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6cc0c6d-53d9-455a-bb40-79be7b816ade tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1241 microversion: 2.1 time: 0.117957 Oct 04 18:21:56.268966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1927/3839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.291284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.292552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.299903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.300417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.304741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.306090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.306778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.307223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.568840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.581098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddf2d50f-b5ed-430e-8ceb-91d1562f07c7 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1471 microversion: 2.1 time: 0.294053 Oct 04 18:21:56.582561 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1913/3840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.708077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.709341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.716426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.717014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.717454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.718168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.718826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.719288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.850170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:56.855975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:56.862020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.867424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.867424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.869071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:56.869697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:56.870139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.963983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.973971 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bf83a406-ec9d-4116-a98c-1b130ff0285b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1284 microversion: 2.1 time: 0.130405 Oct 04 18:21:56.975028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1914/3841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.061206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:57.072827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5fa21b0b-441f-4d72-9843-5bf26f75c83f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.368621 Oct 04 18:21:57.074269 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1928/3842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:56 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.299367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.304130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.323556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.325547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.327991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.335020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.338563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.338563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.427980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:57.431753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:57.442186 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f01acc3-61bf-44b8-8cce-66b88a4e71dd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1289 microversion: 2.1 time: 0.152169 Oct 04 18:21:57.461640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1915/3843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1289 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.605556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461c164b-77d5-4f3b-a945-f1cac32068cf", "name": "network-vif-deleted", "tag": "6c0a5864-8d92-4700-ac6f-895c320d25ad"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:57.606477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.607362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.620406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.622435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.623073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.624979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.628316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.629395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.632212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.634930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.635955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.642062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] Creating event network-vif-deleted:6c0a5864-8d92-4700-ac6f-895c320d25ad for instance 461c164b-77d5-4f3b-a945-f1cac32068cf on n-h1-833090-21 Oct 04 18:21:57.649396 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-47ff389b-c49f-4700-8c78-9eea7fe306c1 req-b10fcbf7-b7db-4b3f-87de-7a7e04545d6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049055 Oct 04 18:21:57.653831 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1929/3844] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:57.852275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Calling method '.version_select at 0x7f90086c3af0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.885175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.888806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.889474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.896666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.897168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.897612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.962159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a17b088-3532-435b-a017-bb922db99422 tempest-AbsoluteLimitsTestJSON-96109063 tempest-AbsoluteLimitsTestJSON-96109063-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.304953 Oct 04 18:21:57.975489 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1930/3845] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:58.009005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.011803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.024998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.025746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.028152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.031176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.035516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.035516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.311710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acce90eaa6974937bde6fcbff439564e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2d1f7ec8ed4c0a9f2cfad334c46fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.315260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.323740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddfd017d-e9df-49ca-9cf8-4872b955dce4 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 200 len: 1429 microversion: 2.1 time: 0.721126 Oct 04 18:21:58.326180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1916/3846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 1429 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:58.327765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-033beedc-3ed3-4733-8f36-fa38e5e83afb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.333113 Oct 04 18:21:58.329634 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1931/3847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.345646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.345646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.375404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.377210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.378543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.381067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.384319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.385148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.473090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.473789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.484894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.485659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.486302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.487026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.487618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.488817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.493808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:58.592980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.608400 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-952b6974-fa16-415c-940d-c98708fbaa0b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1295 microversion: 2.1 time: 0.140126 Oct 04 18:21:58.624006 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1932/3848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.728777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.737154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9f8139b-1391-412c-a7e3-65ccc289232f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.409604 Oct 04 18:21:58.737772 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1917/3849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:59.346972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.348805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] [instance: 461c164b-77d5-4f3b-a945-f1cac32068cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.360817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.364707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.364853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.364853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.365044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.371590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.372165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.372620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.372749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.373263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.373821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.375705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.377074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.377868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.408098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] HTTP exception thrown: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Request method failure captured: Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf HTTP/1.1 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHjksRwBxdl1MvYEXPbKJ2LkZdRHubZPcENnrdc-_MUOKcex1fRQKwAPtBmWHfHlU_nYia2xI7OJzouns5UFdzrfQAOe53yO2NhxClPOFOyXNc-aMy91-4ze51jo9HGHC7wItnhvnpU-oF8OnhoePLe8S2HgYyjhvkDTNBC0BE3vK1E Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0a2d1f7ec8ed4c0a9f2cfad334c46fcc"}]}] Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 0a2d1f7ec8ed4c0a9f2cfad334c46fcc Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1556550421 Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acce90eaa6974937bde6fcbff439564e Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersOnMultiNodesTest-1556550421-project Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '461c164b-77d5-4f3b-a945-f1cac32068cf'} Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:59.410795 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] Returning 404 to user: Instance 461c164b-77d5-4f3b-a945-f1cac32068cf could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:59.417414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72baa916-dab9-4433-b507-4c494a7fd410 tempest-ServersOnMultiNodesTest-1556550421 tempest-ServersOnMultiNodesTest-1556550421-project] 10.222.0.40 "GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf" status: 404 len: 111 microversion: 2.1 time: 0.069795 Oct 04 18:21:59.421556 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1933/3850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/461c164b-77d5-4f3b-a945-f1cac32068cf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:59.430996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f1b2cf-6216-4d92-a17c-d32de299cfed", "name": "network-vif-plugged", "status": "completed", "tag": "6cd792f8-cc02-46bf-a6c8-afe4d17d74eb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:59.465195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.465845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.466436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.488375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] Creating event network-vif-plugged:6cd792f8-cc02-46bf-a6c8-afe4d17d74eb for instance 99f1b2cf-6216-4d92-a17c-d32de299cfed on n-h2-833090-21 Oct 04 18:21:59.505823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e2d76342-ac78-4a9b-9e71-ac887bd5d3d3 req-cf18a30c-b8aa-43bf-9201-ac95a2747601 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082374 Oct 04 18:21:59.507804 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1934/3851] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:59.633959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.634670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.648576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.649079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.649523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.651651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.653298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.653298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.741409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.750199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4892278-af2c-4b84-bfb8-3d73b70391ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.395817 Oct 04 18:21:59.753107 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1918/3852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:59.766859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.768004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.781024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.782390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.784005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.786554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.787271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.787914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.036522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.044745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5934ff7d-e1e5-4f6a-9ec8-7aa74ed36d1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.284127 Oct 04 18:22:00.045466 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1919/3853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:00.115102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.123434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-424b7c93-7e6f-466e-92be-9cc17de33c42 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.494681 Oct 04 18:22:00.124044 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1935/3854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:00.496623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c2405e-8790-47cb-9a5c-1172fc5e6f6a", "tag": "cff4017b-b279-46a6-85ca-920ecbfc37fa"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:00.508413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.508931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.509389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.521401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] Creating event network-changed:cff4017b-b279-46a6-85ca-920ecbfc37fa for instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a on n-h1-833090-21 Oct 04 18:22:00.527114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ffab152f-9b4b-4b55-b63e-e4f062136c1e req-badd15df-d67f-44c7-8aa9-20cfd55cee3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034630 Oct 04 18:22:00.528306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1920/3855] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:00.777587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.778838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.789102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.789959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.790576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.791644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.792270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.792859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.978616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.988383 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ebf2969-0689-489c-aabb-c438ee615284 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.214951 Oct 04 18:22:00.995130 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1936/3856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:01.071915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.073438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.081124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.082228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.082916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.083866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.084584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.085151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.102319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ccd2e23-0a15-47c2-a277-53cc3673b681", "tag": "3ac3b8cc-8457-4127-8c60-26c31552cff5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:01.121231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.127890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.127890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.447417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] Creating event network-changed:3ac3b8cc-8457-4127-8c60-26c31552cff5 for instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 on n-h2-833090-21 Oct 04 18:22:01.454828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-30192a48-e547-456e-a43a-832a3585cc74 req-50ba15b7-6251-412d-aabb-dacd4afcbe45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356400 Oct 04 18:22:01.456766 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1937/3857] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:01.460122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.466604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.468806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45b6d53b-f88e-4157-a830-bcfba7ef6d8d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1309 microversion: 2.1 time: 0.403525 Oct 04 18:22:01.469462 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1921/3858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:01.471934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.477858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.478499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.479147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.480003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.480692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.481337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.649816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.657932 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d38d340e-2872-4fa0-923a-96957b26891f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.199376 Oct 04 18:22:01.658507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1938/3859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.013772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.014452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.022742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.023256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.023778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.024699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.025170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.025595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.167942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.181562 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e21eef5a-6ed7-4c82-acfb-cca0036dc8b9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.171693 Oct 04 18:22:02.196261 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1922/3860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.494806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.495627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.502839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.503411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.504508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.505239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.505883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.506324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.670497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.680165 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4716da82-2fa1-41bc-a6fd-f8529004d80d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1490 microversion: 2.1 time: 0.189538 Oct 04 18:22:02.681014 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1939/3861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1490 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.686555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.689263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.699723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.700249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.700719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.701454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.701941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.702743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.833730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1243788529", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:02.863422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.873067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1fe3800-5143-4e34-9574-e846bc0facad tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.191710 Oct 04 18:22:02.875502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1923/3862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.918055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:03.208685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.209403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.212375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:03.213075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=20 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:03.218071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.218692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.219188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.220006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.220538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.221024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.368480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:03.376519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb3bfc38-04e9-42b1-b3af-bc2949ac9282 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.172826 Oct 04 18:22:03.377108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1924/3863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:03.454642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:03.457729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:03.457729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:03.457729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:03.458454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:03.474211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.475321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.476307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.483756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.483756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.483756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.496921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:03.503123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:03.516168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:03.518502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:03.803332 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6221fd5-e5c9-4c66-8904-e71b24841046 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976178 Oct 04 18:22:03.804601 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1940/3864] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:03.816539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa78b248-4d42-4be4-9d6f-a6155c8766ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.817165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa78b248-4d42-4be4-9d6f-a6155c8766ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.826731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:03.876769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa78b248-4d42-4be4-9d6f-a6155c8766ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:03.885186 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa78b248-4d42-4be4-9d6f-a6155c8766ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1209 microversion: 2.1 time: 0.073433 Oct 04 18:22:03.885762 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1925/3865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1209 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:03.896100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.897034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.903888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.904380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.904992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.905527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.905975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.906396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.120154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.131282 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-072f759b-7a3a-42dd-a399-14b844cb9c02 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.239059 Oct 04 18:22:04.132242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1941/3866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:04.407584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.408894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.422338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.424751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.424751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.426706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.427509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.428773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.643741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.653632 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4112e5e3-1824-4c58-8d42-c22f530d9448 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.253274 Oct 04 18:22:04.667504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1926/3867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:04.910967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-edde50b0-9efe-4c9f-ae96-e1be2a7e603e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.911591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-edde50b0-9efe-4c9f-ae96-e1be2a7e603e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.986452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-edde50b0-9efe-4c9f-ae96-e1be2a7e603e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.996701 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-edde50b0-9efe-4c9f-ae96-e1be2a7e603e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1209 microversion: 2.1 time: 0.091863 Oct 04 18:22:04.997579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1942/3868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.154617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.156244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.179701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.181154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.182154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.183144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.183858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.184506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.416820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.425488 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a5798ef-3571-4628-9b23-02f32e47e727 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.274826 Oct 04 18:22:05.426155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1927/3869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.683773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.683773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.686824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.687506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.687942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.688767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.689279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.689791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.963053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.989384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea8b4dc0-5c64-4e81-9e19-a004ceb89b63 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.314957 Oct 04 18:22:05.993234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1943/3870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.029025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.030127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.045003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.045537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.047999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.048933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.049427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.049901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.214004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.226246 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6a285f6-c4a3-49ac-9ef7-f3957618a279 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1261 microversion: 2.1 time: 0.207409 Oct 04 18:22:06.227654 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1928/3871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.450671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.451288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.466593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.467952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.468573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.470408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.471112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.473706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.852656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c2405e-8790-47cb-9a5c-1172fc5e6f6a", "name": "network-vif-plugged", "status": "completed", "tag": "cff4017b-b279-46a6-85ca-920ecbfc37fa"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:06.884576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.886802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.888172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.923871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] Creating event network-vif-plugged:cff4017b-b279-46a6-85ca-920ecbfc37fa for instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a on n-h1-833090-21 Oct 04 18:22:06.944033 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4bb1665b-4aa5-4d9d-afde-af5769002430 req-eb02a17b-1d72-4fcf-8ab0-758f9081a9ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095785 Oct 04 18:22:06.945059 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1929/3872] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:07.020456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.021536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.031621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.032745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.033646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.036286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.036953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.037632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.435899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.449990 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab413d4d-cc33-471b-b024-15187ef53ae0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.436433 Oct 04 18:22:07.451622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1930/3873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.462659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.467156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.481184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.484407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.486858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.488839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.489989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.495189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.624480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.652252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e52a958-0f67-428b-a728-2ce1ca0cab17 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1269 microversion: 2.1 time: 0.197168 Oct 04 18:22:07.653967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1931/3874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.693461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.712346 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82a6f50f-596c-412e-8ef8-0348e7d8209f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 1.265809 Oct 04 18:22:07.715026 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1944/3875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:08.005720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a5e8de-6c81-4773-8586-ce9820d39649"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:08.013337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.052643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.058195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.059946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.062923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.063856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.064338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.484042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.484921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.506245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.507061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.507748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.508650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.509282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.509976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.004929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.012921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b39f026-83e8-4b9a-9b4d-325bd32780b6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1314 microversion: 2.1 time: 0.533770 Oct 04 18:22:09.025554 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1945/3876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.036428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.037241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.046485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.187823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.198811 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fab5aeb6-fc35-44df-9b70-249afeb042ba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1267 microversion: 2.1 time: 0.171699 Oct 04 18:22:09.204657 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1946/3877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.216664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.217275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.223776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.224378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.224827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.225800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.226261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.226696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.417994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-193bcea5-98e5-4cad-991b-097f5457635a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.416186 Oct 04 18:22:09.425913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1932/3878] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:22:08 2022] POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 194 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:09.972612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.006754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c73d055-2460-4a18-8ec6-31198d9f95d5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 0.791208 Oct 04 18:22:10.010863 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1947/3879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.042517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.043403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.062123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.063076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.063763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.068106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.068106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.068106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.107182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:10.224917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.226219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.234734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.241079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.241924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.242900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.243620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.244298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.838764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.850750 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15e6ea74-2e2c-4dcd-9c87-5a07e2ac29fa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1500 microversion: 2.1 time: 0.813518 Oct 04 18:22:10.854634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1933/3880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1500 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.865061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccd2e23-0a15-47c2-a277-53cc3673b681", "name": "network-vif-plugged", "status": "completed", "tag": "3ac3b8cc-8457-4127-8c60-26c31552cff5"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:10.893007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.894539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.895936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.921035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] Creating event network-vif-plugged:3ac3b8cc-8457-4127-8c60-26c31552cff5 for instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 on n-h2-833090-21 Oct 04 18:22:10.933736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c72572a8-6889-49e3-aa06-08f6d03a015a req-cf1cda3f-91a8-401a-83ef-4d456d809fc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077398 Oct 04 18:22:10.935974 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1934/3881] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:10.950560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:10.954894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.976595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.976595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.979745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.988751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.989775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.990510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.071714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lazy-loading 'flavor' on Instance uuid d2c2405e-8790-47cb-9a5c-1172fc5e6f6a {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:11.220521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.238185 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f445a247-64e3-4569-80da-1307007cc1ac tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 1.016476 Oct 04 18:22:11.238800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1948/3882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:11.247262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.248486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.265703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.266521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.267170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.268144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.269400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.270654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.524956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5fa8e3e1-1cf7-4d63-baf5-05b97b30d488 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "POST /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a/action" status: 200 len: 32 microversion: 2.1 time: 0.585886 Oct 04 18:22:11.526195 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1935/3883] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:10 2022] POST /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a/action => generated 32 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:22:11.536662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.544355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.552074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.552844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.555104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.556091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.558330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.562615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.093207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.103123 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d9bd8ea-a9eb-4857-827e-61664f83e4c0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.571236 Oct 04 18:22:12.103757 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1936/3884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.264646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.267950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.322158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.325843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.327512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.328538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.330409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.332559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.672926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.693735 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-acae0c78-2973-4739-bf0b-4f055fa3736e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1362 microversion: 2.1 time: 1.453373 Oct 04 18:22:12.694505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1949/3885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1362 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.791751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.803415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ececcd77-9679-49d3-9795-38960c8c6dda tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.545306 Oct 04 18:22:12.809363 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1937/3886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:13.136003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:13.141682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:13.155192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.161403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.162550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.183792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.190715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.192257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.488441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:13.721442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:13.722756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:13.746900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.747457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.753467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.753467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.754415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.754616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.206943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.229234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2eaac0d-2ec8-48a9-8fe4-24c9233fc230 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1549 microversion: 2.1 time: 0.512450 Oct 04 18:22:14.234987 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1938/3887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:13 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1549 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:14.250971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.252441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.278501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.279027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.279505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.280356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.280828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.300564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.643230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.659623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51bac559-a091-4c4f-8540-246cbc01c03b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.422861 Oct 04 18:22:14.660836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1939/3888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.666378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.667057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.676044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.676759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.677450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.679779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.679779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.680310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.698459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.718717 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c7fec72-1f6b-4dd8-938f-6848b0e4f52e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 1.595725 Oct 04 18:22:14.724195 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1950/3889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:13 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.891832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7840af99-9aef-43ff-9499-9492c7ff8a65 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229582 Oct 04 18:22:14.892932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1940/3890] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:15.630505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a7305f-8145-4149-82e3-06372b73b34a", "tag": "da3f386b-5cca-4048-8b6d-4ffdf66e6fb1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:15.635411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=22 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:15.677879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.680577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.684051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.687457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:15.697023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.697872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.721914 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] Creating event network-changed:da3f386b-5cca-4048-8b6d-4ffdf66e6fb1 for instance 05a7305f-8145-4149-82e3-06372b73b34a on n-h1-833090-21 Oct 04 18:22:15.729159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5659d534-ed6d-47d9-8993-f12e9af28b8d req-983efe17-4282-47d9-99fc-c20cecacea33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109922 Oct 04 18:22:15.738264 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1951/3891] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:15.751682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.755672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.761306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.764813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.766345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.770493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.773343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.774271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.784027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.784865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.786206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.788715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.789411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.790337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.290797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.302035 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38b2648f-9243-4d5c-9826-4bddce2a9a1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.557381 Oct 04 18:22:16.310310 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1952/3892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:16.974540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91b35942-f23e-4bb6-81b2-4b963c591596 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f900adceaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1075065530", "description": "tempest-description-212273697"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:17.370882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.384524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29fe6135-6623-4d6d-b850-4bfceb9ced2d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 1.698925 Oct 04 18:22:17.385129 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1941/3893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.404303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.404926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.420612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.421115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.421537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.422243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.422716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.423174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.632684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.641596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a693946-5875-4485-bfe6-7763b7429f8d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.255436 Oct 04 18:22:17.642526 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1942/3894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.671420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91b35942-f23e-4bb6-81b2-4b963c591596 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.359371 Oct 04 18:22:17.671803 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1953/3895] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:17.686420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b28f9385-6535-47ce-a2ac-3f83faa6d2f4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008b49160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-87308922", "description": "tempest-description-2037346794"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:18.369632 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b28f9385-6535-47ce-a2ac-3f83faa6d2f4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.687662 Oct 04 18:22:18.370531 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1943/3896] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:17 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:18.411214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.411939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.426981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.429546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.430167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.432585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.434117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.443755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.463960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2113707199", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "27950f4b-8cef-4dd4-ba30-965db96a573a"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:18.563909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:18.618770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] validate_networks() for [('27950f4b-8cef-4dd4-ba30-965db96a573a', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:18.835312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.844052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6a8a009-5a63-4fac-b5f6-a894a345b3dc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.440107 Oct 04 18:22:18.844643 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1954/3897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:18.886370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ccd2e23-0a15-47c2-a277-53cc3673b681", "tag": "3ac3b8cc-8457-4127-8c60-26c31552cff5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:18.934827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.935318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.935828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.962262 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] Creating event network-changed:3ac3b8cc-8457-4127-8c60-26c31552cff5 for instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 on n-h2-833090-21 Oct 04 18:22:18.974063 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-704b5bf1-2d75-45a8-943f-235b5f8ad70e req-022cc776-57ff-478c-b687-47a9ed45d02c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115738 Oct 04 18:22:18.983860 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1955/3898] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:19.003395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:19.004407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:19.067887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.068388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.068838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.069624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.070083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.070509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.750406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:19.751007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:19.751363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:19.752013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:19.753204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:19.773906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.780588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.781063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.781937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.782350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.782784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.853786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Getting quotas for project 7b00849668db4b0481d259fc4fceb449. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:19.879518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Getting quotas for user 0ef65b403d7c46fcbc2de208ba792f65 and project 7b00849668db4b0481d259fc4fceb449. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:19.922195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:19.930074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:20.218982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.220190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7eb40a5-cd65-44d0-80e6-2eeb32996284 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758761 Oct 04 18:22:20.223504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1944/3899] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:22:20.236391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:20.240140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:20.242392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b3588ac-929c-4e6c-b2a8-fdc3eccb738d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 1.254893 Oct 04 18:22:20.243962 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1956/3900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:20.250816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.252204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.252931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.254076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.254772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.255698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.277081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46436d27-4459-49bb-80eb-8b02a3a12af2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:20.277729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46436d27-4459-49bb-80eb-8b02a3a12af2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:20.380385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46436d27-4459-49bb-80eb-8b02a3a12af2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.392302 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46436d27-4459-49bb-80eb-8b02a3a12af2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1216 microversion: 2.1 time: 0.134321 Oct 04 18:22:20.416249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1957/3901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:20 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:20.569071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.581935 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88914484-74d1-4260-97aa-8db704b3ad27 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.354953 Oct 04 18:22:20.585070 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1945/3902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:20 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.268779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.269587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.280868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.281710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.284271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.285307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.289068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.289824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.425850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0b60753-9864-4ddf-8992-153ab1d09749 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.427948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0b60753-9864-4ddf-8992-153ab1d09749 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.494515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0b60753-9864-4ddf-8992-153ab1d09749 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.517995 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0b60753-9864-4ddf-8992-153ab1d09749 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1216 microversion: 2.1 time: 0.090580 Oct 04 18:22:21.521306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1946/3903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.610210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.610836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.644991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.645251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.645549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.646276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.646742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.647179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.954165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.954729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.965695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b83c3f71-d5f0-42a6-8fb0-aff672721bf0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.700376 Oct 04 18:22:21.967255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1958/3904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.972258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50546845-1fd8-4289-87cc-ad1215d4a724 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.366694 Oct 04 18:22:21.973698 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1947/3905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:22.540328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:22.540942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:22.572824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.575056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.575759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.577572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:22.579217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:22.579921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.715282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:22.727444 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1f562a9-f3ea-47a5-a4b1-66901e6622fe tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1212 microversion: 2.1 time: 0.191176 Oct 04 18:22:22.740191 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1959/3906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1212 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:22.998487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:23.001467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:23.003361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:23.004321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:23.022544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.023046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.025342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.026597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.027363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.028299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.029412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.047697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.048145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.054090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.055281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.056590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.509710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.523731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a776d398-36e7-4e98-99b2-ff029d71716a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.532223 Oct 04 18:22:23.525173 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1948/3907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:23.788472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.799310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c12b240f-5c8e-4d58-a349-7fee9895b3d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.806891 Oct 04 18:22:23.803666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1960/3908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:22 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:23.812734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:23.815799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:23.826127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.828883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.831332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.832399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.833134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.835040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.937953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.947882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7014a21-8f9b-4143-90d0-d5710a031a51 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1276 microversion: 2.1 time: 0.142762 Oct 04 18:22:23.953026 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1961/3909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:23 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:24.005962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.007174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.014750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.015571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.016226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.017208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.018431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.019101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.053275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:24.481045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afd47219-25f7-41cb-aa2b-1bd2b6c0f861 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 204 len: 0 microversion: 2.42 time: 0.781142 Oct 04 18:22:24.493924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1949/3910] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:22:23 2022] DELETE /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:22:24.494841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.495544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.502612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:24.515406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.515964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.519842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.520432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.522352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.524538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.552035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.552995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.571806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.574106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.586036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.596773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.597609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.598340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.617547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:24.923351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:24.936135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5eb687d8-6d51-4c01-bb73-8d5606a57934 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.389888 Oct 04 18:22:24.949375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1950/3911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:24 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:24.949375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.949375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.949375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.949375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.950936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.951898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.952523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.953636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.242548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.255124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8263ed40-8413-4a4b-9c92-ad9f6b9723fa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.315003 Oct 04 18:22:25.256083 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1951/3912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:24 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:25.272451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:25.274611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.288325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.407669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.421472 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9614635-2d3e-467e-be3e-d38c307d8ac2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1274 microversion: 2.1 time: 0.164112 Oct 04 18:22:25.422059 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1952/3913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:25 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:25.435754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.453181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.459150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.460519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72ac8e70-b5e8-45a0-8b6b-22a89fb42407 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2960 microversion: 2.42 time: 0.970503 Oct 04 18:22:25.462125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1962/3914] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:24 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2960 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:25.960785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:25.964165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:25.985019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:25.997161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:25.997999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.998983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.000081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.000772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.221796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.240285 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ef42b77-4c98-4d31-9119-163218d040d3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.283488 Oct 04 18:22:26.242554 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1953/3915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:25 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:26.284688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:26.286615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.300596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.301484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.302437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.304794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.309048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.310248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.449388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:26.450637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.469729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.470589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.471037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.471864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.472338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.472782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.818218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.836813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1d1d97bd-a705-447e-be24-e54cfe03dbe1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.553975 Oct 04 18:22:26.838729 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1963/3916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:26 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:26.856198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:26.857305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.877216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.878172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.878876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.886361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.887240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.888374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:26.923293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:26.934298 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95e103ba-bf8e-4337-8473-cf01f207da86 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.490250 Oct 04 18:22:26.971940 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1954/3917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:26 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:26.980962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:26.985665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:26.994519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:26.995496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:26.996277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.000527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.002200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.009366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.072188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'flavor' on Instance uuid d63f2343-aed1-4433-af22-4ed046448951 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:27.383668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.402143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.409726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:27.415256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5bd92fa4-336f-4379-9cea-d560d4b30603 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2960 microversion: 2.42 time: 0.573405 Oct 04 18:22:27.418768 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1964/3918] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:26 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2960 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:27.432484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:27.435735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:27.447477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.453635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.455743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.460836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.461784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.462342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.643335 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cdefad9-8697-46d7-a4d1-821b82474688 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/action" status: 200 len: 32 microversion: 2.1 time: 0.667441 Oct 04 18:22:27.652082 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1955/3919] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:26 2022] POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/action => generated 32 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:22:27.659364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a7305f-8145-4149-82e3-06372b73b34a", "name": "network-vif-plugged", "status": "completed", "tag": "da3f386b-5cca-4048-8b6d-4ffdf66e6fb1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:27.724495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.725029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.725665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.752650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] Creating event network-vif-plugged:da3f386b-5cca-4048-8b6d-4ffdf66e6fb1 for instance 05a7305f-8145-4149-82e3-06372b73b34a on n-h1-833090-21 Oct 04 18:22:27.759379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1da20e40-c6d1-474c-9c0d-9479e5107200 req-cda6b0eb-8813-4bb8-84a8-58b028135c1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112510 Oct 04 18:22:27.766598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1956/3920] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:27.811208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:27.822840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:27.841243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.843263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.844059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.845047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.846282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.846932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.383083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.392736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb456ada-d720-4245-a7b0-5b5487e99025 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.624058 Oct 04 18:22:28.408575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1957/3921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:27 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:28.418958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.419828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.427190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.428115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.431630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.431630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.431630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.431630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.869998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.884581 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-11aeb2c7-3648-4d1d-8d78-ce4502906472 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.472296 Oct 04 18:22:28.885584 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1958/3922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:28.900299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.901468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.919391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.920424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.921263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.922179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.922834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.924137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.313010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.329610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c30d4a0-0147-420e-81e3-d9c0bef8c12f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 1.909581 Oct 04 18:22:29.343230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.349982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1965/3923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:27 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:29.355848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d432df31-3127-4909-b224-932ceade2722 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.466736 Oct 04 18:22:29.362284 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1959/3924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:29.372559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.375355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.397446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.398089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.398990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.400406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.401890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.404763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.424602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.425961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.441106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.446501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.447547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.449700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.451888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.452865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.749983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.760326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98ee4a3c-9934-4617-9881-9b2bce532795 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.339849 Oct 04 18:22:29.780548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1960/3925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:29.832478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.846234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.848280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:29.852484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d0d8447-02a5-442f-89db-096ac1133020 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2960 microversion: 2.42 time: 0.500547 Oct 04 18:22:29.853341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1966/3926] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2960 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:29.910406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.911368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.920960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:29.924036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.927072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.927952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.930382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.930851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.931287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.263880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8917363-196a-4e17-8692-8b5037368479 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Action: 'create', calling method: .version_select at 0x7f9008cb4160>, body: {"keypair": {"name": "tempest-keypair-470861174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzUM0ScleHjuswv8ym7CPyq3ETPKSTKH8BWiXsT++zOYJ13TnCpGzf1n9b9q0ZiBtexxFcKKBbxCSXHhDPJkXAsDVnLvkuk0j4VrD+lwR4NmkG0/Fj9DXEsBvSO23NxfQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:30.282300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f8917363-196a-4e17-8692-8b5037368479 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for project 99f694a0007f4d199b37149b4309a1bb. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:30.289419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f8917363-196a-4e17-8692-8b5037368479 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for user ad04482fd46b4291afa5a2ec32f050d3 and project 99f694a0007f4d199b37149b4309a1bb. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:30.448501 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8917363-196a-4e17-8692-8b5037368479 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.431627 Oct 04 18:22:30.448501 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1967/3927] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:22:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:30.454882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d661115e-e189-4515-b158-5745d1a17508", "tag": "676431ff-0760-4fc7-a5ca-c3d3e9c20722"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:30.469186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.469981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.471796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.488823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] Creating event network-changed:676431ff-0760-4fc7-a5ca-c3d3e9c20722 for instance d661115e-e189-4515-b158-5745d1a17508 on n-h1-833090-21 Oct 04 18:22:30.496291 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-406f2ea4-a170-4967-b6bd-efa5ce524fab req-02d31a30-a9f5-4527-b31a-9cc692bebb7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048693 Oct 04 18:22:30.497628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1968/3928] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:30.503232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:30.504352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:30.512934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.514552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.515380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.516880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.517644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.518320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.784636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.802543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc71f4c0-bba9-428d-9ac6-656d9b2156cb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1309 microversion: 2.1 time: 0.887655 Oct 04 18:22:30.803494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1961/3929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1309 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:30.808770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:30.811074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:30.827512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.828386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.829169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.830671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:30.832694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:30.833424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.103800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.120120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-644cefc8-13a8-4066-b53d-cc0f978dd55d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.620834 Oct 04 18:22:31.144864 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1969/3930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:30 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.150358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.151287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.158759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.159612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.160231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.161196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.161823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.162422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.236739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.251121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b377fc5c-2b7e-4e4b-925a-9f23cf09b83c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.445464 Oct 04 18:22:31.252708 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1962/3931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:30 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.259736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.260812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.269789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.270713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.271523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.272523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.273398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.274075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.507496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:31.540432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.558913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7df7a903-cd7c-455f-8e79-eb9f6479974a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.412390 Oct 04 18:22:31.563146 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1970/3932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.662789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.683054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.686054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.687876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-662ad1eb-5d41-4ce7-bc01-de53ac63c134 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2939 microversion: 2.42 time: 0.433778 Oct 04 18:22:31.688546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1963/3933] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2939 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:31.828151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.828869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.835164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.835709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.836182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.836884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.837342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.837768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.007086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.023527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-09499761-aac8-450d-a572-f626c0774ac1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1489 microversion: 2.1 time: 0.196790 Oct 04 18:22:32.024171 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1971/3934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1489 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.055182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.057188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.066937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.067985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.068658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.069933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.070646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.071351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.150811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.151994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.165293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.165890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.166733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.169481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.170191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.170808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.379700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.387959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aff43b04-3dcb-46c2-95a4-80bf5bd49ae6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.241100 Oct 04 18:22:32.388633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1972/3935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.393407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.394207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.394959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.409494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.409703 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9135e205-023f-461e-a0ff-10cf83e6e7d0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1490 microversion: 2.1 time: 0.365927 Oct 04 18:22:32.410474 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1964/3936] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1490 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.412014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.412484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.413210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.413890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.414332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.438266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.439215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.449692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:32.452399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.453074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.453797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.455860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.456902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.457711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.481238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:32.801421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.815034 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d1994d2-55c8-4269-b6d9-2dd516fbbe24 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.425208 Oct 04 18:22:32.818271 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1973/3937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.827159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.831974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.851647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.852432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.854194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.855244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.856910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.857709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.883577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.894520 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c33b2473-9891-46bc-8342-e233f22e6a80 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1489 microversion: 2.1 time: 0.461890 Oct 04 18:22:32.896547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1965/3938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1489 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:32.910607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.910848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:32.911437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.926284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.928762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.929573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.930631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.931316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.932009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.365579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.371960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.393926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-482ab40f-86ea-4a85-aa1e-8289665a4596 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.574450 Oct 04 18:22:33.401266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.406536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1974/3939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:33.411413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.423149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-unplugged", "status": "completed", "tag": "0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:33.425848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89a9a2d4-c696-43e3-8839-bdd05fb38f9c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2871 microversion: 2.42 time: 0.522490 Oct 04 18:22:33.440941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1966/3940] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2871 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:33.458769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-deleted", "tag": "da05b590-9ea7-43df-b119-25810d130950"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:33.478309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.479091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.481603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.489286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.490090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.490721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.516008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] Creating event network-vif-unplugged:0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:33.535187 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] Creating event network-vif-deleted:da05b590-9ea7-43df-b119-25810d130950 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:33.543668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-315be4bd-e519-4354-aff1-786f47d31166 req-632e48a6-b5bb-4c8f-8e1a-5be0f9a99fe8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132951 Oct 04 18:22:33.548941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1975/3941] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:33.554224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-aa2ec396-7484-488a-b409-5e96cd8e26da req-7772e22d-3def-42b3-8d65-d539edf8476b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111658 Oct 04 18:22:33.560455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:33.562693 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1967/3942] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:33.587749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:33.588105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:33.595642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:33.613670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.616209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.618841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.620070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.623175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.629042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.629202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.629202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.629202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.629202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.634023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.634818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.681680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:33.889647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:33.898594 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfe9afdf-c1c2-482b-8c37-775be6b76c91 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.334282 Oct 04 18:22:33.901435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1968/3943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:33 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:33.906161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:33.906770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:33.920890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.925237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.925237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.925237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.925237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.925237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.216880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbf72504-cca3-4b01-85fb-9c24cabf4ca1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 204 len: 0 microversion: 2.1 time: 0.665676 Oct 04 18:22:34.218209 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1976/3944] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:33 2022] DELETE /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:34.228087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.229296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.242796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.244238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.248245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.249132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.249812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.252501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.298209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.312521 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58f64bfd-d729-45e4-9825-3d6742515262 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.409922 Oct 04 18:22:34.318672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1969/3945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:33 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:34.421920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.422753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.441511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.444061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.445142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.445986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.450875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.452045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.910048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.922311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa48c674-a7b6-4822-aade-67650486688a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1495 microversion: 2.1 time: 0.699429 Oct 04 18:22:34.943881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1977/3946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1495 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:34.959948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.960899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.971317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.972278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.975919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.980785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.980785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.980785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.031715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.043712 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36819326-e732-4bc8-a616-2c9f9db802d7 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.626154 Oct 04 18:22:35.047577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1970/3947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:35.061726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.062864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.071199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.072957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.073881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.074948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.075682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.076334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.357526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.368209 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7194def4-54cb-4696-8e26-75a152be4623 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.319185 Oct 04 18:22:35.369461 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1971/3948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:35.376845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.377828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.400758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.401265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.401707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.402483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.402951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.403378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.474707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.489556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.491299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.493392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1608a18-768e-4be0-92d4-3a92967ef6b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2710 microversion: 2.42 time: 0.545374 Oct 04 18:22:35.494481 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1978/3949] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2710 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:35.593328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-unplugged", "status": "completed", "tag": "c11c9b08-6d87-4862-bf57-e7ac95c6ddf0"}, {"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-unplugged", "status": "completed", "tag": "6001a711-fff4-4bb3-aa13-e6ffbf0fddf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:35.606476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.618152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.618152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.622226 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Creating event network-vif-unplugged:c11c9b08-6d87-4862-bf57-e7ac95c6ddf0 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:35.623281 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] Creating event network-vif-unplugged:6001a711-fff4-4bb3-aa13-e6ffbf0fddf6 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:35.630043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-314036ef-99db-4a11-9a3c-f0a7eca002e3 req-7f43e9da-ea81-4f2d-80b1-7795ed17f57c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.040924 Oct 04 18:22:35.635852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1979/3950] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:35.645836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-deleted", "tag": "83497e6e-55ee-4018-94b0-070a178c6b69"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:35.657351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.658329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.658654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.672900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] Creating event network-vif-deleted:83497e6e-55ee-4018-94b0-070a178c6b69 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:35.678741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6bbc928e-648f-4b8b-9f7c-e9df700ccee0 req-458397f4-db47-4210-9186-d67c1f2babbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Oct 04 18:22:35.679876 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1980/3951] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:35.827166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.838861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab248657-e1fd-4b32-ad6f-188ab9fbe010 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.466959 Oct 04 18:22:35.838861 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1972/3952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:35.953591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.954868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.970862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.970862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.971990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.974634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.975438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.976187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.076045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.076900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.091750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.094638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.095360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.096482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.097118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.098689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.744490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.755318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:36.756424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-229fc798-a860-49e1-ab54-07381e0d2bad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1495 microversion: 2.1 time: 0.807194 Oct 04 18:22:36.757032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1981/3953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1495 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:36.768837 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23b5111d-8ac4-456f-9563-b23d3eca022b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.696436 Oct 04 18:22:36.769459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1973/3954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:36.770880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.771789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.777200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.780269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.788815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.794912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.795405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.799933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.801093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.801754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.802511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.070395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.082439 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1aab0e00-9319-4b5b-8e58-f3b9609acbab tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.323834 Oct 04 18:22:37.084089 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1982/3955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:37.089597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:37.090434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:37.106615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.107272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.107864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.108776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.109288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.109822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.134205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.148766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.150283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.151643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b3da58d-97b1-4cfa-8ea6-e7b74768628d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 2459 microversion: 2.42 time: 0.381135 Oct 04 18:22:37.152271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1974/3956] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 2459 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:37.159865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2013917231", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "063809de-19b2-4d41-aac9-41553db13d6b"}], "security_groups": [{"name": "tempest-securitygroup--133622505"}], "key_name": "tempest-keypair-470861174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:37.478658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.488041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce25756f-d8b2-4a47-9013-388f9e3c77a2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.402461 Oct 04 18:22:37.504248 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1983/3957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:37 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:37.512280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a7305f-8145-4149-82e3-06372b73b34a", "name": "network-vif-deleted", "tag": "da3f386b-5cca-4048-8b6d-4ffdf66e6fb1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:37.525782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.526585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.527547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.541737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] Creating event network-vif-deleted:da3f386b-5cca-4048-8b6d-4ffdf66e6fb1 for instance 05a7305f-8145-4149-82e3-06372b73b34a on n-h1-833090-21 Oct 04 18:22:37.548644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7508a93a-1ef9-446b-84dd-ad770f90c45d req-ed436e69-4a71-4b36-9a40-a2af2b444efc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041791 Oct 04 18:22:37.549897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1984/3958] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:37.573328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] validate_networks() for [('063809de-19b2-4d41-aac9-41553db13d6b', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:37.676433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d661115e-e189-4515-b158-5745d1a17508", "name": "network-vif-plugged", "status": "completed", "tag": "676431ff-0760-4fc7-a5ca-c3d3e9c20722"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:37.694407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.698378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.699141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.717002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] Creating event network-vif-plugged:676431ff-0760-4fc7-a5ca-c3d3e9c20722 for instance d661115e-e189-4515-b158-5745d1a17508 on n-h1-833090-21 Oct 04 18:22:37.725969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f39abdca-b891-427c-ab91-3c21574935c8 req-b5bb1b2a-ac8d-488e-bcff-b992b3be0ce4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054523 Oct 04 18:22:37.727307 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1985/3959] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:37.736744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-deleted", "tag": "6001a711-fff4-4bb3-aa13-e6ffbf0fddf6"}, {"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-deleted", "tag": "c11c9b08-6d87-4862-bf57-e7ac95c6ddf0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:37.749484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.751667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.752388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.774035 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Creating event network-vif-deleted:6001a711-fff4-4bb3-aa13-e6ffbf0fddf6 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:37.775424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] Creating event network-vif-deleted:c11c9b08-6d87-4862-bf57-e7ac95c6ddf0 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:37.781681 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6ed2b7b9-fa96-4fdc-bac4-535a1ac0739b req-1f563da3-385f-451f-b7fa-9f87f3b80989 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052444 Oct 04 18:22:37.783929 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1986/3960] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:37.790567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:37.793242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:37.801057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.801931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.802623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.808469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:37.808963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:37.809413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.097765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.111944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65ff397f-2cbd-4286-a3da-ef5b2378df96 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1294 microversion: 2.1 time: 0.326281 Oct 04 18:22:38.115366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1987/3961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:37 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1294 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:38.127089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.140366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.159236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.164897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.164897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.164897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.164897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.164897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.490037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.515141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91fb69b8-117a-41c9-81e8-f6e6ff96f583 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.398185 Oct 04 18:22:38.515936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1988/3962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:38.521665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:38.522171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.522286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:38.522820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:38.523227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.525374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:38.525374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:38.543660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.543875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.544484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.544780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.545247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.545665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.546543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.546830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.547454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.548703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.548858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.550274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.589680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for project 99f694a0007f4d199b37149b4309a1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:38.616004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for user ad04482fd46b4291afa5a2ec32f050d3 and project 99f694a0007f4d199b37149b4309a1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:38.640531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:38.643500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:38.805940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.816083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b77560ee-9ee8-4323-8bd3-8f49af1d000e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.298676 Oct 04 18:22:38.816692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1989/3963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:38.840826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.843744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.852956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.853955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.855168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.856252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.858891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.859685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.909974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c24d2c6-d8d1-4113-8598-22a85a35faa4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.756067 Oct 04 18:22:38.917836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1975/3964] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:38.930539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.932995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.946733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.947747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.948426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.949470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.950821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.952152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.032981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.048489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.048489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.048489 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fca623ff-3b51-453b-8560-d9a72d058d3f tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.230205 Oct 04 18:22:39.051134 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1990/3965] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:39.078576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9fb29953-b9f6-475e-bb1a-f24bb8e306e4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.079297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9fb29953-b9f6-475e-bb1a-f24bb8e306e4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.143624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9fb29953-b9f6-475e-bb1a-f24bb8e306e4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.152894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9fb29953-b9f6-475e-bb1a-f24bb8e306e4 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1241 microversion: 2.1 time: 0.086671 Oct 04 18:22:39.153486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1991/3966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.169472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.170402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.179278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.181835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.182548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.183483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.184117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.184755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.250254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.251956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.253263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.255449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 05a7305f-8145-4149-82e3-06372b73b34a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:39.325629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.335849 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3630b2e-c3f1-4338-a70b-607bdf65faca tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1316 microversion: 2.1 time: 0.416493 Oct 04 18:22:39.337137 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1976/3967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.370240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.622189 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92ac30b0-6336-4500-90ca-6edae6ac4264 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 200 len: 1299 microversion: 2.1 time: 0.230053 Oct 04 18:22:39.622189 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1992/3968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.627576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.780383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.807884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f8508d0-4b7a-4afb-920d-e72d33c58c27 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.270549 Oct 04 18:22:39.810070 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1977/3969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.843577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.844303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.851991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.851991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.851991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.852568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.853026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.853452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.948612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c16af-5905-4251-8f8d-2178c3ed3335", "name": "network-vif-deleted", "tag": "0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:39.961703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.962466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.963075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.985854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] Creating event network-vif-deleted:0d1afc0b-f8b6-4c60-aad2-f3db48ec6e48 for instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 on n-h2-833090-21 Oct 04 18:22:39.991863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-94f4ec0f-8400-4023-bcce-6f2ec93630f1 req-5d2b71f6-1967-4d14-9e25-eb606e4bca4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048603 Oct 04 18:22:39.993167 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1978/3970] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:40.058746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.061494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:40.069108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d32a3e5-97d4-4f9a-b1e4-7dd8132c6f78 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.229383 Oct 04 18:22:40.070324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1993/3971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:40.080233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.081306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.090354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.090997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.091442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.092332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.092918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.093647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.180727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a74b562c-a572-4792-82bf-ec88eb614982 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.182485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a74b562c-a572-4792-82bf-ec88eb614982 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.184335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.199819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.201284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.202744 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbe23f72-d042-43e1-94d9-51675abebfaf tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.127021 Oct 04 18:22:40.203938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1979/3972] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:40.273763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a74b562c-a572-4792-82bf-ec88eb614982 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.284212 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a74b562c-a572-4792-82bf-ec88eb614982 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1241 microversion: 2.1 time: 0.107793 Oct 04 18:22:40.284879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1994/3973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:40.360117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.361620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.368001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.368843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.369485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.370421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.371088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.371745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.414782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.415398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.424022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.424717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.426244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.427159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.427737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.428171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.442449 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a HTTP/1.1 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '05a7305f-8145-4149-82e3-06372b73b34a'} Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:40.444153 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d153c10e-cd9e-4d17-a466-fbd56013adc0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 404 len: 111 microversion: 2.1 time: 0.034849 Oct 04 18:22:40.451412 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1995/3974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:22:40.456077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:40.456572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.474790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.475285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.475744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.483269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.483991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.484572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.533244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:40.577887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.586999 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-009249fd-828e-4af7-a0a1-05d89266eb66 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1505 microversion: 2.1 time: 0.230549 Oct 04 18:22:40.587952 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1980/3975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:40 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:40.612769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1075065530"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:40.613444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:40.620603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.621108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.621580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.622502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:40.622989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:40.623395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:40.772537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Adding security group f0261661-ce89-456d-8066-21e39e87b085 to port 676431ff-0760-4fc7-a5ca-c3d3e9c20722 Oct 04 18:22:41.070099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9df4bc2f-7f48-4dcf-bff4-cba12ff7d3a7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 204 len: 0 microversion: 2.1 time: 0.617618 Oct 04 18:22:41.072090 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1996/3976] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:40 2022] DELETE /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:41.081310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.082940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.097096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.098491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.100342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.101294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.102003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.102749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.255370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b118506-18f5-4240-b0af-ef71663af675 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/action" status: 202 len: 0 microversion: 2.1 time: 0.642395 Oct 04 18:22:41.255370 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1981/3977] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:40 2022] POST /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:22:41.257156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.259450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.281534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.282841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.283294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.284055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.284509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.285099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.290996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.301085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfb64739-6861-4627-a7d1-b4af78e99a53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.226825 Oct 04 18:22:41.302346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1997/3978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:41.307479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.308355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.314176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:41.316141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.317051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.317683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.318592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.319234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.319884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.510688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.532214 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7ce85d9-0c4e-44d5-a4b0-f53d44182ac2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.227619 Oct 04 18:22:41.543500 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1998/3979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:41.543500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.543500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.577173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.578476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.581145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.582709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.587186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.587875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.757624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.771192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.773249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.775092 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0970fed2-ef7f-4e72-94fe-07cbf33cde1a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.239033 Oct 04 18:22:41.776156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 1999/3980] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:41.782629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-87308922"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:41.783330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.792192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.792779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.793275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.797512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.797512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.797512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.844035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.853532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b3c4868-9133-4682-9f98-002242c713a1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1496 microversion: 2.1 time: 0.600111 Oct 04 18:22:41.854727 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1982/3981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1496 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:41.859622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.860899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.869343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.869343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.869343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.870271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.871062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.872280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.938344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:41.946437 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af87b13d-f19a-4914-9910-bb07aef32bf6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1245 microversion: 2.1 time: 0.090264 Oct 04 18:22:41.947256 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1983/3982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:41.956385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.network.security_group_api [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Adding security group e792f86b-31ef-4d07-b550-aeeb94d9f491 to port 676431ff-0760-4fc7-a5ca-c3d3e9c20722 Oct 04 18:22:42.007141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d661115e-e189-4515-b158-5745d1a17508", "tag": "676431ff-0760-4fc7-a5ca-c3d3e9c20722"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:42.018848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.019259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.019878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.034226 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] Creating event network-changed:676431ff-0760-4fc7-a5ca-c3d3e9c20722 for instance d661115e-e189-4515-b158-5745d1a17508 on n-h1-833090-21 Oct 04 18:22:42.039763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-33f1fddf-0d2b-4bbf-bf7f-b7978fa786bc req-8ebca2fe-ff89-4228-aca7-0d0154671196 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036219 Oct 04 18:22:42.044154 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1984/3983] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:42.330701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.331328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:42.340482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.342177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.343129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.344099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.345523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.346189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.354304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:42.567768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.577006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa7f8939-3bf7-4f86-90b1-c160434f617c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.251626 Oct 04 18:22:42.588596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1a4da779-b3c5-4e44-82fc-add7a17b9b4a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/action" status: 202 len: 0 microversion: 2.1 time: 0.810886 Oct 04 18:22:42.590512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2000/3984] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:41 2022] POST /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:42.592281 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1985/3985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:42.601893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.604497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:42.609767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.613103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:42.629362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.629874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.630321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.631134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.631661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.636532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.651648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.657049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.659659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.666780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.667544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.669786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.106186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.119042 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecf5d820-ea63-4230-a510-16c9876947ef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1506 microversion: 2.1 time: 0.524037 Oct 04 18:22:43.122262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2001/3986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.133586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d661115e-e189-4515-b158-5745d1a17508", "tag": "676431ff-0760-4fc7-a5ca-c3d3e9c20722"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:43.159553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.160045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.160543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.215365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] Creating event network-changed:676431ff-0760-4fc7-a5ca-c3d3e9c20722 for instance d661115e-e189-4515-b158-5745d1a17508 on n-h1-833090-21 Oct 04 18:22:43.239227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7fb3d665-7848-4290-8a1f-14a3a0b8a582 req-0355805d-cb42-4b0a-9c28-8fa407be8638 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110717 Oct 04 18:22:43.239869 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2002/3987] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:43.247513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.249864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.268203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.268307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.268770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.269484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.274588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.275118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.437660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.453932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.455534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.459325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b56659b4-5a6e-4dd5-81a7-2338a03ec1b9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.215429 Oct 04 18:22:43.473177 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2003/3988] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:43.488438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.495503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.506098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.506968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.507423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.508166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.508619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.509048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.664170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d7108b6-318a-4ebd-8a31-18f59349a8c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.065520 Oct 04 18:22:43.665332 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1986/3989] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508/os-security-groups => generated 1156 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.670583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.671409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.682596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.697688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.699180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.700419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.701104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.701801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.773476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.784551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af7748b1-5ba5-4ba9-8a9a-835ef8b39ef3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1496 microversion: 2.1 time: 0.309713 Oct 04 18:22:43.788164 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2004/3990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1496 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.803952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.804627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.819288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.819889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.820457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.821230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.821689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.824576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.865502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.875167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02d2beca-01e9-4a7f-87da-c398a4fafeed tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1293 microversion: 2.1 time: 0.208513 Oct 04 18:22:43.878401 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1987/3991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.890916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04960386-8b69-4c95-8289-b9aa99952bf8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008b03280>, body: {"security_group": {"name": " tempest-securitygroup -1320610015 ", "description": "tempest-description-797170137"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:44.139854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.159261 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45dd7087-3e71-40ca-9546-fe28fa7a17dc tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.369882 Oct 04 18:22:44.177682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2005/3992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:44.187625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f1b2cf-6216-4d92-a17c-d32de299cfed", "name": "network-vif-deleted", "tag": "6cd792f8-cc02-46bf-a6c8-afe4d17d74eb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:44.207402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.208284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.209322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.228339 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] Creating event network-vif-deleted:6cd792f8-cc02-46bf-a6c8-afe4d17d74eb for instance 99f1b2cf-6216-4d92-a17c-d32de299cfed on n-h2-833090-21 Oct 04 18:22:44.238825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f756f6c1-9527-44cb-b5f3-300f0ec338f0 req-16b732c4-d0de-4f99-91bc-a9e9a8784953 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059302 Oct 04 18:22:44.240159 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2006/3993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:44.246727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.247951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.255882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.256734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.257387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.258490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.259217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.260246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.690408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.707066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6d2bade-cd72-412a-990e-937066ac6929 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1486 microversion: 2.1 time: 0.462289 Oct 04 18:22:44.708224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2007/3994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1486 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:44.715100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.715899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.725497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.725497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.725497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.725497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.726121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.726639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.861336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04960386-8b69-4c95-8289-b9aa99952bf8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.981339 Oct 04 18:22:44.862230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1988/3995] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:43 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:44.867947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.868592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.881612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.882001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.882448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.883165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.883667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.884100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.974183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:44.987505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.988013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.991000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.991499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 99f1b2cf-6216-4d92-a17c-d32de299cfed {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:45.002392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.004477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.005963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4b1c3ea-0f04-4632-a36c-a52230fd6e25 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.296677 Oct 04 18:22:45.006971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2008/3996] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:45.020666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6d39d14-a86d-41e8-9cc9-06724986ec36 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009764280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.112832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.124414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b50d1829-bb94-4fb2-9586-72e9f33a88e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 200 len: 1299 microversion: 2.1 time: 0.260965 Oct 04 18:22:45.158486 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1989/3997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:45.169520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.172050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:45.181924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.184694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.185726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.186875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.188856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.192193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.196581 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6d39d14-a86d-41e8-9cc9-06724986ec36 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04" status: 200 len: 223 microversion: 2.1 time: 0.188302 Oct 04 18:22:45.197182 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2009/3998] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 => generated 223 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:45.203297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-960776326", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:45.282472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] validate_networks() for [('1abbd6cd-5909-46c7-b305-5a3f044ecc9d', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:45.296749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.306788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a350325-e42d-4528-bea1-3432bf6fb61c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1299 microversion: 2.1 time: 0.144776 Oct 04 18:22:45.307729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1990/3999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:45.314993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.316116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:45.323100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.323629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.324062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.324787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.326250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.326250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.597788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.611949 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3158d3c-51fc-442f-b00f-99d92e5d5dfb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.302477 Oct 04 18:22:45.613120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1991/4000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:45 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:45.624686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97d6e3a3-89fb-4899-8ec6-7751ac75b904 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008a988b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:45.793222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:45.797343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:45.797343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:45.797343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:45.797343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:45.816400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.817315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.818861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.820111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:45.820830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:45.821655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.852998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Getting quotas for project 166adde709d4401786b61bc60cf36cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:45.862899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Getting quotas for user acc8569ee17146e7ad21d3854be0a780 and project 166adde709d4401786b61bc60cf36cc7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:45.894705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:45.897595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:46.058783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a3ab51b-f4b0-4b40-b04c-c97428c766dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.859704 Oct 04 18:22:46.060222 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2010/4001] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:46.066982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.067691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.075763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.076381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.076822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.077770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.078356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.078812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.116122 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97d6e3a3-89fb-4899-8ec6-7751ac75b904 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04" status: 202 len: 0 microversion: 2.1 time: 0.501168 Oct 04 18:22:46.117334 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1992/4002] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:22:45 2022] DELETE /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:46.124086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73a805c5-0a2c-4b44-8f85-b1894efcea64 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.124861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73a805c5-0a2c-4b44-8f85-b1894efcea64 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.175036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.189279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.192035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.193873 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fdfdb123-bfb8-491a-a6d0-28130f99b75a tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.132419 Oct 04 18:22:46.195112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2011/4003] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:46.200811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008782790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.230577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:22:46.230577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group ddb083c8-b48c-4008-953a-d53351dc4c04 not found {{(pid=123887) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:22:46.230946 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.230946 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 HTTP/1.1 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ddb083c8-b48c-4008-953a-d53351dc4c04'} Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:22:46.233066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-1cf226ec-a3c8-4e02-999e-a3761ef9a96d'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:46.236960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d8aafd3-859f-41cd-9afe-bfbb59587d87 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04" status: 404 len: 194 microversion: 2.1 time: 0.038520 Oct 04 18:22:46.245055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2012/4004] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:46.245055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.245654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.253438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.253940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.255255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.256202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.256718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.257212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.277521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed HTTP/1.1 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '99f1b2cf-6216-4d92-a17c-d32de299cfed'} Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:46.279308 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7c93a86-4f9b-46a9-95bf-34ac706c9ef8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 404 len: 111 microversion: 2.1 time: 0.042550 Oct 04 18:22:46.285493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2013/4005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:46.299595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57117bf8-9d55-4f89-a597-892da1af9e5b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008782790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-160467564", "description": "tempest-description-1863074974"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:46.323823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73a805c5-0a2c-4b44-8f85-b1894efcea64 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.345252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73a805c5-0a2c-4b44-8f85-b1894efcea64 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1213 microversion: 2.1 time: 0.215797 Oct 04 18:22:46.353543 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1993/4006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1213 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:46.373678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.373678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.408264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.790301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.802470 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-261f8d2f-3284-42be-8d6a-85e243e0f27f tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.447732 Oct 04 18:22:46.805003 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1994/4007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:46.810405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2138811556", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:46.836791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57117bf8-9d55-4f89-a597-892da1af9e5b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.552747 Oct 04 18:22:46.839322 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2014/4008] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:46.842923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.844097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.861088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.861576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.864718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.867672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.869457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.869904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.893347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:47.117955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.127850 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-035e5dac-960b-4cc7-82e7-952c9b00ae87 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.289375 Oct 04 18:22:47.128455 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2015/4009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:47.136149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9bb725f4-35c2-442d-a902-98a9bdd8b47f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008782c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-560301302", "description": "tempest-description-792304414"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:47.433058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:47.433587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:47.434094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:47.434390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:47.434749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:47.454271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.454760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.455375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.456269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.457015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.458041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.481406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:47.489192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:47.504841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:47.508122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:47.585736 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9bb725f4-35c2-442d-a902-98a9bdd8b47f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.455973 Oct 04 18:22:47.586535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2016/4010] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:47.591294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.591941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.620071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.620875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.622666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.622666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.623159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.623802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.652493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:47.705011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.715066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.716699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.717937 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9d4619a-da74-49b5-a580-48d05c310bcc tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.130337 Oct 04 18:22:47.719900 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2017/4011] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:47.725105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.725791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.732590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.733174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.733692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.734463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.735560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.736071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.806125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.814689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8d9dd0b-84b2-4d72-b31e-cb24bf9ccf24 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1217 microversion: 2.1 time: 0.093450 Oct 04 18:22:47.815624 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2018/4012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:47.820750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ed1d56-1198-415d-8105-db61feda4e15", "tag": "fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:47.831744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.832265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.832703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.853079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] Creating event network-changed:fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90 for instance e8ed1d56-1198-415d-8105-db61feda4e15 on n-h2-833090-21 Oct 04 18:22:47.862593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2f09faf-7462-4d7b-b305-a3ffaef310cc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057564 Oct 04 18:22:47.863601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1995/4013] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:47.868211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b31f143d-50fa-45b6-97f9-f8055734192c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008aad5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-471796655", "description": "tempest-description-529307693"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:47.876196 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-45c6371a-7d08-4ab8-a3c6-f572b256d4ad req-4b9cb62a-811f-4971-a5e0-c44ca83fd6fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059297 Oct 04 18:22:47.882506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2019/4014] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:47.890391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.891354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.903523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.904412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.905330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.906251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.907458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.908229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.136298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.146349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca9ff878-761f-47ce-a748-54fdf2f7b922 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.263556 Oct 04 18:22:48.148896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2020/4015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:48.155241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be1bb0c5-9809-42c1-bc7a-66d57320105d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.156088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be1bb0c5-9809-42c1-bc7a-66d57320105d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.221022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be1bb0c5-9809-42c1-bc7a-66d57320105d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.223671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=17 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:48.229779 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be1bb0c5-9809-42c1-bc7a-66d57320105d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1209 microversion: 2.1 time: 0.079566 Oct 04 18:22:48.230418 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2021/4016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:48.236774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.236774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.243145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.243885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.244295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.246619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.247918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.248362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.412840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.421815 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92b3afd6-efc3-45b9-8d87-d52d0a2fc8a8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.190250 Oct 04 18:22:48.422493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2022/4017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:48.745905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.746508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.755061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.756232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.758089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.758089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.758415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.758835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.828040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.837734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.839196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.840581 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f26f0bca-b810-45bb-884d-991dc4c37ae9 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.098828 Oct 04 18:22:48.841345 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2023/4018] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:48.845698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.846317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.853430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.854157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.854608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.855408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.860361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.861054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.950329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:48.958972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97ba00ca-9c93-449b-9f95-765ba67c7906 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1209 microversion: 2.1 time: 0.116766 Oct 04 18:22:48.959603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2024/4019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:48.981283 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b31f143d-50fa-45b6-97f9-f8055734192c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.116542 Oct 04 18:22:48.982184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1996/4020] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:49.002979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f95eb8a-a93a-4350-9c44-9df09bdb9832 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90096ba430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.173294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.174575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.181407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.181898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.184053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.184053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.184053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.184663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.240704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f95eb8a-a93a-4350-9c44-9df09bdb9832 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.242459 Oct 04 18:22:49.241323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2025/4021] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:49.255203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-280bc083-9373-4556-8629-1e1563562dae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.255858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-280bc083-9373-4556-8629-1e1563562dae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.335296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-280bc083-9373-4556-8629-1e1563562dae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.347208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-280bc083-9373-4556-8629-1e1563562dae tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1209 microversion: 2.1 time: 0.095997 Oct 04 18:22:49.363507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2026/4022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:49.363507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18d8153e-612a-4d42-a58f-cd6b8cec291d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90099920d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.405976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.418965 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0fc5c28-e45c-4b6d-9f26-23ae94287167 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.249827 Oct 04 18:22:49.420290 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1997/4023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:49.445267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.446614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.475698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.480308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.481055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.482130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.482941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.483650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.692517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.702052 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a562c2ce-b897-447d-ba0f-e1b70f80a4ac tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.260686 Oct 04 18:22:49.702645 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1998/4024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:49.804204 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18d8153e-612a-4d42-a58f-cd6b8cec291d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408" status: 202 len: 0 microversion: 2.1 time: 0.454780 Oct 04 18:22:49.808162 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2027/4025] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:22:49 2022] DELETE /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:49.813972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008b031f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.842934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:22:49.843562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:22:49.844121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.844121 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408 HTTP/1.1 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6a19c0c2-84ca-4a8e-9184-f3502a07c408'} Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:22:49.847397 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0c30b6d0-d619-4c4c-9dc2-70571626a0fd'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-809fd778-7ca8-45de-acbb-204a1b176f0d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408" status: 404 len: 194 microversion: 2.1 time: 0.039701 Oct 04 18:22:49.851304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 1999/4026] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:49.859525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0aad236-fbc2-4d46-8914-748fecb94504 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f900adce9d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.875203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.878104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.885666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.886242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.886863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.887875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.889498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.890668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.966626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.976401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.977853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.979584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b9186d7-28c9-4ad5-8a09-dbff986723aa tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.110903 Oct 04 18:22:49.980778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2000/4027] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:49.986503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.987705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.999963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.001355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.002132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.004265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.005095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.005755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.082066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.089937 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3c2a51a-4e3c-4148-ad6b-cc9e8ba1c4d7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1209 microversion: 2.1 time: 0.107794 Oct 04 18:22:50.090514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2001/4028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.138257 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0aad236-fbc2-4d46-8914-748fecb94504 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc" status: 202 len: 0 microversion: 2.1 time: 0.282687 Oct 04 18:22:50.138855 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2028/4029] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:22:49 2022] DELETE /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:22:50.147644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008aad280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.191095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:22:50.192161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:22:50.192318 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.192318 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc HTTP/1.1 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc'} Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:22:50.198289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:22:50.201303 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-ce2d01d4-f8cd-4f70-abdf-94210fd9e5cb'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:50.206812 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3bb05a4-eb53-4c0e-89ad-87956cbc7fb8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc" status: 404 len: 194 microversion: 2.1 time: 0.058354 Oct 04 18:22:50.206812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2002/4030] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:22:50.211169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4612cb5d-627d-4a4a-952b-68fd43c308b8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90086b2160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.372739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.374046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.378629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:50.384170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.393552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.393552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.393552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.393552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.393552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.462345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.472079 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73ed6f7e-5e1b-4375-bf41-89ab6cfc46ad tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1213 microversion: 2.1 time: 0.105417 Oct 04 18:22:50.473543 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2003/4031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:50.479077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.480298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.488040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.488664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.489264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.490022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.490537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.501052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4612cb5d-627d-4a4a-952b-68fd43c308b8 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda" status: 202 len: 0 microversion: 2.1 time: 0.292822 Oct 04 18:22:50.502719 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2029/4032] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:22:50 2022] DELETE /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:50.512919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90086b2ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.540735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:22:50.541496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group 6bcfcd29-a84b-4985-8110-425cef485fda not found {{(pid=123887) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:22:50.542055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.542055 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda HTTP/1.1 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6bcfcd29-a84b-4985-8110-425cef485fda'} Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:22:50.544076 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-53fe18e2-7bd1-4d84-90c0-394a9270b525'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-832b754e-263d-4503-9327-229b7ebe8d27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda" status: 404 len: 194 microversion: 2.1 time: 0.039320 Oct 04 18:22:50.547702 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2030/4033] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:50.555804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cac66d18-b48d-47b5-aa8d-62469bd41dc4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90086b2790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.736684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.751488 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d66aded1-f7c7-4e35-91ea-cf80279b26a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.276613 Oct 04 18:22:50.752600 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2004/4034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.758153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.758153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.772621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cac66d18-b48d-47b5-aa8d-62469bd41dc4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.220495 Oct 04 18:22:50.774513 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2031/4035] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.781325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.782354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.782794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.783531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.784144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.784707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.796077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0af7d969-d282-49ed-bb78-84628a2b19b5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f90087824c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-37831915", "description": "tempest-description-246372051"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:51.058781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.069931 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fa92cff-fc6a-4d38-bca9-9f9abf0b866b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.316249 Oct 04 18:22:51.070889 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2005/4036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:51.077221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.078229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.085608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.086108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.086614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.087648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.088423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.089005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.211890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.251548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.254008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.255906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7ab437a-d541-4ea5-a7f6-5b4efba0d839 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.183610 Oct 04 18:22:51.278229 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2006/4037] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:51.289365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0af7d969-d282-49ed-bb78-84628a2b19b5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.499305 Oct 04 18:22:51.289976 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2032/4038] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:50 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:51.292150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.293011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.301828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.302601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.303254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.304232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.304336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad6b64af-badd-4361-9048-a8fcccecba6e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9009753160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1188284433", "description": "tempest-description-1975208726"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:51.307145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.307916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.415941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.425607 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-616a86c3-ed6f-4e2e-974d-da202d146734 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1265 microversion: 2.1 time: 0.144735 Oct 04 18:22:51.426553 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2007/4039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:51.500378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.500378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.503941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.504437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.504882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.505591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.506052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.506484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.732773 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad6b64af-badd-4361-9048-a8fcccecba6e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.432582 Oct 04 18:22:51.733407 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2033/4040] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:22:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:51.777436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.778327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.794128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.796007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.796473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.797250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.797709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.801161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.809188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:51.945119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.961121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b660a98-23be-4bb2-974c-5cee09dc1080 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1205 microversion: 2.1 time: 0.468315 Oct 04 18:22:51.976305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2008/4041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1205 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:51.983348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-775461091", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "27950f4b-8cef-4dd4-ba30-965db96a573a"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:52.061366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] validate_networks() for [('27950f4b-8cef-4dd4-ba30-965db96a573a', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:52.139661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.152783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-432c5f09-4be1-447a-ba06-33b62fcd6e56 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.379270 Oct 04 18:22:52.153712 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2034/4042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:52.170960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.171699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.184477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.191973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.193038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.193815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.193938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.202718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.571732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.606107 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a730e2d2-479f-49b0-980b-0c6aa0cecef1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.451154 Oct 04 18:22:52.607077 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2035/4043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.622132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.629313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.644971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.645606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.646057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.646778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.647239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.647753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.743966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.758118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.760338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.761636 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-998f745a-fa85-4220-9323-a0ab8d967fd7 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.152729 Oct 04 18:22:52.762734 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2036/4044] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:52.768478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.769270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.776378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.777435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.778079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.779129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.779823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.783837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.863292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.897696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7757ee2d-ffdb-4195-b4a9-e9a06778814a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1271 microversion: 2.1 time: 0.133576 Oct 04 18:22:52.898607 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2037/4045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.991022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.992159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.004453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.006189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.007397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.009986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.010474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.010916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.168873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.174526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:53.175522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:53.176232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:53.176865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:53.177431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:53.183313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd4fd4bb-9216-4f1b-b48b-01934e3eb5da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1261 microversion: 2.1 time: 0.195601 Oct 04 18:22:53.184011 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2038/4046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:53.192950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.192950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.194753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.198527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.199268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.212320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.233335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.234468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.258033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.261014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.269406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Getting quotas for project 7b00849668db4b0481d259fc4fceb449. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:53.280288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Getting quotas for user 0ef65b403d7c46fcbc2de208ba792f65 and project 7b00849668db4b0481d259fc4fceb449. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:53.282693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.283834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.289586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.290673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.311535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:53.317349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:53.559731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.567168 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79a57e43-beb4-4475-8896-48474b3a4e50 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.381182 Oct 04 18:22:53.573865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2039/4047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:53.597800 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-566af5e3-e7b5-4622-a0ae-b753b3f356c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620378 Oct 04 18:22:53.598977 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2009/4048] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:53.654433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d46da61a-b2a0-4c9f-a666-4f59fc0884a5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.657891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d46da61a-b2a0-4c9f-a666-4f59fc0884a5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.853201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1201278586", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "a8aab048-b631-422f-8410-249aedcefbbd"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:53.853831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d46da61a-b2a0-4c9f-a666-4f59fc0884a5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.862406 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d46da61a-b2a0-4c9f-a666-4f59fc0884a5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1215 microversion: 2.1 time: 0.255922 Oct 04 18:22:53.866775 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2010/4049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:53.873556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.874621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.891580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.891580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.891799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.896412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.897082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.897537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.968479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] validate_networks() for [('a8aab048-b631-422f-8410-249aedcefbbd', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:54.163894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.186748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43380d1f-1abf-438b-b5ba-63a2400afaf6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.314397 Oct 04 18:22:54.188864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2011/4050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.196756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.197510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.204410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.205160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.205807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.206786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.207453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.208117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.279256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.303134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.304640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.305878 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6800b98c-47df-45d8-97c4-2a634edb888d tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.114292 Oct 04 18:22:54.306771 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2012/4051] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:54.311412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.312054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.330042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.330042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.330042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.330920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.331618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.332871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.629011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.637138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4774881c-2fc2-401c-a180-a22b212890fe tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.329318 Oct 04 18:22:54.654123 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2013/4052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.659593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ed1d56-1198-415d-8105-db61feda4e15", "name": "network-vif-plugged", "status": "completed", "tag": "fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:54.682873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.683717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.684354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.690103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:54.690790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:54.691487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:54.692341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:54.692880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:54.709627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.710391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.711007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.715217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] Creating event network-vif-plugged:fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90 for instance e8ed1d56-1198-415d-8105-db61feda4e15 on n-h2-833090-21 Oct 04 18:22:54.716281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.716953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.717548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.729525 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a2c23e32-fa9d-4b46-9a32-b6e6eaade4eb req-0d5d265e-a76f-4d93-bc98-1076de43a45d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073457 Oct 04 18:22:54.731126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2014/4053] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:54.738331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.739057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.745447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Getting quotas for project 09d57df3ab8a4a84a130dc9e3b351f34. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:54.746286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.746795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.747268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.748011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.748463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.749077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.753496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Getting quotas for user c63b303c6f534a5bad3c7e7b90280ab8 and project 09d57df3ab8a4a84a130dc9e3b351f34. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:54.770048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:54.773731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:54.910128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06d23f40-c228-45ae-b0b8-162e057d0dde tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341145 Oct 04 18:22:54.914653 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2040/4054] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:54.926372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.927393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.988080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.992804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.993882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.997445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.999037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.999541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.018282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.043242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d05f0988-b36a-4db0-bf1f-1ce569bc33f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.309890 Oct 04 18:22:55.043242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2015/4055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.060565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.068386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.098644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.099083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.099560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.100310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.100791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.101249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.279620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.298396 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-331757b3-5605-4f6a-b4be-c0d42eb0bb27 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1219 microversion: 2.1 time: 0.247856 Oct 04 18:22:55.315550 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2016/4056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.315550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6e8c9f8-79dc-47ea-9a5c-d294ed53bfeb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.315550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6e8c9f8-79dc-47ea-9a5c-d294ed53bfeb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.408710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.418503 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9463028-c7d3-4a43-8a8e-1f7cde667d59 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.501522 Oct 04 18:22:55.423195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6e8c9f8-79dc-47ea-9a5c-d294ed53bfeb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.435243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6e8c9f8-79dc-47ea-9a5c-d294ed53bfeb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1215 microversion: 2.1 time: 0.131088 Oct 04 18:22:55.437925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2041/4058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.438052 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2017/4058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.447986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.452422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.454749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.456402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.464780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.465571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.466184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.467062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.467725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.467844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.468426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.481951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.481951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.481951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.481951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.481951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.571672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.582296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.584069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.585448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c51c7144-1cdc-4586-8297-bca9eb462d1e tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.146488 Oct 04 18:22:55.600879 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2018/4059] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:55.638358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.650276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db6bd243-091d-4c98-b7b0-24455ec9950c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.211090 Oct 04 18:22:55.651492 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2042/4060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.661891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.662721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.669762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.670449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.671057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.671988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.672598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.673032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.814414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.825599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29e98877-c6e6-41e0-bcc6-0beb3bc5a991 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.168759 Oct 04 18:22:55.826373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2019/4061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:55.868464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ec33f8-1217-43a3-b250-e25bf8072592", "tag": "1234f529-258a-4db5-af49-9010d88ce538"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:55.882844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.887334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.887334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.914714 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] Creating event network-changed:1234f529-258a-4db5-af49-9010d88ce538 for instance 24ec33f8-1217-43a3-b250-e25bf8072592 on n-h2-833090-21 Oct 04 18:22:55.929631 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-067826be-ae08-4e81-b2c6-c97c223934a6 req-1b3b993f-db18-4fef-b13b-78a13e4f2c22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062900 Oct 04 18:22:55.930282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2043/4062] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:56.066969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.067680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.081283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.081840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.082291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.083146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.083659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.084348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.229927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.238135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7d38517-1dc6-4dda-959e-52eaa05972cf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.175544 Oct 04 18:22:56.238737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2020/4063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.324282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.325244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.327617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:56.333335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.334110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.334885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.336039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.336748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.337343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.426320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.438407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7d17fdc-b02b-4213-9530-918dfe69829b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1267 microversion: 2.1 time: 0.117874 Oct 04 18:22:56.439361 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2044/4064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.458005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.458674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.464134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f19320fc-684b-41f6-8e9d-da2802b99518 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.464974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.465636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.466221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f19320fc-684b-41f6-8e9d-da2802b99518 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.466368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.467563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.468361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.469455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.562786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f19320fc-684b-41f6-8e9d-da2802b99518 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.571496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f19320fc-684b-41f6-8e9d-da2802b99518 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1215 microversion: 2.1 time: 0.112559 Oct 04 18:22:56.572419 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2045/4065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.613782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.614649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.621003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.621496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.621938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.622674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.623111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.623541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.669560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.677518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14619f2d-66b8-436d-9e47-75a8493020f1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1366 microversion: 2.1 time: 0.231363 Oct 04 18:22:56.678306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2021/4066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.690874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.691821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.693364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.706880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.710052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.710968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.711530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.711916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.712907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.713482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e510dc84-b060-4234-8669-5bc61505f4e1 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1605 microversion: 2.42 time: 0.103652 Oct 04 18:22:56.714201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.714347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2046/4067] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:22:56.716180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.849779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.851378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.871220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.872512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.876143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.880207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.884651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.885748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.920559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:56.924303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.936611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4935e577-ec9e-4f57-830a-0a0e614c8a8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.256540 Oct 04 18:22:56.936806 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2022/4068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.209968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.217747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0266b6d6-fc54-45e7-8bfc-81f060ca7392 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.372287 Oct 04 18:22:57.223686 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2047/4069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:57.283394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.285653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.317284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.320358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.321064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.323677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.324372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.325087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.480163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.480163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.487360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.488880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.490064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.491504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.492042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.492991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.581732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.595058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6fbd7f3c-766a-4256-96ca-5e21954f33f0 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.330281 Oct 04 18:22:57.601566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.602738 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2023/4070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.616222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725491c4-5c11-4d5a-8ba1-613025ee5529", "tag": "9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:57.633798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.634282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.634705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b775f70-2115-4bbf-90cb-ae31be8fe981 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1273 microversion: 2.1 time: 0.170533 Oct 04 18:22:57.634808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.636153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2048/4071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.643013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.643723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.652613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.653110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.653550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.654255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.654707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.655130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.662515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] Creating event network-changed:9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8 for instance 725491c4-5c11-4d5a-8ba1-613025ee5529 on n-h2-833090-21 Oct 04 18:22:57.667692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d740e3cb-6481-4378-9a15-055ac209bd0b req-16867e09-1dd4-4a9d-963c-68e13b751fdb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063051 Oct 04 18:22:57.668367 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2024/4072] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:57.702574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.703555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.709813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.710296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.710732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.711428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.711926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.712352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.760089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.770506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b718c32d-1712-4b6f-882c-905e9abcf3c5 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1211 microversion: 2.1 time: 0.133402 Oct 04 18:22:57.775065 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2049/4073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.780623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.787059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.793532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.794061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.794504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.795247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.795756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.796403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.836703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.837570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.838227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.838889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lazy-loading 'fault' on Instance uuid 0a1c16af-5905-4251-8f8d-2178c3ed3335 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:57.893672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.905082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.907301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.908634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8bbcb19-cea7-411f-a85a-4567108337ae tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1610 microversion: 2.42 time: 0.132288 Oct 04 18:22:57.909550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2050/4074] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1610 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:57.935111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.943155 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e8b0051-5e67-478b-84c4-a88b1af89924 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1557 microversion: 2.1 time: 0.244737 Oct 04 18:22:57.943766 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2025/4075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:57.963324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.963919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.970234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.970737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.971151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.971756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.972257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.973233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.973706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.974123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.976957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.977444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.977888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.978583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.979652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.980289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.131910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df7a0c41-4dcc-403b-ae42-46610232dcb6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164989 Oct 04 18:22:58.139996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2026/4076] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:58.224502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.238810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-687c3bdf-6b93-4495-9470-3d604c8b15a2 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.280283 Oct 04 18:22:58.243526 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2051/4077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:58.333651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.334266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.346040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.346526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.346971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.348165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.348629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.349065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.626805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.627412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.633846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.634562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.634998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.635725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.636176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.636593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.649725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.662529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04f1f9b8-5232-459e-8b78-dea67f457bdd tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.332704 Oct 04 18:22:58.663709 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2027/4078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:58.669211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.670057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.676503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.677207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.677791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.678669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.679333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.679923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.882352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.912562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c63f019-48d4-4abc-bdb4-6c1773c5a5a3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.289759 Oct 04 18:22:58.914474 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2052/4079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:58.919726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.920785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.927699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.928289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.930192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.930192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.930192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.930445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.996127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.005241 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35170081-694d-44da-9d57-901e72e1dde3 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1275 microversion: 2.1 time: 0.089481 Oct 04 18:22:59.006062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2053/4080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.010490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.011499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.017827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.018325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.022827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.022827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.022827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.022827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.060833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.062069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.062069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.063110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lazy-loading 'fault' on Instance uuid 0a1c16af-5905-4251-8f8d-2178c3ed3335 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:59.095030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.123709 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cce6068-2282-4491-aab7-c5b6c07c2139 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.445169 Oct 04 18:22:59.123709 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2028/4081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.124196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.146372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.146372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.146372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9200ce6-f10d-427d-9687-d8e923808bc5 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1610 microversion: 2.42 time: 0.136337 Oct 04 18:22:59.146372 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2054/4082] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1610 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:22:59.262941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.263648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.270635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.271129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.271593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.272288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.272742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.273163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.292239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:59.685457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.686079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.693535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.694034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.694523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.695241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.698844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.698844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.906532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.917082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.919671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8baf1638-19e8-4c01-bf8d-44b37b9cb740 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.660516 Oct 04 18:22:59.920745 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2029/4083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.929568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ffb2d49-96e3-4dd0-8164-176744412b27", "tag": "01e48f55-5582-46eb-bd87-4845d024a320"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:59.940618 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b910c610-4c5c-4637-81a6-42a53383fbaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.258876 Oct 04 18:22:59.941484 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2055/4084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:59.952727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.955261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.957715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.958465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.959698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.965746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.966865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.967332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.968271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.969301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.969976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.976156 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] Creating event network-changed:01e48f55-5582-46eb-bd87-4845d024a320 for instance 4ffb2d49-96e3-4dd0-8164-176744412b27 on n-h1-833090-21 Oct 04 18:22:59.982105 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0706c17f-9cb7-46a5-b29f-1a4fc7092e49 req-688ff6c3-ac9b-403b-a64b-673120dec8f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059100 Oct 04 18:22:59.983598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2030/4085] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:00.041061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.042024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.050202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.050982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.051501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.052970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.052970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.053449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.159800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.168875 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78bff25e-32cc-4d6d-a282-01a13027c6ed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1273 microversion: 2.1 time: 0.140234 Oct 04 18:23:00.187524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2031/4086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.203334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.212093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.212225 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a67386c-5f83-40e5-aa94-d7127f94a8da tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.269506 Oct 04 18:23:00.212778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.221725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.223016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.223485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.224791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.225262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.225701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.229544 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2056/4087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.237327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.238009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.244703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.245274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.245797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.246563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.247089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.247610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.284026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.284599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.285073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.285596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lazy-loading 'fault' on Instance uuid 0a1c16af-5905-4251-8f8d-2178c3ed3335 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:00.329523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.342668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.345932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e652591703a54e2abb5f322ac67f054a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03445077fd3049d680c7c486a7ae2472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.347249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55ae8797-da0d-4c49-aef0-7dd6085855e4 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 200 len: 1610 microversion: 2.42 time: 0.114019 Oct 04 18:23:00.348372 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2057/4088] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 1610 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:00.353070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ed1d56-1198-415d-8105-db61feda4e15", "tag": "fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:00.368361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.368941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.369448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.383252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] Creating event network-changed:fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90 for instance e8ed1d56-1198-415d-8105-db61feda4e15 on n-h2-833090-21 Oct 04 18:23:00.391493 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e1eb8bf9-fa27-4041-8f64-f88c0fce0dc7 req-5c57c927-23f7-4169-8002-84885917564b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039435 Oct 04 18:23:00.391493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2058/4089] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:00.465041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.474966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f4cf9fd-a8fd-4c8d-8b24-caaa549f92a6 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.286319 Oct 04 18:23:00.481132 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2032/4090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.945611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.946666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.954796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.955413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.955935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.956726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.957184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.957615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.965631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.966340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.975834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.976332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.983303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.984727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.985217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.985856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.187087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.197449 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52ca8887-861a-46dd-a088-a1827a008987 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.255853 Oct 04 18:23:01.198347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2059/4091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.204842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.205432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.211951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.212437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.212915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.213612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.214061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.214484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.260301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.275385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7475805e-9c0d-4e24-b37f-a80a788d8609 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.312979 Oct 04 18:23:01.277471 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2033/4092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:01.287648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.288299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.305516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.307819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.308999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.310255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.311026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.312867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.438001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.451856 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad7024b0-ab75-4780-9a9f-44d2cbfe8191 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.250623 Oct 04 18:23:01.467496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2060/4093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.467496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.467496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.479451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.480121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.480576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.483744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.486332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.486670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.508810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] HTTP exception thrown: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Request method failure captured: Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 HTTP/1.1 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHhK1L0kNFGDocwZX3tGh46SYo7dKFUQjRE49SnOTmoGWVr9NFvt7aJA1KHs_uLBTG9yDEKA5WGLd-hGwTZeO0XAPkTs-eZPLx3hsUn86QEBZNIbWJHulDKr3pF_pSqTIiFKnQcmvhc_rcuJL6b0LYpOS04m8GSLiB8se895s5A9URE Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03445077fd3049d680c7c486a7ae2472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03445077fd3049d680c7c486a7ae2472"}]}] Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e652591703a54e2abb5f322ac67f054a Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0a1c16af-5905-4251-8f8d-2178c3ed3335'} Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:01.510504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Returning 404 to user: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5f84267-38b6-40bb-a2c5-8777913524af tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 404 len: 111 microversion: 2.42 time: 0.053715 Oct 04 18:23:01.513869 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2061/4094] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:01.518762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.519379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.525831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.526423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.529926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.529926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.529926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.529926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.634224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.647534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b054dcb0-b3fa-4515-a694-ddf44a72ef98 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.368901 Oct 04 18:23:01.648129 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2034/4095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.663578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b92f4231-236d-4deb-8f46-d87bb78e492c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '.version_select at 0x7f9008aa3040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.686830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.695942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6e3a393-7fe6-476c-8010-41accb679477 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.181978 Oct 04 18:23:01.696752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2062/4096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.768750 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b92f4231-236d-4deb-8f46-d87bb78e492c tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186932488" status: 204 len: 0 microversion: 2.42 time: 0.115037 Oct 04 18:23:01.769282 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2035/4097] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:23:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1186932488 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:23:02.221352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.222940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.230563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.231359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.232007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.233125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.234573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.235274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.299946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.301149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.307253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.307883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.308320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.309346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.309814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.310249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.469362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.482054 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-98af0ebe-4b81-4189-aeb8-27ab63faa673 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.265298 Oct 04 18:23:02.499550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2063/4098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:02.508021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.509393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.515757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.516586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.517251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.518181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.519492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.521180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.527375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.538956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:02.540799 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c800ee4-7832-4afe-a623-078019e740c7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.245276 Oct 04 18:23:02.553451 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2036/4099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:02.674165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.675063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.686559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.687417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.688502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.689395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.690296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.695866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.907285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.918816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91d3bc30-24f4-44b0-b1ef-c09af3dae322 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.250057 Oct 04 18:23:02.920144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2037/4100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:02.929223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd04b407-912c-4cc6-a2d0-424f869f72e1", "tag": "de4d856c-aa73-4d06-a3bc-0a96bd5788bf"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:02.940293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.941113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.941876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.957839 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] Creating event network-changed:de4d856c-aa73-4d06-a3bc-0a96bd5788bf for instance cd04b407-912c-4cc6-a2d0-424f869f72e1 on n-h1-833090-21 Oct 04 18:23:02.964773 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9556e56d-faed-458a-bab0-f6e19c727354 req-4f555365-4030-4278-9de9-31b62ebeee2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042560 Oct 04 18:23:02.966041 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2038/4101] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:02.974207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:02.975024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:02.982612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.983243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.983828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.985172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.985716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.986237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.233716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:03.246918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.256786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4880db1a-17e2-417f-b376-435bf671cc61 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.288877 Oct 04 18:23:03.257596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2039/4102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:03.354523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.363393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0ca0898-0800-490e-99be-a3b16b95092b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.861241 Oct 04 18:23:03.364320 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2064/4103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:02 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:03.512267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.512990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.521333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.521825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.522279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.522986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.523445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.523920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.566643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.567264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.573403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.574122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.574571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.575352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.575761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.576189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.663651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.672671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-546b3e39-a7ae-45ce-b224-dc262286eab3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.164201 Oct 04 18:23:03.673265 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2040/4104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:03.862035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.869733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3986033-0361-406d-beb5-573efda7856a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.307468 Oct 04 18:23:03.870324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2065/4105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:03.948667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.949264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.955639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.956135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.956577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.957274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.957731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.958184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.104734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.113753 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33d862fd-abc5-457e-bde4-d900dd5820d7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.168792 Oct 04 18:23:04.121401 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2041/4106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.280342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.281531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.288693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.289161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.289717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.290440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.291002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.291325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.389379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.390974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.399181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.399953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.407281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.409632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.410189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.411954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.519230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.537077 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a07cdf8b-737c-4f8c-9be8-186ef6322dfb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.253615 Oct 04 18:23:04.548704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2066/4107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.553633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ec33f8-1217-43a3-b250-e25bf8072592", "name": "network-vif-plugged", "status": "completed", "tag": "1234f529-258a-4db5-af49-9010d88ce538"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:04.565812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.566323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.566760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.586643 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] Creating event network-vif-plugged:1234f529-258a-4db5-af49-9010d88ce538 for instance 24ec33f8-1217-43a3-b250-e25bf8072592 on n-h2-833090-21 Oct 04 18:23:04.592459 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cdeeb6f3-038f-405d-a3f9-707250c92793 req-4032711d-651d-4994-abeb-b5a000af12e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042559 Oct 04 18:23:04.593949 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2067/4108] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:04.608081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.617225 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5dcdf5e-eb03-4568-8074-208d67626113 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.232715 Oct 04 18:23:04.617941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2042/4109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.697576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.699444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.707245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.707781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.708433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.709174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.709722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.710166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.737104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:04.893900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.894716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.898959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:04.902643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.903330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.903947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.904689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.905232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.905697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.924302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.933394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae9a97e5-1782-4fd5-82d6-9370cfddc576 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1737 microversion: 2.1 time: 0.240260 Oct 04 18:23:04.933987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2068/4110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:05.135983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.137405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.138046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.147135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-54aeed2c-3a70-46d5-a2c5-5db69f048644 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.257280 Oct 04 18:23:05.148063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.148730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.149367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.150281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.150906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.151600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.164519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2043/4111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:05.366210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.374669 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0672129-1b0f-4f9c-a7e0-7d7c1d752d9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.242056 Oct 04 18:23:05.375493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2069/4112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:05.565484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.566515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.569258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:05.576088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.576959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.576959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.578374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.578842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.579445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.642781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.644071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.654962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.656338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.658275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.660461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.661431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.662263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.733831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.743273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b397c1f9-fcff-4335-93f6-e8dfc2f70db2 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.183021 Oct 04 18:23:05.744377 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2044/4113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:05.959924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.961090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.978812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.997531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbb57264-2bec-48e8-ad36-c17eacdbacb2 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.359720 Oct 04 18:23:05.998652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2070/4114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:06.006006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.010215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.011046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.015880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.015880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.016989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.172453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.172453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.178012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.178433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.178881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.179632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.180095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.180536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.284692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.295619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f8302e2-42bb-46c1-bf15-14d5126abb5b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1717 microversion: 2.1 time: 0.341609 Oct 04 18:23:06.300099 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2045/4115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1717 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:06.400970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.401714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.411354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.413453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.417287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.417866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.418726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.422865 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-53772b0d-e3f6-4a8b-ac08-ff3165734362 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1313 microversion: 2.1 time: 0.254837 Oct 04 18:23:06.423563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2071/4116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:06.424063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.424838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.589588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.590405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.592697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:06.617024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.619508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.621356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.626668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.631160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.632218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.745991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.757590 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-892684cb-6943-4619-957d-4daa688a59a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.361646 Oct 04 18:23:06.758452 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2046/4117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:06.765612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ffb2d49-96e3-4dd0-8164-176744412b27", "name": "network-vif-plugged", "status": "completed", "tag": "01e48f55-5582-46eb-bd87-4845d024a320"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:06.780492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.782075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.782705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.797512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] Creating event network-vif-plugged:01e48f55-5582-46eb-bd87-4845d024a320 for instance 4ffb2d49-96e3-4dd0-8164-176744412b27 on n-h1-833090-21 Oct 04 18:23:06.803346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c7ceaa43-b1bb-4c7c-a1cd-1dcf73051dd3 req-1480825b-3519-4df8-bd1f-88366d1ab0c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043416 Oct 04 18:23:06.804992 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2047/4118] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:06.811113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.812423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.816820 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Cannot 'detach_volume' instance d63f2343-aed1-4433-af22-4ed046448951 while it is in vm_state rescued Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments/66a5e8de-6c81-4773-8586-ce9820d39649 HTTP/1.1 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'detach_volume' instance d63f2343-aed1-4433-af22-4ed046448951 while it is in vm_state rescued Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': 'd63f2343-aed1-4433-af22-4ed046448951', 'id': '66a5e8de-6c81-4773-8586-ce9820d39649'} Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d63f2343-aed1-4433-af22-4ed046448951 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d63f2343-aed1-4433-af22-4ed046448951 while it is in vm_state rescued Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:06.819231 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d63f2343-aed1-4433-af22-4ed046448951 while it is in vm_state rescued Oct 04 18:23:06.822476 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:06.823511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.823841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 409 to user: Cannot 'detach_volume' instance d63f2343-aed1-4433-af22-4ed046448951 while it is in vm_state rescued {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:06.823928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.824010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbdff107-a4cb-42f0-8e26-3cba7a59e659 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments/66a5e8de-6c81-4773-8586-ce9820d39649" status: 409 len: 152 microversion: 2.1 time: 0.236590 Oct 04 18:23:06.824010 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2072/4119] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:23:06 2022] DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments/66a5e8de-6c81-4773-8586-ce9820d39649 => generated 152 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:23:06.824918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.825872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.826442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.826792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.835975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:06.839154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.855365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.857216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.857745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.860162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.865301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.865862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.028544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.039601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-086be0dc-733a-4b48-9be7-240a63e9ea74 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.233111 Oct 04 18:23:07.040729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2048/4120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:07.045707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.046598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.053658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.054383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.055073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.058792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.060240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.060848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.067726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:07.236364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0635c5f5-81da-4d1e-b333-0f3e71ecd517 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/action" status: 202 len: 0 microversion: 2.1 time: 0.406534 Oct 04 18:23:07.239504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2073/4121] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:06 2022] POST /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:07.246410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.247402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.254898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.255587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.256204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.256967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.257587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.258020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.258291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.268734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c59d3fc-4aa8-4aa2-af52-54b3234667b0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.226667 Oct 04 18:23:07.277362 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2049/4122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:07.447637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.448268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.456003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.456623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.456960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.457744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.458149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.460654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.529690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.544176 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f58217d4-0032-4a2e-aee9-40f01f50067b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1725 microversion: 2.1 time: 0.302079 Oct 04 18:23:07.545035 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2074/4123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:07.641063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.652096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d997f52c-0ca1-4cb2-ae42-f13131975d01 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1499 microversion: 2.1 time: 0.208376 Oct 04 18:23:07.656321 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2050/4124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:07.679033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:07.683072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.694506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.695091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.695568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.696321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.696797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.697226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.725599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lazy-loading 'flavor' on Instance uuid 24ec33f8-1217-43a3-b250-e25bf8072592 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:07.788233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.789124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.795635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.797066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.797656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.798403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.799072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.799842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.988751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.997017 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-792bca5f-57ce-4e2b-b394-5e1e83453ef9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.213968 Oct 04 18:23:07.997713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2051/4125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.002732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.003545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.009915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.010619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.011233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.012282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.012993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.013446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.029442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] HTTP exception thrown: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Request method failure captured: Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 HTTP/1.1 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhK1L0kNFGDocwZX3tGh46SYo7dKFUQjRE49SnOTmoGWVr9NFvt7aJA1KHs_uLBTG9yDEKA5WGLd-hGwTZeO0XAPkTs-eZPLx3hsUn86QEBZNIbWJHulDKr3pF_pSqTIiFKnQcmvhc_rcuJL6b0LYpOS04m8GSLiB8se895s5A9URE Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03445077fd3049d680c7c486a7ae2472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03445077fd3049d680c7c486a7ae2472"}]}] Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e652591703a54e2abb5f322ac67f054a Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0a1c16af-5905-4251-8f8d-2178c3ed3335'} Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:08.032018 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.035626 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.037091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Returning 404 to user: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:08.037956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba0cc396-a6b2-4fb3-aad4-4c46fa0b1e90 tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 404 len: 111 microversion: 2.42 time: 0.039266 Oct 04 18:23:08.038706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2052/4126] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:23:07 2022] DELETE /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:08.047654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.048280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] [instance: 0a1c16af-5905-4251-8f8d-2178c3ed3335] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.054340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.054887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.055334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.056152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.056613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.057030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.071384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] HTTP exception thrown: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Request method failure captured: Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 HTTP/1.1 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHhK1L0kNFGDocwZX3tGh46SYo7dKFUQjRE49SnOTmoGWVr9NFvt7aJA1KHs_uLBTG9yDEKA5WGLd-hGwTZeO0XAPkTs-eZPLx3hsUn86QEBZNIbWJHulDKr3pF_pSqTIiFKnQcmvhc_rcuJL6b0LYpOS04m8GSLiB8se895s5A9URE Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_03445077fd3049d680c7c486a7ae2472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/03445077fd3049d680c7c486a7ae2472"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/03445077fd3049d680c7c486a7ae2472"}]}] Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 03445077fd3049d680c7c486a7ae2472 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-868210423 Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e652591703a54e2abb5f322ac67f054a Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TaggedBootDevicesTest_v242-868210423-project Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0a1c16af-5905-4251-8f8d-2178c3ed3335'} Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.072961 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] Returning 404 to user: Instance 0a1c16af-5905-4251-8f8d-2178c3ed3335 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49198334-a12c-42b1-8d34-6add952e33ee tempest-TaggedBootDevicesTest_v242-868210423 tempest-TaggedBootDevicesTest_v242-868210423-project] 10.222.0.40 "GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335" status: 404 len: 111 microversion: 2.42 time: 0.031326 Oct 04 18:23:08.078659 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2053/4127] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/0a1c16af-5905-4251-8f8d-2178c3ed3335 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:23:08.083065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.083728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.089814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.093611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.093611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.093611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.093611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.093611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.148199 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94f8e66b-3a68-4ab9-a7d8-8e1f321f2cce tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "POST /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592/action" status: 200 len: 32 microversion: 2.1 time: 0.474506 Oct 04 18:23:08.148948 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2075/4128] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:07 2022] POST /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:08.160540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.161473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.168198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.168907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.169522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.170247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.170703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.171769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.257411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.266980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51683c6a-e149-408f-8dd5-4491eff7e43f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1315 microversion: 2.1 time: 0.187965 Oct 04 18:23:08.267518 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2054/4129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.294081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.294930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.303784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.307513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.316284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.317457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.318113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.319434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.368726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.379273 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fecb2a6-8416-48da-a914-a981dd9bce28 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.224356 Oct 04 18:23:08.382465 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2076/4130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.567571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.572654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.573758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.584560 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-749f20a7-cade-4ed0-817f-863c37b41d97 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.294485 Oct 04 18:23:08.584699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.585218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.585527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2055/4131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:08.586118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.587091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.587610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.588193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.876944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.891157 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46318421-ab8e-4272-8ec3-364f402539f5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1725 microversion: 2.1 time: 0.324098 Oct 04 18:23:08.892225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2077/4132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:09.022687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.024282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.032072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.032982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.033572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.034711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.035430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.037282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.054767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd04b407-912c-4cc6-a2d0-424f869f72e1", "name": "network-vif-plugged", "status": "completed", "tag": "de4d856c-aa73-4d06-a3bc-0a96bd5788bf"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:09.070555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.071183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.071878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.085287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] Creating event network-vif-plugged:de4d856c-aa73-4d06-a3bc-0a96bd5788bf for instance cd04b407-912c-4cc6-a2d0-424f869f72e1 on n-h1-833090-21 Oct 04 18:23:09.094853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-01bc342f-4963-4d0d-bd38-a2b72b97462f req-41dc6469-1638-42bf-b3dc-4c728ea54609 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041421 Oct 04 18:23:09.094853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2078/4133] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:09.208096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.216442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bf6e2773-2c33-41ac-b94b-765653a63b32 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.198873 Oct 04 18:23:09.228344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2056/4134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.292766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.294444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.302765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.303391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.304108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.304926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.305463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.305971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.309246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:09.404275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.404902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.411849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.416601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.416601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.416601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.416601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.416601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.461888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.473385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1287d50d-17a0-44c9-9578-deb2b2d71d7d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1504 microversion: 2.1 time: 0.186370 Oct 04 18:23:09.495264 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2079/4135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.504258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-37831915"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:09.505023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.514296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.515866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.516949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.518288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.519460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.520179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.584646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.599597 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9f79e16-ade6-4628-bb01-7e88cbd2c5e6 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.198698 Oct 04 18:23:09.600240 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2057/4136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.611415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.612360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.619950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.620457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.620900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.621963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.622585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.623744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.685842 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.network.security_group_api [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Adding security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 to port 01e48f55-5582-46eb-bd87-4845d024a320 Oct 04 18:23:09.778369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.787339 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5a14e35-7100-4448-b995-3609c92ed9f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.180784 Oct 04 18:23:09.788160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2058/4137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.917233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.918007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.925591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.926189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.926895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.927915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.928052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.928560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.077312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.086207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbb21e01-4805-491a-912a-09c835f0ac77 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1725 microversion: 2.1 time: 0.174488 Oct 04 18:23:10.086812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2059/4138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:10.139852 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95c75da9-2b4b-43d0-ba59-aa8b90372128 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action" status: 202 len: 0 microversion: 2.1 time: 0.640786 Oct 04 18:23:10.144092 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2080/4139] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:09 2022] POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:23:10.149206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008f3c8b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.194652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ffb2d49-96e3-4dd0-8164-176744412b27", "tag": "01e48f55-5582-46eb-bd87-4845d024a320"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:10.213420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.214129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.214849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.230651 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] Creating event network-changed:01e48f55-5582-46eb-bd87-4845d024a320 for instance 4ffb2d49-96e3-4dd0-8164-176744412b27 on n-h1-833090-21 Oct 04 18:23:10.239198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f8b48029-5f73-4e5b-a9dd-59fec24ca8b7 req-a592a295-0e04-4f4a-ba82-ec6c3efd3d1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050668 Oct 04 18:23:10.240525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2081/4140] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:23:10.247808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.248768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.259454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.260237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.260939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.262396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.263183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.264135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.290472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use.", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:10.291165 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.291165 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55 HTTP/1.1 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: exception: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'bc2852e1-e454-48f3-98a0-6dc804f2fe55'} Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:10.293939 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] Oct 04 18:23:10.298208 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:10.301188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 400 to user: Security Group bc2852e1-e454-48f3-98a0-6dc804f2fe55 in use. Oct 04 18:23:10.301188 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-db7fe061-06fd-45d5-9e17-0551624257c5'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:10.302319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a25c7e5-87d9-419b-821b-fdcfb9544da9 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55" status: 400 len: 185 microversion: 2.1 time: 0.157192 Oct 04 18:23:10.303724 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2060/4141] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:10 2022] DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55 => generated 185 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:10.313853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:10.316535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.334656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.335179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.335681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.336407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.336874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.337312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.587505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.616751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca3b08a9-4d02-46c4-af46-0397d0ed3ebb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.372457 Oct 04 18:23:10.619633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2082/4142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:10.627511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.633638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.642625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.643349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.643968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.644847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.645807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.646443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.646557 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00586cac-3fa7-459c-9698-668ac78b0678 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action" status: 202 len: 0 microversion: 2.1 time: 0.336975 Oct 04 18:23:10.650901 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2061/4143] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:10 2022] POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:23:10.666897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.668363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.692156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.692666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.693109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.699886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.700392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.701331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.927131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:10.935877 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-935775dd-71bf-4444-91d7-79c0592157cb tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1573 microversion: 2.1 time: 0.283626 Oct 04 18:23:10.937271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2062/4144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1573 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:10.954162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.955237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.963030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.963762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.964209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.964953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.965413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.965843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.129494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.145638 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1f39a96-db45-4f4d-b923-60685b63c76d tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.197358 Oct 04 18:23:11.147927 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2063/4145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:11.153909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.154627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.164722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.165490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.165946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.166798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.167155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.167612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.292363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.293516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92a9a3f0-eca6-4137-94ee-51eaf2ffac54 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.671813 Oct 04 18:23:11.294116 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2083/4146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:11.300984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725491c4-5c11-4d5a-8ba1-613025ee5529", "name": "network-vif-plugged", "status": "completed", "tag": "9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:11.312856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.313661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.314488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.329163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] Creating event network-vif-plugged:9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8 for instance 725491c4-5c11-4d5a-8ba1-613025ee5529 on n-h2-833090-21 Oct 04 18:23:11.335423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8a5721b1-4156-42e9-b062-299bdbf3b804 req-4865645b-3f01-4a24-85c5-4aa33cde27b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039667 Oct 04 18:23:11.338882 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2084/4147] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:11.359770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.369996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7be37347-3f6f-4d64-940c-f765513a6277 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1731 microversion: 2.1 time: 0.220872 Oct 04 18:23:11.383776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2064/4148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:11.395700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.396309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.403963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.404467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.404915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.405720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.406764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.407203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.556474 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9ec302f5-416d-4cb2-8e72-c52cb657abb1 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166715 Oct 04 18:23:11.557374 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2085/4149] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:11.655418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.656746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.665169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.665649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.666267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.667282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.668573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.669333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.962240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:11.965852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.965963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.974124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.974423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad363f01-5d94-49a7-9a80-ab5e7d5f7eb8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.336170 Oct 04 18:23:11.974578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.975025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.975750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.976214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.976641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.977888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2065/4150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.172236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.173009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.179877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.180559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.181239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.182740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.183368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.184018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.338625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.347401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82994658-ad89-4242-a446-2cec1e4eaef0 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1315 microversion: 2.1 time: 0.180029 Oct 04 18:23:12.359870 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2066/4151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:12.359870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.359870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.360201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.365383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.365383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.365383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.365383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.365383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.367223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:12.415418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.426563 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0fc65074-5b82-46ef-9a7c-2000142fb24d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1573 microversion: 2.1 time: 0.467988 Oct 04 18:23:12.427702 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2086/4152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:11 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1573 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.544183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.558185 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ccca28b-96d4-46d2-9910-ba00ee3b2bc4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.209049 Oct 04 18:23:12.558976 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2067/4153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.002068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.002691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.009417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.009915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.010354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.011069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.011658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.012529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.301076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:13.318678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.319952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.320620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.335268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.352678 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0482a1e-68be-4bf4-9332-d7df2b901a23 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1309 microversion: 2.1 time: 0.354665 Oct 04 18:23:13.362660 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] Creating event network-changed:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:23:13.370411 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2087/4154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1309 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.371960 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d9aa90cf-1917-4552-a40c-744e60fbe536 req-7ce9ca7a-bb96-4e97-b94d-975b7f3b5a2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077572 Oct 04 18:23:13.390718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.391215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2068/4155] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:23:13.391510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.407243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.410360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.412759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.415232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.415924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.418458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.457576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.458660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.470080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.470820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.477496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.478646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.479279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.479921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.712056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.723830 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86d99a2b-5a5d-499c-8ce8-e8ed436fcb5a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1573 microversion: 2.1 time: 0.270349 Oct 04 18:23:13.725358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2069/4156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1573 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.743696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.744583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.753804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.754637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.755155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.756346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.756963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.759019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.813043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.828955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9c3d0ef-86c9-414a-a50f-caf94ef19f2c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1503 microversion: 2.1 time: 0.455077 Oct 04 18:23:13.830545 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2088/4157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:13.860338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.861239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.868151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.868857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.869823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.872372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.873187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.886758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.989008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.020548 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ca4fb3f-958e-493a-8d3b-5f4c28ca2626 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.287405 Oct 04 18:23:14.021622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2070/4158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.121930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.134854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b4359eb-d41b-4336-8b3d-2a255e130b2b tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1503 microversion: 2.1 time: 0.282328 Oct 04 18:23:14.136429 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2089/4159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:14.161847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:14.162818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.177480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.177991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.178442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.179167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.179664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.180104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.232256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lazy-loading 'flavor' on Instance uuid cd04b407-912c-4cc6-a2d0-424f869f72e1 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:14.385555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.386346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.395235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:14.397809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.398454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.399091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.400040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.400637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.401348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.510368 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27332d4f-59c4-4043-856a-4d503b8e7ccb tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action" status: 202 len: 0 microversion: 2.1 time: 0.353752 Oct 04 18:23:14.515059 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2071/4160] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:14 2022] POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:14.528635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.532746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.554549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.555059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.555527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.556253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.557283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.557283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.597677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.622392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4227e73f-06f9-4920-ae51-db552958f93a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1489 microversion: 2.1 time: 0.237736 Oct 04 18:23:14.623198 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2090/4161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1489 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:14.647618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:14.650919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.658258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.658856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.659369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.660231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.661380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.661930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.751564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.762277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f35796f-6058-49b4-a885-9757948b328c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1511 microversion: 2.1 time: 0.245386 Oct 04 18:23:14.773415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2072/4162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.779416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.780332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.787687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.788349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.788943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.789902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.790429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.791058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.844972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b5d11c2-cc39-4ab9-b5a8-e686993b5aba tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "PUT /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1084 microversion: 2.1 time: 0.201952 Oct 04 18:23:14.845807 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2091/4163] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:23:14 2022] PUT /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1084 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.865666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.866701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.880436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.880940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.881381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.882098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.882552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.882984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.966246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.976340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d94bbc9-5316-4eda-9a45-433ffb08a089 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1571 microversion: 2.1 time: 0.203386 Oct 04 18:23:14.977475 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2073/4164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1571 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:15.002549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1188284433"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:15.003640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.010996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.012416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.012941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.013730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.014267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.015353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.115642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.125396 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b11c7ea-f396-47db-aab9-034556f1f752 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1510 microversion: 2.1 time: 0.264456 Oct 04 18:23:15.127235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2092/4165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:15.132794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.133959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.141635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.142475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.143151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.144399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.145078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.146066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.218399 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Adding security group 122c42f0-9430-4920-9a9c-8fb6a74d348a to port 01e48f55-5582-46eb-bd87-4845d024a320 Oct 04 18:23:15.700012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.708341 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eaf04d46-5631-47f9-9cf8-a6ef370deea9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.579749 Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2093/4166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.723642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.724078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.724345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.725176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.755679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3691d216-0901-40df-816f-d37e48d5987b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action" status: 202 len: 0 microversion: 2.1 time: 0.757229 Oct 04 18:23:15.760831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2074/4167] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:14 2022] POST /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:15.767352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:15.791271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.795868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.797060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.820816 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] Creating event network-changed:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:23:15.833786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-14284b11-ea83-412f-8790-776ba4c37023 req-d6d312a9-fb4d-4bab-9492-35c779fd4cb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071382 Oct 04 18:23:15.835808 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2075/4168] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:15.844061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008fe41f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.976811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use.", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:15.977608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.977608 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a HTTP/1.1 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: exception: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '122c42f0-9430-4920-9a9c-8fb6a74d348a'} Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:15.979853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] Oct 04 18:23:15.983797 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:15.987071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 400 to user: Security Group 122c42f0-9430-4920-9a9c-8fb6a74d348a in use. Oct 04 18:23:15.987071 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-0759afe7-afb6-4022-853c-f6280da8ab99'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:15.988278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f5b4180-69cc-47fa-a5d4-64242283e03e tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a" status: 400 len: 185 microversion: 2.1 time: 0.151208 Oct 04 18:23:15.993690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2076/4169] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:15 2022] DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a => generated 185 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:23:15.998734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.000276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.007223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.007779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.008206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.008912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.009432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.009860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.051878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.060974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8c6675f-0310-46ea-99ce-603eea24a669 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1510 microversion: 2.1 time: 0.350690 Oct 04 18:23:16.079749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2094/4170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:16.085379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ffb2d49-96e3-4dd0-8164-176744412b27", "tag": "01e48f55-5582-46eb-bd87-4845d024a320"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:16.096342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.097082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.097521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.127350 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] Creating event network-changed:01e48f55-5582-46eb-bd87-4845d024a320 for instance 4ffb2d49-96e3-4dd0-8164-176744412b27 on n-h1-833090-21 Oct 04 18:23:16.133287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3f7e7e46-9b5d-42fa-83b9-bb66eba57b84 req-cd75e9d6-6068-4f6a-b2c0-d070a333fd80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051773 Oct 04 18:23:16.134888 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2095/4171] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:16.141811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.142607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.149548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.150039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.150480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.151292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.152169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.152781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.201022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:16.257903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:16.267010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.276377 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14f42708-b929-4cb3-abe6-bb740439e2f8 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1494 microversion: 2.1 time: 0.281369 Oct 04 18:23:16.283585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2077/4172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:16.283585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.284052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.290153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.290669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.291112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.291839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.292300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.292728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.320718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:16.560505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc2a8c96-fcff-450d-9290-06ea92436890 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 204 len: 0 microversion: 2.1 time: 0.424125 Oct 04 18:23:16.561163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2096/4173] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:16 2022] DELETE /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:16.566746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:16.574131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.574131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.574542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.574987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.575707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.576168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.576591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.795184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-715aa546-3e49-4620-804b-9845e63b2915 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 204 len: 0 microversion: 2.1 time: 0.515976 Oct 04 18:23:16.796446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2078/4174] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:16 2022] DELETE /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:16.802111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.802826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.809266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.809765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.810211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.810927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.811373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.811984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.893663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ba70c42-2ad9-46f2-b9cc-c74a33355011 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action" status: 202 len: 0 microversion: 2.1 time: 0.330905 Oct 04 18:23:16.894670 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2097/4175] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:16 2022] POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:16.899404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.910072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.910894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.997569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.006667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26b5121c-50e1-40c6-b86b-a8f9896f9949 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1646 microversion: 2.1 time: 0.208594 Oct 04 18:23:17.007260 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2079/4176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1646 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.012185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.012960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.028822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.029541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.030296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.031165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.031824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.032435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.063681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.072341 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4aefc940-9fdf-494f-a55d-1455e02f8ec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.176794 Oct 04 18:23:17.073087 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2098/4177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.078587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.079492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.086190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.086968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.087663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.088587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.089259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.090005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.167248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.176233 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-359a8d36-f546-4bf8-8ccf-2d75d01f17f2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1516 microversion: 2.1 time: 0.167723 Oct 04 18:23:17.177045 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2080/4178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.228303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.236613 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8206abf-be9a-4c3e-9789-ee55595e2d1f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1500 microversion: 2.1 time: 0.162269 Oct 04 18:23:17.237206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2099/4179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:18.032803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.036279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.098395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.098926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.106506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.107004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.107444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.108278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.108740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.109180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.266889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.280786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46206154-bd3e-4c96-868f-7c7c0f37f130 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1646 microversion: 2.1 time: 0.254250 Oct 04 18:23:18.281715 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2081/4180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1646 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:18.296746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.297373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.315374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.315900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.316338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.317039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.318118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.318562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.495664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.505469 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b740a95d-67ed-45aa-98b9-cad245300b61 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.411255 Oct 04 18:23:18.506262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2100/4181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:18.518327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.518327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.519610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.520105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.520807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.521541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.521985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.522411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.599746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.611536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1be943f8-57a9-4b2a-865e-1f36055f84bc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1516 microversion: 2.1 time: 0.328720 Oct 04 18:23:18.612285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2082/4182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1516 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:18.816588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.824626 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cc54a81-0dd8-4ef5-82cc-95763c554d80 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1500 microversion: 2.1 time: 0.317522 Oct 04 18:23:18.840471 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2101/4183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:19.274137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ffb2d49-96e3-4dd0-8164-176744412b27", "name": "network-vif-deleted", "tag": "01e48f55-5582-46eb-bd87-4845d024a320"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:19.295170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.295706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.297713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.308172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.309632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.326074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.326341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.327454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.328207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.328673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.329142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.348380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:19.353534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] Creating event network-vif-deleted:01e48f55-5582-46eb-bd87-4845d024a320 for instance 4ffb2d49-96e3-4dd0-8164-176744412b27 on n-h1-833090-21 Oct 04 18:23:19.357143 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9eadb437-d92b-472c-9ab4-ef0c7926f914 req-88a9ddd1-4713-4017-8656-f1454f72eb5d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092652 Oct 04 18:23:19.358400 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2083/4184] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:19.531052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.531984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.545146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.548408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.548881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.549622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.561914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.562370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.594227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.604813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ea96b00-e31b-4dcc-b5ee-951c9dad2258 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1468 microversion: 2.1 time: 0.300488 Oct 04 18:23:19.608420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2102/4185] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1468 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:19.639080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.639927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.663881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.666240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.666240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.666240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.666240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.666240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.805633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.808495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.815752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d2dcf1f-e404-4da4-8e05-485c965d03a7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.289551 Oct 04 18:23:19.817291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2084/4186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:19.818064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e899390-3fea-4230-867b-1ed23f5a976f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1474 microversion: 2.1 time: 0.183605 Oct 04 18:23:19.832277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2103/4187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1474 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:19.854256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.856183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.871280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.872275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.873925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.877590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.878363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.880868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.064480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.073390 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21255aee-4c7c-4572-97ea-15803e79b315 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1500 microversion: 2.1 time: 0.227873 Oct 04 18:23:20.087962 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2085/4188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.637612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.638231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.645756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.648620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.648620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.648620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.648620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.648620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.693917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.694413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.694972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.695440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lazy-loading 'fault' on Instance uuid 4ffb2d49-96e3-4dd0-8164-176744412b27 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:20.738814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.752286 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e1b7bb7-8f88-45a9-b709-238fabd2a63c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 200 len: 1305 microversion: 2.1 time: 0.117714 Oct 04 18:23:20.752286 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2104/4189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:20.844414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.845646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.846789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.847642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.854814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.855639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.856263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.857162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.858013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.858740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.863177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.864780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.866654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.869474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.870866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.870866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.913469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.914203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.914797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.916823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 725491c4-5c11-4d5a-8ba1-613025ee5529 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:20.975359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.984503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2590fd1-0727-4b17-88b8-2d85a7325929 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 200 len: 1320 microversion: 2.1 time: 0.144542 Oct 04 18:23:20.988889 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2086/4190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.048746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.057433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad49fb16-2b5e-421d-9029-7882f97d4ed9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.216249 Oct 04 18:23:21.058579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2105/4191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.098070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.098701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.104937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.105429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.105902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.106626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.107085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.107551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.240134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.248005 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aab3829a-879d-46ee-8df0-9cb6bdd34bed tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1503 microversion: 2.1 time: 0.154275 Oct 04 18:23:21.249241 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2087/4192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.274298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:21.274855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.281021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.281514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.281955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.282645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.283148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.283591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.307591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lazy-loading 'flavor' on Instance uuid cd04b407-912c-4cc6-a2d0-424f869f72e1 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:21.372775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725491c4-5c11-4d5a-8ba1-613025ee5529", "name": "network-vif-deleted", "tag": "9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:21.383192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.383680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.384115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.395363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] Creating event network-vif-deleted:9d52bc0a-6c89-46e7-ac69-d9bf6e6445d8 for instance 725491c4-5c11-4d5a-8ba1-613025ee5529 on n-h2-833090-21 Oct 04 18:23:21.400384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7089bc3d-ded8-458d-ab00-ba09c89ab72a req-2a563243-5fee-4fec-8978-64b0778821b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 Oct 04 18:23:21.401006 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2088/4193] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:23:21.523889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bb76735-3eca-4d14-a24d-ed3da3eb88e6 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action" status: 202 len: 0 microversion: 2.1 time: 0.253285 Oct 04 18:23:21.524761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2106/4194] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:21 2022] POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:21.534799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.535751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.542349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.542929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.543556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.544292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.544756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.545189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.685440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.693504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d2ff735d-7763-47c8-bb63-42238165f7cd tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1511 microversion: 2.1 time: 0.164538 Oct 04 18:23:21.694083 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2089/4195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.774545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.775361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.782332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.782816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.783255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.783977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.784428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.784849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.799212 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 HTTP/1.1 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4ffb2d49-96e3-4dd0-8164-176744412b27'} Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:21.800923 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfce9591-db29-433b-b8ef-e665a57e504f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 404 len: 111 microversion: 2.1 time: 0.033424 Oct 04 18:23:21.805266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2107/4196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:21.811190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e253fa9f-a6a1-4ae4-8bcb-3c070fe59fea tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008ee1d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.012705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.020314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.021451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.021943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.022379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.023076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.023552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.024121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.047504 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 HTTP/1.1 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '725491c4-5c11-4d5a-8ba1-613025ee5529'} Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:22.049673 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:23:22.053780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:22.054718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:22.056152 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8437c4b0-730e-4524-b669-5be7d3c7b80e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 404 len: 111 microversion: 2.1 time: 0.047366 Oct 04 18:23:22.058717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2108/4197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:22.081113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.083454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.088192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e253fa9f-a6a1-4ae4-8bcb-3c070fe59fea tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55" status: 202 len: 0 microversion: 2.1 time: 0.280794 Oct 04 18:23:22.092166 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2090/4198] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:21 2022] DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:23:22.092823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.097112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.097112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.097112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.097112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.097646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.101206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfaca252-317f-4951-bb02-dd196425846d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008a98430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.377080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.397217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5807934-3b41-469f-8f7a-a9fd436e23e3 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.320023 Oct 04 18:23:22.412835 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2109/4199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:22.424278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1846018314", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "61c5963b-ed6e-46b7-896f-eb580853eb34"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:22.488674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] validate_networks() for [('61c5963b-ed6e-46b7-896f-eb580853eb34', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:22.488802 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cfaca252-317f-4951-bb02-dd196425846d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a" status: 202 len: 0 microversion: 2.1 time: 0.395424 Oct 04 18:23:22.495510 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2091/4200] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:22 2022] DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:22.506526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ec4ddb1-c0e2-45b6-8a28-e42c081003e0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'create', calling method: .version_select at 0x7f9008fd58b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-785826038", "description": "tempest-description-1827072555"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:22.961862 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ec4ddb1-c0e2-45b6-8a28-e42c081003e0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.465132 Oct 04 18:23:22.973043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2092/4201] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:23:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:22.977288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.978226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.986171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.986771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.987387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.988286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.988825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.989356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.159787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.171121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b7e42f7-0448-432f-8461-5d7a5179602f tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1494 microversion: 2.1 time: 0.206770 Oct 04 18:23:23.172058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2093/4202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1494 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:23.179302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-701fff89-2d88-429d-adc9-ecec1fa8450d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Action: 'update', calling method: .version_select at 0x7f9008ee1700>, body: {"security_group": {"name": "tempest-sg-hth-1289967548", "description": "tempest-description-hth-689562694"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:23.431526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-701fff89-2d88-429d-adc9-ecec1fa8450d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8" status: 200 len: 217 microversion: 2.1 time: 0.257564 Oct 04 18:23:23.439932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2094/4203] 10.222.0.40 () {60 vars in 1290 bytes} [Tue Oct 4 18:23:23 2022] PUT /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8 => generated 217 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:23.445589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:23.446144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.449466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:23.454289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.454984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.455681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.456407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.457030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.457464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.550068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:23.550520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:23.550990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:23.551440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:23.551972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:23.561283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.561775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.562199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.562951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.563375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.563953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.581543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:23.587058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Getting quotas for user 6fa2db6eeff04a2a804e22ed1ddfd9a9 and project ff5642b49be949e685762fb6d9f2e93d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:23.600867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:23.604539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:23.822045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44d264cf-cc89-4c0f-a293-e9acb4b8a40a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407714 Oct 04 18:23:23.822609 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2110/4204] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:23:23.827131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.827966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.834670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.835153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.835625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.836320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.836769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.837247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.850660 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c24c6e4-2d19-43a5-8b0d-a0f2fe52beee tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action" status: 202 len: 0 microversion: 2.1 time: 0.408795 Oct 04 18:23:23.852039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2095/4205] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:23 2022] POST /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:23.859953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81fc2b53-ceba-432f-83c4-7a1d13cf0245 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9008ee1940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.913781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81fc2b53-ceba-432f-83c4-7a1d13cf0245 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8" status: 200 len: 217 microversion: 2.1 time: 0.059234 Oct 04 18:23:23.914606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2096/4206] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8 => generated 217 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:23.921916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73f79c8d-20ae-4835-a430-b04f6393a392 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.922822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73f79c8d-20ae-4835-a430-b04f6393a392 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.014960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73f79c8d-20ae-4835-a430-b04f6393a392 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.035285 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73f79c8d-20ae-4835-a430-b04f6393a392 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1209 microversion: 2.1 time: 0.119353 Oct 04 18:23:24.035923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2097/4207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:24.056654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.057267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.064558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.069404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.069404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.069404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.069404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.069404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.198244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.202644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:24.212482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de2108ae-668c-48a1-a13e-c3c69e93a3c2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.388634 Oct 04 18:23:24.218393 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2111/4208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:24.222640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-867bfc34-4956-419e-9037-9c499c403bc3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009626310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.228928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.237637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fc98488-839d-49c9-8115-4710975d4b40 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1500 microversion: 2.1 time: 0.189914 Oct 04 18:23:24.249973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2098/4209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:24 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:24.872443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-867bfc34-4956-419e-9037-9c499c403bc3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8" status: 202 len: 0 microversion: 2.1 time: 0.650573 Oct 04 18:23:24.872443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2112/4210] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:24 2022] DELETE /compute/v2.1/os-security-groups/b2d1fd41-079e-4f22-b030-076c3606ebd8 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:24.875551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.876128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.883336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.883931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.884463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.885239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.885782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.886216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.905706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 HTTP/1.1 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4ffb2d49-96e3-4dd0-8164-176744412b27'} Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:24.907429 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a5a076b-e1ff-442f-b04a-21a52a7d5b7f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 404 len: 111 microversion: 2.1 time: 0.038328 Oct 04 18:23:24.915319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2099/4211] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:24 2022] DELETE /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:24.918952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.919594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: 4ffb2d49-96e3-4dd0-8164-176744412b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.926888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.927377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.927865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.928777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.929165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.929588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.944432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 HTTP/1.1 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4ffb2d49-96e3-4dd0-8164-176744412b27'} Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:24.946210 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. Oct 04 18:23:24.950117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:24.951328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Instance 4ffb2d49-96e3-4dd0-8164-176744412b27 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:24.952353 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dcbb371a-49c3-4f53-abf9-053670e6da2f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27" status: 404 len: 111 microversion: 2.1 time: 0.038313 Oct 04 18:23:24.956030 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2113/4212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:24 2022] GET /compute/v2.1/servers/4ffb2d49-96e3-4dd0-8164-176744412b27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:24.961236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90097509d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.995853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:24.996461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group 122c42f0-9430-4920-9a9c-8fb6a74d348a not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:24.997730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:24.997730 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a HTTP/1.1 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '122c42f0-9430-4920-9a9c-8fb6a74d348a'} Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.005229 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group 122c42f0-9430-4920-9a9c-8fb6a74d348a does not exist Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-bcd0f6d6-82e4-4ce6-9001-c479a49f8dd2'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e0d7b5c-425b-4b66-b84c-7ec9b072293a tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a" status: 404 len: 194 microversion: 2.1 time: 0.043756 Oct 04 18:23:25.009096 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2100/4213] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:24 2022] DELETE /compute/v2.1/os-security-groups/122c42f0-9430-4920-9a9c-8fb6a74d348a => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:25.012943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f900d8d9550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.050096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:25.051591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 not found {{(pid=123887) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:25.052327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.052327 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55 HTTP/1.1 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'bc2852e1-e454-48f3-98a0-6dc804f2fe55'} Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.054907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group bc2852e1-e454-48f3-98a0-6dc804f2fe55 does not exist Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-6102cdff-cc1a-40b1-96b0-502aafd7204a'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.058074 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af0bacb8-d6bd-482f-a29e-c3a420ae7e1f tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55" status: 404 len: 194 microversion: 2.1 time: 0.048340 Oct 04 18:23:25.062774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.062774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.063039 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2114/4214] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-security-groups/bc2852e1-e454-48f3-98a0-6dc804f2fe55 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:25.067162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f900d7d8ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.083020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.083635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.084262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.084990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.085696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.086147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.110013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:25.110934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group 6bcfcd29-a84b-4985-8110-425cef485fda not found {{(pid=123887) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:25.111458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.111458 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda HTTP/1.1 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6bcfcd29-a84b-4985-8110-425cef485fda'} Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.113594 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group 6bcfcd29-a84b-4985-8110-425cef485fda does not exist Oct 04 18:23:25.117416 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-0f71ed8f-f004-4d31-b9be-3b8be50f44ad'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.120041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b80c067f-898b-4fa1-9302-0c71b82d964b tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda" status: 404 len: 194 microversion: 2.1 time: 0.055725 Oct 04 18:23:25.120550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2115/4215] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-security-groups/6bcfcd29-a84b-4985-8110-425cef485fda => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:25.129228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f90098d7040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.157181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.165593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dedb44cc-23b9-40b3-bf23-e2528c7be485 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1213 microversion: 2.1 time: 0.111001 Oct 04 18:23:25.180151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2101/4216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:25.198804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG neutronclient.v2_0.client [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist", "detail": ""}} {{(pid=123887) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:25.199410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc not found {{(pid=123887) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:25.200241 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.200241 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc HTTP/1.1 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: exception: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc'} Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.202856 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc does not exist Oct 04 18:23:25.208809 n-d-833090-21 devstack@n-api.service[123887]: Neutron server returns request_ids: ['req-e7d509ea-2d54-441c-a9da-178cddf15b60'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.211376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-636754d7-2b63-4a9a-a3ef-23be94a83850 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc" status: 404 len: 194 microversion: 2.1 time: 0.080507 Oct 04 18:23:25.212474 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2116/4217] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-security-groups/c5e221bd-c2c0-4dcc-951f-aa1d675eb6fc => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:23:25.220456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009750dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.236956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.238067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.247086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.247086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.247086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.249797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:25.250398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:25.250950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.250950 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408 HTTP/1.1 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6a19c0c2-84ca-4a8e-9184-f3502a07c408'} Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.253185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] Oct 04 18:23:25.256981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.260620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group 6a19c0c2-84ca-4a8e-9184-f3502a07c408 does not exist Oct 04 18:23:25.260620 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-82ff51df-d9bb-4ae8-b736-34a9bbdebb44'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.261531 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7562514c-a45d-423c-af0c-5f58337dc72c tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408" status: 404 len: 194 microversion: 2.1 time: 0.045150 Oct 04 18:23:25.262097 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2102/4218] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-security-groups/6a19c0c2-84ca-4a8e-9184-f3502a07c408 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:25.262676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.263509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.264658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.273865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.276290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.294821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.295614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.297248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.297248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.297946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.299733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.454378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.462762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe63784e-ae58-43e6-8bc2-ac421a172144 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1500 microversion: 2.1 time: 0.195865 Oct 04 18:23:25.463936 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2103/4219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:25.468791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009997550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.486434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.494974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9cfff7c8-2666-49df-a514-1519d15097ec tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.261977 Oct 04 18:23:25.495102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG neutronclient.v2_0.client [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist", "detail": ""}} {{(pid=123886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 18:23:25.495949 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2117/4220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:25.496097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.security_group_api [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Neutron security group ddb083c8-b48c-4008-953a-d53351dc4c04 not found {{(pid=123886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 18:23:25.496622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.496622 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 HTTP/1.1 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: exception: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ddb083c8-b48c-4008-953a-d53351dc4c04'} Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 18:23:25.500149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] Oct 04 18:23:25.503557 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:23:25.506293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Security group ddb083c8-b48c-4008-953a-d53351dc4c04 does not exist Oct 04 18:23:25.506293 n-d-833090-21 devstack@n-api.service[123886]: Neutron server returns request_ids: ['req-6789d359-83d0-4529-982a-7d2c29d2c908'] {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:25.507151 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8cc3f65a-641d-49ed-9b8a-1c24447d5590 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04" status: 404 len: 194 microversion: 2.1 time: 0.042045 Oct 04 18:23:25.507755 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2104/4221] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/os-security-groups/ddb083c8-b48c-4008-953a-d53351dc4c04 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:25.517167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.517993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.524729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.529320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.529320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.529320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.529320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.529320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.559433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:25.891283 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60c133ee-8197-46d6-91d1-ea9ee9c7cefd tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 204 len: 0 microversion: 2.1 time: 0.378796 Oct 04 18:23:25.899227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2118/4222] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:25 2022] DELETE /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:25.911879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.916209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.930616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.931154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.931656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.932377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.932931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.933341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.103612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:26.112506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc84dc9f-46f1-4c51-9cbb-0b39532d4dd0 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1647 microversion: 2.1 time: 0.216213 Oct 04 18:23:26.113142 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2105/4223] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1647 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:26.199417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.200763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.207687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.208178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.210480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.210480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.210480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.210739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.296861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:26.310266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a7e1259-14da-4d8f-8bba-b3210cccccaf tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1261 microversion: 2.1 time: 0.110385 Oct 04 18:23:26.310266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2119/4224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:26.487718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.488470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.494974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.495540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.495989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.496690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.497147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.497603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.524056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.525217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.532766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.533264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.533707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.534483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.535112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.536205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.658379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:26.667875 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4b49ea7-1868-4d46-94cb-687038630f54 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1503 microversion: 2.1 time: 0.184564 Oct 04 18:23:26.669190 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2106/4225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:26.694609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.695498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.702721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.703613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.704188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.705047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.705750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.706281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.745099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:26.911144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:27.060570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.068682 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f2ba47f-e29e-4020-9728-042ce4bd6250 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.549591 Oct 04 18:23:27.069278 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2120/4226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:27.073931 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fabb68a-d949-4d9d-b747-214e1d05efd1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 204 len: 0 microversion: 2.1 time: 0.383907 Oct 04 18:23:27.077507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2107/4227] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:26 2022] DELETE /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:27.084992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:27.085620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:27.092255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.092744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.093182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.094668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.095134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.095600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.137357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:27.138098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:27.145624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.146162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.146599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.147313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.147801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.148235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.276973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.286893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-897c8478-0958-4ac6-a3b2-35359c441efe tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1509 microversion: 2.1 time: 0.207130 Oct 04 18:23:27.288757 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2121/4228] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:27 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:27.330056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:27.330980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:27.337936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.338532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.339215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.340278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.340797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.341329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.425858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.430553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.435395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ba63157-515b-4799-92fd-84ef36568cb5 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1647 microversion: 2.1 time: 0.302177 Oct 04 18:23:27.438482 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2108/4229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:27 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1647 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:27.448485 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9508902b-ae7f-4707-ae28-848420a47dfb tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1261 microversion: 2.1 time: 0.122808 Oct 04 18:23:27.450216 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2122/4230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:27 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:28.094443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.094443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.101626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.102155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.102601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.103307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.103801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.104241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.260757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.269261 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa61205e-0d9d-4999-b90a-e6ef1cb1227b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.179785 Oct 04 18:23:28.269981 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2109/4231] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:28.310705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.311344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.318866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.319361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.319866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.320576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.321032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.321486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.461609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.462221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.468892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.469384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.469821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.470528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.470985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.471702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.541640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.550280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c818241f-8d8e-4aeb-a904-8f7eaac0d535 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1509 microversion: 2.1 time: 0.243402 Oct 04 18:23:28.551028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2123/4232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:28.555929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.556789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.563541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.564139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.564789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.566087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.566753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.567383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.643694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.654628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f23934a-31db-4ff3-b25e-a69c7ca6457c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1261 microversion: 2.1 time: 0.102237 Oct 04 18:23:28.670250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.670991 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2124/4233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:28.675458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b44b7206-8393-4698-a736-69a50e1d6753 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1647 microversion: 2.1 time: 0.217687 Oct 04 18:23:28.676086 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2110/4234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1647 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:29.294673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.295286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.302897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.303707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.304145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.305612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.306206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.306637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.580027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.581297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.592578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.593248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.594460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.595421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.596915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.598214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.807088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.813951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.824465 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8a2a445-ffed-455d-ba25-32e3147eb4a1 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1509 microversion: 2.1 time: 0.250641 Oct 04 18:23:29.825384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2111/4235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:29.835816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cffb19e-3296-46fa-89d0-9f0cfc0fa8c9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.535950 Oct 04 18:23:29.835816 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2125/4236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:29.835816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.835816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.844323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.848117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.848873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.855682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.856458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.857079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.857812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.858272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.858700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.981595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.003114 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6a8a3dd-404a-479c-9a8c-3785b54391c1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1267 microversion: 2.1 time: 0.175037 Oct 04 18:23:30.004242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2126/4237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:30.060824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd04b407-912c-4cc6-a2d0-424f869f72e1", "name": "network-vif-deleted", "tag": "de4d856c-aa73-4d06-a3bc-0a96bd5788bf"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:30.071719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.072524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.072945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.085206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] Creating event network-vif-deleted:de4d856c-aa73-4d06-a3bc-0a96bd5788bf for instance cd04b407-912c-4cc6-a2d0-424f869f72e1 on n-h1-833090-21 Oct 04 18:23:30.090243 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e51b035f-b8c5-48dc-8423-ec244bb5971b req-015cc9eb-992f-44d3-bf68-c85c46117eb0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033296 Oct 04 18:23:30.091171 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2127/4238] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:30.136783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.145663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ed578d9-b84c-4eb5-a1b0-9443569cfd76 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1647 microversion: 2.1 time: 0.302968 Oct 04 18:23:30.146246 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2112/4239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1647 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:30.852622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.857868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.858908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.863579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.878364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.880295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.882349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.888186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.888299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.888384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.888384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.890938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.891562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.892355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.895436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.895975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.993877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.994665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.995527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.996174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lazy-loading 'fault' on Instance uuid cd04b407-912c-4cc6-a2d0-424f869f72e1 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:31.083640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c63b303c6f534a5bad3c7e7b90280ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d57df3ab8a4a84a130dc9e3b351f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.097057 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cf4721d-9e9e-4e96-a2ab-ba1a64c1450c tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 200 len: 1305 microversion: 2.1 time: 0.250631 Oct 04 18:23:31.110894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2128/4240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 1305 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.122232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d661115e-e189-4515-b158-5745d1a17508", "name": "network-vif-deleted", "tag": "676431ff-0760-4fc7-a5ca-c3d3e9c20722"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:31.141661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:31.141661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.141661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.141661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.161236 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] Creating event network-vif-deleted:676431ff-0760-4fc7-a5ca-c3d3e9c20722 for instance d661115e-e189-4515-b158-5745d1a17508 on n-h1-833090-21 Oct 04 18:23:31.171000 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0b1fa90f-73b9-46cc-937f-d6cae2c4f778 req-9d942d11-957c-4a68-a0ab-a5585ac47cdd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052360 Oct 04 18:23:31.171710 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2129/4241] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:31.175903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.180712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.181745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.190664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.192261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.193205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.194457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.194639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-788ec862-196b-4b57-9b4d-f0786b02cf62 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.345503 Oct 04 18:23:31.195313 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2113/4242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.195431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.195941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.201103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.201718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.209029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.209600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.210118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.210834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.211291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.211786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.289258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.300066 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57ae58c5-899b-4475-9d52-96801de8d4c3 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1301 microversion: 2.1 time: 0.102989 Oct 04 18:23:31.300254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.315494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2114/4243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.315853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06c24318-e571-4f5d-9c54-5e016afaffc4 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1267 microversion: 2.1 time: 0.138280 Oct 04 18:23:31.315853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2130/4244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.889002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.889873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.903582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.904499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.905168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.906982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.908250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.909089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.972763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09ea9999-c018-4ee2-b691-f438e2445f91 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/ips" status: 200 len: 146 microversion: 2.1 time: 0.091002 Oct 04 18:23:31.973948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2115/4245] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/ips => generated 146 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:32.129143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.136389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] [instance: cd04b407-912c-4cc6-a2d0-424f869f72e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.142437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.148863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.149513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.150283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.150753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.151177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.169830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] HTTP exception thrown: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Request method failure captured: Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 HTTP/1.1 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHn5Jy4srzD9SroP4j1sHJoRV2fFNvJe7jB-9BlE4flFXdwDCU_tI7uWy-ZCchSAp-YolNl1PmryQkLHNad0R9jmpl5MTLVEdRUO4NxJAPwuXfj2ZcbtOhU9td7hci7WN0AWbJK1bwvTEOx-IjFC_rajBKW8TBEqyjlxufCMZa55MHY Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 09d57df3ab8a4a84a130dc9e3b351f34 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestServerAdvancedOps-672525389 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_09d57df3ab8a4a84a130dc9e3b351f34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09d57df3ab8a4a84a130dc9e3b351f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/09d57df3ab8a4a84a130dc9e3b351f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/09d57df3ab8a4a84a130dc9e3b351f34"}]}] Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestServerAdvancedOps-672525389 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 09d57df3ab8a4a84a130dc9e3b351f34 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestServerAdvancedOps-672525389 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestServerAdvancedOps-672525389-project Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c63b303c6f534a5bad3c7e7b90280ab8 Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestServerAdvancedOps-672525389-project Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'cd04b407-912c-4cc6-a2d0-424f869f72e1'} Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:32.173519 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. Oct 04 18:23:32.177008 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:32.178854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] Returning 404 to user: Instance cd04b407-912c-4cc6-a2d0-424f869f72e1 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:32.180465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55126b76-7b88-4ec7-9bed-c42043660a87 tempest-TestServerAdvancedOps-672525389 tempest-TestServerAdvancedOps-672525389-project] 10.222.0.40 "GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1" status: 404 len: 111 microversion: 2.1 time: 0.059620 Oct 04 18:23:32.185188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2131/4246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/cd04b407-912c-4cc6-a2d0-424f869f72e1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:32.221749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.222384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.232610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.233118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.233575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.234336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.237785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.242974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.336590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.337400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.346833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.347341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.347803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.348502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.349314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.349830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.387994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.388774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.389375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.390626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lazy-loading 'fault' on Instance uuid d661115e-e189-4515-b158-5745d1a17508 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:32.465660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef65b403d7c46fcbc2de208ba792f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b00849668db4b0481d259fc4fceb449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.468206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:32.476712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a892934-fad5-4525-a14f-e51bd75efb48 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 200 len: 1306 microversion: 2.1 time: 0.147871 Oct 04 18:23:32.477511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2132/4247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:32.502807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.503850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.511604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.512371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.512836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.518492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.518492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.518492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.518492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.524583 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8069b922-bb11-4da3-aee2-15059bc3413a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.307752 Oct 04 18:23:32.525451 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2116/4248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:32.835021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.849557 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f06bac7-c416-4079-bcb5-5ad483187dc7 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.360242 Oct 04 18:23:32.851819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2133/4249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:33.474093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafbce24-a1bb-4eab-8271-8aadc1ed4c16", "tag": "55a15219-5350-404b-ab16-076d340ccfa9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:33.487812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.488646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.489334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.507563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.509070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] [instance: d661115e-e189-4515-b158-5745d1a17508] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:33.523850 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] Creating event network-changed:55a15219-5350-404b-ab16-076d340ccfa9 for instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 on n-h1-833090-21 Oct 04 18:23:33.527142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.528038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.528699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.533054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.537664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.538747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.543011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e5cf18c2-5d44-4e80-8a1c-fa230231c2d0 req-ee996749-ddeb-44be-98a9-98b5ab43ee4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075046 Oct 04 18:23:33.569633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2117/4250] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:33.573563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.588595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:33.594300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:33.595698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:33.597567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] HTTP exception thrown: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Request method failure captured: Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 HTTP/1.1 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnXPip0Y1uBT5chnhjwYmxa1so7mN5NJh30vPn6OjDTaf-xBCOjCNGJ10hbGVtk8ow9zXfhDmiIE_BRFKZ8nRao_zxaAlOYCoAaGb-AVbNj94LehWmxtLVOISq2oD6Zb0-cMuPVa0Jjxyw9Wce1Y5np_ZxSH9ZbyST93dw8c73xzRo Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b00849668db4b0481d259fc4fceb449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b00849668db4b0481d259fc4fceb449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b00849668db4b0481d259fc4fceb449"}]}] Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7b00849668db4b0481d259fc4fceb449 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-62227880 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0ef65b403d7c46fcbc2de208ba792f65 Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-SecurityGroupsTestJSON-62227880-project Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd661115e-e189-4515-b158-5745d1a17508'} Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:33.600612 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. Oct 04 18:23:33.604140 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:33.610066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Returning 404 to user: Instance d661115e-e189-4515-b158-5745d1a17508 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:33.620043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d06a5b1f-abce-498f-9a3c-8a52300680c4 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508" status: 404 len: 111 microversion: 2.1 time: 0.110372 Oct 04 18:23:33.620043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2134/4251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/v2.1/servers/d661115e-e189-4515-b158-5745d1a17508 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.620303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.635137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff3fcc1a-ce48-431b-a684-5de144d4f648 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009603670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.857727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:33.865952 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f538477-b49d-4f28-9b41-4897685cfec4 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.303501 Oct 04 18:23:33.866548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2118/4252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:33.874001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.874838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:33.881387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.882179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.882764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.884693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.885294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.885892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.021005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:34.060552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.069416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63583540-fdb6-4a97-b87e-c507f4a72940 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.199049 Oct 04 18:23:34.073456 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2119/4253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:34.322630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff3fcc1a-ce48-431b-a684-5de144d4f648 tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/e792f86b-31ef-4d07-b550-aeeb94d9f491" status: 202 len: 0 microversion: 2.1 time: 0.698291 Oct 04 18:23:34.323283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2135/4254] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:33 2022] DELETE /compute/v2.1/os-security-groups/e792f86b-31ef-4d07-b550-aeeb94d9f491 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:34.331789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9036ab76-dd63-40cc-a627-5fcbe6cc249d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] Calling method '.version_select at 0x7f9009f25670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:34.701037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9036ab76-dd63-40cc-a627-5fcbe6cc249d tempest-SecurityGroupsTestJSON-62227880 tempest-SecurityGroupsTestJSON-62227880-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f0261661-ce89-456d-8066-21e39e87b085" status: 202 len: 0 microversion: 2.1 time: 0.373514 Oct 04 18:23:34.701625 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2120/4255] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:34 2022] DELETE /compute/v2.1/os-security-groups/f0261661-ce89-456d-8066-21e39e87b085 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:34.898335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:34.899194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:34.934745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.937563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.938235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.939082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.941158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.941857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.094240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:35.094967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.102799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.105423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.106615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.109863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.145380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.145945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.147201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:35.158554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6fad772b-e8ea-487b-a09f-2b189188367a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.270701 Oct 04 18:23:35.159914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2136/4256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:34 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:35.394725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:35.404103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc8f9db7-3e8c-4877-975f-f4224987aefa tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.313823 Oct 04 18:23:35.416406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2121/4257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:35.805905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be9bea9-bb5f-44b7-b0b3-3ed096a76bbd"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:35.808579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.815170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.815949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.816397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.817108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.817567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.818953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.186065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:36.187306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:36.194418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.195211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.195685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.196477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.196910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.197342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.461362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.469827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0358545-16b7-434a-8955-fef729a25be0 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.289970 Oct 04 18:23:36.470837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2122/4258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:36 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:36.475901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:36.476799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:36.483095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.483770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.484348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.485222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.485874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.486582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.736807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.750542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45e59379-79e4-4171-acd7-49c0cbb42382 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.275750 Oct 04 18:23:36.751263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2123/4259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:36 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:37.496125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.496797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.518411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.519001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.519386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.520152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.520627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.524096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.748012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:37.756914 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b284e88d-225b-4a0b-8d8b-7a894791e9dc tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.264774 Oct 04 18:23:37.771753 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2124/4260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:37.787274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.795027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.798782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.799296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.802415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.803181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.804435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.804897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.833916 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5733a91-e2e8-4bd4-a90a-2923960ea276 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.032023 Oct 04 18:23:37.834620 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2137/4261] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:23:35 2022] POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments => generated 194 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:38.044896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.050950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01ed424a-25df-4b41-89cf-9e17f93f2560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.274641 Oct 04 18:23:38.052113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2125/4262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:38.783968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:38.785185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:38.796199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.796964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.797642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.798564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.799241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.799922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.079351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.080039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.091499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.093492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.096143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.097014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.098926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.099561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.128265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:39.175533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.186451 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0962558f-deac-4739-bfa1-c541bfdc375b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1485 microversion: 2.1 time: 0.407781 Oct 04 18:23:39.188200 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2138/4263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:38 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1485 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:39.193023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafbce24-a1bb-4eab-8271-8aadc1ed4c16", "name": "network-vif-plugged", "status": "completed", "tag": "55a15219-5350-404b-ab16-076d340ccfa9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:39.205656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.206152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.206646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.222233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] Creating event network-vif-plugged:55a15219-5350-404b-ab16-076d340ccfa9 for instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 on n-h1-833090-21 Oct 04 18:23:39.227577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6b1d0c5c-90d9-45f0-b6cc-4a76777bf292 req-078e2f90-6158-48e0-8895-bf61fffeff60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037904 Oct 04 18:23:39.228658 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2139/4264] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:39.236772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:39.237490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.245449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.246161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.246794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.247794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.248801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.250798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.341110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.355506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2deb4c9-43da-447e-bb9b-a6e9baaf75bd tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.281366 Oct 04 18:23:39.356137 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2126/4265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:39.509375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-441178ba-ec90-4138-98c5-3ac173c65d5d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "POST /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592/action" status: 202 len: 0 microversion: 2.1 time: 0.278726 Oct 04 18:23:39.513056 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2140/4266] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:39 2022] POST /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:39.519393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.521034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.529077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.529906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.531138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.532244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.533047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.533698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.713284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.723425 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-54e01e95-20b6-4f67-bf81-bf1b1bcf5f4c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1493 microversion: 2.1 time: 0.208817 Oct 04 18:23:39.727996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2127/4267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1493 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:40.389273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:40.391955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:40.407666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.408739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.409629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.410525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.412757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.413386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.747124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:40.748286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:40.763306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.763835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.768390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.769216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.769694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.770978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.846802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.862655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e92d636-48fb-459d-90ce-959be6c8762c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1309 microversion: 2.1 time: 0.483977 Oct 04 18:23:40.863324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2141/4268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:40 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:41.197205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.213271 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2978aa9-f76b-4801-809a-5c480ce4c72d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1493 microversion: 2.1 time: 0.470791 Oct 04 18:23:41.215057 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2128/4269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:40 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:41.890728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.894691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.909175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.911106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.913028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.915011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.916908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.917721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.127528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.136253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bedaaff3-1d18-4fdc-8a4a-6d14794aa7d5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1490 microversion: 2.1 time: 0.253233 Oct 04 18:23:42.137022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2142/4270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1490 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.162354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-603967449"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:42.164932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.172440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.172935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.173381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.174085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.174548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.174976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.241982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.241982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.249291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.249792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.250238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.250946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.251423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.251876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.375311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7c8d7c3-0902-48bd-afac-9374be5a4f7b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "PUT /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1074 microversion: 2.1 time: 0.217142 Oct 04 18:23:42.376602 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2129/4271] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:23:42 2022] PUT /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1074 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.398226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.398756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.421903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.422765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.423450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.430900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.430900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.430900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.535291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.554983 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfaee3d1-27be-4171-8ebc-09a95fa4e0a2 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1493 microversion: 2.1 time: 0.316406 Oct 04 18:23:42.559536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2143/4272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1493 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.233826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.250757 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b14cf6e-77b4-409d-addd-f6b2f7e61470 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1500 microversion: 2.1 time: 0.854766 Oct 04 18:23:43.251966 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2130/4273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1500 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.277606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.278284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.290205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.290721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.292259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.294884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.295584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.297485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.515411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.528285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f05cd952-aaf5-41d9-bc28-e3291042fe50 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1500 microversion: 2.1 time: 0.254519 Oct 04 18:23:43.529075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2144/4274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.552322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:43.560795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.562111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.562856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.581579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.582515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.590909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.591405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.591911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.592654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.593147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.593578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.747564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:23:43.985814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.015321 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4cf8838b-c4b8-4cbb-86f9-502dcfec939a tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1493 microversion: 2.1 time: 0.438114 Oct 04 18:23:44.033012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2145/4275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1493 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:44.070880 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a5676a8-72bb-4a78-91dd-bc474f1b54ee tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "POST /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16/action" status: 202 len: 0 microversion: 2.1 time: 0.522764 Oct 04 18:23:44.071932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2131/4276] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:43 2022] POST /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:44.080854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:44.082403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:44.097794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.111252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.111252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.111252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.111252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.111252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.436293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.448617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac6849b6-69f6-45e8-bd98-09cceabb048d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.371592 Oct 04 18:23:44.449325 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2146/4277] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:44 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:45.043901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.044698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.067292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.451637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.461831 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7db1947a-8967-430a-a6af-b03c307cf29b tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1499 microversion: 2.1 time: 0.423361 Oct 04 18:23:45.462984 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2132/4278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:45.473966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.474500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.485922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.491515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.491515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.491515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.491515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.495303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.495830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.503131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.511273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.518352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.519147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.520207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.520913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.521560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.589853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:45.723311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.739561 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-515a0b23-c5bb-4cfe-9ce1-38983f550f8a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.264984 Oct 04 18:23:45.739561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2147/4279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:45.982963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db42f7bc-5d37-47b9-a38b-16f7e240e92f tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "DELETE /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 204 len: 0 microversion: 2.1 time: 0.488163 Oct 04 18:23:45.984411 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2133/4280] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:45 2022] DELETE /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:23:45.996939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.998003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:46.008364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.011213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.011213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.012160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.013367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.014033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.108972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-160033561", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "46e19804-7e19-45f9-ae44-7dc535fcfc54"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:46.179873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] validate_networks() for [('46e19804-7e19-45f9-ae44-7dc535fcfc54', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:46.360596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:46.375833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-361afbca-93f2-4883-8690-1560a03b0aef tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.385466 Oct 04 18:23:46.379058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2134/4281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:46.723795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:46.724733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:46.725344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:46.725866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:46.726452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:46.742015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.742409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.742848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.743799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.744243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.750879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.772083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:46.772957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:46.774561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:46.780859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for user ae17dd6021594d549826a12292cf70a3 and project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:46.792597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.793218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.794071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.795126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.796424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.797552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:46.798175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.800507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:46.954791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d05c18bc-ad88-4816-82d6-a420980771f2 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006289 Oct 04 18:23:46.967023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2148/4282] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:23:47.042965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1076551082", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "46e19804-7e19-45f9-ae44-7dc535fcfc54"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:47.110060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] validate_networks() for [('46e19804-7e19-45f9-ae44-7dc535fcfc54', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:47.225968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.237610 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07427399-283b-4686-8e48-df33453a9a1d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.473958 Oct 04 18:23:47.252948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2135/4283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:46 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:47.401821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:47.403426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:47.413479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.414165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.414697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.415512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.416244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.416885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.669932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.710319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e40ba537-cf0c-4a25-ab85-76e2f98f2aaa tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.314359 Oct 04 18:23:47.721490 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2136/4284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:47 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:48.266085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.266762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.278472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.281163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.281621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.282364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.284661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.287395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.552915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:48.553381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:48.553797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:48.554218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:48.554616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:48.572260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.572640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.573072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.573792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.574241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.574659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.619422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:48.627401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.642148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e80aaccd-e100-4f47-8d98-7b0dc4d5f92f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.375912 Oct 04 18:23:48.642744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2137/4285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:48.646826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for user ae17dd6021594d549826a12292cf70a3 and project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:48.674878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:48.683410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:48.735249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.735894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.767371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.767371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.767371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.781522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.782064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.782520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.909395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-99112d91-9a9d-4a30-9b58-fb0fc4f2953c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870321 Oct 04 18:23:48.910666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2149/4286] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:23:48.994545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.004674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.036551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.037048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.037486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.038197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.049890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.050351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.205357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.214190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30e407e6-2304-48ea-adda-4bd3fc692790 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 0.483704 Oct 04 18:23:49.215308 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2138/4287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:49.224950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2105926891", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "451", "networks": [{"uuid": "46e19804-7e19-45f9-ae44-7dc535fcfc54"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:49.273926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:49.281248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'services' on Instance uuid d63f2343-aed1-4433-af22-4ed046448951 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:49.413257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] validate_networks() for [('46e19804-7e19-45f9-ae44-7dc535fcfc54', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:49.714222 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9618fdc-7072-46d8-83fa-89628423d544 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments/66a5e8de-6c81-4773-8586-ce9820d39649" status: 202 len: 0 microversion: 2.1 time: 0.723974 Oct 04 18:23:49.715431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2150/4288] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:23:48 2022] DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments/66a5e8de-6c81-4773-8586-ce9820d39649 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:49.725264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.726173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.765030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.765733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.766195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.766949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.767416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.776441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.650249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.663915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c17c21e4-994e-47ae-9db3-5bae2496a499 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.942472 Oct 04 18:23:50.668308 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2151/4289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:50.673580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.684114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.698859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.699367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.708831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.709843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.710669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.711118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.797304 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c38bdf7-e68e-464a-8a78-a4bb9177074d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127725 Oct 04 18:23:50.797909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2152/4290] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:50.818714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.844248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.867189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.867739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.868163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.882139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.883574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.887778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.932062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:50.933562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:50.934322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:50.935015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:50.935717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:50.956705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.957575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.958292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.959247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.959976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.960629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.987896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:50.996133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Getting quotas for user ae17dd6021594d549826a12292cf70a3 and project 517596408a7e4175b1593b7ec9d55b65. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:51.000299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:51.018882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:51.039243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:51.167214 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bd66a7e4-4941-4917-9759-c7b198032770 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.950620 Oct 04 18:23:51.171512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2139/4291] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:23:51.189732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92cdc97c-fdfd-4afc-8b5b-0417d2d83fec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.193451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-92cdc97c-fdfd-4afc-8b5b-0417d2d83fec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.349374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92cdc97c-fdfd-4afc-8b5b-0417d2d83fec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.365357 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92cdc97c-fdfd-4afc-8b5b-0417d2d83fec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1221 microversion: 2.1 time: 0.182822 Oct 04 18:23:51.373091 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2140/4292] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.691430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.692205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.722954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.762506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:52.064070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:52.074505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0baf6058-efd3-43a4-927c-f333d1d5f01e tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1505 microversion: 2.1 time: 1.275516 Oct 04 18:23:52.075121 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2153/4293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1505 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:52.090525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:52.112900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.113568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.115752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.250950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:52.275564 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-979951f8-3788-410d-b05f-4f8714644c05 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.586480 Oct 04 18:23:52.278023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2141/4294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:52.291907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.305737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.363848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.370444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Going to try to stop instance {{(pid=123887) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:23:52.381491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.385559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.391811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.393865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.397648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.522654 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd304cf6-4887-4b64-a9d8-d56eaf7a805b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240141 Oct 04 18:23:52.526826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2142/4295] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:52.559597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3aab59ef-7a2a-49f9-ae95-d169ad01a24b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.559597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3aab59ef-7a2a-49f9-ae95-d169ad01a24b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.636614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24410e21-5dba-4161-ad43-600bd2ca4998 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action" status: 202 len: 0 microversion: 2.1 time: 0.555855 Oct 04 18:23:52.640443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2154/4296] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:52 2022] POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:52.663899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.664759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.704799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.709511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.710148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.710878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.717998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.718596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.778016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3aab59ef-7a2a-49f9-ae95-d169ad01a24b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:52.786249 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3aab59ef-7a2a-49f9-ae95-d169ad01a24b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1221 microversion: 2.1 time: 0.258145 Oct 04 18:23:52.794425 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2143/4297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1221 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:52.814861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ec33f8-1217-43a3-b250-e25bf8072592", "name": "network-vif-deleted", "tag": "1234f529-258a-4db5-af49-9010d88ce538"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:52.854666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.857026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.858858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.887491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] Creating event network-vif-deleted:1234f529-258a-4db5-af49-9010d88ce538 for instance 24ec33f8-1217-43a3-b250-e25bf8072592 on n-h2-833090-21 Oct 04 18:23:52.900727 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9ec186fa-b493-4415-873a-62e745813228 req-33116372-980c-407c-96c7-70b12a68872e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103908 Oct 04 18:23:52.905153 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2144/4298] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:53.103222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:53.104923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:53.134047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.134549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.135016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.143376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.144775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.145243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.227085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.230355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.232639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.234429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lazy-loading 'fault' on Instance uuid 24ec33f8-1217-43a3-b250-e25bf8072592 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:53.439645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.457469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec29c2dc-9d18-4543-85f4-8a9fed104bf7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 200 len: 1303 microversion: 2.1 time: 0.358407 Oct 04 18:23:53.460078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2145/4299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:53 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 1303 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:53.469171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:53.480314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:53.505502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.506178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.506735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.509103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:53.509821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:53.511998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.590637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.605436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c38b505b-451e-430d-a613-36d025a1cc7b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 0.963129 Oct 04 18:23:53.609203 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2155/4300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:53.848788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.858885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4551a3a5-77fe-4573-a44c-94ad160600ef tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.396857 Oct 04 18:23:53.872929 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2146/4301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:53 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:53.998976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1376704460", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "5578dbaa-bab1-4aa4-9936-4139395169aa"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:54.034786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.038039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.084792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.085600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.086844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.090341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.091526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.096903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.149423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d0abca1-2ded-4126-9720-414fdb32010b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.538903 Oct 04 18:23:54.154108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2156/4302] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:53 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:54.163869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.164871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.175895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] validate_networks() for [('5578dbaa-bab1-4aa4-9936-4139395169aa', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:23:54.198892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.199455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.201819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.203926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.205229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.205807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.824399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:54.824876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:54.825573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:54.825987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:54.826941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:54.838345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.839511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.839511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.840008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.840468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.840967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.862713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Getting quotas for project edf95381d73a4f7fb4753d32f17a1858. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:54.863143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.870003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Getting quotas for user c9bf55837ccc4cc19de9e39b7ade2ff6 and project edf95381d73a4f7fb4753d32f17a1858. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:54.873632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9bb13ad7-f086-4932-850c-eaedc31777ab tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1217 microversion: 2.1 time: 0.721872 Oct 04 18:23:54.874584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2157/4303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1217 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:54.896481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.898634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: 24ec33f8-1217-43a3-b250-e25bf8072592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.901855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:54.905008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:54.910073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.912067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.912941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.914084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.915608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.916269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.942223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] HTTP exception thrown: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Request method failure captured: Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 HTTP/1.1 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm8cT14J6a-Z4LF5pGFeRolbzRBauOOfjlgPup6T1x7AobEBfNEIfGIrANVf3adzaFKAoSH2S55Aen-S8un1ozfnTzoZaEhlwXPEV8p8VRrH_WANZ0ntLaBemqYj5J5dG9aQ8OMg1wDg6Trqk_Jpn3TRW6ZruHEnunBe9OvV4gz2Cg Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 166adde709d4401786b61bc60cf36cc7 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueTestJSON-491233223 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_166adde709d4401786b61bc60cf36cc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/166adde709d4401786b61bc60cf36cc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/166adde709d4401786b61bc60cf36cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/166adde709d4401786b61bc60cf36cc7"}]}] Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueTestJSON-491233223 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 166adde709d4401786b61bc60cf36cc7 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueTestJSON-491233223 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueTestJSON-491233223-project Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acc8569ee17146e7ad21d3854be0a780 Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueTestJSON-491233223-project Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '24ec33f8-1217-43a3-b250-e25bf8072592'} Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:54.945267 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Returning 404 to user: Instance 24ec33f8-1217-43a3-b250-e25bf8072592 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:54.951853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-721abf2b-f2ee-4de9-8594-5567edd58d1d tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592" status: 404 len: 111 microversion: 2.1 time: 0.071460 Oct 04 18:23:54.953454 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2158/4304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/24ec33f8-1217-43a3-b250-e25bf8072592 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:54.970231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.973621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.990148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.994241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.995163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.996776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.998045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.999355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.077484 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7acc4bc2-f35c-4a73-a444-4948b6fbd671 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.193024 Oct 04 18:23:55.077899 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2147/4305] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:23:55.089075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.089698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.118284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.118284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.118284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.118284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.118672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.119393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.340859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.351313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e124c1ec-eb59-4347-ba71-ae96d97e1a75 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.272264 Oct 04 18:23:55.369379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2148/4306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:55.376315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.377042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.384456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.384845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.385291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.386057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.387005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.387794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.441084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:55.844601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba78f8dc-857a-4660-8275-f83dfb6f35da tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 204 len: 0 microversion: 2.1 time: 0.469604 Oct 04 18:23:55.848447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2149/4307] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:55 2022] DELETE /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:55.894011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.895901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.947927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.960417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e73ab044-5f35-4a00-add1-cd13c651adef tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 1.006180 Oct 04 18:23:55.972136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2159/4308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:56.005841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.013405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.026619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.033231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.036814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.038844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.039656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.041919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.042792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.063696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.071697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.075423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca36b9ce-ab5c-4963-a015-c59f913621e8 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1259 microversion: 2.21 time: 0.223011 Oct 04 18:23:56.076836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2150/4309] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:56.103784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.103784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.118744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.120084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.120748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.122578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.123399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.124335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.140705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a39eafb-57cd-4de2-8265-294a08929e21 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161623 Oct 04 18:23:56.146358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2160/4310] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:56.152545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.153404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.161661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.162607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.167067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.167067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.167067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.167067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.336366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.356785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b9aee98-7827-4d7a-a56c-0196d8036270 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1279 microversion: 2.1 time: 0.208718 Oct 04 18:23:56.358060 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2161/4311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:56.376148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.377140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.392381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.393247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.393956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.394915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.395706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.396289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.423230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.440593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa6094ff-2969-4c22-bc1a-f3b13e400d80 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1492 microversion: 2.1 time: 0.358451 Oct 04 18:23:56.447187 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2151/4312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1492 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:56.663229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.682894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe9c9d14-d7a4-44a8-90e8-da69cf353d2e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.308132 Oct 04 18:23:56.682894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2162/4313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:56.990346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.990982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.999035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.999753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.000538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.002799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.004036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.004878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.106818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.108759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.119997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.126586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.127206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.128117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.128703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.129809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.286610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.305125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.306758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.308067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-070def48-53ec-437e-ad57-37b3508d2f0f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1263 microversion: 2.21 time: 0.205210 Oct 04 18:23:57.323969 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2163/4314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1263 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:57.337119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.339653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.350663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.351363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.351925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.352896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.353575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.354220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.432471 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-99e705a9-3785-4fd1-8450-a7f72685ffc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107091 Oct 04 18:23:57.441909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2164/4315] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:57.442807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.446718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.460818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:57.467790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.468706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.469326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.472634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.473380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.474037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.518176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.533347 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8bea052-7ed7-48d4-a419-f938bf5f5d81 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 0.546890 Oct 04 18:23:57.534565 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2152/4316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:57.568774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.573557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.600863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.601667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.602274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.604108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.604772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.605379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.631098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.647667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-814a1767-94c4-431e-b037-3c4fcd6c98f9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1279 microversion: 2.1 time: 0.208559 Oct 04 18:23:57.648291 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2165/4317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:57.714242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.715150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.742126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.744572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.748741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.748741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.748741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.748741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.858860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.272225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.314672 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa78f9a3-1b52-4b92-9fb1-0f4bd13577b7 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1492 microversion: 2.1 time: 0.776432 Oct 04 18:23:58.318283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2153/4318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1492 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:58.377600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.386204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.408487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.409254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.409863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.410759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.411377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.415412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.594008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.665999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=12 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.921302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.940775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-352bcb6e-4127-4cfa-b67d-2d09afbc8050 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 1.234392 Oct 04 18:23:58.961733 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2166/4319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:58.973959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.983369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.990999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.991868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.992564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.993493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.994160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.994838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.084195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5294640d-d403-41e4-bf70-c152ae046e1e tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120939 Oct 04 18:23:59.085579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2167/4320] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:59.090547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.095457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.114039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.117365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.118054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.119047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.121760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.122472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.385539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.398003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.400158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.401496 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3aa3d61-b393-4e04-910b-51846c1e3755 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1311 microversion: 2.21 time: 1.053866 Oct 04 18:23:59.427952 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2154/4321] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1311 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:59.435444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.436350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.446327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.447069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.447729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.449018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.450548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.451693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.667254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.676074 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a62ac205-229f-445f-925c-29b369b8b283 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 0.589116 Oct 04 18:23:59.696430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2168/4322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:59.702296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.707200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.714978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.715799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.716405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.718525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.719143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.720054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.986447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.991754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.998752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7bd55a52-dbd2-4d3b-9ee5-c6d2a639267c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.567630 Oct 04 18:23:59.999124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2155/4323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.017005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.017927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.018106 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac640b7c-1c1a-4a39-88b1-e3628710cf74 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1492 microversion: 2.1 time: 0.320097 Oct 04 18:24:00.022896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2169/4324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1492 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.031261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.033941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.042409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.042409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.042409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.042409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.097547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.105067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.115364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.115364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.115364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.116135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.116599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.117031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.171931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8fadd05-924f-4c51-b046-48073cd4452d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078972 Oct 04 18:24:00.177562 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2170/4325] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:24:00.320317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:00.323086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.352014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.352526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.352978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.353704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.354175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.354610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.389678 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Cannot 'reboot' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action HTTP/1.1 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 28 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: {"reboot": {"type": "HARD"}} Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'reboot' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b8bc6846-0767-418f-9b96-01d81dec03b6', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:24:00.392088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.396375 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.398279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 409 to user: Cannot 'reboot' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:00.399639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9203fa0-9fd9-4654-bf42-701a78e9889d tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action" status: 409 len: 145 microversion: 2.1 time: 0.086545 Oct 04 18:24:00.400861 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2171/4326] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:00 2022] POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action => generated 145 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:24:00.416893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:00.426175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.437479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.443365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.443943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.444703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.445188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.448677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.507408 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Cannot 'rebuild' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action HTTP/1.1 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 65 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'rebuild' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b8bc6846-0767-418f-9b96-01d81dec03b6', 'body': {'rebuild': {'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6'}}} Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:00.509979 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 409 to user: Cannot 'rebuild' instance b8bc6846-0767-418f-9b96-01d81dec03b6 while it is in vm_state rescued {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-517bc2cf-0a08-4b25-9f8f-ecceec45f013 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action" status: 409 len: 146 microversion: 2.1 time: 0.107020 Oct 04 18:24:00.517989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2172/4327] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:00 2022] POST /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:24:00.522665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.530733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.531341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.540523 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3b2c7c4-a147-40a0-9d28-e4a2a595224f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.527694 Oct 04 18:24:00.541111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2156/4328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.546927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.547270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.547426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.547897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.548254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.548605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.549059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.549549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.561349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.564386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.565051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.565949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.568000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.568609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.618668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:00.778973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:01.007824 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27fe78bf-9e27-47ee-8296-aec9a04dc333 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 204 len: 0 microversion: 2.1 time: 0.465123 Oct 04 18:24:01.010240 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2157/4329] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:00 2022] DELETE /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:01.017643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.018581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.026220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.027381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.028189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.029109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.031364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.032036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.111431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.124775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.127212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.129279 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d91d46b7-8fcf-4e4b-a8a7-d22951304e58 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1317 microversion: 2.21 time: 0.609590 Oct 04 18:24:01.147120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2173/4330] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:01.160590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c2405e-8790-47cb-9a5c-1172fc5e6f6a", "name": "network-vif-deleted", "tag": "cff4017b-b279-46a6-85ca-920ecbfc37fa"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:01.184802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.186216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.186792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.209337 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] Creating event network-vif-deleted:cff4017b-b279-46a6-85ca-920ecbfc37fa for instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a on n-h1-833090-21 Oct 04 18:24:01.214812 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-34499e3e-8945-4d18-9e23-f3c38bca9c36 req-d53dd377-33be-4a02-821f-97cad3fd012c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065901 Oct 04 18:24:01.216110 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2174/4331] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:01.224591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.226868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.236855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.237864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.238923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.240023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.241563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.242231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.273296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.287646 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9582aac0-efa3-4d32-9fb0-ab7d63fa4d0d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 0.275766 Oct 04 18:24:01.300185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2158/4332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.311430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.313860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.323664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.324851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.326994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.328993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.329937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.331754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.607507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.607732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.620068 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6cfbb8b-f13d-4fa5-ad37-cbc44d2642c3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.317639 Oct 04 18:24:01.623912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8216fc3d-3516-4647-9078-073549b74872 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1691 microversion: 2.1 time: 0.405998 Oct 04 18:24:01.624501 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2175/4333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1691 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.638093 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2159/4334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.642584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.643412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.646189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.650090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.652299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.652545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.652639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.652639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.653299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.653883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.666933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.667389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.667879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.668617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.669452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.670418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.893475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.905475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.908529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-60e8329f-160a-4dec-8a3c-ef6cdecb9c9e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.268683 Oct 04 18:24:01.923576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2160/4335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.923576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa1350d3-98e0-486f-90dd-af2195421b27", "tag": "62a03e9c-260a-4a0e-bd94-11a8483c289e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:01.933424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b72671ad-ace0-4b12-985a-4b5c5716f195 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1450 microversion: 2.1 time: 0.307663 Oct 04 18:24:01.934226 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2176/4336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1450 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.942253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.942745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.943186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.972870 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] Creating event network-changed:62a03e9c-260a-4a0e-bd94-11a8483c289e for instance aa1350d3-98e0-486f-90dd-af2195421b27 on n-h1-833090-21 Oct 04 18:24:01.981753 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a0bd7070-664f-43d3-bac6-6ed638e16609 req-5c242f98-cb43-440d-a63d-4309be2983e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070647 Oct 04 18:24:01.982446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2161/4337] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:02.174270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.175913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.197408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.200101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.200703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.202212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.202790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.203506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.311584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.312572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.327124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.329152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.329152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.330921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.332892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.333523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.589720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.605765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f83ad3f5-b921-4bd8-bbfe-6095f6dafb5b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1723 microversion: 2.1 time: 0.293352 Oct 04 18:24:02.605765 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2162/4338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:02.606055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.611144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.613098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.615041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9aa173c3-19c6-47e8-af9e-071a5485b7a1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.453415 Oct 04 18:24:02.619516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2177/4339] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:02.650685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.651303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.654474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.656087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.661826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.662554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.663577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.664501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.665072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.665391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.666057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.666574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.667091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.667196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.668123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.672410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.930429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.940394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6390b71-2c7f-4619-8460-24b0893b0bb4 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.298764 Oct 04 18:24:02.942169 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2163/4340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:02.950163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.951736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.958257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.959028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.959709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.960778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.961599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.962558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.996918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.014837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3bf21c4-9352-4b29-9a68-ca1678023eba tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1691 microversion: 2.1 time: 0.368168 Oct 04 18:24:03.027717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2178/4341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1691 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.027717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.027717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.039029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.039562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.040020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.040744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.041206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.041638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.190770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.215416 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dff5f66b-32d6-439a-b333-2c89bd056cd9 tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1450 microversion: 2.1 time: 0.198767 Oct 04 18:24:03.218939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2179/4342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.233613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.243147 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b00261d-3bdb-4e19-9e7d-0f909b2b3b2b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.297220 Oct 04 18:24:03.252753 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2164/4343] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.321619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06b5e22-f5ca-4bae-9c48-1cdd6af8e898", "tag": "f0a00013-c56a-4587-920d-8e9246d20109"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:03.335288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.337285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.337812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.362076 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] Creating event network-changed:f0a00013-c56a-4587-920d-8e9246d20109 for instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 on n-h2-833090-21 Oct 04 18:24:03.385493 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7c7fc633-be05-4c5e-8cc8-6bcf82f6f737 req-785f629b-e510-4431-9fa6-205c9d5bb367 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073334 Oct 04 18:24:03.388023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2180/4344] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:03.629192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.629812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.641714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.642575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.643079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.643554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.647443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.647443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.647443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.648159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.654862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.656048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.656733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.657671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.658343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.659007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.958036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.968340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5666d4c7-7de3-4eaa-945d-24f9491bb6e6 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1700 microversion: 2.1 time: 0.342958 Oct 04 18:24:03.969077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2165/4345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1700 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.974899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.983824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.998386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.999187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.999863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.000896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.001557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.002177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.213396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.225739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.228208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.229607 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-264a41b4-9e93-4643-b6b8-2e5abcf601e2 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.593624 Oct 04 18:24:04.231908 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2181/4346] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:04.256101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.269695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa2de649-7d10-46d5-a835-4b56e9b63f70 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.299143 Oct 04 18:24:04.270871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2166/4347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:04.275674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.276476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.279435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:04.283678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.284353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.285069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.286611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.287244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.287869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.317957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.318599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.319256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.356115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Going to try to start instance {{(pid=123887) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:24:04.517716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.526763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18e35961-1949-4637-b253-3316a28d1f85 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1691 microversion: 2.1 time: 0.254528 Oct 04 18:24:04.527850 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2167/4348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:04.533182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c547966-549a-4ef4-b82d-ad60344c5896", "tag": "401e08ee-4afb-4339-8f33-81f29aeae049"}, {"name": "network-changed", "server_uuid": "10932733-79a7-4951-abea-f21d0eafbce1", "tag": "afa62d32-b540-47f5-b943-a8b24ad525e2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:04.546567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9a75015-b839-487e-b844-f2f8ffee9a23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action" status: 202 len: 0 microversion: 2.1 time: 0.312161 Oct 04 18:24:04.547201 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2182/4349] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:04 2022] POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:04.552419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.553052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.553599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.556218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.560954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.575697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.578436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.579162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.582088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.582088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.582911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Creating event network-changed:401e08ee-4afb-4339-8f33-81f29aeae049 for instance 9c547966-549a-4ef4-b82d-ad60344c5896 on n-h1-833090-21 Oct 04 18:24:04.583584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] Creating event network-changed:afa62d32-b540-47f5-b943-a8b24ad525e2 for instance 10932733-79a7-4951-abea-f21d0eafbce1 on n-h2-833090-21 Oct 04 18:24:04.584296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.603098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-22a4f00a-50df-4137-b3e9-5f601eb501e2 req-ee747428-ff16-4491-8dfa-ce999c3a92eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073452 Oct 04 18:24:04.605070 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2168/4350] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:04.621293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.622046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.629299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:04.630939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.631977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.632639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.633847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.634527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.635187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.759337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acc8569ee17146e7ad21d3854be0a780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166adde709d4401786b61bc60cf36cc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.776446 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-48e5c929-51b7-4bde-9411-205474c333eb tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 200 len: 1285 microversion: 2.1 time: 0.227064 Oct 04 18:24:04.777896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2183/4351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:04.784880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.785834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.806376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.806993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.809324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.809324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:04.809324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:04.809324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:04.813105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:04.853819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:04.885113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:04.897996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-776f31e6-1fc3-48ea-a04d-82bc78be1d94 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.289639 Oct 04 18:24:04.911503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2169/4352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.263041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.264503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.266505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.279568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.280430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.281413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.281578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f86f8bc-bccb-43f2-abe4-6af43335f3ff tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.502037 Oct 04 18:24:05.282787 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2184/4353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.283216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.284263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.285176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.294312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.295311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.302166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.302754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.303258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.304046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.304566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.305081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.454079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.463960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.465473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.467447 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-feca8fca-550c-4378-8ef4-d4a8b7066e7d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.211036 Oct 04 18:24:05.468210 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2170/4354] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:05.553383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.553933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.561344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.562053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.562884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.563654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.564351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.567293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.704350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.713773 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6efda0c-38d9-44bd-8764-eee0df132c30 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.423331 Oct 04 18:24:05.720531 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2185/4355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.802489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.803108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] [instance: d2c2405e-8790-47cb-9a5c-1172fc5e6f6a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.810920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.811589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.812034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.812979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.813597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.814205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.833919 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] HTTP exception thrown: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Request method failure captured: Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a HTTP/1.1 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm8cT14J6a-Z4LF5pGFeRolbzRBauOOfjlgPup6T1x7AobEBfNEIfGIrANVf3adzaFKAoSH2S55Aen-S8un1ozfnTzoZaEhlwXPEV8p8VRrH_WANZ0ntLaBemqYj5J5dG9aQ8OMg1wDg6Trqk_Jpn3TRW6ZruHEnunBe9OvV4gz2Cg Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 166adde709d4401786b61bc60cf36cc7 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueTestJSON-491233223 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_166adde709d4401786b61bc60cf36cc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/166adde709d4401786b61bc60cf36cc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/166adde709d4401786b61bc60cf36cc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/166adde709d4401786b61bc60cf36cc7"}]}] Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueTestJSON-491233223 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 166adde709d4401786b61bc60cf36cc7 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueTestJSON-491233223 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueTestJSON-491233223-project Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: acc8569ee17146e7ad21d3854be0a780 Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueTestJSON-491233223-project Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd2c2405e-8790-47cb-9a5c-1172fc5e6f6a'} Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:05.835950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. Oct 04 18:24:05.839559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:05.842366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] Returning 404 to user: Instance d2c2405e-8790-47cb-9a5c-1172fc5e6f6a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:05.843446 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60cbb903-05aa-4047-a85f-67ce2d107b5c tempest-ServerRescueTestJSON-491233223 tempest-ServerRescueTestJSON-491233223-project] 10.222.0.40 "GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a" status: 404 len: 111 microversion: 2.1 time: 0.045154 Oct 04 18:24:05.848221 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2186/4356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/d2c2405e-8790-47cb-9a5c-1172fc5e6f6a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:05.925528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:05.926409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:05.932834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.933602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.934313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.935271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.936083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.936731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.057993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=18 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:06.096517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.109056 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8085e1e9-5d7b-491f-907c-61fe5200a0be tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1691 microversion: 2.1 time: 0.559611 Oct 04 18:24:06.115530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2171/4357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1691 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:06.311985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.315146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.320415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.323265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.327011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.327532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.328409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.329413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.329868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.334258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba51e433-c100-467c-bb99-afd6ba77b51c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.412437 Oct 04 18:24:06.335913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2187/4358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:05 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:06.494701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.495754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.504103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.504894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.505581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.506517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.507194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.507919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.632646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:06.648657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae211e86-7493-47a1-9032-c2de912d341e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.345289 Oct 04 18:24:06.663498 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2172/4359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:06.743044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.744046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.757679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.758622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.759286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.761320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.762123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.762952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.075101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.085719 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2c417c0-044e-4eb8-854d-39e71d1b72fe tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.346821 Oct 04 18:24:07.086597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2173/4360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:07.133593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:07.134563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:07.144491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.145333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.150303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.150303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.150303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.150303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.253953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.267388 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8957bc62-1ed7-4b04-858e-96acfbda1d8c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1623 microversion: 2.1 time: 0.138211 Oct 04 18:24:07.268537 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2174/4361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:07 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1623 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:07.327801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.337339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.339382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.340805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c836176a-9489-42da-975c-188cf842b84b tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.850921 Oct 04 18:24:07.342140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2188/4362] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:07.363688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:07.364944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:07.371797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.372708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.373315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.374515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.375154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.375828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.567665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63f2343-aed1-4433-af22-4ed046448951", "name": "network-vif-deleted", "tag": "5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:07.583921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.586427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:07.596464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b98619da-ef23-496f-911a-4b60547f57b5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.237037 Oct 04 18:24:07.597568 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2175/4363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:07 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:07.599671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.600423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.605845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.619782 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] Creating event network-vif-deleted:5b8a938d-8aa1-45b0-a86a-b2d8d07fcb66 for instance d63f2343-aed1-4433-af22-4ed046448951 on n-h1-833090-21 Oct 04 18:24:07.635674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2519611e-9b68-4a4e-ac98-9f937f888af9 req-f1ec48ad-0035-4f1a-bf9a-cf396daf8cfe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067112 Oct 04 18:24:07.636916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2189/4364] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:07.679601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:07.680475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:07.696739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.701622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.702404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:07.703319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:07.703970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:07.704695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.113887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.114625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.131184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.131723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.132170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.132895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.133361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.137643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.152436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.173398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b403e417-cd21-4081-9707-552cfbe94d54 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.504138 Oct 04 18:24:08.198285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2176/4365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:07 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:08.292418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.293326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.306405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.307158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.307985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.310705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.311213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.314934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.449124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.455888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.461003 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-803591b6-d5da-4051-b3ad-95d0d370d862 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1331 microversion: 2.1 time: 0.170484 Oct 04 18:24:08.466289 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2177/4366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:08.473500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.474138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.496857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.498244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.499008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.502047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.502792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.506260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.508088 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d130f573-df6f-444a-a506-9095aaf887a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.399000 Oct 04 18:24:08.514514 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2190/4367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:08.623455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:08.624203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:08.635869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.638856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.639571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.640467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:08.642784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:08.643231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:08.890207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.906507 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46c60edc-51ac-44a8-9ec4-4584a2819560 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.287927 Oct 04 18:24:08.907375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2191/4368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:08.948415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.958784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.971978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:08.975045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a432642-f6b3-45da-acfb-feb4e4c42918 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.508839 Oct 04 18:24:08.976548 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2178/4369] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:08 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:09.203103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.203820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.218370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.219410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.220037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.221122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.222598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.223381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.486657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.487281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.497595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.498100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.501625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.502317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.502820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.503266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.594570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.599516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.603629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.604501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.610444 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c258473-463e-4f7c-b9fa-e4f2c7f8e043 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.411833 Oct 04 18:24:09.614412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'fault' on Instance uuid d63f2343-aed1-4433-af22-4ed046448951 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:09.617430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2192/4370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:09.637835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.640315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.655091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.657268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.658089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.659018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.659680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.660261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.779778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:09.788423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12761794-1310-4c46-9397-1f7ed832e631 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 200 len: 1336 microversion: 2.1 time: 0.306276 Oct 04 18:24:09.789426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2179/4371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 1336 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:09.930320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:09.930937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:09.946844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.947696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.948291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:09.949148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:09.949751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:09.955223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.072063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.085624 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76cdb829-d230-4b89-8f06-318e2919b5bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.462944 Oct 04 18:24:10.088929 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2193/4372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:10.101455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.102807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.118482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.120123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.122095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.124791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.126032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.128042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.418502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.438568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.443058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.444627 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-288b0e53-8141-4460-9ec2-33435a9274c3 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.354460 Oct 04 18:24:10.452384 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2194/4373] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:10.508130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.522393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-701946cc-5f40-40d4-a0b1-a0c7b9046a20 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.595841 Oct 04 18:24:10.524682 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2180/4374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:09 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:10.648112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.649308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.657131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.658081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.658734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.659715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.660420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.661215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.818770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.819560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: d63f2343-aed1-4433-af22-4ed046448951] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:10.839544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.840185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.840726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.842063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:10.845713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:10.846526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:10.873365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 HTTP/1.1 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd63f2343-aed1-4433-af22-4ed046448951'} Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:10.875629 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. Oct 04 18:24:10.879039 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:10.883622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 404 to user: Instance d63f2343-aed1-4433-af22-4ed046448951 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:10.885067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ee42272-542e-477b-bfa5-c2fc3b8e79d3 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951" status: 404 len: 111 microversion: 2.1 time: 0.070749 Oct 04 18:24:10.886225 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2181/4375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/d63f2343-aed1-4433-af22-4ed046448951 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:10.893472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:10.901517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46b36f5e-f812-4b9d-b041-72840aef90bb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '.version_select at 0x7f9009733a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:10.906564 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecb8e150-466a-4230-8810-15149aeaf9d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.261938 Oct 04 18:24:10.908332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2195/4376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:10 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:11.015099 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46b36f5e-f812-4b9d-b041-72840aef90bb tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876516155" status: 202 len: 0 microversion: 2.1 time: 0.123778 Oct 04 18:24:11.016516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2182/4377] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876516155 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:24:11.113768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.114650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.121115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.132322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.133811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.136596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.137244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.137913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.371608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.382223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6083cb8f-4ee4-4f54-a061-a2f481ddf980 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.272009 Oct 04 18:24:11.401495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2196/4378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:11.471910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.472693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.496667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.498896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.500104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.501150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.501986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.502712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.547197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.547742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.555924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.557278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.557940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.559391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.561634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.562153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.802420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.818041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebfc97bd-f445-417f-8f8f-ca111d64824e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.274769 Oct 04 18:24:11.820760 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2197/4379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:11.936593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:11.937573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:11.951230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.951903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.952779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.953496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:11.954176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:11.954929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:11.971911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.984438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.986000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:11.987192 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8790250b-aba7-4bfa-90cd-957d6bfb45c4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.520161 Oct 04 18:24:12.008943 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2183/4380] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:12.283365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.294235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7a97518-1da0-4192-b40c-6761f8bba0ba tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1709 microversion: 2.1 time: 0.363825 Oct 04 18:24:12.295121 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2198/4381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:11 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1709 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:12.410108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:12.410908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.422131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.422992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.423584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.424422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.425256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.425776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.627823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.640491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4980b79c-d070-4e81-9122-55456f54e3c6 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.235258 Oct 04 18:24:12.641126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2184/4382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:12 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.916183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.007436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.011920 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-419a912d-8ad6-407f-b6ee-9d4438376e9a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.173880 Oct 04 18:24:13.012560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2199/4383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:12 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.034863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.035517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.042611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.043102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.043591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.044802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.045275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.045686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.315707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.316908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.317719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.331755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.333529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.333529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.333529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.334325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.336355 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac14bce0-c3c7-4efc-b660-ccebf79c7b25 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.317253 Oct 04 18:24:13.340412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.341736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.342504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.348575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2185/4384] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:13.590130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.603392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68b98446-582c-4614-a66f-649d0b19cbbe tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1713 microversion: 2.1 time: 0.290198 Oct 04 18:24:13.624751 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2200/4385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1713 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.671890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.672659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.682917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.683425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.683888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.684815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.686899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.687797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.039290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c547966-549a-4ef4-b82d-ad60344c5896", "name": "network-vif-plugged", "status": "completed", "tag": "401e08ee-4afb-4339-8f33-81f29aeae049"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:14.054943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.059184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.060235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.097334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] Creating event network-vif-plugged:401e08ee-4afb-4339-8f33-81f29aeae049 for instance 9c547966-549a-4ef4-b82d-ad60344c5896 on n-h1-833090-21 Oct 04 18:24:14.115032 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-69dc97ef-bd05-4ad6-aa2d-3952569cfcbc req-bf3dacbe-fb21-4d6b-b6e8-701364e0e079 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077710 Oct 04 18:24:14.116139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2201/4386] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:14.143794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.144874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.157493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.158411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.159073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.160502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.161377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.162144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.193205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.224366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f00e1fc-33f4-4c29-b5bc-fe4b2c3077de tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.541399 Oct 04 18:24:14.227867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2186/4387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:14.364481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.365114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.375958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.376464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.376913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.383284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.387864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.388441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.425257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.428068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:14.437293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80a87569-a346-4123-9a6d-afa53581c67e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1510 microversion: 2.1 time: 0.319005 Oct 04 18:24:14.452025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2202/4388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:14.673978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.688268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.691116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:14.692600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46e0df8b-ea62-4ae1-9902-ff4b6cefabbb tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.332940 Oct 04 18:24:14.710817 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2187/4389] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:24:15.256970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.258949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.272026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.273416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.274074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.275119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.275815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.276466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.465727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.465727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.470964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.482337 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91aa8350-3c8c-422c-b992-4826c3d8262b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.235384 Oct 04 18:24:15.493943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.494428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.495022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.495929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.496547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.497636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.502332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2203/4390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:15.696064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.706869 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e77dbe15-8663-4e58-95bc-e2344c2bbe03 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1487 microversion: 2.1 time: 0.249594 Oct 04 18:24:15.717650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2188/4391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1487 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:15.720119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.721001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.733230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1200133119"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:15.735518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.736886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.737387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.738624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.740847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.741449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.745611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.753788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.754292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.754734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.755450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.767139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.784228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.002402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44260514-530c-4586-a719-2b5872060adc tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "PUT /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1061 microversion: 2.1 time: 0.273709 Oct 04 18:24:16.003729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2189/4392] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:24:15 2022] PUT /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1061 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:16.038861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.040567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.056315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.062617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.063862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.070032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.071304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.072043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.160938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.170428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.172058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.173232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18d11090-d97f-4ea3-833e-48b210b8c2b7 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.459633 Oct 04 18:24:16.199146 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2204/4393] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:16.232835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06b5e22-f5ca-4bae-9c48-1cdd6af8e898", "name": "network-vif-plugged", "status": "completed", "tag": "f0a00013-c56a-4587-920d-8e9246d20109"}, {"server_uuid": "aa1350d3-98e0-486f-90dd-af2195421b27", "name": "network-vif-plugged", "status": "completed", "tag": "62a03e9c-260a-4a0e-bd94-11a8483c289e"}, {"server_uuid": "10932733-79a7-4951-abea-f21d0eafbce1", "name": "network-vif-plugged", "status": "completed", "tag": "afa62d32-b540-47f5-b943-a8b24ad525e2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:16.259145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.260738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.265774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.305525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Creating event network-vif-plugged:f0a00013-c56a-4587-920d-8e9246d20109 for instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 on n-h2-833090-21 Oct 04 18:24:16.307429 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Creating event network-vif-plugged:62a03e9c-260a-4a0e-bd94-11a8483c289e for instance aa1350d3-98e0-486f-90dd-af2195421b27 on n-h1-833090-21 Oct 04 18:24:16.309099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] Creating event network-vif-plugged:afa62d32-b540-47f5-b943-a8b24ad525e2 for instance 10932733-79a7-4951-abea-f21d0eafbce1 on n-h2-833090-21 Oct 04 18:24:16.331768 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ff077b6b-3e6e-4129-972f-67c72d1f13c5 req-cca77bcd-6055-4b08-b590-ce3676a4864a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.103820 Oct 04 18:24:16.334761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2205/4394] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:16.383084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.394270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d88b114-131a-4dc5-8a9f-6dec745bd8a5 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1488 microversion: 2.1 time: 0.368728 Oct 04 18:24:16.419215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.420259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.428019 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2190/4395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1488 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:16.436311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.437658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.437658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.438520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.439181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.439794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.514106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.515564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.531855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.533198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.533860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.534816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.537166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.538008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.977249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.990427 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2531b03-adb3-4d2c-99a2-039d99774859 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1488 microversion: 2.1 time: 0.577111 Oct 04 18:24:16.994062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2206/4396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1488 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:17.239988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:17.253142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7587249-7ccb-4f8c-a37d-ad4098006058 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.741803 Oct 04 18:24:17.253760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2191/4397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:17.262870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.263708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.276866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.277620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.278385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.279352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.281291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0bdbc9b-a083-40af-86d1-a5ff9e1a53ea tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Action: 'create', calling method: .version_select at 0x7f900890dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-988746141", "metadata": {"Type": "work"}}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:17.283386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.284209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.329008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:17.359998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:17.803146 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1131fd41-f313-4937-b47d-26f4d9eb69f1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 204 len: 0 microversion: 2.1 time: 0.547168 Oct 04 18:24:17.804171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2192/4398] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:17 2022] DELETE /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:17.811355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.814621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.818438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.818922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.819374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.820114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.820571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.821001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.038733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.048252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.052399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.053623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1412985e-5022-4355-b8fc-0c360abd97d4 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.247673 Oct 04 18:24:18.054172 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2193/4399] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:18.071564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.072228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:18.079307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.079875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.080467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.081187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.084163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.084690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.256879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.281022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63716077-c060-4f4b-8759-bf88ced89725 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1494 microversion: 2.1 time: 0.225306 Oct 04 18:24:18.281916 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2194/4400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:18.286805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.287975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:18.295769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.300464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.308438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.309945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.311773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.316612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.512743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.525570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b3449b7-57d8-45cf-9738-7731e2fb7c58 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1321 microversion: 2.1 time: 0.242363 Oct 04 18:24:18.541998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2195/4401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:18.564062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0bdbc9b-a083-40af-86d1-a5ff9e1a53ea tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.567863 Oct 04 18:24:18.565665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2207/4402] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 4 18:24:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:24:18.582889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1638f96a-956b-4eca-ae65-1e7a76ca1b55 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f90099c7d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:18.670352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1638f96a-956b-4eca-ae65-1e7a76ca1b55 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.095112 Oct 04 18:24:18.670928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2196/4403] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:18 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:19.042362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f058491-b88b-466d-9dc5-15ac758e1a20"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:19.045811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.057173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.058529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.059851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.061551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.062550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.063424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.080995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.082315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.099366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.100412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.101048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.108381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.108381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.108381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.288998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.300474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.303361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.305760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28136924-66f2-4dd4-becc-be7fc3ce8e98 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1359 microversion: 2.21 time: 0.229447 Oct 04 18:24:19.321415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2197/4404] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:19.333679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.334903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.350994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.352101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.355496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.355496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.355496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.355496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.671301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.688116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-448d894f-a49b-473f-93f4-2ab3d2739e42 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1494 microversion: 2.1 time: 0.361649 Oct 04 18:24:19.701789 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2198/4405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:19.701789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.701789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.729255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.729762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.735650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.743901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.744919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.745387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.092693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.106181 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8689a61c-dc8b-4958-aeeb-4d4499beb737 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1512 microversion: 2.1 time: 0.416287 Oct 04 18:24:20.122917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2199/4406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:20.130910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b534d17c-f56a-4b21-9c59-7a3f7e77d857 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f9008f24ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.214766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b534d17c-f56a-4b21-9c59-7a3f7e77d857 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.090613 Oct 04 18:24:20.215373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2200/4407] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:20.220417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.223431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.229627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.230626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.231620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.232335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.232791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.233216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.490932 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90e66474-4424-4801-b743-e7b1554608a1 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "POST /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.454689 Oct 04 18:24:20.492641 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2208/4408] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:24:19 2022] POST /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 194 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:20.501685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.502421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.511862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.512407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.512855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.514146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.514632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.517337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.542225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.569523 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2fb51c86-457c-4590-ae3e-5c6be4883c5b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1511 microversion: 2.1 time: 0.342497 Oct 04 18:24:20.585473 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2201/4409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:20.612319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.612889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.643953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.650852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.662713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.662713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.662713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.662713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.806528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.815732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.817204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.818414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3bc23f61-2324-4238-a93f-50aeedea09c1 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1552 microversion: 2.21 time: 0.324219 Oct 04 18:24:20.850817 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2209/4410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1552 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:20.854954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.862251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.882561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.883059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.883523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.888169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.889847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.895755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.075975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.087408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e07b28d-b521-40da-bf8b-41897b054f8c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1512 microversion: 2.1 time: 0.492496 Oct 04 18:24:21.088343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2202/4411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:21.094653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.095831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.103446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.104947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.105592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.106536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.107188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.108186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.175662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:21.203890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.220518 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbb7a88e-a5fc-4e83-a55a-66fcf57d0aa3 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1452 microversion: 2.1 time: 0.369991 Oct 04 18:24:21.221785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2210/4412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1452 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:21.233963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafbce24-a1bb-4eab-8271-8aadc1ed4c16", "name": "network-vif-deleted", "tag": "55a15219-5350-404b-ab16-076d340ccfa9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:21.259917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.260723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.261317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.274988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] Creating event network-vif-deleted:55a15219-5350-404b-ab16-076d340ccfa9 for instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 on n-h1-833090-21 Oct 04 18:24:21.284120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-80e7b405-0614-4030-85e7-00eccee956c5 req-a7eab23e-2463-4e61-95e2-8d1eeb8e4a59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059799 Oct 04 18:24:21.285281 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2211/4413] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:21.292285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.297706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.298693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:21.314341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.314979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.315547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.316280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.316738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.317165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.460211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:21.549148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-beeb4e31-03eb-44c2-8f22-e8905d72b09f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 204 len: 0 microversion: 2.21 time: 0.457724 Oct 04 18:24:21.549148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2203/4414] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:24:21 2022] DELETE /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:24:21.557981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5601d386-7a0c-4fa1-b443-8f63bdb4d6b4 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f90098fc550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.570961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.577896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.578395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.578890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.658120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5601d386-7a0c-4fa1-b443-8f63bdb4d6b4 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 353 microversion: 2.1 time: 0.105145 Oct 04 18:24:21.669252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2204/4415] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:21.674919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.679947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.702865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.703376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.703851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.704580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.705046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.705485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.760527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df087d2d-9dc9-411e-9d14-a29c27f13415 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.473866 Oct 04 18:24:21.761584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2212/4416] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:21.767122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfc27d42-428f-4ba9-92af-5f781e664413 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f900d7041f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.848307 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfc27d42-428f-4ba9-92af-5f781e664413 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 353 microversion: 2.1 time: 0.084855 Oct 04 18:24:21.849074 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2213/4417] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:21.854310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.860553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.861348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-160033561', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:21.868334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.868822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.869326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.873529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.873529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.873529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.923221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.936025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.937807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.939196 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d7702b82-cb2d-493e-9c6d-77957cecbedc tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1558 microversion: 2.21 time: 0.268909 Oct 04 18:24:21.940065 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2205/4418] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:21.945159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62b61b4c-5b6a-4740-abac-8461838b2a04 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f9009ae0160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.992131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:22.077974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.080136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:22.085724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.086204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.086647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.236358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62b61b4c-5b6a-4740-abac-8461838b2a04 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 202 len: 0 microversion: 2.1 time: 0.291353 Oct 04 18:24:22.236358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2206/4419] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:24:21 2022] DELETE /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:22.242346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-830fd8d4-6306-4bf7-8c1b-156e3412c989 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f90098c79d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.252429 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c89f00f0-71d8-4603-b08c-b354267192be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-160033561" status: 200 len: 1514 microversion: 2.1 time: 0.402038 Oct 04 18:24:22.253363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2214/4420] 10.222.0.40 () {58 vars in 1261 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-160033561 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:22.275211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.276273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.296586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.297095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.298389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.302354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.307531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.312712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.375864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.376602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.376863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.379291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid fafbce24-a1bb-4eab-8271-8aadc1ed4c16 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:22.381698 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-830fd8d4-6306-4bf7-8c1b-156e3412c989 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.137847 Oct 04 18:24:22.384308 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2207/4421] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:22.393153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.395298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.421482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.423133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.423815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.424175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.425115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.426486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.427860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.432784 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10e6c3d1-a2ad-4637-b43c-273f7c59998a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 200 len: 1310 microversion: 2.1 time: 0.162971 Oct 04 18:24:22.447499 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2215/4422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 1310 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:22.447499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.447499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.447499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:22.452868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.453113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.453491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.454224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.455169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.455680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.530810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:22.608503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:22.713766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.722641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.723137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.723602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.997007 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0a27f93-717a-470e-bc0e-ab6edc1e5f74 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 204 len: 0 microversion: 2.1 time: 0.611116 Oct 04 18:24:22.998188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2208/4423] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:22 2022] DELETE /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:23.003945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.005635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.012180 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a44d68d-f02b-4c14-944e-e128ba61d8fc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.576791 Oct 04 18:24:23.013479 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2216/4424] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:23.019301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.036209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.061327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.063499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.063665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.066791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.067243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.067935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.070477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.072249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.072943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.074690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.075485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.076465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.449783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.453697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:23.466219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.466439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.470422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.470422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a219662-4f5a-4f71-9acd-b723dd377c0d tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1558 microversion: 2.21 time: 0.470398 Oct 04 18:24:23.483531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07ecadcc-3b3f-4ce0-a753-3bde541beb8f tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1507 microversion: 2.1 time: 0.462654 Oct 04 18:24:23.484837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2209/4425] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1558 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:23.498339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.500867 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2217/4426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:23.507082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3c9f31ca-ad21-4536-bfa8-614808cffbab tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f900d7d8ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.510686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.512012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.servers [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Removing options 'limit' from query {{(pid=123886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:24:23.513164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:23.520329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.521305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.521998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.522986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.523952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.524605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.591140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.603460 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3c9f31ca-ad21-4536-bfa8-614808cffbab tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.101216 Oct 04 18:24:23.605842 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2218/4427] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:23.616995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.616995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.617224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.617631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.617710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.626911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.627665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.628509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.629849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.630377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.630874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.661062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 HTTP/1.1 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'fafbce24-a1bb-4eab-8271-8aadc1ed4c16'} Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.667003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5800616c-ce62-40f3-ae7e-789bb9e5d78d tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 404 len: 111 microversion: 2.1 time: 0.061278 Oct 04 18:24:23.671392 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2219/4428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:23.704153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.707072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.721649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.722157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.722595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.729439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.729997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.730563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.779137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 HTTP/1.1 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'fafbce24-a1bb-4eab-8271-8aadc1ed4c16'} Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:23.781004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:23.784541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1cc7e19e-6298-4dc1-ba18-e39df752ee9c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 404 len: 111 microversion: 2.1 time: 0.089142 Oct 04 18:24:23.789007 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2220/4429] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:23 2022] DELETE /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:23.802413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.803030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: fafbce24-a1bb-4eab-8271-8aadc1ed4c16] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.820961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.821465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.821903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.822718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.823181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.823633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.869156 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 HTTP/1.1 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'fafbce24-a1bb-4eab-8271-8aadc1ed4c16'} Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.870963 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance fafbce24-a1bb-4eab-8271-8aadc1ed4c16 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb2338d7-4d32-43f5-9b57-b63f852ed35a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16" status: 404 len: 111 microversion: 2.1 time: 0.083240 Oct 04 18:24:23.876215 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2221/4430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/fafbce24-a1bb-4eab-8271-8aadc1ed4c16 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:23.882881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.883388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.901237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.901892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.903295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.904299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.904762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.905190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.919357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:23.939520 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 HTTP/1.1 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '725491c4-5c11-4d5a-8ba1-613025ee5529'} Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:23.941337 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:23.944966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:23.945706 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34edf06e-e838-4a2e-b0a8-e84df69ca95f tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 404 len: 111 microversion: 2.1 time: 0.067171 Oct 04 18:24:23.946272 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2222/4431] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:23 2022] DELETE /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:23.967053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.968882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 725491c4-5c11-4d5a-8ba1-613025ee5529] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.988053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.990036 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4ea2725-b040-473c-9b47-93992f208e3d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.503769 Oct 04 18:24:23.990663 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2210/4432] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:23.991801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.992457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.993810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.994598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.995208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.028693 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 HTTP/1.1 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '725491c4-5c11-4d5a-8ba1-613025ee5529'} Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.030490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. Oct 04 18:24:24.034075 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.034487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.036836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 725491c4-5c11-4d5a-8ba1-613025ee5529 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.040145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39ca8cb1-4a26-47e1-8898-b29abd835027 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529" status: 404 len: 111 microversion: 2.1 time: 0.084188 Oct 04 18:24:24.041293 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2223/4433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/725491c4-5c11-4d5a-8ba1-613025ee5529 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.048842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.049866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.050518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.055134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:24.060318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.061229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.061839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.062433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.063027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.063664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.064251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.067413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.068234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.069089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.069572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.069980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.115776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a HTTP/1.1 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '05a7305f-8145-4149-82e3-06372b73b34a'} Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.117646 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.121294 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.124282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.125390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d01a771d-c8c5-4c74-982a-2a5ea8c4e3a9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 404 len: 111 microversion: 2.1 time: 0.080459 Oct 04 18:24:24.126562 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2224/4434] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.135623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.136803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 05a7305f-8145-4149-82e3-06372b73b34a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.154680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.155499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.156567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.161896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.162712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.163337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.200232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a HTTP/1.1 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '05a7305f-8145-4149-82e3-06372b73b34a'} Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.203976 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. Oct 04 18:24:24.207710 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.212296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 05a7305f-8145-4149-82e3-06372b73b34a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.213449 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1f15c25-34d3-4a68-9765-2cbb11ab362c tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a" status: 404 len: 111 microversion: 2.1 time: 0.083097 Oct 04 18:24:24.214888 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2225/4435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/05a7305f-8145-4149-82e3-06372b73b34a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:24.229294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.230115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.244147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.244744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.245183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.246691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.247162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.247635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.280324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed HTTP/1.1 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '99f1b2cf-6216-4d92-a17c-d32de299cfed'} Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.282092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b5cef67-e4bf-4732-a9d9-42b9a02a44a2 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 404 len: 111 microversion: 2.1 time: 0.064002 Oct 04 18:24:24.286238 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2226/4436] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.287129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:24.302467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.303659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 99f1b2cf-6216-4d92-a17c-d32de299cfed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.311038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.312357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.313098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.314011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.314622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.315419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.336705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed HTTP/1.1 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '99f1b2cf-6216-4d92-a17c-d32de299cfed'} Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.338520 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. Oct 04 18:24:24.343695 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.345499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 99f1b2cf-6216-4d92-a17c-d32de299cfed could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.346521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9ad9995-70a4-4a0a-9434-39acafd00629 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed" status: 404 len: 111 microversion: 2.1 time: 0.054117 Oct 04 18:24:24.347578 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2227/4437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/99f1b2cf-6216-4d92-a17c-d32de299cfed => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.357318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.358059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.366525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.367386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.368063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.369067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.369959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.370569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.392026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c HTTP/1.1 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0bf11fc0-b276-405f-8afd-a242fbdf041c'} Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.394088 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.398435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.400664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.406704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf355eaf-21fc-47c1-a4f0-f82b508252a8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 404 len: 111 microversion: 2.1 time: 0.049590 Oct 04 18:24:24.406704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2228/4438] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.414580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.417554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 0bf11fc0-b276-405f-8afd-a242fbdf041c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.435452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5494fa32-133f-41f0-bcba-12e16a2bf272 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.418139 Oct 04 18:24:24.436485 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2211/4439] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.452317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.459218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.460395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c HTTP/1.1 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0bf11fc0-b276-405f-8afd-a242fbdf041c'} Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.461734 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 0bf11fc0-b276-405f-8afd-a242fbdf041c could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.465632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3770e28-d44c-4602-b0c3-eefef9e588d8 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c" status: 404 len: 111 microversion: 2.1 time: 0.053843 Oct 04 18:24:24.467175 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2229/4440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/0bf11fc0-b276-405f-8afd-a242fbdf041c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:24.473679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.474428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.servers [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Removing options 'limit' from query {{(pid=123886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:24:24.475225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:24.479005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:24.481798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.482322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.482814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.483410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.484020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.484854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.485460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.485978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.494219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.494722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.495166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.503111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.504101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.504563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.525240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:24.533041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 HTTP/1.1 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '492dd343-27af-4724-b63d-b09659d0aab2'} Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.534938 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.539240 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ce4dd44-e34d-46ce-97d3-b1ca77f93d38 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 404 len: 111 microversion: 2.1 time: 0.068470 Oct 04 18:24:24.540412 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2230/4441] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:24 2022] DELETE /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.545532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.546144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.554204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.554756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.555191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.556008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.556785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.557214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.614596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f92c20fe-3bed-42e6-a404-9db2a048d2e7 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.158993 Oct 04 18:24:24.615798 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2212/4442] 10.222.0.40 () {58 vars in 1150 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:24.620935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.622549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.629964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.630753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.631529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.632616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.633306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.634053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.752728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.762820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.764701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.767397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bae8f1ee-44ae-4ef3-b3c7-e08f2532bbf9 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1558 microversion: 2.21 time: 0.225655 Oct 04 18:24:24.768518 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2231/4443] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:24.774232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.775018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 492dd343-27af-4724-b63d-b09659d0aab2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.784761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.785509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.786061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.787534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.788121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.789813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.815765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 HTTP/1.1 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '492dd343-27af-4724-b63d-b09659d0aab2'} Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:24.817934 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. Oct 04 18:24:24.822196 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:24.822932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 492dd343-27af-4724-b63d-b09659d0aab2 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:24.824806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcdc159d-49b8-4964-b63d-62c341e34e0a tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2" status: 404 len: 111 microversion: 2.1 time: 0.054481 Oct 04 18:24:24.826136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2232/4444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/492dd343-27af-4724-b63d-b09659d0aab2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:24.832620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9525b9c-0809-4f39-b060-8f053a9862bb tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f9009712430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.927675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9525b9c-0809-4f39-b060-8f053a9862bb tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.100087 Oct 04 18:24:24.929475 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2233/4445] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:24.934913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.949649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.959127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:24.966664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.967453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.968623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.970514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.975833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.976615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.037460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:25.040260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.061297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3356462-334b-44ed-b8b9-9007ef7bbc48 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1507 microversion: 2.1 time: 0.444203 Oct 04 18:24:25.062488 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2213/4446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:25.067946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.068659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.075377 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a HTTP/1.1 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '23892c70-75a7-48e8-aae8-3bcce4832b8a'} Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:25.077948 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.081737 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.083447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:25.084605 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79b1deff-fc33-43df-9979-42d43a17ad62 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a" status: 404 len: 111 microversion: 2.1 time: 0.020992 Oct 04 18:24:25.086991 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2214/4447] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:25 2022] DELETE /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:25.094208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.096395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 23892c70-75a7-48e8-aae8-3bcce4832b8a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.108108 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.108705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac821b1e-1bbf-47d6-aa8a-e5f439163098 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.177174 Oct 04 18:24:25.109310 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2234/4448] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers => generated 1011 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a HTTP/1.1 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '23892c70-75a7-48e8-aae8-3bcce4832b8a'} Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:25.110428 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 23892c70-75a7-48e8-aae8-3bcce4832b8a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:25.114075 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c203897e-09f4-4784-aa99-6c755fdf864e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a" status: 404 len: 111 microversion: 2.1 time: 0.022466 Oct 04 18:24:25.116078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2215/4449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/23892c70-75a7-48e8-aae8-3bcce4832b8a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:25.121019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.122652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.123932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.129687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.130254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.130700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.131068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:25.131637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.132537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.133201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.134526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.153964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.154733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.155360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.156524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.157147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.157973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.208436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:25.346615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:25.490680 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-334df06d-d374-4b2d-8e7f-423b2ff88db8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.371209 Oct 04 18:24:25.492028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2216/4450] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:25.512618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.528868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.529536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.servers [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Removing options 'limit' from query {{(pid=123886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:24:25.531637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:25.547178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.549421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.550097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.551828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.553623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.554188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.568774 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be67728d-a992-420e-a017-e8691eef2792 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 204 len: 0 microversion: 2.1 time: 0.451400 Oct 04 18:24:25.569618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2235/4451] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:25 2022] DELETE /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:25.580267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.581054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.602227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.602725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.603159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.603907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.616413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.617061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.628117 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3c642a1-3a59-446d-a08e-bfd0f3f6aa67 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.115033 Oct 04 18:24:25.628541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2217/4452] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:25.635936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.642835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.643585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-160033561', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:25.650524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.651190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.651806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.654416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.654949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.655389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.816608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:25.998461 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-316d3476-318f-4cc2-869e-ccd226127195 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-160033561" status: 200 len: 345 microversion: 2.1 time: 0.368631 Oct 04 18:24:26.006802 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2218/4453] 10.222.0.40 () {58 vars in 1240 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-160033561 => generated 345 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:26.015058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.015833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.023069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.023689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.024345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.025368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.026031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.026652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.133914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.149001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.151812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.154092 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c7c20bd-1c0c-4c89-ab21-d167f97f0902 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1516 microversion: 2.21 time: 0.150579 Oct 04 18:24:26.154280 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2219/4454] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:26.158934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79bd760b-1073-45ef-b1e3-60dbaa827703 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f900d890e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.226577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79bd760b-1073-45ef-b1e3-60dbaa827703 tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 200 len: 352 microversion: 2.1 time: 0.071187 Oct 04 18:24:26.227307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2220/4455] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:26.234729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06b5e22-f5ca-4bae-9c48-1cdd6af8e898", "name": "network-vif-deleted", "tag": "f0a00013-c56a-4587-920d-8e9246d20109"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:26.253728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.254222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.254659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.269881 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] Creating event network-vif-deleted:f0a00013-c56a-4587-920d-8e9246d20109 for instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 on n-h2-833090-21 Oct 04 18:24:26.275260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5cdf0385-6a2e-4ff9-b366-88bce4b14443 req-252c5bb2-589d-47fe-931c-684fdb7b075e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045250 Oct 04 18:24:26.276259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2221/4456] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:26.281752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:26.288631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.289135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.289565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.318019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:24:26.498884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.515839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf5530d1-1cde-4ba6-a508-3a4412da77c9 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1477 microversion: 2.1 time: 0.941837 Oct 04 18:24:26.516443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2236/4457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1477 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:26.521859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.522500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.533067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.533513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.533944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.534642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.535091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.535575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.646274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c567341a-bdde-42ad-9469-a30a23fe11b3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "POST /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27/action" status: 202 len: 0 microversion: 2.1 time: 0.366369 Oct 04 18:24:26.653221 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2222/4458] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:26 2022] POST /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:26.653378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.662124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19613824-3196-42d6-8bc4-50979e851e53 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1465 microversion: 2.1 time: 0.144551 Oct 04 18:24:26.662720 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2237/4459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1465 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:26.673224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.676754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.705682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.717036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.717498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.718514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.718982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.719406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.785153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bc6846-0767-418f-9b96-01d81dec03b6", "name": "network-vif-deleted", "tag": "ad726d0f-bd25-4937-a900-184072180be2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:26.797604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.798087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.798553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.823339 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] Creating event network-vif-deleted:ad726d0f-bd25-4937-a900-184072180be2 for instance b8bc6846-0767-418f-9b96-01d81dec03b6 on n-h2-833090-21 Oct 04 18:24:26.845016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-20d8f0f9-bbe6-442c-bb3f-0cc174ef7843 req-ac374f11-757e-4190-a937-11edd9e5fe18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063618 Oct 04 18:24:26.848659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2238/4460] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:27.132759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.141419 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fa2333b-f938-497c-b535-c9b521ecf991 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.486834 Oct 04 18:24:27.164138 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2223/4461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:27.178929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.179817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.198068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.198505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.198954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.205419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.206519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.208662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.252694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-293bf289-232d-4803-a14a-ef7d1a09797b tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Calling method '.version_select at 0x7f90099f65e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.287444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.293821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.294694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.295316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lazy-loading 'fault' on Instance uuid d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:27.312363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-293bf289-232d-4803-a14a-ef7d1a09797b tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] HTTP exception thrown: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-293bf289-232d-4803-a14a-ef7d1a09797b tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Request method failure captured: Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe HTTP/1.1 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHpQQTlgwezSFvFal9_gzgX-NeEdidmqn7BYLWK0Gpk5IwgEOBOm1aY3oZZtvLMECIP7p3kt1oJcsZW7sBDq4eIe5iJd8l4QIuoVtvUaVSelk1KzOeSOaRgfobpq1LKitarsDScEKPtw1M_uiF68EL8fSsXKolNqbdg91qGr5-0dmcI Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c2551510da384ef59a74e6fdf2d4a7d5 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesGetTestJSON-1839634900 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c2551510da384ef59a74e6fdf2d4a7d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c2551510da384ef59a74e6fdf2d4a7d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c2551510da384ef59a74e6fdf2d4a7d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c2551510da384ef59a74e6fdf2d4a7d5"}]}] Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesGetTestJSON-1839634900 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c2551510da384ef59a74e6fdf2d4a7d5 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesGetTestJSON-1839634900 Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesGetTestJSON-1839634900-project Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: edc37fa9005b41a484d8931cf98c60cd Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesGetTestJSON-1839634900-project Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '16db898d-5c64-4006-b373-d763383f84fe'} Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. (HTTP 404) (Request-ID: req-221aea10-5eb5-4d8d-96da-16fda84ffe72) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:24:27.368501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-293bf289-232d-4803-a14a-ef7d1a09797b tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] Returning 404 to user: Volume 16db898d-5c64-4006-b373-d763383f84fe could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-293bf289-232d-4803-a14a-ef7d1a09797b tempest-VolumesGetTestJSON-1839634900 tempest-VolumesGetTestJSON-1839634900-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe" status: 404 len: 109 microversion: 2.1 time: 0.122132 Oct 04 18:24:27.372942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2224/4462] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/os-volumes/16db898d-5c64-4006-b373-d763383f84fe => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:27.381411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.397420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.402000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9bf55837ccc4cc19de9e39b7ade2ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf95381d73a4f7fb4753d32f17a1858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.406035 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-176e3702-7d02-4877-aa52-3bdc2d624172 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 200 len: 1349 microversion: 2.21 time: 0.230818 Oct 04 18:24:27.422649 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2239/4463] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 1349 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:27.544772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.547051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.576119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.582394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.582899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.583694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.586993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.587435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.697074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.698456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.713235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.715744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.717260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.721535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.723375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.724469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.795729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.796220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.796697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.797153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'fault' on Instance uuid b8bc6846-0767-418f-9b96-01d81dec03b6 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:27.901119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.901119 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8950f0cf-4b14-41a3-8068-56248eb18fc6 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1312 microversion: 2.1 time: 0.210815 Oct 04 18:24:27.909343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2240/4464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:28.002317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.015844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88c4a407-237f-497f-847a-29385e56ed6e tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1477 microversion: 2.1 time: 0.473563 Oct 04 18:24:28.017145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2225/4465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:28.176409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.177118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.190212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.192750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.193538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.195257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.196774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.197416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.296176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67495e92-6504-4244-89d3-a13399c06c06", "name": "network-vif-deleted", "tag": "5d9927d8-79c1-4ba0-a310-475cd52c9283"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:28.325638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.336752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.337251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.354057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] Creating event network-vif-deleted:5d9927d8-79c1-4ba0-a310-475cd52c9283 for instance 67495e92-6504-4244-89d3-a13399c06c06 on n-h1-833090-21 Oct 04 18:24:28.365736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ec95f4e4-4888-4291-a399-a828ce10ee03 req-4b378f78-7b2f-4b2a-9011-28b27658e26c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073877 Oct 04 18:24:28.367044 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2226/4466] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:28.445501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.446447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.487017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.501627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.516568 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2c4eb98-d11f-41d5-8c0c-8651e8cf4212 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.344564 Oct 04 18:24:28.527480 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] HTTP exception thrown: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Request method failure captured: Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 HTTP/1.1 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHo5z5H8DbG58pRMXQpOfgLChrhQy47bI6WT5T0uZW5V1Vs8EZTYoekd4tl_VlgOqN5Scq8pVuJYIRwzmkWxnZ9R65bMTO8u0Mu06kt2Gx2wNcj3leUqbw7sEX6bzSVvw92EfOTBi0fB0NO0Bx8xVu4HlE2Y9_7R85-0Jr9_8akJvog Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/edf95381d73a4f7fb4753d32f17a1858"}]}] Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: c9bf55837ccc4cc19de9e39b7ade2ff6 Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd06b5e22-f5ca-4bae-9c48-1cdd6af8e898'} Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.529179 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.532781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Returning 404 to user: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:28.538705 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-618a2bfd-6fea-49c8-9e33-821140577e4e tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 404 len: 111 microversion: 2.21 time: 0.089842 Oct 04 18:24:28.546763 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2241/4467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:28.547250 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2227/4468] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:24:28.588221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '.version_select at 0x7f90089109d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.588925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.625620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.626642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.628459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.629663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.630817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.631785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.788352 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0ece88e1-17be-4dbd-a10b-0d46a69afb95 tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.219499 Oct 04 18:24:28.799380 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2242/4469] 10.222.0.40 () {60 vars in 1337 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898/os-instance-actions => generated 611 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:24:28.807163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.807892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.816070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.817142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.817728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.818591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.819188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.819782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.841165 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] HTTP exception thrown: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Request method failure captured: Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 HTTP/1.1 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHo5z5H8DbG58pRMXQpOfgLChrhQy47bI6WT5T0uZW5V1Vs8EZTYoekd4tl_VlgOqN5Scq8pVuJYIRwzmkWxnZ9R65bMTO8u0Mu06kt2Gx2wNcj3leUqbw7sEX6bzSVvw92EfOTBi0fB0NO0Bx8xVu4HlE2Y9_7R85-0Jr9_8akJvog Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/edf95381d73a4f7fb4753d32f17a1858"}]}] Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: c9bf55837ccc4cc19de9e39b7ade2ff6 Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd06b5e22-f5ca-4bae-9c48-1cdd6af8e898'} Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:28.842917 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Returning 404 to user: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a597de7-4474-44cf-9376-84c14c6ace1f tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 404 len: 111 microversion: 2.21 time: 0.041873 Oct 04 18:24:28.847120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2228/4470] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:24:28 2022] DELETE /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:24:28.861426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.862070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] [instance: d06b5e22-f5ca-4bae-9c48-1cdd6af8e898] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.874729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.875219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.875703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.876405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.876858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.878556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.898821 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] HTTP exception thrown: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Request method failure captured: Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 HTTP/1.1 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHo5z5H8DbG58pRMXQpOfgLChrhQy47bI6WT5T0uZW5V1Vs8EZTYoekd4tl_VlgOqN5Scq8pVuJYIRwzmkWxnZ9R65bMTO8u0Mu06kt2Gx2wNcj3leUqbw7sEX6bzSVvw92EfOTBi0fB0NO0Bx8xVu4HlE2Y9_7R85-0Jr9_8akJvog Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/edf95381d73a4f7fb4753d32f17a1858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/edf95381d73a4f7fb4753d32f17a1858"}]}] Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: edf95381d73a4f7fb4753d32f17a1858 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-213907761 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: c9bf55837ccc4cc19de9e39b7ade2ff6 Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-InstanceActionsV221TestJSON-213907761-project Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd06b5e22-f5ca-4bae-9c48-1cdd6af8e898'} Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.900569 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] Returning 404 to user: Instance d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:28.905082 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ffd08a63-7da4-461d-94be-f16f78cfe62a tempest-InstanceActionsV221TestJSON-213907761 tempest-InstanceActionsV221TestJSON-213907761-project] 10.222.0.40 "GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898" status: 404 len: 111 microversion: 2.21 time: 0.052500 Oct 04 18:24:28.920013 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2243/4471] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/d06b5e22-f5ca-4bae-9c48-1cdd6af8e898 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:24:28.929148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:28.930183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:28.938302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.938803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.940412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.940554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.940913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.941346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.981692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:28.982127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:28.983011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.983488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lazy-loading 'fault' on Instance uuid b8bc6846-0767-418f-9b96-01d81dec03b6 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:29.047721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:29.048346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:29.056336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.057140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.057696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.058935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.059416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.060234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.072144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.091331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-257e0d9b-b451-4e08-b3d4-6ec0bc39cb43 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 200 len: 1312 microversion: 2.1 time: 0.167530 Oct 04 18:24:29.091994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2229/4472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:28 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:29.138237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.138730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.139174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.139659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lazy-loading 'fault' on Instance uuid 67495e92-6504-4244-89d3-a13399c06c06 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:29.196632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fa2db6eeff04a2a804e22ed1ddfd9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5642b49be949e685762fb6d9f2e93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.205996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:29.210419 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-342e378a-fe9b-4e60-ac5f-c77301900a8b tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 200 len: 1281 microversion: 2.1 time: 0.167928 Oct 04 18:24:29.211228 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2244/4473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:29 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:29.546427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:29.547820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:29.556909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.557635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.558154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.559121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.559839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.560422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.935971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:29.944733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cfad71e7-1905-4fcc-91ec-a914459fb4b1 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.403330 Oct 04 18:24:29.956603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2230/4474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:29 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:30.119725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.120366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: b8bc6846-0767-418f-9b96-01d81dec03b6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.127783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.128278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.128717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.129609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.130987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.130987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.147263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 HTTP/1.1 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b8bc6846-0767-418f-9b96-01d81dec03b6'} Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.149104 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 404 to user: Instance b8bc6846-0767-418f-9b96-01d81dec03b6 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3dfeec0-f16d-44df-9f8f-47f7738e2b49 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6" status: 404 len: 111 microversion: 2.1 time: 0.036230 Oct 04 18:24:30.152692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2245/4475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/b8bc6846-0767-418f-9b96-01d81dec03b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:30.159813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.168514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.174314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.175030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.175852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.176621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.177209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.177743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.183339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:30.206815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:30.239574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.240216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] [instance: 67495e92-6504-4244-89d3-a13399c06c06] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.248755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.249274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.249688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.252861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.253377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.255818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.275909 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] HTTP exception thrown: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Request method failure captured: Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 HTTP/1.1 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHlZKPOsh1gnKB3Y4Bffh4pcxztiW2xY30x23svZjN6xgzSGysj4Owap2iKsOH4o74LK3MRwHQgFJ6akJmtbbGvxRd162WytyeQVid7s8IZUMrk5NutpIEb7nFzsAAVMa-fVFeB1xjZEXTH-icbpw7tL0XGI0NJk-pkQTQvRzqZdVLg Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ff5642b49be949e685762fb6d9f2e93d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ff5642b49be949e685762fb6d9f2e93d"}]}] Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersTestJSON-1912555070 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ff5642b49be949e685762fb6d9f2e93d Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersTestJSON-1912555070 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6fa2db6eeff04a2a804e22ed1ddfd9a9 Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersTestJSON-1912555070-project Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '67495e92-6504-4244-89d3-a13399c06c06'} Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:30.277769 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. Oct 04 18:24:30.281835 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:30.283529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] Returning 404 to user: Instance 67495e92-6504-4244-89d3-a13399c06c06 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:30.284534 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cc351bb-79cb-4073-b15f-8af1688392e1 tempest-ServersTestJSON-1912555070 tempest-ServersTestJSON-1912555070-project] 10.222.0.40 "GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06" status: 404 len: 111 microversion: 2.1 time: 0.050163 Oct 04 18:24:30.285247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2246/4476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/67495e92-6504-4244-89d3-a13399c06c06 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:24:30.661891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c351314-0268-47f7-afc9-b0d0f77e5cea tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "DELETE /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 204 len: 0 microversion: 2.1 time: 0.505078 Oct 04 18:24:30.662601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2231/4477] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:30 2022] DELETE /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:24:30.674419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.675089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.708617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.709185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.709633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.710555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.711671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.712706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.914544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.923689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a450441-0024-4d2c-b75d-9264c52b0cd8 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.255890 Oct 04 18:24:30.925603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2247/4478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:30.973422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.987994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.373507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:31.387955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5b22292-cdee-49ee-ae3e-2e19b9a3b937 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.417733 Oct 04 18:24:31.389189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2232/4479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:31.956200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:31.957422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:31.973684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.974178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.975352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:31.976394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:31.977908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:31.978390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.306341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:32.323555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2a614c8f-1afa-4c94-ae36-51f11ad769d5 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.370793 Oct 04 18:24:32.340945 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2248/4480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:31 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:32.411728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:32.413259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:32.425419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.426469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.432637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.432637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:32.432637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:32.432637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:32.774597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:32.788536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1dc35f6-42c0-4a5a-80bf-9ddc898ff11b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.380538 Oct 04 18:24:32.792133 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2233/4481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:32 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:33.348993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:33.360725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:33.371313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:33.381379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.381883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.382332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.383246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.383750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.392631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.816124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:33.816733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:33.823363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:33.825924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.826492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.827165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.828269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:33.828945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:33.829601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:33.862465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:33.871517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-009cbac4-5a38-43a5-81bc-5fab8603cb1c tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1521 microversion: 2.1 time: 0.526272 Oct 04 18:24:33.880096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2249/4482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:33 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:34.147544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:34.166459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31a006ae-947b-4a3b-ae67-0b4f5fd66c10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.354269 Oct 04 18:24:34.169908 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2234/4483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:33 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:34.303482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-710d23b3-3751-4057-9a24-6a74d26b64c3 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f9008772dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:34.373625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-710d23b3-3751-4057-9a24-6a74d26b64c3 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d5aca856-4639-4910-90d1-4ecbd4ac3c2e" status: 200 len: 350 microversion: 2.1 time: 0.078037 Oct 04 18:24:34.384260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2250/4484] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:34 2022] GET /compute/v2.1/os-volumes/d5aca856-4639-4910-90d1-4ecbd4ac3c2e => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:34.831385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d41405-e13e-4099-82e3-33a64017e70c", "name": "network-vif-deleted", "tag": "444cc805-e0eb-4282-9572-aafe69b5cd84"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:34.860160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.861660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.862716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.883817 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] Creating event network-vif-deleted:444cc805-e0eb-4282-9572-aafe69b5cd84 for instance 78d41405-e13e-4099-82e3-33a64017e70c on n-h2-833090-21 Oct 04 18:24:34.894687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-757da14c-9b91-4a30-b1ab-da6eda2d687f req-cedafe8a-9603-4c2a-af32-3d1ec40df14e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069642 Oct 04 18:24:34.897571 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2235/4485] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:34.903877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:34.905870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:34.919831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.921465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.922115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.923044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.923711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.924325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.989352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:35.094075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.111866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06c565ca-a342-4152-9d69-22125f9f7c1a tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1479 microversion: 2.1 time: 0.214624 Oct 04 18:24:35.123504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2251/4486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:34 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1479 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:35.196381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:35.197293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:35.207402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.209225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.209716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.210519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:35.211174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:35.211925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:35.662724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:35.671659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75b68f1d-b9e7-4964-8ef5-2ae4c9734204 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.479926 Oct 04 18:24:35.684196 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2236/4487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:35 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:36.136725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.137356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.155006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.156890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.161870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.165616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.166205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.186239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.452687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e550a02a79411a9e202c7d952d32bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ddc78218054468aad4028cc79a2c4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:36.461366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9250bc50-c21c-4bf9-9907-b9e25872de8b tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 200 len: 1306 microversion: 2.1 time: 0.328276 Oct 04 18:24:36.462375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2252/4488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 1306 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:36.697996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:36.699793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:36.702040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:36.720474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.721585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.722244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:36.723150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:36.723831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:36.724471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.010697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:37.020791 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cec32a58-74d8-4285-a865-092d4c105e40 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.328891 Oct 04 18:24:37.024177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2237/4489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:36 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:37.486819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:37.487439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] [instance: 78d41405-e13e-4099-82e3-33a64017e70c] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:37.509370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.509943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.524164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.526988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:37.527975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:37.528715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:37.551672 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] HTTP exception thrown: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Request method failure captured: Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c HTTP/1.1 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHkMhSy5oVO7ONrtfypcUDIkdunh1Y90z-RXZTcH640QM3oFYAqpyV50lX6b_ZejNzZ6yYw8jthfMkHmr2vRYwnoUPhZJmoN5iWRwGMWA2QvFItPRXxeWR3gxkW0WIaA5AxewU5JvNtNLpIqGu-9Cr19wpG8rngJbpUllo1YeFqhf6I Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/00ddc78218054468aad4028cc79a2c4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/00ddc78218054468aad4028cc79a2c4d"}]}] Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 00ddc78218054468aad4028cc79a2c4d Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280050721 Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 12e550a02a79411a9e202c7d952d32bb Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280050721-project Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '78d41405-e13e-4099-82e3-33a64017e70c'} Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:37.556317 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] Returning 404 to user: Instance 78d41405-e13e-4099-82e3-33a64017e70c could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:37.564720 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4d8e439-ab03-41ec-8b1b-45cc35b15454 tempest-ServerRescueNegativeTestJSON-1280050721 tempest-ServerRescueNegativeTestJSON-1280050721-project] 10.222.0.40 "GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c" status: 404 len: 111 microversion: 2.1 time: 0.080170 Oct 04 18:24:37.568301 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2253/4490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:37 2022] GET /compute/v2.1/servers/78d41405-e13e-4099-82e3-33a64017e70c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:38.026306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "248f9123-2250-4baa-b914-6787d999ffe7"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:38.032784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.043733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.044514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.051938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.051938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.051938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.051938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.052295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.052922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.066867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.069425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.070183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.074841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.075754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.077927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.295076 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] HTTP exception thrown: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Request method failure captured: Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: request: PUT /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments/4f058491-b88b-466d-9dc5-15ac758e1a20 HTTP/1.1 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 74 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHnloU6-BabtO06sUseZoLAOB5-AG0-mSQwgh-zlsww6eBDqrt47nt8kmqYCyTYDxI5K3eVQut840oDDxD_QWWXLZGkKbhCWQNfCSuEB6asu9yMPqqhFinYFTPOUoUOS5Lnut0mgFeUX4Qfec0F5qiZslLu6Nxkpm3Dx5JA_AIDoPT4 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 1b8abb1b83f04e4e9c8c113256b6fde2 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b8abb1b83f04e4e9c8c113256b6fde2"}]}] Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 1b8abb1b83f04e4e9c8c113256b6fde2 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesAdminNegativeTest-514558082-project-admin Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 83a3ad8066ef4db29fdc17c3aa479769 Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesAdminNegativeTest-514558082-project-admin Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: {"volumeAttachment": {"volumeId": "248f9123-2250-4baa-b914-6787d999ffe7"}} Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': 'e8ed1d56-1198-415d-8105-db61feda4e15', 'id': '4f058491-b88b-466d-9dc5-15ac758e1a20', 'body': {'volumeAttachment': {'volumeId': '248f9123-2250-4baa-b914-6787d999ffe7'}}} Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. (HTTP 404) (Request-ID: req-badb1639-0c46-4ebe-a130-8453a8919be4) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:24:38.297311 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Returning 400 to user: Volume 248f9123-2250-4baa-b914-6787d999ffe7 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7a91f59-fafc-4890-beac-a09fb0a45b95 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments/4f058491-b88b-466d-9dc5-15ac758e1a20" status: 400 len: 107 microversion: 2.1 time: 0.786897 Oct 04 18:24:38.302035 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2238/4491] 10.222.0.40 () {60 vars in 1433 bytes} [Tue Oct 4 18:24:37 2022] PUT /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments/4f058491-b88b-466d-9dc5-15ac758e1a20 => generated 107 bytes in 788 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:24:38.396910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.397875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.412779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.413540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.414247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.415189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.415892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.416611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.549342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lazy-loading 'services' on Instance uuid e8ed1d56-1198-415d-8105-db61feda4e15 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:38.780987 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f162d6bb-8abb-4c86-ac6f-1f92815bb39e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments/4f058491-b88b-466d-9dc5-15ac758e1a20" status: 202 len: 0 microversion: 2.1 time: 0.389073 Oct 04 18:24:38.781732 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2239/4492] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:24:38 2022] DELETE /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments/4f058491-b88b-466d-9dc5-15ac758e1a20 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:38.792658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f725af97-f30a-4301-8187-294568c7e191 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f9008ca2940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.870133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:38.880885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-56d1263c-f51b-4c06-b9dd-4cacad4b7218 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.837424 Oct 04 18:24:38.884800 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f725af97-f30a-4301-8187-294568c7e191 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a7488cbf-2ccc-466b-8701-b56bce4f68fd" status: 200 len: 351 microversion: 2.1 time: 0.100299 Oct 04 18:24:38.886122 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2240/4493] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/os-volumes/a7488cbf-2ccc-466b-8701-b56bce4f68fd => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:38.895549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:38.897089 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2254/4494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:38.901642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:38.921303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.924043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.924514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.925263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:38.925730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:38.926165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:38.976233 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca9352d5-e0ec-424d-9fa6-5c86b00115a6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088033 Oct 04 18:24:38.977038 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2241/4495] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:38 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:39.907122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.908772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:39.919427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.920171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.920758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.921795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:39.922433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:39.923014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:39.989442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:39.992290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:40.014665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.019697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.019697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.019697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:40.033896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:40.034508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:40.120011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-47821faa-e91d-40fa-b18e-a35951c523f6 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134436 Oct 04 18:24:40.122145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2242/4496] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:40.387731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:40.400311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b8c8fa4-026f-4de3-9010-ba59048e75ce tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.497199 Oct 04 18:24:40.401363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2255/4497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:39 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:41.139877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.142888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:41.156628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.159331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.160711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.164397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.165436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.166684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.214344 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7676861f-8634-43ef-9cee-64291be5ab58 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082585 Oct 04 18:24:41.215831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2243/4498] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:41.428455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.429229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:41.446031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.447663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.449304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.452549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:41.452549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:41.454065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:41.930828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a81ab99-c617-435d-8795-c5b7335f43a0 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f9008d229d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:41.934749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:41.946858 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afd505f1-dadb-4b49-912d-4146eb3934be tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1521 microversion: 2.1 time: 0.522773 Oct 04 18:24:41.966315 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2256/4499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:42.030623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a81ab99-c617-435d-8795-c5b7335f43a0 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b1251813-c341-44f1-82e5-c0b9ac820411" status: 200 len: 350 microversion: 2.1 time: 0.103740 Oct 04 18:24:42.031344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2244/4500] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:41 2022] GET /compute/v2.1/os-volumes/b1251813-c341-44f1-82e5-c0b9ac820411 => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:42.050948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6986e0b2-0dd6-4f77-a408-c9b744a6efc9 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90086e3c10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.228376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.230568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:42.256789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.257295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.257770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.262464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:42.262984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:42.263429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:42.297319 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6986e0b2-0dd6-4f77-a408-c9b744a6efc9 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.252202 Oct 04 18:24:42.309860 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2257/4501] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:42.318664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87d32900-7ead-4d60-80d1-5f8267c91c6d tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90084b39d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.348165 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a4ff1a5-ba8e-486e-a67d-c694ef4683a0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124583 Oct 04 18:24:42.356082 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2245/4502] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:42.474481 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87d32900-7ead-4d60-80d1-5f8267c91c6d tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.159792 Oct 04 18:24:42.486068 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2258/4503] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:42.490981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-63e8d685-0ba2-4dd7-811e-670970318d28 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90084b3ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.557135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ebf655b-767b-450d-bc57-d286d7aabc5b tempest-ComputeTenantNetworksTest-1249300722 tempest-ComputeTenantNetworksTest-1249300722-project] Calling method '.version_select at 0x7f900d833dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.655810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-63e8d685-0ba2-4dd7-811e-670970318d28 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.166170 Oct 04 18:24:42.655810 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2259/4504] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:42.668384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35ce578f-c1f3-457b-9c76-9fc42c8d037a tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90087c1820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:42.818675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35ce578f-c1f3-457b-9c76-9fc42c8d037a tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154408 Oct 04 18:24:42.819920 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2260/4505] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:42.835620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bc674c8-4299-4fbf-8569-5a1223ee0682 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f9009712160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.012766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bc674c8-4299-4fbf-8569-5a1223ee0682 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.181152 Oct 04 18:24:43.013344 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2261/4506] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:43.026358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.027220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:43.036632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.040389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.040389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.043744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.044106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.044559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.047994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ebf655b-767b-450d-bc57-d286d7aabc5b tempest-ComputeTenantNetworksTest-1249300722 tempest-ComputeTenantNetworksTest-1249300722-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.690574 Oct 04 18:24:43.049040 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2246/4507] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 4 18:24:42 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:43.058799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-824058f9-e197-4e65-9352-190f1e4b55d8 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f9008d42550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.278924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-824058f9-e197-4e65-9352-190f1e4b55d8 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.228371 Oct 04 18:24:43.280350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2247/4508] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:43.296641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-881e3245-f69d-45b8-8998-618a822326fe tempest-ComputeTenantNetworksTest-1249300722 tempest-ComputeTenantNetworksTest-1249300722-project] Calling method '.version_select at 0x7f9008c79700>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.566800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.581433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46746a04-f32b-4d7d-8a3c-8a70bd1a6d2d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1498 microversion: 2.1 time: 0.567005 Oct 04 18:24:43.582414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2262/4509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1498 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:43.597136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b208f946-bdbc-40d0-bcf0-e780532535d4 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90086e3700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.618778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-881e3245-f69d-45b8-8998-618a822326fe tempest-ComputeTenantNetworksTest-1249300722 tempest-ComputeTenantNetworksTest-1249300722-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks/412495ef-9eda-4b74-b22a-bfeae97add70" status: 200 len: 139 microversion: 2.1 time: 0.336992 Oct 04 18:24:43.619491 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2248/4510] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/os-tenant-networks/412495ef-9eda-4b74-b22a-bfeae97add70 => generated 139 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:43.629480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.636052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:43.663548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.664411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.669213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.669213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.669213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.669887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.743064 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f1596e8-fac9-4017-9ad4-70bee48ca883 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122242 Oct 04 18:24:43.747513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2249/4511] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:43.776262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.783762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:43.790561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:43.793587 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b208f946-bdbc-40d0-bcf0-e780532535d4 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210019 Oct 04 18:24:43.794473 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2263/4512] 10.222.0.40 () {58 vars in 1188 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:43.797973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.804891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.804891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.804891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.804891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.804891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:43.816467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a382a5d-4c5d-435b-9528-15e1e7d54484 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] Calling method '.version_select at 0x7f90084bf550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:43.865434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:43.928607 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32ca755a-16d0-480f-8f49-128cb18ab25e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.177910 Oct 04 18:24:43.929283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2250/4513] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:43.949231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:43.962825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:43.963819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:43.965181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.000402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:44.008119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Going to try to start instance {{(pid=123886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:24:44.018026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a382a5d-4c5d-435b-9528-15e1e7d54484 tempest-VolumesTestJSON-1380655839 tempest-VolumesTestJSON-1380655839-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212316 Oct 04 18:24:44.018965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2264/4514] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:24:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:44.262810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45e9e228-ddfc-4284-9393-77964a33e7a9 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "POST /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27/action" status: 202 len: 0 microversion: 2.1 time: 0.321755 Oct 04 18:24:44.263454 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2251/4515] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:43 2022] POST /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:44.273374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.274583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.288542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.289046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.289484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.291303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.291303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.291303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.762307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:44.767048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:44.789563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.795502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.796203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.797676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:44.798752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:44.801556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:44.912879 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba1feefd-5aaa-4b69-ab4c-ad60d7d1464e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156825 Oct 04 18:24:44.913965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2252/4516] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:45.123119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:45.135700 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d11705b-7364-497c-a611-6f5e152a320f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1507 microversion: 2.1 time: 0.867678 Oct 04 18:24:45.140075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2265/4517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:44 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1507 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:45.929535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:45.935311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:45.972106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.974490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.974988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:45.977471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:45.977993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:45.985134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.053427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a3c938e-79cc-4bd4-96e3-d4b6edeea3e0 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131043 Oct 04 18:24:46.054705 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2253/4518] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:45 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:46.172185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:46.175774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:46.186108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:46.191997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.193576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.196663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.203716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:46.203716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:46.203716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:46.708125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:46.734210 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1507 microversion: 2.1 time: 0.566642 Oct 04 18:24:46.735744 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2266/4519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:46 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1507 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:47.066310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.069548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.090865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.091290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.091811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.092781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.093240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.099219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.210741 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d11aed49-d529-453c-861a-ea6e6b561410 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148299 Oct 04 18:24:47.219153 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2254/4520] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:47.737835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.739700 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002321 Oct 04 18:24:47.756260 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2267/4521] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/ => generated 377 bytes in 19 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:24:47.763516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.764482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:47.767250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.768786 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002029 Oct 04 18:24:47.773745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.775666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2268/4522] 10.222.0.40 () {54 vars in 1035 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 04 18:24:47.776038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.779222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.780579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.781776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001611 Oct 04 18:24:47.782029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.789898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.789898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.790993 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2269/4523] 10.222.0.40 () {54 vars in 1041 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/ => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:47.792887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:47.794479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-564d2fa2-2c04-4cab-aaab-3d1d22f1f056 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002315 Oct 04 18:24:47.803896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2270/4524] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:24:48.226659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.230396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.239305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.248249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.248249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.248249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.248249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.248249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.284219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c7bbdd3-b450-41bf-be63-4ec9c2fc96ba tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062982 Oct 04 18:24:48.289169 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2271/4525] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:24:48.513322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.529691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2129949296", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "063809de-19b2-4d41-aac9-41553db13d6b"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:48.547799 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c51b443a-9eaf-4a36-98fd-891561756cca tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1511 microversion: 2.1 time: 0.771176 Oct 04 18:24:48.547799 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2255/4526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:47 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1511 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:48.562716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.573648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:48.574553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.servers [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Removing options 'limit' from query {{(pid=123886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 18:24:48.575431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:48.576876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.581245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.581951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.583366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.585982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.588411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.594145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1da8960c-0eb2-423e-8874-6ca776a77e3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.036751 Oct 04 18:24:48.615899 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2256/4527] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:24:48.625607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.626435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.634286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.635051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.635717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.636613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:48.637240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:48.637837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:48.681648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] validate_networks() for [('063809de-19b2-4d41-aac9-41553db13d6b', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:49.020804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.029922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e127296c-f1a6-43c9-a6b3-a0314ce424fa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1511 microversion: 2.1 time: 0.421982 Oct 04 18:24:49.030861 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2257/4528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:49.059251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:49.060164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:49.067703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.068645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.069433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.070321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.070956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.071610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.234098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:49.235792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:49.236945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:49.237942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:49.238667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:49.273312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.274022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.274597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.275542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.284004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.284802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.362335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for project 99f694a0007f4d199b37149b4309a1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:49.386967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Getting quotas for user ad04482fd46b4291afa5a2ec32f050d3 and project 99f694a0007f4d199b37149b4309a1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:49.402887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.419136 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58dfc81d-7c98-4d82-b554-b9b60679b8bc tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1512 microversion: 2.1 time: 0.361570 Oct 04 18:24:49.423540 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2258/4529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:49 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:49.438155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:49.452760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:49.454551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:49.457134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:49.468551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.469610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.470565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.472187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:49.473276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:49.474323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:49.690100 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19ffc683-5761-4cef-a713-9ad618befe6e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164901 Oct 04 18:24:49.698242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2272/4530] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:24:50.039678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aabcf521-13ca-4df8-aa91-fc39f606d711 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Action: 'create', calling method: .version_select at 0x7f90086b08b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1278905879"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:50.111819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.121876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5933b7e8-908b-4b7d-a49f-b77e082543bd tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1512 microversion: 2.1 time: 0.681706 Oct 04 18:24:50.136216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2259/4531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:49 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1512 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:50.153911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46e09d1a-41d9-47c0-81f9-27e886e65acd tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:50.154561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46e09d1a-41d9-47c0-81f9-27e886e65acd tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:50.370310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46e09d1a-41d9-47c0-81f9-27e886e65acd tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.381310 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46e09d1a-41d9-47c0-81f9-27e886e65acd tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1218 microversion: 2.1 time: 0.242630 Oct 04 18:24:50.383207 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2260/4532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:50 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:50.429255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:50.434732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.447317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:50.789905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.790405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.790849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.791707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.792209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.793211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.071959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:51.300633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7839e912-65bf-4a3e-8a5c-e75f674c590e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.913135 Oct 04 18:24:51.303766 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2261/4533] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 4 18:24:50 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:51.317060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.319545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.343126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.344211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.348197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.348197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.348728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.349416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.497073 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aabcf521-13ca-4df8-aa91-fc39f606d711 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.797352 Oct 04 18:24:51.498925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2273/4534] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Oct 4 18:24:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1800 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:24:51.505263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5c584be-c039-4d9f-a29e-2496a8c55f30 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.507746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5c584be-c039-4d9f-a29e-2496a8c55f30 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.685767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5c584be-c039-4d9f-a29e-2496a8c55f30 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.701768 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5c584be-c039-4d9f-a29e-2496a8c55f30 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1218 microversion: 2.1 time: 0.201397 Oct 04 18:24:51.702381 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2274/4535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:51.724549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47514227-001b-4534-9568-00abc99d94c2 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90084a2c10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.832885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47514227-001b-4534-9568-00abc99d94c2 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 345 microversion: 2.1 time: 0.127619 Oct 04 18:24:51.833545 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2275/4536] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:51.965660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:51.974596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ecec083-f9c1-4b16-80d6-6afd45af9a10 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1511 microversion: 2.1 time: 0.661634 Oct 04 18:24:51.993023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2262/4537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1511 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:51.999968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.000599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.035307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.037157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.038283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.039225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.039913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.040504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.218945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.228988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a95ff0fd-13a4-44ef-bac1-bc543495eeec tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1512 microversion: 2.1 time: 0.234794 Oct 04 18:24:52.230327 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2276/4538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:52.257491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.258126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.272627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.275134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.275971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.277822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.279872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.281704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.656923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.683081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6779222c-029c-484a-be55-0cc6b183c77a tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1512 microversion: 2.1 time: 0.426474 Oct 04 18:24:52.689687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2263/4539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:52.730426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.730863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:52.731938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:52.732827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.733611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:52.746193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.748480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.751145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.753319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.753676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.754346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.754945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.761552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.763304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.771044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.771044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.771044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.816224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:52.874568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.888039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:52.888866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:52.889509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.965871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.975994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-292b7767-5edb-4752-9849-90181b44e025 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1214 microversion: 2.1 time: 0.252188 Oct 04 18:24:52.976588 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2264/4540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:52.997597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f320e55-da4f-40e6-a288-d37973828d9e tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008d001f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.072986 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f320e55-da4f-40e6-a288-d37973828d9e tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 345 microversion: 2.1 time: 0.079350 Oct 04 18:24:53.073656 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2265/4541] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:53.301105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5743356a-8620-48e8-aa98-76d8fbdafb1b tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.578218 Oct 04 18:24:53.302102 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2277/4542] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:24:52 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:53.328892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.334520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.335852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:53.432198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.436483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.438171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.444210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.444868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.445423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.520441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:53.577469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e42b7dc1-81ce-4e1e-8a4b-c6142437db6c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1011 microversion: 2.1 time: 0.253267 Oct 04 18:24:53.578105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2266/4543] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1011 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:53.594621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.602266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:53.602266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:53.610686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:53.618168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.620880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.620880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.622473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.623907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.624353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.897427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:54.070940 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d22236c2-888d-4bef-a055-fd69511aabcf tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.477389 Oct 04 18:24:54.072076 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2267/4544] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:54.087011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.092292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:54.102862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.106376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.107089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.108019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.108645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.109389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.221537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1803365551", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6d545094-14e0-4259-be8a-5271d906e283"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:54.250807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:54.254340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:54.260060 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc8d498a-dc75-416c-a91b-b971bce245d3 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1278 microversion: 2.1 time: 0.184156 Oct 04 18:24:54.273918 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2268/4545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:54.284075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.303242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:54.318550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:54.319744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] validate_networks() for [('6d545094-14e0-4259-be8a-5271d906e283', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:54.344005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.344693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.345143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.345940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.346393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.346807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.489438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:54.564401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8854e095-fa47-45db-8ba8-fa44e0efaa7f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.285954 Oct 04 18:24:54.565562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2269/4546] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:54.577935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94310a0e-a0fa-43ff-b812-baa2e40477f4 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9009895a60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.648700 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94310a0e-a0fa-43ff-b812-baa2e40477f4 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 346 microversion: 2.1 time: 0.081823 Oct 04 18:24:54.649292 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2270/4547] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:54.665200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:54.672630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:54.673651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': '-160033561', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:54.679204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.680092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.680661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.681548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:54.682152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:54.682753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.802288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:54.927353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cbe2c41d-9c33-4368-8026-9a02f353ea41 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-160033561" status: 200 len: 345 microversion: 2.1 time: 0.267119 Oct 04 18:24:54.927975 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2271/4548] 10.222.0.40 () {58 vars in 1156 bytes} [Tue Oct 4 18:24:54 2022] GET /compute/v2.1/servers?name=-160033561 => generated 345 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:54.939776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a343bd4-3fb5-495a-8809-e28395ae6d30 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Action: 'create', calling method: .version_select at 0x7f9008c798b0>, body: {"snapshot": {"volume_id": "ffaff619-71dc-4fa1-92b1-f5b5a79d0a44", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-351831054"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:55.286586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:55.287134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:55.287742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:55.288384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:55.289050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:55.309159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.310302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.316320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.316320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.316320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.316320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.398693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Getting quotas for project 9a2798439b374319b553b6052f18a953. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:55.417651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Getting quotas for user 64b8585a981e48d6a7102768b59f06ee and project 9a2798439b374319b553b6052f18a953. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:55.460086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Going to run 2 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:55.466202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12557df9-549b-4b11-aaa1-5612eae46c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:55.637982 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a343bd4-3fb5-495a-8809-e28395ae6d30 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.708896 Oct 04 18:24:55.639220 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2272/4549] 10.222.0.40 () {60 vars in 1162 bytes} [Tue Oct 4 18:24:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:55.650724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:55.673220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.673915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:55.689797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.690292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.690730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.694537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.695046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.698999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.710717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=12557df9-549b-4b11-aaa1-5612eae46c60,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:55.918929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:55.948726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36bc2067-c318-4e69-a6d9-216e286c17b1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.401949 Oct 04 18:24:55.949757 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2278/4550] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:24:55.956437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:55.957411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:55.964508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.965226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.965976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.967092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.967786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.968566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.972577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:56.095314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa8f0c64-34a5-442f-bcb7-f773eaf224e5 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.454321 Oct 04 18:24:56.096210 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2273/4551] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 4 18:24:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:56.101693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d4dab6d-4fdf-47b8-a1a8-f42eb2429c9c tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008d48280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.175645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d4dab6d-4fdf-47b8-a1a8-f42eb2429c9c tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.078089 Oct 04 18:24:56.176986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2274/4552] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:56.187254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.195700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.198313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Searching by: {'deleted': False, 'project_id': '9a2798439b374319b553b6052f18a953'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:56.254854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.258930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.259767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.260986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.262180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.262845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.310328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a40ad342-1465-42c8-bac1-ec14e7648e14 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.129198 Oct 04 18:24:56.311684 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2275/4553] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers => generated 677 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:56.328737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.345583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.347434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-16003356', 'deleted': False, 'project_id': '517596408a7e4175b1593b7ec9d55b65'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:24:56.365683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.365683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.368020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.370723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.372264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.372883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.597772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.608387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9b7658d-6090-4050-ba9e-3845e11eae7d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.657365 Oct 04 18:24:56.608994 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2279/4554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:55 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:56.634699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4e29539-67a5-4d00-b05c-7999b93ef9fd tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90087c1ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.714402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4e29539-67a5-4d00-b05c-7999b93ef9fd tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096953 Oct 04 18:24:56.721355 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2280/4555] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:56.721355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88f26d78-8f7b-4e42-982a-2ad85ea24094 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.727673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88f26d78-8f7b-4e42-982a-2ad85ea24094 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:56.912379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88f26d78-8f7b-4e42-982a-2ad85ea24094 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:56.922552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88f26d78-8f7b-4e42-982a-2ad85ea24094 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1220 microversion: 2.1 time: 0.205971 Oct 04 18:24:56.935688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2281/4556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:56.941030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-594288b5-adf4-4be1-bd18-cb4d35b64afe tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008c698b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:57.040757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-594288b5-adf4-4be1-bd18-cb4d35b64afe tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.103652 Oct 04 18:24:57.043600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2282/4557] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:57.440223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:24:57.604834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e28a1b02-d563-4434-b9ce-dc9edab95d04 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-16003356" status: 200 len: 345 microversion: 2.1 time: 1.289655 Oct 04 18:24:57.605651 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2276/4558] 10.222.0.40 () {58 vars in 1226 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-16003356 => generated 345 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:57.619403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:57.620524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:57.635657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:57.636294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:57.641223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.641728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.642172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.642889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.643346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.643811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.649714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.650224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.650673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.651423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:57.651913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:57.652347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.721829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:24:57.984799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.997440 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5db2811b-1775-4b48-a901-eea1a6eb9737 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.366278 Oct 04 18:24:58.001393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2277/4559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:57 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:58.004968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d1a349a-06b7-4a37-8bbc-8d9c4c14a557 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:58.006211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d1a349a-06b7-4a37-8bbc-8d9c4c14a557 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:58.160870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d1a349a-06b7-4a37-8bbc-8d9c4c14a557 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.161043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee56e32a-a08a-42f1-953a-4561a94d2833 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 204 len: 0 microversion: 2.1 time: 0.546531 Oct 04 18:24:58.173465 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2283/4560] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:24:57 2022] DELETE /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:24:58.173691 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d1a349a-06b7-4a37-8bbc-8d9c4c14a557 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1220 microversion: 2.1 time: 0.170411 Oct 04 18:24:58.173797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3735959b-c791-441f-9952-bed96aec7f3f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f900906e310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:58.188690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2278/4561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:57 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:58.226529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3735959b-c791-441f-9952-bed96aec7f3f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.060375 Oct 04 18:24:58.227106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2284/4562] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:24:58 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:58.233017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:58.236006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:58.265493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.265857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.267556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.269822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.277213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.277901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.443802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0", "tag": "a6d30ccb-9942-4f7a-bc5c-40dd9193c150"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:58.474420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.475328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.476071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.513792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] Creating event network-changed:a6d30ccb-9942-4f7a-bc5c-40dd9193c150 for instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 on n-h2-833090-21 Oct 04 18:24:58.522620 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f4a2421f-b8fa-4347-bdea-f4669c466d93 req-0685d4ba-39fe-48c1-acf7-9684e7236b39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081322 Oct 04 18:24:58.525678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2285/4563] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:58.603623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.616861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77f951ab-c0a7-4518-b24e-087ff65efa2e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1518 microversion: 2.1 time: 0.426755 Oct 04 18:24:58.619130 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2279/4564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:58 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1518 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:59.035278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.041690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.055420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.056180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.056758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.063874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.064408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.065075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.205708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-799a5e1c-5a98-4d14-aa9c-900466041b0f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.206723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-799a5e1c-5a98-4d14-aa9c-900466041b0f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.362591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-799a5e1c-5a98-4d14-aa9c-900466041b0f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:59.376959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-799a5e1c-5a98-4d14-aa9c-900466041b0f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1220 microversion: 2.1 time: 0.176722 Oct 04 18:24:59.383541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2280/4565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1220 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:59.409489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc068588-dad6-4197-a143-29d1a9980c70 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90097e29d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.462655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:59.487833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc068588-dad6-4197-a143-29d1a9980c70 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.101460 Oct 04 18:24:59.489099 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2281/4566] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:59.504517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e984bc70-f4c1-42bb-99ff-902c70405b9d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.458344 Oct 04 18:24:59.505675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2286/4567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:59.642156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.642767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.649736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.650501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.651648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.652519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.653130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.653852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.236752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.247891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05ccdc97-6317-4d5c-88fc-efc7d3a4f8f8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1518 microversion: 2.1 time: 0.609566 Oct 04 18:25:00.253893 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2282/4568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1518 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:00.410659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.411276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:00.423740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.424303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.424826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.425992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.427440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.428126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.506242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56726be8-26dc-42fb-b048-ba4c73e2b465 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008d429d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.540850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.551003 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c87b42dc-e302-4357-99b3-0492e17b9699 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1216 microversion: 2.1 time: 0.145907 Oct 04 18:25:00.555128 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2287/4569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:00 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:00.565519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.567181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:00.584279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.587687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.588358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.589330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:00.592514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:00.593916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.600369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56726be8-26dc-42fb-b048-ba4c73e2b465 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 287 microversion: 2.1 time: 0.102365 Oct 04 18:25:00.610765 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2283/4570] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:25:00 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:00.616669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b294c95-9a2a-447f-85b8-d2a09861d672 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008c79e50>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.930993 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b294c95-9a2a-447f-85b8-d2a09861d672 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 202 len: 0 microversion: 2.1 time: 0.318632 Oct 04 18:25:00.938569 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2284/4571] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 18:25:00 2022] DELETE /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:25:00.944748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.953243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3830926-072f-42ef-8523-c65624afa6ab tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008d009d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:00.957736 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8fa91aae-4fb0-40d1-bee9-a505be90bd18 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.401220 Oct 04 18:25:00.961250 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2288/4572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:00 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:01.030820 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3830926-072f-42ef-8523-c65624afa6ab tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.091096 Oct 04 18:25:01.034048 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2285/4573] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:25:00 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:01.272331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:01.273562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:01.285091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.289775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.294116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.294915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.295385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.295847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.523679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.556487 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbff684c-ecad-47eb-bd75-1a12660aed3c tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1476 microversion: 2.1 time: 0.280898 Oct 04 18:25:01.557639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2289/4574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:01 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:01.587057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:01.587740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:01.608546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.611730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.616012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.616012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.617231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.617699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.783769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.795987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b476d6ef-bafb-4b3e-9657-9c4269fd59fc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1272 microversion: 2.1 time: 0.216265 Oct 04 18:25:01.819362 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2290/4575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:01 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:01.855536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10932733-79a7-4951-abea-f21d0eafbce1", "name": "network-vif-deleted", "tag": "afa62d32-b540-47f5-b943-a8b24ad525e2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:01.875496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.878853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.881606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.909670 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] Creating event network-vif-deleted:afa62d32-b540-47f5-b943-a8b24ad525e2 for instance 10932733-79a7-4951-abea-f21d0eafbce1 on n-h2-833090-21 Oct 04 18:25:01.916898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fd52d384-db86-46e9-86e9-cfe323df2a43 req-7d45c8cd-2608-40a9-a5d2-c0e5bd1d093b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386009 Oct 04 18:25:01.917793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2286/4576] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:01.982941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:01.983828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:01.998843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.999670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.001541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.002410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.004589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.007015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.047838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c735d253-041e-435b-a82b-5366e006bd2c tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90097e28b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.127191 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c735d253-041e-435b-a82b-5366e006bd2c tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.084416 Oct 04 18:25:02.128252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2287/4577] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:02.350760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.379908 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8dabd93e-bfa2-4b5b-ba71-9a7a764cc946 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.401778 Oct 04 18:25:02.381202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2291/4578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:01 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:02.587233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.587501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:02.602944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.605540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.606083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.608175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.609238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.610294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.757615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.774396 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e3d5eaa-d4bc-4342-96d6-f8d977540b38 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1476 microversion: 2.1 time: 0.193655 Oct 04 18:25:02.776738 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2288/4579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:02.819829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.820343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:02.844024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.844613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.845063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.848695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.849156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.852343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.975044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:02.987707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d1a2bcd-03b9-4cc2-9399-4b6835c7b2e0 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1272 microversion: 2.1 time: 0.170060 Oct 04 18:25:02.995621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2292/4580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:03.144594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b71ed06-6e3b-4263-b583-8b8cb033e5da tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9009ff6550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:03.247546 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b71ed06-6e3b-4263-b583-8b8cb033e5da tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 200 len: 286 microversion: 2.1 time: 0.110587 Oct 04 18:25:03.248917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2289/4581] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:25:03 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:03.405545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:03.406172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:03.421341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.422983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.424785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.427336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.428019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.460382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.724253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.734094 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f44e5b52-ad1a-44ca-aa20-494ba5cf6bfe tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.333416 Oct 04 18:25:03.747511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2293/4582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:03 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:03.803658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:03.804731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:03.813583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.814708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.821586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.828551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:03.828551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:03.828551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.938748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.949475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-114136d2-bf3a-43b6-af52-cd763e1113a8 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1476 microversion: 2.1 time: 0.151690 Oct 04 18:25:03.958512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2290/4583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:03 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:04.021217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.021835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.032716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.033221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.033664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.034385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.034842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.035269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.154983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:04.179334 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9cb6a098-4236-47a6-92a7-09c1de40266b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1280 microversion: 2.1 time: 0.159968 Oct 04 18:25:04.179334 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2294/4584] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:04.261217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a584388-e165-41b1-b021-0ccbe14fe380 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008d224c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.303218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5a584388-e165-41b1-b021-0ccbe14fe380 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] HTTP exception thrown: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a584388-e165-41b1-b021-0ccbe14fe380 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Request method failure captured: Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 HTTP/1.1 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHpxPVYY-n1jrofIOLI32mF531XZmB-F88_bAhzuxlBbb8NaUeIyzif3o3nix1HbB2l3G24y-Amcc71LAQanSNSG7V5q_8KvxZzz_TO8qz9zfJgXXWW8wMXDiLvdETP69A5aIfSkhsctWho60Y0GPfH8NZhe4AHou5wwMPS2EysOSNg Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2be6fbca65b047dda47b4b57afdc61ea"}]}] Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 1953dfe22b9641f5b68e9b4d03ad1da8 Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: exception: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd9cbbd3f-14a7-4b30-984e-e702fb6e7d19'} Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. (HTTP 404) (Request-ID: req-191a064c-ac0e-453c-8822-776a40acdf73) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:04.317824 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. Oct 04 18:25:04.321885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:04.330154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a584388-e165-41b1-b021-0ccbe14fe380 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Returning 404 to user: Snapshot d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:04.330154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a584388-e165-41b1-b021-0ccbe14fe380 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19" status: 404 len: 111 microversion: 2.1 time: 0.071199 Oct 04 18:25:04.331156 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2291/4585] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/os-snapshots/d9cbbd3f-14a7-4b30-984e-e702fb6e7d19 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:04.354637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b24cb93-5534-47b8-b945-abf2b8fb72b6 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90087725e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.617075 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b24cb93-5534-47b8-b945-abf2b8fb72b6 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 202 len: 0 microversion: 2.1 time: 0.281338 Oct 04 18:25:04.617894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2295/4586] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:25:04 2022] DELETE /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:25:04.626463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17d265b7-9522-49c5-ab73-4c9273a6e72f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f900973fb80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.717391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17d265b7-9522-49c5-ab73-4c9273a6e72f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 345 microversion: 2.1 time: 0.094967 Oct 04 18:25:04.718332 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2292/4587] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:04.760514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.761105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.768917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.769419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.769855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.770642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.771107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.771555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.974812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.975600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.989149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.989673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.991576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.003240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.003240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.003240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.073120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.073985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.074601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.075393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lazy-loading 'fault' on Instance uuid 10932733-79a7-4951-abea-f21d0eafbce1 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:05.154194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:05.176679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f530f2b7-538c-4118-8487-4866c539e414 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 200 len: 1311 microversion: 2.1 time: 0.204768 Oct 04 18:25:05.178466 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2293/4588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:05.198530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:05.209578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:05.210630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:05.211840 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d02a703d-d3c5-4584-8645-852f87fdf600 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.454217 Oct 04 18:25:05.213604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2296/4589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:05.232404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.234887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.236733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.239649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.242530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.244942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.341852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12557df9-549b-4b11-aaa1-5612eae46c60", "tag": "69200250-6155-4596-822b-4e175b2944de"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:05.356543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:05.359334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.360955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.361950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.380171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] Creating event network-changed:69200250-6155-4596-822b-4e175b2944de for instance 12557df9-549b-4b11-aaa1-5612eae46c60 on n-h1-833090-21 Oct 04 18:25:05.387854 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f12afc16-384c-4529-b3d0-e95059dc835a req-c2c731e5-640d-453e-8aac-633a388e371f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049927 Oct 04 18:25:05.390646 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2297/4590] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:05.515318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:05.525531 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f4f926e-ce2d-4d46-a946-b6074e2822a7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1278 microversion: 2.1 time: 0.321480 Oct 04 18:25:05.526749 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2294/4591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:05 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1278 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:05.742812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-985e7970-0f89-490f-9d77-b481f326e737 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008c69820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:05.865803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-985e7970-0f89-490f-9d77-b481f326e737 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 345 microversion: 2.1 time: 0.136564 Oct 04 18:25:05.866397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2298/4592] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:05 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:06.209832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:06.210787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 10932733-79a7-4951-abea-f21d0eafbce1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:06.225794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.231245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.235083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.236694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.237399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.238139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.247116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:06.249246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.280967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.300495 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] HTTP exception thrown: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Request method failure captured: Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 HTTP/1.1 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHox5B5JLlpuCULYvUXiM_I5tK70KJdOQ5WL6ZSzSEFRGrWRp2s6eOq0JCrf0sFYg_eAs49PcViM6efeMwdGzFmNjLivJDvrsMa15ZEWgJWQfalnNtbNUTeuzezrNVbbMb16cry-xI3UtWaN0l0OnQYjlaEXiho8SNo3cD8F88vYxHc Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/517596408a7e4175b1593b7ec9d55b65"}]}] Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ae17dd6021594d549826a12292cf70a3 Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '10932733-79a7-4951-abea-f21d0eafbce1'} Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:06.305601 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. Oct 04 18:25:06.310335 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:06.313582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Returning 404 to user: Instance 10932733-79a7-4951-abea-f21d0eafbce1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:06.315958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9f3bf61-4e39-46fb-adac-d77fbb67e5a0 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1" status: 404 len: 111 microversion: 2.1 time: 0.110544 Oct 04 18:25:06.318731 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2295/4593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:06 2022] GET /compute/v2.1/servers/10932733-79a7-4951-abea-f21d0eafbce1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:06.333037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:06.336975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:06.360645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.364936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.375262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.376057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.376546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.376988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.433182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:06.492571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=18 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:06.686513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:06.700889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce6c9f51-3b06-4235-ba85-117c56b70369 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.459141 Oct 04 18:25:06.715514 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2299/4594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:06 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:06.715514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:06.715514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:06.725043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.725546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.725982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.726684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.727134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.727603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.862895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c285cb4-a684-4867-8709-445ca81b501d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 204 len: 0 microversion: 2.1 time: 0.537819 Oct 04 18:25:06.867379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2296/4595] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:06 2022] DELETE /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:06.922183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:07.215796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8d95ec5-b92f-4f63-b547-3cf259148e5b tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Action: 'create', calling method: .version_select at 0x7f900973faf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1813407083", "metadata": {"Type": "work"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8d95ec5-b92f-4f63-b547-3cf259148e5b tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 122 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1813407083", "metadata": {"Type": "work"}}} Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1813407083', 'metadata': {'Type': 'work'}}}} Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:25:07.220593 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:25:07.225502 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.237626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8d95ec5-b92f-4f63-b547-3cf259148e5b tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.238766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f8d95ec5-b92f-4f63-b547-3cf259148e5b tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.370084 Oct 04 18:25:07.239598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2297/4596] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 4 18:25:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:07.250219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.251262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:07.265126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.267944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.268620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.278508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.279252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.279920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.326920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:07.578954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.589528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a0680b1-34ec-4b62-a889-10f61dcc1ddc tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.886541 Oct 04 18:25:07.607538 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2300/4597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:06 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:07.616490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52701c35-2f7d-4b85-a77b-23f07e63e69e tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90086e3790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.654190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.667535 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33ea186b-79d8-43cc-ac60-3901c2f18573 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1518 microversion: 2.1 time: 0.426599 Oct 04 18:25:07.668160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2298/4598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1518 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:07.695698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d894fbb-502a-4635-b13d-37789c96dfdb tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Action: 'create', calling method: .version_select at 0x7f9009786b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1829920192", "metadata": {"Type": "work"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d894fbb-502a-4635-b13d-37789c96dfdb tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 120 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1829920192", "metadata": {"Type": "work"}}} Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1829920192', 'metadata': {'Type': 'work'}}}} Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '0' Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:25:07.700089 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.706401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d894fbb-502a-4635-b13d-37789c96dfdb tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.708546 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d894fbb-502a-4635-b13d-37789c96dfdb tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019241 Oct 04 18:25:07.709904 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2299/4599] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 4 18:25:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:07.712958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52701c35-2f7d-4b85-a77b-23f07e63e69e tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 200 len: 345 microversion: 2.1 time: 0.104120 Oct 04 18:25:07.714038 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2301/4600] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:07.726353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c4817d3-b552-4890-bf74-355726b71005 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Action: 'create', calling method: .version_select at 0x7f90097fd550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1630461604", "metadata": {"Type": "work"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:07.730070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c4817d3-b552-4890-bf74-355726b71005 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 119 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1630461604", "metadata": {"Type": "work"}}} Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1630461604', 'metadata': {'Type': 'work'}}}} Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi '' Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:25:07.730748 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c4817d3-b552-4890-bf74-355726b71005 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.735371 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c4817d3-b552-4890-bf74-355726b71005 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009912 Oct 04 18:25:07.742246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:07.742334 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2300/4601] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 4 18:25:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:25:07.743908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94ee78fe-ad02-44d9-a047-becafe6bcf59 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Calling method '.version_select at 0x7f9008f1d0d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.747053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.747804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.748938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.750007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.750861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.751762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.773544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:07.775448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-94ee78fe-ad02-44d9-a047-becafe6bcf59 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] HTTP exception thrown: Volume tempest-invalid-1500768180 could not be found. Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94ee78fe-ad02-44d9-a047-becafe6bcf59 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1500768180 HTTP/1.1 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume tempest-invalid-1500768180 could not be found. Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'tempest-invalid-1500768180'} Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1500768180 could not be found. (HTTP 404) (Request-ID: req-8aa9bd41-e7d0-4b98-b154-ecc645f117a9) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:07.777639 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1500768180 could not be found. Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1500768180 could not be found. Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1500768180 could not be found. Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94ee78fe-ad02-44d9-a047-becafe6bcf59 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 404 to user: Volume tempest-invalid-1500768180 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94ee78fe-ad02-44d9-a047-becafe6bcf59 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1500768180" status: 404 len: 99 microversion: 2.1 time: 0.040838 Oct 04 18:25:07.788023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2301/4602] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:25:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1500768180 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:25:07.797312 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-347da34c-29fe-4615-b662-34ddebb5659f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003870 Oct 04 18:25:07.802779 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2302/4603] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 4 18:25:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:25:07.812603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b6f579f-185f-4fa4-be84-5957f3eee046 tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007514 Oct 04 18:25:07.813459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2303/4604] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:25:07.822837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0bebcf3-87eb-498c-bfa9-9b0c460a7a6f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Calling method '.version_select at 0x7f900d742040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.855395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a0bebcf3-87eb-498c-bfa9-9b0c460a7a6f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] HTTP exception thrown: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0bebcf3-87eb-498c-bfa9-9b0c460a7a6f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-volumes/4308d59d-f663-44f3-81fb-3de2983e793c HTTP/1.1 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4308d59d-f663-44f3-81fb-3de2983e793c'} Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. (HTTP 404) (Request-ID: req-184417cd-b6aa-49d7-b257-b4569ed50ee8) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:07.858474 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0bebcf3-87eb-498c-bfa9-9b0c460a7a6f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 404 to user: Volume 4308d59d-f663-44f3-81fb-3de2983e793c could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0bebcf3-87eb-498c-bfa9-9b0c460a7a6f tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/4308d59d-f663-44f3-81fb-3de2983e793c" status: 404 len: 109 microversion: 2.1 time: 0.042150 Oct 04 18:25:07.869497 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2304/4605] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:25:07 2022] DELETE /compute/v2.1/os-volumes/4308d59d-f663-44f3-81fb-3de2983e793c => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:07.879707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96081fa3-b853-47df-a92a-adbf48ab038e tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Calling method '.version_select at 0x7f900981b280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.911353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-96081fa3-b853-47df-a92a-adbf48ab038e tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] HTTP exception thrown: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96081fa3-b853-47df-a92a-adbf48ab038e tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Request method failure captured: Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-volumes/d1086dc4-8078-44b7-bc87-1cbd681e3670 HTTP/1.1 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqCcxuLVhq2DPleQeTuC5z_Mx56z8bONTX8ym-QvVO_6WzGgAs0LAMP6XBrpgAZe11ioEdAFOEWAxcv7IkB6xQVb9G_P_bISMofx9PfvnDpFKtYm2V6fBOidLwOoMscV1UQPIWFZxPH77rYgpG4_X69R5jcxmFm-NSRUphIUPwT08k Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea2c9d393ead40d2b6846fc4df090e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea2c9d393ead40d2b6846fc4df090e71"}]}] Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea2c9d393ead40d2b6846fc4df090e71 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-1934688981 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 02a7724df97b4ab1937b7a9785770547 Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-1934688981-project Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd1086dc4-8078-44b7-bc87-1cbd681e3670'} Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. (HTTP 404) (Request-ID: req-d4308a25-ef42-45bc-90a7-4cb6b7321474) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:07.913525 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. Oct 04 18:25:07.917805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:07.923724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96081fa3-b853-47df-a92a-adbf48ab038e tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] Returning 404 to user: Volume d1086dc4-8078-44b7-bc87-1cbd681e3670 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:07.923724 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-96081fa3-b853-47df-a92a-adbf48ab038e tempest-VolumesNegativeTest-1934688981 tempest-VolumesNegativeTest-1934688981-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d1086dc4-8078-44b7-bc87-1cbd681e3670" status: 404 len: 109 microversion: 2.1 time: 0.047254 Oct 04 18:25:07.928453 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2305/4606] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/os-volumes/d1086dc4-8078-44b7-bc87-1cbd681e3670 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:07.948477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.957931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fef10bde-369b-41b2-ae69-4e763b600b73 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.235049 Oct 04 18:25:07.958449 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2302/4607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:08.620149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:08.620787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:08.630007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.632511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.634025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.635689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.636571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.637885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.696376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:08.697657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:08.711027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.711939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.714403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.715578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.717183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.717828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.064679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:09.076260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:09.078099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c355f55-0c41-487c-917c-6759ac00a9d3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1518 microversion: 2.1 time: 0.386899 Oct 04 18:25:09.079994 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2303/4608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:08 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:09.098396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dd46521-f119-4d88-bad9-80ff2e5b951f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f90087c1430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.110811 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16288f03-7f5d-4a44-a3e6-aba228c10d26 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.496641 Oct 04 18:25:09.130161 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2306/4609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:08 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8dd46521-f119-4d88-bad9-80ff2e5b951f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] HTTP exception thrown: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dd46521-f119-4d88-bad9-80ff2e5b951f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Request method failure captured: Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 HTTP/1.1 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHpxPVYY-n1jrofIOLI32mF531XZmB-F88_bAhzuxlBbb8NaUeIyzif3o3nix1HbB2l3G24y-Amcc71LAQanSNSG7V5q_8KvxZzz_TO8qz9zfJgXXWW8wMXDiLvdETP69A5aIfSkhsctWho60Y0GPfH8NZhe4AHou5wwMPS2EysOSNg Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2be6fbca65b047dda47b4b57afdc61ea"}]}] Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 1953dfe22b9641f5b68e9b4d03ad1da8 Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: exception: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ffaff619-71dc-4fa1-92b1-f5b5a79d0a44'} Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. (HTTP 404) (Request-ID: req-1e1c6597-9621-4322-95f5-7a5c5ccc03d0) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:09.175333 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8dd46521-f119-4d88-bad9-80ff2e5b951f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Returning 404 to user: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8dd46521-f119-4d88-bad9-80ff2e5b951f tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 404 len: 109 microversion: 2.1 time: 0.094576 Oct 04 18:25:09.179667 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2304/4610] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:09 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:09.186339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c27abeb-a9f5-499b-9761-8e6776d0cd0e", "tag": "0952b0a0-c485-4cb2-bab9-a704ed3b4044"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:09.217479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.217951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.218377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.234806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] Creating event network-changed:0952b0a0-c485-4cb2-bab9-a704ed3b4044 for instance 0c27abeb-a9f5-499b-9761-8e6776d0cd0e on n-h2-833090-21 Oct 04 18:25:09.250871 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2462c703-67a9-492b-a92a-5e305fa85aa8 req-5f574abd-8e12-4ef4-b372-14647ffdcbf2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067911 Oct 04 18:25:09.252462 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2305/4611] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:09.258664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.259713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:09.271379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.272261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.272988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.273974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.274677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.275362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.376726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:09.550069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0", "name": "network-vif-plugged", "status": "completed", "tag": "a6d30ccb-9942-4f7a-bc5c-40dd9193c150"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:09.574630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:09.584731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.590775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.590775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.594659 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a6ddc41-246f-4330-9e40-44acacf1cdc9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.340795 Oct 04 18:25:09.595240 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2306/4612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:09 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:09.614894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21a93c0b-ccd1-4de4-9f7e-b402a9d30512 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f900849ac10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.623299 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] Creating event network-vif-plugged:a6d30ccb-9942-4f7a-bc5c-40dd9193c150 for instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 on n-h2-833090-21 Oct 04 18:25:09.644582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-aa89c697-0f01-4ff0-89df-5e093aee44ce req-ae3b0492-80f2-4831-b58d-c51544b69f8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.512932 Oct 04 18:25:09.645311 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2307/4613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:09.655403 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-21a93c0b-ccd1-4de4-9f7e-b402a9d30512 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] HTTP exception thrown: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21a93c0b-ccd1-4de4-9f7e-b402a9d30512 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Request method failure captured: Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 HTTP/1.1 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHpxPVYY-n1jrofIOLI32mF531XZmB-F88_bAhzuxlBbb8NaUeIyzif3o3nix1HbB2l3G24y-Amcc71LAQanSNSG7V5q_8KvxZzz_TO8qz9zfJgXXWW8wMXDiLvdETP69A5aIfSkhsctWho60Y0GPfH8NZhe4AHou5wwMPS2EysOSNg Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2be6fbca65b047dda47b4b57afdc61ea"}]}] Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 1953dfe22b9641f5b68e9b4d03ad1da8 Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: method: Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: exception: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ffaff619-71dc-4fa1-92b1-f5b5a79d0a44'} Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. (HTTP 404) (Request-ID: req-a16ed106-219e-4eaf-b38f-3f7c68385532) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:09.657561 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21a93c0b-ccd1-4de4-9f7e-b402a9d30512 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Returning 404 to user: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21a93c0b-ccd1-4de4-9f7e-b402a9d30512 tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 404 len: 109 microversion: 2.1 time: 0.058172 Oct 04 18:25:09.662605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2307/4614] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:25:09 2022] DELETE /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:09.682986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae21085c-99ad-425e-b8c1-7f4783e8cc3b tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Calling method '.version_select at 0x7f9008c63040>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.762904 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ae21085c-99ad-425e-b8c1-7f4783e8cc3b tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] HTTP exception thrown: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae21085c-99ad-425e-b8c1-7f4783e8cc3b tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Request method failure captured: Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 HTTP/1.1 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHpxPVYY-n1jrofIOLI32mF531XZmB-F88_bAhzuxlBbb8NaUeIyzif3o3nix1HbB2l3G24y-Amcc71LAQanSNSG7V5q_8KvxZzz_TO8qz9zfJgXXWW8wMXDiLvdETP69A5aIfSkhsctWho60Y0GPfH8NZhe4AHou5wwMPS2EysOSNg Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2be6fbca65b047dda47b4b57afdc61ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2be6fbca65b047dda47b4b57afdc61ea"}]}] Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2be6fbca65b047dda47b4b57afdc61ea Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-628966052 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 1953dfe22b9641f5b68e9b4d03ad1da8 Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-628966052-project Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: exception: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ffaff619-71dc-4fa1-92b1-f5b5a79d0a44'} Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. (HTTP 404) (Request-ID: req-b223a3c0-864a-443d-8fdd-0af2518d57d3) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:09.765957 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. Oct 04 18:25:09.770619 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:09.785219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae21085c-99ad-425e-b8c1-7f4783e8cc3b tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] Returning 404 to user: Volume ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:09.786435 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae21085c-99ad-425e-b8c1-7f4783e8cc3b tempest-VolumesSnapshotsTestJSON-628966052 tempest-VolumesSnapshotsTestJSON-628966052-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44" status: 404 len: 109 microversion: 2.1 time: 0.116656 Oct 04 18:25:09.787399 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2308/4615] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 4 18:25:09 2022] GET /compute/v2.1/os-volumes/ffaff619-71dc-4fa1-92b1-f5b5a79d0a44 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:10.116501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:10.117269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:10.119381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:10.124908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.125664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.126778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.127738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.130141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.130602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.154185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:10.155067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:10.169770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.170807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.171414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.172385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.173031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.173621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.376415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:10.392249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5640286-6016-46de-aeeb-fffc99307050 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1518 microversion: 2.1 time: 0.286987 Oct 04 18:25:10.411228 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2308/4616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:10 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:10.617993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:10.618814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:10.622148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:10.632973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.633683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.635853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.637188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.637815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.638421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.640363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ace6505b-2418-4b08-8feb-4b0da1b0007d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.492254 Oct 04 18:25:10.643549 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2309/4617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:10 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:10.684779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:10.684779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:10.690685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.693293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.694048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.695011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.695861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.696457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.907709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lazy-loading 'services' on Instance uuid 9ccd2e23-0a15-47c2-a277-53cc3673b681 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:11.032635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.049118 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc84f932-1712-452b-ae54-55b05a4ec0ea tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.435307 Oct 04 18:25:11.052416 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2309/4618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:10 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:11.275247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c547966-549a-4ef4-b82d-ad60344c5896", "name": "network-vif-deleted", "tag": "401e08ee-4afb-4339-8f33-81f29aeae049"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:11.302953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4f6086c-d9e6-4c26-9f66-34d8ae496223 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments/8be9bea9-bb5f-44b7-b0b3-3ed096a76bbd" status: 202 len: 0 microversion: 2.1 time: 0.632129 Oct 04 18:25:11.304174 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2310/4619] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:25:10 2022] DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments/8be9bea9-bb5f-44b7-b0b3-3ed096a76bbd => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:25:11.305655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.306338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.307837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.358825 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] Creating event network-vif-deleted:401e08ee-4afb-4339-8f33-81f29aeae049 for instance 9c547966-549a-4ef4-b82d-ad60344c5896 on n-h1-833090-21 Oct 04 18:25:11.365634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0ecdc37d-6c57-4103-9816-c6483cc9dc01 req-acec8c7e-1b7d-4461-8c02-03d6e659d463 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099844 Oct 04 18:25:11.367161 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2310/4620] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:11.422748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:11.424123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:11.434981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.435587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.436356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.437333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.438645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.439161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.479928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.480609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.481018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.481551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lazy-loading 'fault' on Instance uuid 9c547966-549a-4ef4-b82d-ad60344c5896 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:11.531240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.539414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04f744d9-ef47-4946-8780-454ed56d3d01 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 200 len: 1311 microversion: 2.1 time: 0.124546 Oct 04 18:25:11.540002 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2311/4621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:11 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:11.678297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:11.678958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:11.694948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.695606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.695936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.696687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.697176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.697606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.879707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.888879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9688bb29-3994-4c35-ba01-f2e5a656d9c1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.223953 Oct 04 18:25:11.889671 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2311/4622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:11 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:12.076817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.077362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.084405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.084894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.085338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.086037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.086498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.086929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.157378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12557df9-549b-4b11-aaa1-5612eae46c60", "name": "network-vif-plugged", "status": "completed", "tag": "69200250-6155-4596-822b-4e175b2944de"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:12.184192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.184717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.185113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.197924 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] Creating event network-vif-plugged:69200250-6155-4596-822b-4e175b2944de for instance 12557df9-549b-4b11-aaa1-5612eae46c60 on n-h1-833090-21 Oct 04 18:25:12.207832 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-97e95c80-aa14-41f5-aed7-368d31595219 req-2604abdf-f6c2-45b3-95b2-3aef3446a2fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050646 Oct 04 18:25:12.207832 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2312/4623] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:12.260615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:12.268736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16f29653-81d5-4bd3-aa73-092498a03292 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.196526 Oct 04 18:25:12.269573 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2312/4624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:12 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:12.564656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.565370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: 9c547966-549a-4ef4-b82d-ad60344c5896] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.575019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.576370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.576994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.578896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.579926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.580637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.598289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] HTTP exception thrown: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Request method failure captured: Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 HTTP/1.1 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHox5B5JLlpuCULYvUXiM_I5tK70KJdOQ5WL6ZSzSEFRGrWRp2s6eOq0JCrf0sFYg_eAs49PcViM6efeMwdGzFmNjLivJDvrsMa15ZEWgJWQfalnNtbNUTeuzezrNVbbMb16cry-xI3UtWaN0l0OnQYjlaEXiho8SNo3cD8F88vYxHc Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/517596408a7e4175b1593b7ec9d55b65"}]}] Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ae17dd6021594d549826a12292cf70a3 Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9c547966-549a-4ef4-b82d-ad60344c5896'} Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:12.600078 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Returning 404 to user: Instance 9c547966-549a-4ef4-b82d-ad60344c5896 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bac7effa-0247-4c70-ad33-0fd9aecfcfc3 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896" status: 404 len: 111 microversion: 2.1 time: 0.042567 Oct 04 18:25:12.604437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2313/4625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:12 2022] GET /compute/v2.1/servers/9c547966-549a-4ef4-b82d-ad60344c5896 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:12.610274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.610779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.617567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.621252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.621252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.621252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.621252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.621252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.656669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:12.911908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.912635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.920633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.921121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.921633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.922407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.922950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.923400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.069197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6adea4a4-5c1e-4102-bb3d-b2f1a6f28a6d tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 204 len: 0 microversion: 2.1 time: 0.462480 Oct 04 18:25:13.069909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2313/4626] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:12 2022] DELETE /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:13.078732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:13.079448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:13.083300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:13.087338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.088398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.089558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.090471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.091364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.091982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.095096 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd553d94-8bef-43f3-aeb5-2836bc7e7628 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.187095 Oct 04 18:25:13.106800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2314/4627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:12 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:13.294728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:13.295359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:13.303068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:13.306821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.307604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.308198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.309733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:13.310467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:13.313306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.313604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b06ed69-b17d-4290-bcc3-8637e165a636 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1517 microversion: 2.1 time: 0.239094 Oct 04 18:25:13.314202 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2314/4628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:13 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:13.592591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:13.597354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92d5bea0-3c80-4bd1-aca0-66c11ae1b085 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1318 microversion: 2.1 time: 0.307270 Oct 04 18:25:13.597934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2315/4629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:13 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:14.121017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:14.121640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:14.128939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.129435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.129882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.130588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.131048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.131508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.340923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:14.342019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:14.366454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.367230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.372524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.373460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.378280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.380993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.736640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.749002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5582b84-ae76-4267-bb73-e9ae6d21022e tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1517 microversion: 2.1 time: 0.412001 Oct 04 18:25:14.755570 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2316/4630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:14 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:14.767544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:14.772492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:14.803878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.805961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.811299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.812123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.813081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.813480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.981180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.998394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df131db9-9701-45de-bf1b-1d310aa31ec7 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.881644 Oct 04 18:25:14.999271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2315/4631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:14 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:15.119864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.137938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a49e0a02-17b0-40f3-909a-a0221e1b1cf8 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1508 microversion: 2.1 time: 0.380421 Oct 04 18:25:15.140868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2317/4632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:14 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:15.780674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.782487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.804115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.806374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.807178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.811497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.818983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.819694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.022534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:16.024248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:16.047433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.048430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.049175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.051152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.054893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.055608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.217246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:16.230256 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42afca34-131e-4db9-bfd6-9730692cd6aa tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1517 microversion: 2.1 time: 0.451936 Oct 04 18:25:16.234569 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2316/4633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:15 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:16.269687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1350d3-98e0-486f-90dd-af2195421b27", "name": "network-vif-deleted", "tag": "62a03e9c-260a-4a0e-bd94-11a8483c289e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:16.336769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.337271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.337756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.385540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] Creating event network-vif-deleted:62a03e9c-260a-4a0e-bd94-11a8483c289e for instance aa1350d3-98e0-486f-90dd-af2195421b27 on n-h1-833090-21 Oct 04 18:25:16.401167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d8a3cb50-47cb-4974-acbf-8dfcffab8d88 req-dcd9dc2c-e753-47d2-b538-d015e8cef420 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162034 Oct 04 18:25:16.404131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2317/4634] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:16.730258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:16.730258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1a1c238a-a42f-47ef-985a-8607aacaeb28 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.707997 Oct 04 18:25:16.730258 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2318/4635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:16 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:17.154864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c27abeb-a9f5-499b-9761-8e6776d0cd0e", "name": "network-vif-plugged", "status": "completed", "tag": "0952b0a0-c485-4cb2-bab9-a704ed3b4044"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:17.188010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.197550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.197550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.221415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] Creating event network-vif-plugged:0952b0a0-c485-4cb2-bab9-a704ed3b4044 for instance 0c27abeb-a9f5-499b-9761-8e6776d0cd0e on n-h2-833090-21 Oct 04 18:25:17.236745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c53c673b-c6d6-4c38-a11b-d2a0b4321080 req-a19ad432-2220-4bd6-9f21-f379f65c059d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093131 Oct 04 18:25:17.246892 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2318/4636] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:17.265322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:17.266650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:17.273991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.274735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.275356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.276261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.276867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.277440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.371185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.374842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.375382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.375879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lazy-loading 'fault' on Instance uuid aa1350d3-98e0-486f-90dd-af2195421b27 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:17.588549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae17dd6021594d549826a12292cf70a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517596408a7e4175b1593b7ec9d55b65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.597195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4470c080-ad67-4e87-98d7-809a939d7794 tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 200 len: 1310 microversion: 2.1 time: 0.339231 Oct 04 18:25:17.598155 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2319/4637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:17 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:17.752402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:17.753386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:17.764075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.765601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.766350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.767228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.768473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.769068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.066079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:18.076518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76ffdb11-6bc5-4443-b8ec-28399c4231b2 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.331094 Oct 04 18:25:18.077763 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2319/4638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:17 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:18.549736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "251afcb6-e5c6-4e37-9878-6263017e7beb"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:18.553319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:18.563638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.564246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.565924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.566960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.567526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.568039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.628447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:18.630524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] [instance: aa1350d3-98e0-486f-90dd-af2195421b27] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] HTTP exception thrown: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Request method failure captured: Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0/os-volume_attachments/96409415-e9ee-4d34-a283-5b603014463e HTTP/1.1 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 74 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnloU6-BabtO06sUseZoLAOB5-AG0-mSQwgh-zlsww6eBDqrt47nt8kmqYCyTYDxI5K3eVQut840oDDxD_QWWXLZGkKbhCWQNfCSuEB6asu9yMPqqhFinYFTPOUoUOS5Lnut0mgFeUX4Qfec0F5qiZslLu6Nxkpm3Dx5JA_AIDoPT4 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 1b8abb1b83f04e4e9c8c113256b6fde2 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b8abb1b83f04e4e9c8c113256b6fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b8abb1b83f04e4e9c8c113256b6fde2"}]}] Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 1b8abb1b83f04e4e9c8c113256b6fde2 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-514558082 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesAdminNegativeTest-514558082-project-admin Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 83a3ad8066ef4db29fdc17c3aa479769 Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesAdminNegativeTest-514558082-project-admin Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: {"volumeAttachment": {"volumeId": "251afcb6-e5c6-4e37-9878-6263017e7beb"}} Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: exception: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0', 'id': '96409415-e9ee-4d34-a283-5b603014463e', 'body': {'volumeAttachment': {'volumeId': '251afcb6-e5c6-4e37-9878-6263017e7beb'}}} Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. (HTTP 404) (Request-ID: req-eb216f2b-a65f-4b1f-a0fc-95745d592cf1) Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 18:25:18.642298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] Returning 404 to user: Volume 96409415-e9ee-4d34-a283-5b603014463e could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:18.646203 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-671cdd4b-dfda-4924-be20-84fc98997dd4 tempest-VolumesAdminNegativeTest-514558082 tempest-VolumesAdminNegativeTest-514558082-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0/os-volume_attachments/96409415-e9ee-4d34-a283-5b603014463e" status: 404 len: 109 microversion: 2.1 time: 0.098917 Oct 04 18:25:18.649594 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2320/4639] 10.222.0.40 () {60 vars in 1433 bytes} [Tue Oct 4 18:25:18 2022] PUT /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0/os-volume_attachments/96409415-e9ee-4d34-a283-5b603014463e => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:18.654631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.655339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.655998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.657989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:18.658659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:18.659286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:18.681772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] HTTP exception thrown: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Request method failure captured: Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 HTTP/1.1 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHox5B5JLlpuCULYvUXiM_I5tK70KJdOQ5WL6ZSzSEFRGrWRp2s6eOq0JCrf0sFYg_eAs49PcViM6efeMwdGzFmNjLivJDvrsMa15ZEWgJWQfalnNtbNUTeuzezrNVbbMb16cry-xI3UtWaN0l0OnQYjlaEXiho8SNo3cD8F88vYxHc Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/517596408a7e4175b1593b7ec9d55b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/517596408a7e4175b1593b7ec9d55b65"}]}] Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 517596408a7e4175b1593b7ec9d55b65 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1705554847 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ae17dd6021594d549826a12292cf70a3 Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ListServerFiltersTestJSON-1705554847-project Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'aa1350d3-98e0-486f-90dd-af2195421b27'} Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:18.684005 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] Returning 404 to user: Instance aa1350d3-98e0-486f-90dd-af2195421b27 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33d82265-91fb-4db9-8032-135123973b3f tempest-ListServerFiltersTestJSON-1705554847 tempest-ListServerFiltersTestJSON-1705554847-project] 10.222.0.40 "GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27" status: 404 len: 111 microversion: 2.1 time: 0.061351 Oct 04 18:25:18.692307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2320/4640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:18 2022] GET /compute/v2.1/servers/aa1350d3-98e0-486f-90dd-af2195421b27 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:25:19.100579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:19.101190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.116499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.119208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.124282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.125180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.127865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.129185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.352745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.372399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2fedf24-2348-4f1d-b505-dd27de750033 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1320 microversion: 2.1 time: 0.275789 Oct 04 18:25:19.373048 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2321/4641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:19 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:20.396129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:20.397432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:20.405279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.406079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.406786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.407765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.408471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.409344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.748859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.761923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12e91c87-f60a-469e-94b9-4fc408093940 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 200 len: 1509 microversion: 2.1 time: 0.369705 Oct 04 18:25:20.763942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2321/4642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:20 2022] GET /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:20.792889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:20.794125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12557df9-549b-4b11-aaa1-5612eae46c60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:20.809965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.817279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.818007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.818938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.819593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.820374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.034499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.060683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc9fe3bc-e2a4-4636-8e80-8680a7ad3b69 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12557df9-549b-4b11-aaa1-5612eae46c60" status: 200 len: 1508 microversion: 2.1 time: 0.271367 Oct 04 18:25:21.075043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2322/4643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:20 2022] GET /compute/v2.1/servers/12557df9-549b-4b11-aaa1-5612eae46c60 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:21.086253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:21.086766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12557df9-549b-4b11-aaa1-5612eae46c60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:21.102204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.102204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.102204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.102204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.102204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.104030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.150195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12557df9-549b-4b11-aaa1-5612eae46c60] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:21.156011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:21.547983 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a27f4ec4-2f07-4150-b59f-b115bce3b6bd tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "DELETE /compute/v2.1/servers/12557df9-549b-4b11-aaa1-5612eae46c60" status: 204 len: 0 microversion: 2.1 time: 0.465378 Oct 04 18:25:21.549087 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2322/4644] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:21 2022] DELETE /compute/v2.1/servers/12557df9-549b-4b11-aaa1-5612eae46c60 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:21.557616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:21.558254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:21.568677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.570485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.573843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.573843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.573843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.575982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.650159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 0c27abeb-a9f5-499b-9761-8e6776d0cd0e] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:21.659323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:21.664620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:21.674613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.675029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.675493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.725783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:25:22.135236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9bea8bb-cf9c-4d3b-9fd0-d1bae0ed9f51 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action" status: 202 len: 0 microversion: 2.1 time: 0.489489 Oct 04 18:25:22.136813 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2323/4645] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:25:21 2022] POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:25:22.162862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:22.163968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:22.171081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:22.175895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.183884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.185096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.186549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:22.187234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:22.187701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:22.258326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fec38e01-c3c6-487a-a8d9-70ab29dc0fca tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e" status: 204 len: 0 microversion: 2.1 time: 0.704829 Oct 04 18:25:22.262961 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2323/4646] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:21 2022] DELETE /compute/v2.1/servers/0c27abeb-a9f5-499b-9761-8e6776d0cd0e => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:22.433036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:22.441351 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-927ffc07-ecba-4497-aa1d-78c4b779e474 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.291958 Oct 04 18:25:22.442864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2324/4647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:22 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:23.114283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-885639507", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6d545094-14e0-4259-be8a-5271d906e283"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:23.242299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] validate_networks() for [('6d545094-14e0-4259-be8a-5271d906e283', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:25:23.398529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:23.399021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:23.409981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.410420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.410955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.424608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.425259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.425765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.516190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:24.051116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-764ef0f5-bd21-4592-8f12-0c811699a11d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 204 len: 0 microversion: 2.1 time: 0.656918 Oct 04 18:25:24.053437 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2325/4648] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:23 2022] DELETE /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:24.062033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.062729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:24.081742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.084434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.088811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.089760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.090386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.091210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.317959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.333236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-be559e26-c999-4c3f-aa50-d240690cee9a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.273197 Oct 04 18:25:24.341515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2326/4649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:24.347541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.353460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:24.360705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.361405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.362214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.363180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.363716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.364245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.449225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:25:24.450694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:25:24.451295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:25:24.451830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:25:24.452346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:25:24.466569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.468440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.468988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.469821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.470946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.471618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.514092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Getting quotas for project 9a2798439b374319b553b6052f18a953. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:24.520202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Getting quotas for user 64b8585a981e48d6a7102768b59f06ee and project 9a2798439b374319b553b6052f18a953. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:24.536147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Going to run 2 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:25:24.539413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:24.682450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=1799430f-117c-443a-936f-55dddc0fe010,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:24.685349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.700715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d72248c6-11ee-43d2-bfba-60c910a473f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1514 microversion: 2.1 time: 0.357655 Oct 04 18:25:24.703778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2327/4650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:24.899317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef285435-3dbd-4a77-b13d-5efa85831795 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.789853 Oct 04 18:25:24.904854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2324/4651] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:25:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1795 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:25:24.908703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.918064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.919998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Searching by: {'deleted': False, 'project_id': '9a2798439b374319b553b6052f18a953'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:25:24.961262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.962828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.963486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.964799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.965464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.966468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.084636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:25:25.148295 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d2ffb58-81ec-494c-aed0-f124b301d201 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.243723 Oct 04 18:25:25.149914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2328/4652] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers => generated 1335 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:25.175678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e1ac19b-95b7-4a01-8415-eaf35cce738e tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:25.179861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e1ac19b-95b7-4a01-8415-eaf35cce738e tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:25.307278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7e1ac19b-95b7-4a01-8415-eaf35cce738e tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.317550 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e1ac19b-95b7-4a01-8415-eaf35cce738e tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1217 microversion: 2.1 time: 0.157768 Oct 04 18:25:25.319301 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2329/4653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:25 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:25.363542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:25.364403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:25.372183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.372931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.381273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.382255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.382919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.383592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.760498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.772898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c2cb962-7967-4ed4-afbf-dd2e31fcd2b5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.413121 Oct 04 18:25:25.790137 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2330/4654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:25 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:25.810151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:25.811521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:25.848056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12557df9-549b-4b11-aaa1-5612eae46c60", "name": "network-vif-deleted", "tag": "69200250-6155-4596-822b-4e175b2944de"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:25.860054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.860556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.871988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.871988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.871988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.871988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.874591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.887298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.889365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.941219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] Creating event network-vif-deleted:69200250-6155-4596-822b-4e175b2944de for instance 12557df9-549b-4b11-aaa1-5612eae46c60 on n-h1-833090-21 Oct 04 18:25:25.966502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-58bc0674-21b7-4307-8a6c-60f060818b6a req-1b0a0592-faa4-411f-9edf-589e6e7f71dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.889755 Oct 04 18:25:25.970398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2325/4655] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:26.279825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:26.296200 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29ba3f91-4d62-4ca7-bedf-71e3b7afff3e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1514 microversion: 2.1 time: 0.503081 Oct 04 18:25:26.300213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2331/4656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:25 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:26.353515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a9d47f5-4efd-474a-ace3-42df8b5212ce tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:26.355082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a9d47f5-4efd-474a-ace3-42df8b5212ce tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.446659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a9d47f5-4efd-474a-ace3-42df8b5212ce tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:26.455733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a9d47f5-4efd-474a-ace3-42df8b5212ce tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1217 microversion: 2.1 time: 0.114209 Oct 04 18:25:26.456639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2326/4657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:26 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:26.798678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:26.800651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.831067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.833803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c27abeb-a9f5-499b-9761-8e6776d0cd0e", "name": "network-vif-deleted", "tag": "0952b0a0-c485-4cb2-bab9-a704ed3b4044"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:26.836732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.838142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.840323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.844133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.844866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.887768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.889158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.903789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.954740 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] Creating event network-vif-deleted:0952b0a0-c485-4cb2-bab9-a704ed3b4044 for instance 0c27abeb-a9f5-499b-9761-8e6776d0cd0e on n-h2-833090-21 Oct 04 18:25:26.971365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f22f0325-6115-4c86-b2b0-cb94f16dd8ab req-e43d273f-f2fe-4618-a717-39f63b651dc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149339 Oct 04 18:25:26.996359 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2327/4658] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:27.258260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.268126 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6254b712-7c8b-48ab-8387-fd6fdb3b2930 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.473671 Oct 04 18:25:27.275593 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2332/4659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:26 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:27.324195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:27.324960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:27.346476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.347185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.347834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:27.348759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.349372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.350017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:27.485902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d304ad76-7cee-4226-a8ef-d8229e8ecdd1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:27.486771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d304ad76-7cee-4226-a8ef-d8229e8ecdd1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:27.542739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.556775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3813aa3e-01b2-4b85-8d36-bdba16ee28ce tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1303 microversion: 2.1 time: 0.238048 Oct 04 18:25:27.573034 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2328/4660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:27 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:27.609789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d304ad76-7cee-4226-a8ef-d8229e8ecdd1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.617036 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d304ad76-7cee-4226-a8ef-d8229e8ecdd1 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1217 microversion: 2.1 time: 0.141442 Oct 04 18:25:27.617837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2333/4661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:27 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:28.009338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0", "name": "network-vif-deleted", "tag": "a6d30ccb-9942-4f7a-bc5c-40dd9193c150"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:28.031934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.031934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.031934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.068405 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] Creating event network-vif-deleted:a6d30ccb-9942-4f7a-bc5c-40dd9193c150 for instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 on n-h2-833090-21 Oct 04 18:25:28.083376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9a36d6c2-9407-4c1e-8fa3-6d225dc19419 req-d7625815-8606-4769-b0b8-6957ce04c352 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082356 Oct 04 18:25:28.084543 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2329/4662] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:28.305140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.306892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.319076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.320227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.320721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.322177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.322638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.323066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.587251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.588584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.590068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.599739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21976988-9ce5-4928-b0fc-cbd6fbe36135 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.299185 Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.604093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.606175 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2334/4663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:28.641363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.642832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.650798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.651535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.652161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.653321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.653941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.654522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.690266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.690914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.691582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.693183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lazy-loading 'fault' on Instance uuid 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:28.762310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.770177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac68a7fa-f56a-4d01-ac24-a48bdb99a2d4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1213 microversion: 2.1 time: 0.133279 Oct 04 18:25:28.777853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.788344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2335/4664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:28.792979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9ca58807-eff6-42c3-8fea-c6516272c8f9 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 200 len: 1308 microversion: 2.1 time: 0.209473 Oct 04 18:25:28.809831 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2330/4665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:29.639279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.640010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.653115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.653645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.654088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.658052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.658723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.659384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.806766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.808595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.830553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.831374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.832038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.834189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.834859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.835545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.972289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:29.985323 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-342580dc-3aa8-411f-b0ac-8e4e263b892f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1269 microversion: 2.1 time: 0.185214 Oct 04 18:25:29.989352 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2331/4666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:30.031962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:30.034350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:30.052763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.054802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.055248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.056755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.057259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.060043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] HTTP exception thrown: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Request method failure captured: Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 HTTP/1.1 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnWuhWn1SVvSD_-6HlT_qYA5Qc5X3FF6aA4o7Tcok_zhu86t_yB5tPZ7g_3uF25QA3N4GpvKuMdlbRFyuC5Xl5x6GU5BiN7ucUemlAgae36pEPksolSCbud9nz8-kEhXv_rCT9vp-O9XlOJZYoq11puSSCXGoLQ5w741xBL4-q9SVU Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 99f694a0007f4d199b37149b4309a1bb Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99f694a0007f4d199b37149b4309a1bb"}]}] Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 99f694a0007f4d199b37149b4309a1bb Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesAdminNegativeTest-1975632004-project Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ad04482fd46b4291afa5a2ec32f050d3 Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesAdminNegativeTest-1975632004-project Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0'} Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:30.136762 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:30.141722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Returning 404 to user: Instance 3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:30.144311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-142d0831-06c2-4c82-a616-4aa1c2d899ae tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0" status: 404 len: 111 microversion: 2.1 time: 0.150919 Oct 04 18:25:30.144998 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2332/4667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/3a861e12-7f8c-4b1d-b8cc-6a87984a7cd0 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:30.208044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.231633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:30.241164 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4550e4b0-3adf-4bd4-acf2-045d4e3c2cfd tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.605728 Oct 04 18:25:30.262207 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2336/4668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:31.017616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.019164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.028656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.029369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.030030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.031873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.032682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.033274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.269960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.271171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.297545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.298337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.299725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.300961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.301603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.302193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.566744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.578953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7e6621f-aaff-4d61-a6c1-0aa6c3a49ae8 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.312881 Oct 04 18:25:31.592324 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2337/4669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:32.108648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.121148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17e788d7-69dd-4898-a6ea-a5f1661ee84f tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1275 microversion: 2.1 time: 1.109335 Oct 04 18:25:32.123247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2333/4670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1275 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:32.609193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.610417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.623626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.624971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.626123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.627887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.629549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.633024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.114242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:33.123514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc3e30f3-95fe-42d5-bb99-8bb4ed3e9e9c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1677 microversion: 2.1 time: 0.518815 Oct 04 18:25:33.132408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2338/4671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1677 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:33.157280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:33.157915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:33.195798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.196363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.196815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.197556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.198017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.198441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.402750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:33.438295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c35348a-b0a1-4846-bc7d-847fede7e21b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1275 microversion: 2.1 time: 0.284521 Oct 04 18:25:33.442829 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2334/4672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:33 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:34.159394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:34.160723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:34.172854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.173450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.173826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.174535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.174996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.189679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.471098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:34.472517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:34.486515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:34.491658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.493846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.495026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.497711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.499809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.500602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.877980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.895136 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-affa3797-1f77-45d0-afbb-24514f1b7812 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1654 microversion: 2.1 time: 0.738185 Oct 04 18:25:34.897960 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2339/4673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:34 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1654 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:34.926628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:34.938427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:34.939101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:34.941639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.996811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:35.018794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Going to try to start instance {{(pid=123886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:25:35.277007 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4702d579-57b9-403c-8bd5-4d2eefbf0937 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action" status: 202 len: 0 microversion: 2.1 time: 0.357313 Oct 04 18:25:35.280648 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2340/4674] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:25:34 2022] POST /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:25:35.299632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:35.300919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:35.317601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.318122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.318574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.319301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.324700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.339824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.591731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:35.605367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78096536-e3a0-49c8-9547-743b33aa7377 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 1.138427 Oct 04 18:25:35.607724 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2335/4675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:34 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:35.796392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:35.813129 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b1d56b6-50cf-4399-83bb-cea85f382761 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1663 microversion: 2.1 time: 0.531042 Oct 04 18:25:35.817180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2341/4676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:35 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1663 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:36.630210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:36.630881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:36.632757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:36.643277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.643827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.649809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.650837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.651570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.652161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.845190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:36.846938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:36.874537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.876830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.881203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.884062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:36.884829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:36.886783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.619593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:37.986063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:38.000359 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a1c2e21-5885-482c-b8a1-0a9671b7a0e1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1663 microversion: 2.1 time: 1.162989 Oct 04 18:25:38.000959 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2342/4677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:36 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1663 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:38.006848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:38.011138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:38.028786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.030700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.031734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.036368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.037114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.040110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.067967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:38.081270 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36f86206-51f1-43c6-959e-6a8db700d31b tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 1.454855 Oct 04 18:25:38.082953 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2336/4678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:36 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:38.093165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1799430f-117c-443a-936f-55dddc0fe010", "tag": "bc19c421-80a1-4c5a-b7ad-04d4dbc6081c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:38.116191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.118525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:38.119288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.120036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.151276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] Creating event network-changed:bc19c421-80a1-4c5a-b7ad-04d4dbc6081c for instance 1799430f-117c-443a-936f-55dddc0fe010 on n-h1-833090-21 Oct 04 18:25:38.158113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3eede557-54fd-4e93-b510-60ba942ec023 req-d9ca92bb-2e62-4d6c-955b-10b02b75142b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073357 Oct 04 18:25:38.160002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2337/4679] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:38.173696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12c835c9-df62-4780-80a3-0540fe05a27a", "tag": "d4c46725-3e8f-4c7e-9da6-32b174bb1926"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:38.204949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.209347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.209795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.250915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] Creating event network-changed:d4c46725-3e8f-4c7e-9da6-32b174bb1926 for instance 12c835c9-df62-4780-80a3-0540fe05a27a on n-h1-833090-21 Oct 04 18:25:38.256799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-971cf8c4-79a7-4d96-b40a-2cf78ed51633 req-363a1e66-5eda-4f1a-83f6-02edf6002915 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094881 Oct 04 18:25:38.262901 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2338/4680] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:38.559277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e103b2f-c4ea-4098-824a-4f36bcde38f5 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 204 len: 0 microversion: 2.1 time: 0.551551 Oct 04 18:25:38.560714 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2343/4681] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:38 2022] DELETE /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:38.569122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:38.570817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:38.583083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.584567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.585023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.590652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.592679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.593184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.026000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:39.026928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:39.039051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.042226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.043076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.044433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.047027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.048060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.135901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:39.147174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0240709-dd11-4136-b28e-bbb470127c74 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1681 microversion: 2.1 time: 0.582278 Oct 04 18:25:39.158632 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2339/4682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:38 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1681 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:39.179360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:39.180938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:39.189551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.192947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.193674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.198166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:39.198886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:39.199581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.418498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:39.436499 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d79af4e9-80b0-4445-b9c8-ffdf8626a969 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1663 microversion: 2.1 time: 0.408728 Oct 04 18:25:39.438187 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2344/4683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:39 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1663 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:39.656125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:39.677823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76ce8340-67eb-4798-8423-87fe04709c86 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 0.501646 Oct 04 18:25:39.677823 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2340/4684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:39 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.190183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.190790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:40.205846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.206116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.208188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.210763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.213091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.213948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.465170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.466429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:40.475007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.482505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.482505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.482505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.482505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.482505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.744533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:40.781278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20d562d4-9e9d-439d-8915-c4b9c62eaf5c tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1681 microversion: 2.1 time: 0.591390 Oct 04 18:25:40.788438 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2345/4685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1681 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.813351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.814106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:40.846170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.846730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.847183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.847965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.854100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.860509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.089811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:41.111198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-062a8c0b-6fcd-478e-8d59-22a66a335845 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1663 microversion: 2.1 time: 0.648812 Oct 04 18:25:41.111198 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2341/4686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1663 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:41.430583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:41.463096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-539c1334-890c-4113-a7a7-cec66be1f9f4 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 0.670503 Oct 04 18:25:41.466417 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2346/4687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:41.812017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:41.814009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:41.828195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.830869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.832513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.833545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:41.836001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:41.837368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.133459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:42.134424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:42.153227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:42.156278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:42.156974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.159284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:42.162561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:42.165057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.235978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:42.251652 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f34a6914-5b41-4e86-947a-5a256f053e55 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1681 microversion: 2.1 time: 0.441551 Oct 04 18:25:42.253332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2342/4688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:41 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1681 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.048783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.059924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-636a9644-5233-4027-817e-ab0da43aa132 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1667 microversion: 2.1 time: 0.930714 Oct 04 18:25:43.068256 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2347/4689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:42 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1667 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:43.074039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:43.074919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:43.082041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.082549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.083042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.083780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.084247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.084684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.170183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: .version_select at 0x7f90086b0040>, body: {"keypair": {"name": "tempest-keypair-1114369247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWfLlWObR0S0HZO/Uv0QAKuX7mjVG0TajzS8v/yKuHKlgw/uMlgJxB3AzMiaeCVfWIZA6lZJN7io5JMIXYp8tMIqBRyQPqvYxZMVA44epwf1ScY33SdiHtV4GT6iqKd4g=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:43.175982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:43.204697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:43.212972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:43.230809 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:25:43.583622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.595534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d70ee5b4-f5b0-41f9-be3c-7208e58018c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 0.525582 Oct 04 18:25:43.596143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2348/4690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:43 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.609305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:43.610252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:43.626976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.629114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.631019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.636019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.636748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.637355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.896749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad04482fd46b4291afa5a2ec32f050d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f694a0007f4d199b37149b4309a1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.910280 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b3be989-5997-4e5d-b5c4-4534bf1b307d tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 200 len: 1326 microversion: 2.1 time: 0.311349 Oct 04 18:25:43.911242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2349/4691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:43 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 1326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.939786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ed1d56-1198-415d-8105-db61feda4e15", "name": "network-vif-deleted", "tag": "fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:43.954149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:43.954914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:43.955620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.970464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] Creating event network-vif-deleted:fd90ed3c-5c5c-4eae-81a6-4bc169ddfd90 for instance e8ed1d56-1198-415d-8105-db61feda4e15 on n-h2-833090-21 Oct 04 18:25:43.977103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-81059fb6-59ec-4c9a-9d34-97ae4588b58d req-8f2f2023-d9f9-4005-9c16-1813d27be84f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047720 Oct 04 18:25:43.978434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2350/4692] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:44.239847 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 59724. Oct 04 18:25:44.388605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9338dab-64fa-47ce-abf6-ce15ed195c66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.133711 Oct 04 18:25:44.389465 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2343/4693] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:25:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:44.625436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.627452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.650651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.653140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.653607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.654362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.654832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.655270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.703183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:44.811804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c835c9-df62-4780-80a3-0540fe05a27a", "name": "network-vif-plugged", "status": "completed", "tag": "d4c46725-3e8f-4c7e-9da6-32b174bb1926"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:44.845348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.846060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.846709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.879184 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] Creating event network-vif-plugged:d4c46725-3e8f-4c7e-9da6-32b174bb1926 for instance 12c835c9-df62-4780-80a3-0540fe05a27a on n-h1-833090-21 Oct 04 18:25:44.894400 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5020a0dd-c5cd-4b9c-a8c7-2534e577339c req-c114f8b9-8fa2-421e-906e-629ca1f5b7d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085324 Oct 04 18:25:44.894739 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2344/4694] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:44.942774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.943727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] [instance: e8ed1d56-1198-415d-8105-db61feda4e15] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.955019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.958709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.960473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.966958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.967942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.978063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.015885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] HTTP exception thrown: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Request method failure captured: Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 HTTP/1.1 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHnWuhWn1SVvSD_-6HlT_qYA5Qc5X3FF6aA4o7Tcok_zhu86t_yB5tPZ7g_3uF25QA3N4GpvKuMdlbRFyuC5Xl5x6GU5BiN7ucUemlAgae36pEPksolSCbud9nz8-kEhXv_rCT9vp-O9XlOJZYoq11puSSCXGoLQ5w741xBL4-q9SVU Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 99f694a0007f4d199b37149b4309a1bb Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/99f694a0007f4d199b37149b4309a1bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/99f694a0007f4d199b37149b4309a1bb"}]}] Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 99f694a0007f4d199b37149b4309a1bb Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1975632004 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesAdminNegativeTest-1975632004-project Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ad04482fd46b4291afa5a2ec32f050d3 Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesAdminNegativeTest-1975632004-project Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e8ed1d56-1198-415d-8105-db61feda4e15'} Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:45.020517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. Oct 04 18:25:45.025777 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:45.026799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Returning 404 to user: Instance e8ed1d56-1198-415d-8105-db61feda4e15 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:45.034733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a471b955-7752-4c95-b902-267cb6d52e26 tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15" status: 404 len: 111 microversion: 2.1 time: 0.093516 Oct 04 18:25:45.035385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2345/4695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/e8ed1d56-1198-415d-8105-db61feda4e15 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:25:45.052388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d274e76-99d4-4767-8689-74732edb3d5e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] Calling method '.version_select at 0x7f900846df70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:45.155140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:45.163861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95499bba-20ec-40f7-a980-e836685d37a3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 0.548439 Oct 04 18:25:45.171258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d274e76-99d4-4767-8689-74732edb3d5e tempest-VolumesAdminNegativeTest-1975632004 tempest-VolumesAdminNegativeTest-1975632004-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470861174" status: 202 len: 0 microversion: 2.1 time: 0.128549 Oct 04 18:25:45.184351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2346/4696] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:25:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470861174 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:25:45.202785 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2351/4697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:46.192667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:46.193291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:46.219656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.220230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.221096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.224756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:46.225405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:46.226008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:46.274916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:46.583941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:46.599390 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20df10c7-d846-4bd9-b612-42e45cacf480 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1317 microversion: 2.1 time: 0.410765 Oct 04 18:25:46.620088 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2347/4698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:46 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:47.625488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.711883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.345470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:48.357487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc701d31-859d-46e9-89d6-31551cfcfe76 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 200 len: 1506 microversion: 2.1 time: 0.735480 Oct 04 18:25:48.360844 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2352/4699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:47 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:48.383636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:48.385045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:48.392988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.393871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.394521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.395444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.396185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.396796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.706312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:48.719206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c234cdc-ae36-40ee-b816-ee9abd3e5dad tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1317 microversion: 2.1 time: 0.340344 Oct 04 18:25:48.719959 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2348/4700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:48 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:48.956443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1799430f-117c-443a-936f-55dddc0fe010", "name": "network-vif-plugged", "status": "completed", "tag": "bc19c421-80a1-4c5a-b7ad-04d4dbc6081c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:48.971404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.972290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.972887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.008908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] Creating event network-vif-plugged:bc19c421-80a1-4c5a-b7ad-04d4dbc6081c for instance 1799430f-117c-443a-936f-55dddc0fe010 on n-h1-833090-21 Oct 04 18:25:49.017721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4cb9c208-bb0f-4e55-be76-45e52418c34a req-a0025d20-d570-4f15-890b-fb489897ed51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064991 Oct 04 18:25:49.019360 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2353/4701] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:49.180160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-131570843", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "615cdc98-a3fe-4da3-8339-6361f3daab74"}], "security_groups": [{"name": "tempest-securitygroup--2069480933"}], "key_name": "tempest-keypair-1114369247", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:49.332161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] validate_networks() for [('615cdc98-a3fe-4da3-8339-6361f3daab74', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:25:49.743100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:49.743974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:49.750975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.751101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.751636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.756334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.756822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.757266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.086161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:50.096683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5643c634-3a77-4abf-b091-4eb4f8a0383c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1317 microversion: 2.1 time: 0.358138 Oct 04 18:25:50.097608 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2354/4702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:49 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:50.165320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:25:50.165852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:25:50.166776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:25:50.167375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:25:50.167972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:25:50.189003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.192149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.192149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.193420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.194061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.196247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.244289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:50.263215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:50.290394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:25:50.293202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:50.536309 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f5b8787-fca1-4aa0-bd5e-a1170568b842 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.361228 Oct 04 18:25:50.545631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2349/4703] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:25:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:25:50.552900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f71c30b-d5f3-45c8-a5c5-a061a4139b66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.553870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f71c30b-d5f3-45c8-a5c5-a061a4139b66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.769922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f71c30b-d5f3-45c8-a5c5-a061a4139b66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:50.781232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f71c30b-d5f3-45c8-a5c5-a061a4139b66 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1238 microversion: 2.1 time: 0.232723 Oct 04 18:25:50.799759 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2355/4704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1238 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:51.122102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.122728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.132269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.135539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.136092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.136899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.137383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.137858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.388279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.402016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-253d2c36-4824-4351-8fa5-2866999dd177 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1506 microversion: 2.1 time: 0.283579 Oct 04 18:25:51.406589 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2350/4705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:51.437927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.443123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.465193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.468703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.470563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.476552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.476552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.480620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.542715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:51.829245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e711da1d-96f1-4dcf-abcb-41385e7070c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.830378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e711da1d-96f1-4dcf-abcb-41385e7070c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.934911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e711da1d-96f1-4dcf-abcb-41385e7070c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.953536 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e711da1d-96f1-4dcf-abcb-41385e7070c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1238 microversion: 2.1 time: 0.123047 Oct 04 18:25:51.954814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2351/4706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.009317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe6a8c1f-bd00-40b7-b1a8-6ec48f6f5153 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 204 len: 0 microversion: 2.1 time: 0.580942 Oct 04 18:25:52.014090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2356/4707] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:51 2022] DELETE /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:52.020991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.022035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.030623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.031308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.031943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.032851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.033517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.034240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.137781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:52.769517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64f5f605-e0e4-4802-a78b-b0c10214f046 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "DELETE /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 204 len: 0 microversion: 2.1 time: 0.754698 Oct 04 18:25:52.775143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2352/4708] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:52 2022] DELETE /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:25:52.780634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.781373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.795633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.983899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.984739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.993506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.000021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.000757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.004424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.005166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.005762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.057325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:53.072570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-087a0b16-7c98-44d1-83ff-02503af61b0d tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1512 microversion: 2.1 time: 0.296573 Oct 04 18:25:53.073185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2357/4709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:53.139521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:53.154145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8132c82a-48a7-4234-890d-bbf185b57101 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1234 microversion: 2.1 time: 0.175467 Oct 04 18:25:53.177387 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2353/4710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1234 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:54.098023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:54.098870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:54.112115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:54.113629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.114156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.114595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.115375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.115869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.116298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.187237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:54.188494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:54.215052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.382727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.408583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4583bd85-cbc8-4fe0-89f1-00f5c87b56b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1290 microversion: 2.1 time: 0.218643 Oct 04 18:25:54.408583 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2354/4711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:54 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1290 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:54.848446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.870361 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91747e18-32be-4e5d-80ba-18f3597ecbda tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1512 microversion: 2.1 time: 0.776029 Oct 04 18:25:54.871656 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2358/4712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:54 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:55.430306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.430924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.451803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.452556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.453208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.454502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.455261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.456208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.642923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:55.665197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8aead083-1c46-494c-9b8d-74de7cfa5be3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1296 microversion: 2.1 time: 0.235101 Oct 04 18:25:55.668876 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2355/4713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1296 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:55.737874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12c835c9-df62-4780-80a3-0540fe05a27a", "name": "network-vif-deleted", "tag": "d4c46725-3e8f-4c7e-9da6-32b174bb1926"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:55.776599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.779340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.780936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.812262 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] Creating event network-vif-deleted:d4c46725-3e8f-4c7e-9da6-32b174bb1926 for instance 12c835c9-df62-4780-80a3-0540fe05a27a on n-h1-833090-21 Oct 04 18:25:55.833556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-35ca79e6-6159-45a1-8cb7-f63046fe575d req-c8e9aaf0-6e76-4924-afcc-83cce07492ba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101710 Oct 04 18:25:55.838291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2359/4714] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:55.900816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.901659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.916209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.917023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.919129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.922091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.924876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.925536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.340116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:56.340116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0528c132-34d3-4349-a0c8-d3d7016dfdc5 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1512 microversion: 2.1 time: 0.443030 Oct 04 18:25:56.340116 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2356/4715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:56.670657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1799430f-117c-443a-936f-55dddc0fe010", "name": "network-vif-deleted", "tag": "bc19c421-80a1-4c5a-b7ad-04d4dbc6081c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:56.699439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:56.711553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:56.713575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.714882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.717080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.718697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.719448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.720820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.726596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.727311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.727826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.770764 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] Creating event network-vif-deleted:bc19c421-80a1-4c5a-b7ad-04d4dbc6081c for instance 1799430f-117c-443a-936f-55dddc0fe010 on n-h1-833090-21 Oct 04 18:25:56.797462 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9fda2c38-053f-46c7-91c1-7aa4243d51e5 req-53a077e7-8308-49be-93ec-6623619079c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127901 Oct 04 18:25:56.818061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2360/4716] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:56.925124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:56.943316 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b468964a-7085-4e69-9061-e09b53c17d62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1296 microversion: 2.1 time: 0.248792 Oct 04 18:25:56.944448 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2357/4717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:56 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:57.371714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.373539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.381848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.383440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.384408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.385083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.385754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.386404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.442774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.443537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.444129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.444955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lazy-loading 'fault' on Instance uuid 1799430f-117c-443a-936f-55dddc0fe010 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:57.654055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b8585a981e48d6a7102768b59f06ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2798439b374319b553b6052f18a953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:57.654660 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aeb4acb8-4621-46f7-9341-2601fd922309 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 200 len: 1307 microversion: 2.1 time: 0.287673 Oct 04 18:25:57.670236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2361/4718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:57 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:57.973102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.973893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.993432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.993931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.994422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.995312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.995943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.996648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.485684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:58.516476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b62239b2-eeb2-400e-9d86-abed8d1cc40f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.548494 Oct 04 18:25:58.517831 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2358/4719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:57 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:58.685617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.686944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 1799430f-117c-443a-936f-55dddc0fe010] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.703533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.703533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.703533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.703533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.703533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.704602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.727202 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] HTTP exception thrown: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Request method failure captured: Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 HTTP/1.1 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHp1cHZc0Bsf5Bw5OO0ubAQkRrFEwM8ZAjoIj4BA3hl_qn_MVkBC9OKwe4fF-xipW6cJrY48vxCThMDG4GDUqBq5efrjOB2nl6iREnCHEg8pP9lzYAFbLIv9McvAd_dY-CG0cMxeZHqTtjG9E6nYmlpX-gxyxlhU_JbNBO06pknMOx4 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9a2798439b374319b553b6052f18a953 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a2798439b374319b553b6052f18a953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a2798439b374319b553b6052f18a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a2798439b374319b553b6052f18a953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a2798439b374319b553b6052f18a953"}]}] Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9a2798439b374319b553b6052f18a953 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-MultipleCreateTestJSON-1180758451-project Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 64b8585a981e48d6a7102768b59f06ee Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-MultipleCreateTestJSON-1180758451-project Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '1799430f-117c-443a-936f-55dddc0fe010'} Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:58.729116 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Returning 404 to user: Instance 1799430f-117c-443a-936f-55dddc0fe010 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dab07db0-e4c9-4735-9684-417ecf95086c tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010" status: 404 len: 111 microversion: 2.1 time: 0.056318 Oct 04 18:25:58.739834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2362/4720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/1799430f-117c-443a-936f-55dddc0fe010 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:58.745033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.745741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] [instance: 12c835c9-df62-4780-80a3-0540fe05a27a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.764229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.764735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.765175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.765899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.766351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.766777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.804589 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] HTTP exception thrown: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Request method failure captured: Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a HTTP/1.1 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHp1cHZc0Bsf5Bw5OO0ubAQkRrFEwM8ZAjoIj4BA3hl_qn_MVkBC9OKwe4fF-xipW6cJrY48vxCThMDG4GDUqBq5efrjOB2nl6iREnCHEg8pP9lzYAFbLIv9McvAd_dY-CG0cMxeZHqTtjG9E6nYmlpX-gxyxlhU_JbNBO06pknMOx4 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9a2798439b374319b553b6052f18a953 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a2798439b374319b553b6052f18a953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a2798439b374319b553b6052f18a953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a2798439b374319b553b6052f18a953"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a2798439b374319b553b6052f18a953"}]}] Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9a2798439b374319b553b6052f18a953 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1180758451 Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-MultipleCreateTestJSON-1180758451-project Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 64b8585a981e48d6a7102768b59f06ee Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-MultipleCreateTestJSON-1180758451-project Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '12c835c9-df62-4780-80a3-0540fe05a27a'} Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:58.806288 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] Returning 404 to user: Instance 12c835c9-df62-4780-80a3-0540fe05a27a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04690751-c0f0-427a-aeb5-9f017efeb7c3 tempest-MultipleCreateTestJSON-1180758451 tempest-MultipleCreateTestJSON-1180758451-project] 10.222.0.40 "GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a" status: 404 len: 111 microversion: 2.1 time: 0.067174 Oct 04 18:25:58.810235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2359/4721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/12c835c9-df62-4780-80a3-0540fe05a27a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:59.546771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:59.550088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:59.562112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.567572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.568043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.575490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:59.576004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:59.576455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.253762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:00.275910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b8f5308-fedb-44c5-a29a-96b73012be00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.725526 Oct 04 18:26:00.288400 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2363/4722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:59 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:01.048580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:01.066284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:01.070181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.071567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.072165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.084902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] Creating event network-changed:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:26:01.092242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5388dbef-e9f6-46af-8686-b3ded4a64d6b req-7e026474-5855-461d-a6ab-7db72b2dc9a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053408 Oct 04 18:26:01.093525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2360/4723] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:01.305115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:01.305813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:01.309049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:01.320737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.325073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.325694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.326584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.327119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.327657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.946482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:01.964919 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-789a6343-6083-493c-a092-0dfbac55ada6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.661465 Oct 04 18:26:01.967598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2364/4724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:01 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:02.993886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=12 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:03.011830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:03.011830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:03.019418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:03.041206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:03.042249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:03.042766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:03.043630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:03.046587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:03.438275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:03.448178 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5107f520-052e-45d5-b5a9-b9c131a6fe1d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.455116 Oct 04 18:26:03.448786 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2361/4725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:02 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:04.471413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:04.472833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:04.496801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.521032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.521867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.523363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.524259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.524919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.839367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:04.861580 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dbf4aacb-00a0-4998-b73e-225c4a18626b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.393149 Oct 04 18:26:04.862551 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2365/4726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:04 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:05.886983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:05.888163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:05.896821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.898242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.899021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.900052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.900881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.901469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.170829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.194848 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9adf943e-d263-4786-9240-cc86d1023871 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.311316 Oct 04 18:26:06.196007 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2362/4727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:05 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:07.218987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:07.219652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:07.243768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.485416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.493572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-372a7d51-76e5-40fd-8959-c0e7a5c8d6cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.278932 Oct 04 18:26:07.494479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2366/4728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:07 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:08.519015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:08.521493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:08.530973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.531902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.532686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.533570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.534269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.535701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.803438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:08.803438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0915349-0151-438c-9731-e64d0baa2416 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.283263 Oct 04 18:26:08.817108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2363/4729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:08 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.276365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-plugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:09.292607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.293090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.293527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.306739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] Creating event network-vif-plugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:26:09.312174 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4b2a1832-4b8a-4532-9aed-eb42b9c5c5a2 req-b696b0b4-3771-47ac-a10f-5f0f9ba5f8e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040605 Oct 04 18:26:09.312794 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2367/4730] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:09.827198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:09.834404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:09.864746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.865675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.867101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.868135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.868999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.869754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.184830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:10.193458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee7fdcec-3038-4007-96c3-ca00421eb7bf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1364 microversion: 2.1 time: 0.373258 Oct 04 18:26:10.195664 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2364/4731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:09 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:11.226001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.228006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:11.235266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.236011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.236745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.237716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.238290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.238797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.830049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:11.839020 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6903e3fa-7b1b-41ea-8803-700610ca6be7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1551 microversion: 2.1 time: 0.622401 Oct 04 18:26:11.839623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2368/4732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1551 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:11.865389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:11.866583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:11.892525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.892525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.892525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.894486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.895029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.895799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.940463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:12.152580 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07293b24-d10f-415a-a448-c28c48962062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291342 Oct 04 18:26:12.153858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2365/4733] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:26:11 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/os-interface => generated 285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:14.609410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:14.635577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.636267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.637728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.679810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] Creating event network-changed:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:26:14.698563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-845cdb69-de48-4df1-8a71-a66a958ad1e0 req-34838b2f-4488-4075-aa2d-5a432d573722 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092493 Oct 04 18:26:14.703221 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2369/4734] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:27.613999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:27.890711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1618306756", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "44b242be-ac7c-410a-8774-aa97ed4572a1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:27.980699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] validate_networks() for [('44b242be-ac7c-410a-8774-aa97ed4572a1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:28.982450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=25 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:28.983525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:29.420719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:29.422426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:29.423120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:29.423726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:29.426961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:29.457202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.459878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.460246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.461372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.462145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.463416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.527289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:29.537034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for user 8553f76d0f804314b29e82142e728c71 and project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:29.562221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-643995512", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:29.595225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:29.600773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:29.687659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] validate_networks() for [('a0b80a12-354f-464d-afaf-f366817e6cf0', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:29.948412 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-247e0e92-c077-4330-a4b6-fd4399df9921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336669 Oct 04 18:26:29.951633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2366/4735] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:26:29.980514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d3d3b2e0-493f-4692-be49-7fec04f7581f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.984020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d3d3b2e0-493f-4692-be49-7fec04f7581f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:30.096119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3d3b2e0-493f-4692-be49-7fec04f7581f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:30.110012 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d3d3b2e0-493f-4692-be49-7fec04f7581f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1208 microversion: 2.1 time: 0.149453 Oct 04 18:26:30.111202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2367/4736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:31.051307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:31.052881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:31.053054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:31.053720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:31.054365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:31.069274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.073627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.075989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.076935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:31.077518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:31.091813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.135844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8b3a519-4797-42a6-adfd-f9c8ec5a539f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.137088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8b3a519-4797-42a6-adfd-f9c8ec5a539f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.194377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Getting quotas for project 6f7856da64d2406f9a966453e13a4de7. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:31.202009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Getting quotas for user 0e34d39fa45849a28f9a1bacf9bfb4c1 and project 6f7856da64d2406f9a966453e13a4de7. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:31.250032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:31.256177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:31.262784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8b3a519-4797-42a6-adfd-f9c8ec5a539f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.274656 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8b3a519-4797-42a6-adfd-f9c8ec5a539f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1208 microversion: 2.1 time: 0.143804 Oct 04 18:26:31.276191 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2368/4737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:31.516058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2640596-6570-462f-a227-7e74324b53f2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.548025 Oct 04 18:26:31.516988 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2370/4738] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:26:31.542929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e45c4587-e617-40d3-ad5e-662e8ee59344 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:31.544977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e45c4587-e617-40d3-ad5e-662e8ee59344 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:31.644575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e45c4587-e617-40d3-ad5e-662e8ee59344 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.655228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e45c4587-e617-40d3-ad5e-662e8ee59344 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1222 microversion: 2.1 time: 0.117181 Oct 04 18:26:31.657270 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2369/4739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:31 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:32.304338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:32.305675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:32.334180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.357956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.357956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.357956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.357956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.357956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.527240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.541116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59590108-0254-450d-aee9-b0d40b944321 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1212 microversion: 2.1 time: 0.240575 Oct 04 18:26:32.542364 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2371/4740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:32 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1212 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:32.693416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8724e5f4-998b-4a83-a0ea-660f1b6e77b0 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:32.694203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8724e5f4-998b-4a83-a0ea-660f1b6e77b0 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:32.826585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8724e5f4-998b-4a83-a0ea-660f1b6e77b0 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:32.840690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8724e5f4-998b-4a83-a0ea-660f1b6e77b0 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1222 microversion: 2.1 time: 0.155189 Oct 04 18:26:32.844409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2370/4741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:32 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:33.566175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:33.566941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:33.580915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.581536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.582969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.583343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.584609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.585142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.683060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:33.700190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64108e80-cdf3-4538-937a-eb50be766fbe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1260 microversion: 2.1 time: 0.138238 Oct 04 18:26:33.707256 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2372/4742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:33 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:33.867628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:33.868776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:33.878591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.879559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.880337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:33.882200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:33.882914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:33.883812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.544097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.555387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aaf16eb4-0f2a-421e-804d-2cc45aae4ee2 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1226 microversion: 2.1 time: 0.692821 Oct 04 18:26:34.556055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2371/4743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:33 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1226 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:34.728925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.729634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.738118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.738613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.740644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.741390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.741865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.742303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.932975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:34.954363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02de426b-f1d3-47a9-9e1a-5d79053f60be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1278 microversion: 2.1 time: 0.229234 Oct 04 18:26:34.955644 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2373/4744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:34 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:35.586671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:35.587326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:35.613822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.619222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.621806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.622586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.623388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.623911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.901611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:35.920438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1dacc292-c6be-430f-86ce-1dfa6b3488d6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1282 microversion: 2.1 time: 0.338906 Oct 04 18:26:35.921892 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2372/4745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:35 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1282 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:35.985011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:35.986477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:35.996552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.997048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.002785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.003588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.007668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.009571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.948996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.949724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.967857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.968418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.968871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.969619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.970076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.970510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.048827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.061965 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19fdc2c5-cb70-4656-9709-b365f390971c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 1.081760 Oct 04 18:26:37.077294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2374/4746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:35 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:37.190187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:37.207850 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d866df70-8d80-4bc3-ad76-59dc506724e5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.263117 Oct 04 18:26:37.208892 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2373/4747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:38.101805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.104016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.126073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.126951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.133929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.135726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.136596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.137406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.255807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.259284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.282574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.283600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.284636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.286138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.287199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.288210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.450100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.465103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c1fba69-4dcd-411d-90a2-bbcab9641555 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.370031 Oct 04 18:26:38.466304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2375/4748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:38.660670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0beee5a1-5483-47fe-97ae-e8147663d18a", "tag": "44699acb-5c85-4b11-816b-7f9da8b5e9dc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:38.678345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:38.693658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f692701d-3a85-4280-8f14-39d8096a8c02 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.454699 Oct 04 18:26:38.695421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.696112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2374/4749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:38.696872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.697485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.712085 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] Creating event network-changed:44699acb-5c85-4b11-816b-7f9da8b5e9dc for instance 0beee5a1-5483-47fe-97ae-e8147663d18a on n-h1-833090-21 Oct 04 18:26:38.721239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.722860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.724680 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5e29dab0-3000-40b0-b752-c2868662f170 req-024b80f4-6f1f-4ceb-88a5-c18e6706b226 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067624 Oct 04 18:26:38.726295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2376/4750] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:38.732437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.733014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.733537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.734339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.735587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.737311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.789658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd0a7a66-de4d-48c5-8c04-6365078a85b1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074965 Oct 04 18:26:38.796464 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2375/4751] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:26:38.870286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.877489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.898119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.898858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.901462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.902442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.903078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.903731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.913993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:38.931139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.931997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.932625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.936376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:38.965019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] Creating event network-changed:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:26:38.977866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6e804546-f6e3-4db4-b4cf-4a298d749e8f req-e8cd5a37-f5b9-4706-ab8f-5bdbe824b168 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070605 Oct 04 18:26:38.979037 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2376/4752] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:39.494059 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-659bcd43-d0cc-44a6-8650-8635506f1726 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 204 len: 0 microversion: 2.1 time: 0.628678 Oct 04 18:26:39.498415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2377/4753] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:38 2022] DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:26:39.503838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.507311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.510615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.514726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.522088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:39.527048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.538329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.550731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.551039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.551161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.551161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.551333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.551333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.555528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.556629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.559496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.560606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.881863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:39.893888 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e5fc351-5721-4204-a613-a2a7f530cf91 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.405831 Oct 04 18:26:39.915068 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2377/4754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:39.921288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.922929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:39.932857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:39.935282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.936765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.936765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.938029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:39.938518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:39.939367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:39.955649 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2268f42c-4c60-4bfe-a342-614f529b5cc2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1673 microversion: 2.1 time: 0.455820 Oct 04 18:26:39.957990 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2378/4755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:40.197925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:40.212723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-253bf0a7-1d37-483b-a638-dc3f54db8b04 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.300678 Oct 04 18:26:40.216430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2378/4756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:40.922324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:40.924312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:40.932626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.933350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.934248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.935153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.935860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.936437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.981527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:40.982151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:40.996042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.996548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.000835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.010324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.011535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.012000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.142120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:41.179647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.188514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9dbc7dac-3ccc-4b86-9f81-b2095d590e0a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.270721 Oct 04 18:26:41.189114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2379/4757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:40 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:41.237238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.241119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:41.242169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:41.246057 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aca2fa4f-8e1c-4672-b9da-03d7242c4af2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1673 microversion: 2.1 time: 0.268392 Oct 04 18:26:41.246956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2379/4758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:40 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:41.251631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:41.252489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.253062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.253585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.254740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.255814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.256337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.498428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:41.509738 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c445ff88-bdf1-40b1-baf8-9ccccd235f67 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.272927 Oct 04 18:26:41.527031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2380/4759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:41 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:42.213663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.215163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.222981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.224776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.225455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.226614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.227431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.229654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.270511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.271795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.287873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.288637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.289262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.290158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.294678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.295281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.437799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.457431 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2aa38a0d-c977-4a61-ace1-bf16b0c4bb0d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.241529 Oct 04 18:26:42.457431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2380/4760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:42.485267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.511795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6ea2840-f9fe-43c5-8a4b-aaa044357cd4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1606 microversion: 2.1 time: 0.244206 Oct 04 18:26:42.527377 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2381/4761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1606 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:42.536989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.538324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.545428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.545928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.546837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.547792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.548853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.548853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.767543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:42.777906 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a87cad50-c98b-412a-8508-e3e9605587de tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.248127 Oct 04 18:26:42.782587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2381/4762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:43.065951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccd2e23-0a15-47c2-a277-53cc3673b681", "name": "network-vif-deleted", "tag": "3ac3b8cc-8457-4127-8c60-26c31552cff5"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:43.086969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.088390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.089397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.111529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] Creating event network-vif-deleted:3ac3b8cc-8457-4127-8c60-26c31552cff5 for instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 on n-h2-833090-21 Oct 04 18:26:43.122814 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b3c05f14-bbc3-414b-9213-edd03c37ce18 req-ce5e48a7-63d9-49b3-8a51-33122427e2ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055937 Oct 04 18:26:43.123989 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2382/4763] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:43.477166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.477787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.483557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:43.492387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.492893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.493326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.494040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.495163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.495633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.538874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.540357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.556052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.556976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.558333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.560184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.575715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.579878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.653724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.654397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.654961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.656125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lazy-loading 'fault' on Instance uuid 9ccd2e23-0a15-47c2-a277-53cc3673b681 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:43.725881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.744787 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca226dc1-d7db-47d8-9945-509059f38c7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.272250 Oct 04 18:26:43.746975 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2382/4764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:43.787054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:43.818796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0ed3507-15f7-4603-8c72-d7a1459403f3 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 200 len: 1327 microversion: 2.1 time: 0.285110 Oct 04 18:26:43.820599 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2383/4765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 1327 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:43.822055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.822853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.831087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.831622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.832071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.832795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.833299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.843865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.178262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:44.190962 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e9e91d5-d776-4d96-863a-f09c34de65cf tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.373240 Oct 04 18:26:44.195856 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2383/4766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:44.773218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:44.774453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:44.782512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.783380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.787998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.787998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.787998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.787998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.060859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.069502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35a516f0-f8fb-4fad-9e9d-f5a24dfa8dd9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.300826 Oct 04 18:26:45.070111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2384/4767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:45.217832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.218458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:45.228352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.229045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.229639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.230367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.231010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.231438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.456595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.457967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:45.471425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.472254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.472885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.475001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.476597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.477205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.510758 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 HTTP/1.1 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9ccd2e23-0a15-47c2-a277-53cc3673b681'} Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:45.512472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:26:45.518704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:26:45.523637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:45.523637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcc8a089-a883-4de4-bd2b-1d9081091a92 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 404 len: 111 microversion: 2.1 time: 0.676411 Oct 04 18:26:45.523637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2384/4768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 111 bytes in 678 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:26:45.533759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:45.545863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "name": "network-vif-plugged", "status": "completed", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:45.547969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5c8eaf60-9bd9-4fde-b738-d301d3c7bfcb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.331088 Oct 04 18:26:45.548629 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2385/4769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:45 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:45.565206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ced882a0-74d6-4c6b-95e9-3a028edb6c44 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '.version_select at 0x7f9009a7aaf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.565308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.565308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.565308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.569444 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ced882a0-74d6-4c6b-95e9-3a028edb6c44 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [2486dde6-bef4-4f1f-9970-a457178f7981] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:26:45.578719 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] Creating event network-vif-plugged:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:26:45.584456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b011c193-cf05-4265-899e-863c68ae4ca9 req-587cb359-ce3b-4368-8d70-4c72fa5e7430 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061165 Oct 04 18:26:45.585775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2385/4770] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:46.098239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:46.098239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:46.106172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.106875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.107518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.119084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.121674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.123414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.287234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.298052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42fd18ec-409b-4677-8980-1a9b0e32cb2b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.207487 Oct 04 18:26:46.298800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2386/4771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:46 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:46.577028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:46.577822 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-ced882a0-74d6-4c6b-95e9-3a028edb6c44 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [2486dde6-bef4-4f1f-9970-a457178f7981] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33396. Oct 04 18:26:46.579521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:46.590024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.590539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.592906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.595073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:46.595757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:46.597452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.744512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:46.756456 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ced882a0-74d6-4c6b-95e9-3a028edb6c44 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844612408" status: 202 len: 0 microversion: 2.1 time: 1.203514 Oct 04 18:26:46.756456 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2386/4772] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844612408 => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:46.756831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40451f06-ac2f-44c5-93c1-b366ec4a536b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1322 microversion: 2.1 time: 0.181944 Oct 04 18:26:46.773178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2387/4773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:46 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:47.325936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.329421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.343823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.345272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.345898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.347540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.350077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.351686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.381040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:47.608337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beee5a1-5483-47fe-97ae-e8147663d18a", "name": "network-vif-plugged", "status": "completed", "tag": "44699acb-5c85-4b11-816b-7f9da8b5e9dc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:47.618577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:47.625345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.625828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.626263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.628398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0688a26-acff-42d2-91cb-cee9152ea18b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.309608 Oct 04 18:26:47.636746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2387/4774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:47.639045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] Creating event network-vif-plugged:44699acb-5c85-4b11-816b-7f9da8b5e9dc for instance 0beee5a1-5483-47fe-97ae-e8147663d18a on n-h1-833090-21 Oct 04 18:26:47.644879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5672db24-27fb-4347-86e7-ac767dad38b4 req-2278fe9f-236b-4394-8d06-79d56874d58c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041297 Oct 04 18:26:47.648201 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2388/4775] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:47.778674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.779656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.788633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.789135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.789770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.790737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.791945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.792781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.096237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.108141 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ceae5f3-ade0-41df-b1d0-e04638c2ce10 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1516 microversion: 2.1 time: 0.333730 Oct 04 18:26:48.109178 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2388/4776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:48.135052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:48.137813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:48.145232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.156455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.156455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.156455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.156455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.156455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.183843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lazy-loading 'flavor' on Instance uuid ea28a926-a4ea-4981-b457-c765cd7c9e03 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:48.183843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:48.334085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05e2b795-edb9-409e-a73f-22cbb76dddc9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: .version_select at 0x7f9009debf70>, body: {"keypair": {"name": "tempest-keypair-1185720946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxdesW3hlpvATarw296oA8jIxQb8kg7JXwBZ40n55QGwGWLmmnCwVBm8smrWDRx1t33VT9zFlkhmWh4y6gtPs4wk8B4ppHtkrlFZldGzogJafWufJXAsl4sLb/n+x3TJw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:48.356567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-05e2b795-edb9-409e-a73f-22cbb76dddc9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:48.372643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-05e2b795-edb9-409e-a73f-22cbb76dddc9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for user 61ba22151375420182b815277e8bd12c and project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:48.479197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05e2b795-edb9-409e-a73f-22cbb76dddc9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150172 Oct 04 18:26:48.480723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2389/4777] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:26:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:48.511213 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6aebb74-625e-482d-947b-14232666694d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action" status: 200 len: 32 microversion: 2.1 time: 0.380085 Oct 04 18:26:48.519252 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2389/4778] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:48 2022] POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action => generated 32 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:26:48.533903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:48.535960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:48.548654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.548654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.548654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.549346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.549814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.550248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.653487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:48.654799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:48.668478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.670018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.670764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.675005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:48.675877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:48.680170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.722329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.734242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ee17062-419b-468c-b756-37af378ea994 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.208260 Oct 04 18:26:48.736454 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2390/4779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:48 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:49.081083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:49.117166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67f3b4d1-3c6e-4aba-8bb8-a949e5801fbf tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1308 microversion: 2.1 time: 0.468706 Oct 04 18:26:49.117864 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2390/4780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:48 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:49.768497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:49.771671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:49.782927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.783539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.784109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.785133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.785857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.786202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.938651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:49.950964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f0467f8-4789-41ad-90f6-478088295c3d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.186626 Oct 04 18:26:49.952016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2391/4781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:49 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:50.141479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.142654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.150327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.150932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.151437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.152226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.152750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.157461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.307390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.315815 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-31a24b8b-237e-4cc1-abb2-7197c3f49810 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1487 microversion: 2.1 time: 0.179029 Oct 04 18:26:50.316405 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2391/4782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1487 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:50.339830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:50.340826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.346768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.347265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.347742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.348981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.349634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.350071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.611495 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9b8d6d3-42fb-4efc-a702-663d1cbbf921 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a/action" status: 202 len: 0 microversion: 2.1 time: 0.275486 Oct 04 18:26:50.612152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2392/4783] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:50 2022] POST /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:26:50.621192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.621923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.630428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.631026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.631764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.632703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.633465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.634770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.858765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:50.867254 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f7a9864-b2c3-47b8-9563-6f47a4a7ff51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1492 microversion: 2.1 time: 0.250061 Oct 04 18:26:50.875315 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2392/4784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:50.976242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.977030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.984963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.985464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.985910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.986753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.987271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.988030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.890833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:51.891442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:51.899324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.912129 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d28cc2b0-0e27-4ae4-bcf0-1a4dcd749cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.940994 Oct 04 18:26:51.912238 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2393/4785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:51.925136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.925581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.926062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.926808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:51.936278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:51.938557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.266212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:52.274577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01ec3358-1408-4be4-8d02-ae93ba8167eb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 200 len: 1472 microversion: 2.1 time: 0.388038 Oct 04 18:26:52.275175 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2393/4786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:51 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:52.307279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-231817329"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:52.310816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:52.323004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.323004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.323004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.324479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.324953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.325564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.419191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-568787099", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb367ab0-1b84-4e69-9b25-7e0823b31694"}], "security_groups": [{"name": "tempest-securitygroup--1307068429"}], "key_name": "tempest-keypair-1185720946", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:52.662258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] validate_networks() for [('fb367ab0-1b84-4e69-9b25-7e0823b31694', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:26:53.072987 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3869f22-dc01-424a-b7d2-719b3ec9d4d7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a/action" status: 202 len: 0 microversion: 2.1 time: 0.771063 Oct 04 18:26:53.073702 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2394/4787] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:52 2022] POST /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:26:53.118903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:53.121594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:53.139889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.141735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.143020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.145173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.145897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.157689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.405383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.419176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f7c206e-a876-4b79-ad27-2cc4b5e99fdd tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.344119 Oct 04 18:26:53.419849 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2395/4788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:53 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:53.424991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-002f599e-8a0e-4882-a879-10ed95b6d2f8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d42d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:53.501964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-002f599e-8a0e-4882-a879-10ed95b6d2f8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.080752 Oct 04 18:26:53.503434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2396/4789] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:53 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:53.744936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:26:53.745974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:26:53.748427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:26:53.749028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:26:53.749464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:26:53.761244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.761244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.761244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.761866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.762311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.762716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.788326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:26:53.794428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Getting quotas for user 61ba22151375420182b815277e8bd12c and project 62fbdf1bd77d4482864a1e4e38bf4f66. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:26:53.816171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:26:53.818939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:26:53.972190 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c79ed48d-8a2b-4ced-9df7-3250d68947d7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.559060 Oct 04 18:26:53.974440 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2394/4790] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:26:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:26:53.986729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb41c190-065d-4f2c-8f5b-f729f2482a1e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:53.987170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eb41c190-065d-4f2c-8f5b-f729f2482a1e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.132745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eb41c190-065d-4f2c-8f5b-f729f2482a1e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:54.142511 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb41c190-065d-4f2c-8f5b-f729f2482a1e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1237 microversion: 2.1 time: 0.159999 Oct 04 18:26:54.147641 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2397/4791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:53 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1237 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:54.448580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.449798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.461347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.462807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.465564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.466697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.471245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.471768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.518148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82b14eba-87e1-4c59-b56e-3c3e9ad1686d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90097daee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.594276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82b14eba-87e1-4c59-b56e-3c3e9ad1686d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.079964 Oct 04 18:26:54.605288 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2398/4792] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:54.716664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:54.729458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f062fcef-634a-49f1-809d-be64531e610e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.285327 Oct 04 18:26:54.730919 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2395/4793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:55.167220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66e45f24-05d3-4369-b2b8-6113d5554261 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:55.167901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66e45f24-05d3-4369-b2b8-6113d5554261 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:55.250529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66e45f24-05d3-4369-b2b8-6113d5554261 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:55.262700 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66e45f24-05d3-4369-b2b8-6113d5554261 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1237 microversion: 2.1 time: 0.096573 Oct 04 18:26:55.264088 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2399/4794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:55 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:55.611320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f95f30cc-e8f7-4e98-9e25-2a8848b0fa51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d706700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:55.673683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f95f30cc-e8f7-4e98-9e25-2a8848b0fa51 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.066580 Oct 04 18:26:55.677872 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2396/4795] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:55 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:55.761102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:55.763784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:55.771984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.772828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.773522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.774451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:55.775136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:55.775822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:55.959947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:55.962985 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8cfb070-9083-4f0e-911f-e2fc8503cda8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.205804 Oct 04 18:26:55.963907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2400/4796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:55 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.287296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.287296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:56.290301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.306611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.444814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:56.456824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b1f99ed-f283-4914-b7f7-e3b36fc2f88a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1289 microversion: 2.1 time: 0.174370 Oct 04 18:26:56.458190 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2397/4797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.694638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a486a4f-b121-46d2-a469-cb30d34c528a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009997ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.788055 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a486a4f-b121-46d2-a469-cb30d34c528a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.098920 Oct 04 18:26:56.789464 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2401/4798] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:56.898263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beee5a1-5483-47fe-97ae-e8147663d18a", "name": "network-vif-plugged", "status": "completed", "tag": "44699acb-5c85-4b11-816b-7f9da8b5e9dc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:56.916335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:56.916835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:56.925157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:56.947867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] Creating event network-vif-plugged:44699acb-5c85-4b11-816b-7f9da8b5e9dc for instance 0beee5a1-5483-47fe-97ae-e8147663d18a on n-h1-833090-21 Oct 04 18:26:56.953404 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-19eb26c0-2215-4c9a-8da4-b9f159205e21 req-9d25fa8b-4d5f-4ed4-94eb-303b911e844a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069974 Oct 04 18:26:56.958071 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2398/4799] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:56.989594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:56.990214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:57.001343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.002081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.002526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.003290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.003787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.004247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.391936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.401202 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e4e9db7-4ce8-49c5-8e8f-05176f4674d8 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.416099 Oct 04 18:26:57.401741 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2402/4800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:56 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:57.486444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:57.488355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:57.508408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.509581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.510269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.511855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:57.512729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:57.513520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:57.671781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:57.684642 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a370652e-cab8-4c91-9ca1-85747b86164d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1295 microversion: 2.1 time: 0.204783 Oct 04 18:26:57.685895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2399/4801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:57 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:57.805959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d21a6f4b-8cc9-48ba-8303-3debe324f984 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008f0edc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:57.885332 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d21a6f4b-8cc9-48ba-8303-3debe324f984 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.083886 Oct 04 18:26:57.896419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2403/4802] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:57 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:58.433777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:58.441862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:58.456461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.458300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.458926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.460220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.481113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.483424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.711521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:58.712381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:58.724186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:58.727132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.728581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.730891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.732216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:58.732698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:58.733133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:58.915049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:58.949740 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f51e8b9c-2fde-4b9c-bb6e-cac4c926d188 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.528135 Oct 04 18:26:58.956207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2400/4803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:58.968280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8502df6b-ae2b-40c2-a7f0-d616537742ca tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900850d8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.075998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8502df6b-ae2b-40c2-a7f0-d616537742ca tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.118303 Oct 04 18:26:59.076936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2401/4804] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:59.321789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:59.335663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fa41445-8cbb-4cb2-8d29-814eae939097 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.628668 Oct 04 18:26:59.340426 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2404/4805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:58 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:59.947922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91487e9f-016c-4ede-b666-50974c0dbca3", "tag": "13749059-63b1-40a4-ba2a-2bff559dbfe2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:59.982102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:59.982102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:59.982102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:59.989232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:59.989869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:00.050322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:00.051087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:00.053744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:00.053744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:00.053744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:00.053744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:00.077293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] Creating event network-changed:13749059-63b1-40a4-ba2a-2bff559dbfe2 for instance 91487e9f-016c-4ede-b666-50974c0dbca3 on n-h2-833090-21 Oct 04 18:27:00.086991 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ea4e6dbf-2485-4623-a430-5efd05e08770 req-670df21b-6874-4968-9255-691467b5f3b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148520 Oct 04 18:27:00.094358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2402/4806] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:00.120034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72b2850d-d731-4b8a-9607-11bccc78a0b0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900890d670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:00.243303 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72b2850d-d731-4b8a-9607-11bccc78a0b0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.142423 Oct 04 18:27:00.243303 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2403/4807] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:00 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:00.365674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:00.366597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:00.376069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:00.388568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:00.389294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:00.390201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:00.390825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:00.391424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:00.500007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.513639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f3051cd-d657-4e31-aebe-f67d2e2c790b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.530089 Oct 04 18:27:00.520220 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2405/4808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:59 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:00.691498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:00.700764 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70b09241-3f5a-4ce5-a2a9-40c74643f877 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.342083 Oct 04 18:27:00.738353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2404/4809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:00 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:01.258146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74e7b452-be89-4d50-9200-fd75d2732781 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009ff6550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.357188 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74e7b452-be89-4d50-9200-fd75d2732781 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.103802 Oct 04 18:27:01.367595 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2406/4810] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:01.538448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.539078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:01.552045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.552565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.553004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.555657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.556400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.558727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.729299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:01.729918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:01.740231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.752403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.752403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.752403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:01.752403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:01.752717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:01.815612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.831510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3057fbe2-5b18-46fc-9b2f-f60a326aea84 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.292334 Oct 04 18:27:01.833581 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2405/4811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:01.962283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:01.974934 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93c93b78-99a0-472b-84da-51e3d16a6253 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.249537 Oct 04 18:27:01.976175 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2407/4812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:01 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:02.375141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6202ff33-5d35-4783-9710-9c1e0be68a93 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d015e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:02.436233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6202ff33-5d35-4783-9710-9c1e0be68a93 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.059355 Oct 04 18:27:02.437139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2406/4813] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:02 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:02.856191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:02.857405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:02.865401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.866972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.867725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.868717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:02.869296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:02.869811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:02.999645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:03.001109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:03.010514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.011326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.011999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.012753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:03.013218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:03.013647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:03.217308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.228656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:03.234256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e603abb-5204-480c-a9b1-e0e6a6e721a2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.239662 Oct 04 18:27:03.235154 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2407/4814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:02 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:03.237036 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-812800ad-0ca0-4800-9e68-295da0618e1d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.384901 Oct 04 18:27:03.237699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2408/4815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:02 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:03.452786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e57531ea-4efb-4399-b093-fa49360797e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90088d9ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:03.512218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e57531ea-4efb-4399-b093-fa49360797e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.063208 Oct 04 18:27:03.512844 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2408/4816] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:03 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:04.262417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:04.263212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:04.267221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.278308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.278308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:04.278558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:04.291039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.291435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.292201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.293937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.294430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.294579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.296893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.297568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.298166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.312347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:04.315281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:04.315801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:04.596576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:04.601214 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81446dbb-116f-4e6d-8e6e-11de83134d7f tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.338214 Oct 04 18:27:04.611570 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2409/4817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:04.620343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30f759a3-3001-48be-8034-8ac7b099fa8d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90084ad430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:04.703246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-30f759a3-3001-48be-8034-8ac7b099fa8d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.098813 Oct 04 18:27:04.703898 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2410/4818] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:04.819794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:04.828018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:04.846548 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16ab246e-f0fb-40e8-8b1e-17ea50a814cb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.587578 Oct 04 18:27:04.860986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2409/4819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:04 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:05.626811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:05.627402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:05.643645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.653050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.653050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.653050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.653050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.656986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.665706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91487e9f-016c-4ede-b666-50974c0dbca3", "name": "network-vif-plugged", "status": "completed", "tag": "13749059-63b1-40a4-ba2a-2bff559dbfe2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:05.684086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:05.718573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:05.720197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:05.724338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:05.777610 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] Creating event network-vif-plugged:13749059-63b1-40a4-ba2a-2bff559dbfe2 for instance 91487e9f-016c-4ede-b666-50974c0dbca3 on n-h2-833090-21 Oct 04 18:27:05.818378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c810b92e-2efb-452a-bcb8-ff83705978ac req-0bc7fa24-36aa-4142-a997-a1d655d65f1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160699 Oct 04 18:27:05.824458 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2410/4820] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:05.842385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69682160-0cee-4008-a910-8d3c4b4e3b55 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009a7a550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:06.006293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69682160-0cee-4008-a910-8d3c4b4e3b55 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.178880 Oct 04 18:27:06.020149 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2411/4821] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:05 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:06.033020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:06.038976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:06.053654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.054185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.058451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.059822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:06.067586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:06.068124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:06.098805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:06.113742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec98d365-e0d4-4a8b-9876-6789a4156eea tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.491172 Oct 04 18:27:06.130668 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2411/4822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:05 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:06.483438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:06.495045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa636ef3-bb45-4941-b992-703135fbf05e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.473803 Oct 04 18:27:06.497365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2412/4823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:06 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:07.039181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77bea02d-0a0f-4479-a052-22ea1192f005 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d01550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:07.126989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77bea02d-0a0f-4479-a052-22ea1192f005 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.108157 Oct 04 18:27:07.127937 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2412/4824] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:07 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:07.141199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:07.141868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:07.160703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.161230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.161688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.162435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.162907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.163454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.525982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:07.526908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:07.537595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.538532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.539185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.540238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:07.540884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:07.541634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:07.565206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:07.739784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:07.761898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86a6afe0-ad4d-44c3-a40d-12aee50354d4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1363 microversion: 2.1 time: 0.624984 Oct 04 18:27:07.766994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2413/4825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:07 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1363 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:07.776173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:07.792308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-478b70bf-cd40-4915-8f14-a30c0a3880db tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.272163 Oct 04 18:27:07.792944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2413/4826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:07 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:08.145740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7add12f-e600-47a5-976e-2dc3f714439b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008f24430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.228379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7add12f-e600-47a5-976e-2dc3f714439b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.087450 Oct 04 18:27:08.230180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2414/4827] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:08.787118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.787806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.806739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.807240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.807713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.808492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.808980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.830166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.830598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.848731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.850890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.851394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.851894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.852559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.853017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.853492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.148788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.157734 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0733b9e-3eb1-4f07-a3b9-78e9e99ef155 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1549 microversion: 2.1 time: 0.376371 Oct 04 18:27:09.160564 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2414/4828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1549 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:09.187410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:09.188144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:09.201913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.202583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.203213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.204132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:09.209475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:09.210439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:09.328685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:09.345094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a66695bd-e791-4400-97e2-c8d5e0113a70 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.519339 Oct 04 18:27:09.347202 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2415/4829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:09.368994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e009a667-b98a-4823-bdfc-9e9c2e0325a0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1bca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:09.471443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7153d92e-ab36-4906-ae54-923c1224422e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287036 Oct 04 18:27:09.476851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2415/4830] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:09.492012 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e009a667-b98a-4823-bdfc-9e9c2e0325a0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.140975 Oct 04 18:27:09.501395 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2416/4831] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:10.369564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.371433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:10.391605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.397526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.403602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.404528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.405259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.405927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.509812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-462f1ebd-12cc-4f09-8fdc-31f3759b246c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008fe40d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.603420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-462f1ebd-12cc-4f09-8fdc-31f3759b246c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.097425 Oct 04 18:27:10.611268 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2417/4832] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:10 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:10.813134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:10.829354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b03a394d-f29d-4747-9838-06666e3db84b tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.463577 Oct 04 18:27:10.831590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2416/4833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:10 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:11.623841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb41cbfe-b17f-4064-8dd2-e6d6c8ea5f93 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008f249d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:11.694867 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb41cbfe-b17f-4064-8dd2-e6d6c8ea5f93 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.078035 Oct 04 18:27:11.695711 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2418/4834] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:11 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:11.858244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:11.861426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:11.884653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.888723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.888723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.893049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.893779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.898501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.315356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:12.329233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee0c995b-fe64-42f2-9060-a43567abeb93 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.475128 Oct 04 18:27:12.333540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2417/4835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:11 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:12.712766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3018d16-d9a2-446a-96b4-872a15121393 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900981b3a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.753033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91487e9f-016c-4ede-b666-50974c0dbca3", "tag": "13749059-63b1-40a4-ba2a-2bff559dbfe2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:12.802713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.807761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.809168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.825718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3018d16-d9a2-446a-96b4-872a15121393 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.118435 Oct 04 18:27:12.826454 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2419/4836] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:12.860603 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] Creating event network-changed:13749059-63b1-40a4-ba2a-2bff559dbfe2 for instance 91487e9f-016c-4ede-b666-50974c0dbca3 on n-h2-833090-21 Oct 04 18:27:12.880051 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a48b8939-8a0a-42b7-8aa2-b8408b079386 req-fffc4da5-ee98-462d-a44e-e427c7180ab5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134126 Oct 04 18:27:12.894321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2418/4837] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:13.361221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:13.368105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:13.381055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.382358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.383812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.386985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:13.387603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:13.388654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.809297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:13.817572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-832ce67e-ba42-41b9-9493-d3355f7eba75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.460351 Oct 04 18:27:13.822429 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2420/4838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:13.849360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0ed2ef9f-4712-45a0-90f2-1764b074720b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c2de50>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:13.936163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0ed2ef9f-4712-45a0-90f2-1764b074720b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.091546 Oct 04 18:27:13.936822 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2419/4839] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:14.851967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.853676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:14.887749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.900766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.900766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.900766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.900766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.900766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.953789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d717ffe5-8362-4b2c-b470-271b459dd384 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083be9d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:15.043777 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d717ffe5-8362-4b2c-b470-271b459dd384 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.094807 Oct 04 18:27:15.044386 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2420/4840] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:15.245290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:15.253511 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0721337d-1ab7-4bcc-a47f-12e1b4ea9d81 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.407155 Oct 04 18:27:15.256459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2421/4841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:16.062018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a398ebf6-aa68-4108-a023-946cadfb5444 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c2daf0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:16.130989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a398ebf6-aa68-4108-a023-946cadfb5444 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.073900 Oct 04 18:27:16.132202 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2421/4842] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:16 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:16.284413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:16.285707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:16.294131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.294744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.295250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.301829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:16.302425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:16.302948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:16.583398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:16.593793 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b149d475-95f1-4948-afaa-e3a957fa8f33 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.314806 Oct 04 18:27:16.608524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2422/4843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:16 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:17.149194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16dbc3a9-3d97-4411-b46e-72a3ea82ba82 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008f1fd30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.216851 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16dbc3a9-3d97-4411-b46e-72a3ea82ba82 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.072901 Oct 04 18:27:17.217796 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2422/4844] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:17.623576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.623576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:17.633186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.633685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.634119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.639300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.643492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.644680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.978922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.989011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30d1f8e0-7912-4782-aa3c-8959e826a2eb tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.372857 Oct 04 18:27:18.008993 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2423/4845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.046599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.047667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.055340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.056562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.065381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.065381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.065381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.065381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.236111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c37996c9-a647-41ba-a7d9-2b6feee401e7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009d97160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.460818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c37996c9-a647-41ba-a7d9-2b6feee401e7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1411 microversion: 2.1 time: 0.062714 Oct 04 18:27:18.460818 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2424/4846] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.461630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.461630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45b0f6b6-fe93-4e23-ae85-fc82cf660521 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.282615 Oct 04 18:27:18.461630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2423/4847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.462769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.599577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.607398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c21f2a9-af9f-47a1-b816-326fb2a6be92 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.264385 Oct 04 18:27:18.608034 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2425/4848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.631705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.632436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.639070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.639681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.640126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.641010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.641653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.642261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.846033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.856023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44a4c079-069e-4476-ad95-cbad5c731d7d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.228397 Oct 04 18:27:18.857056 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2424/4849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.881045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1223919405"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:18.884336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.894330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.895069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.896248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.896971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.897441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.897911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.018811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.020949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:19.028458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.029258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.036629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.037584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.038076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.038518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.196602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.215384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d77cdf4c-9369-4163-8ba6-bab539543070 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.200904 Oct 04 18:27:19.220418 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2425/4850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:19.310295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0963e40d-a77c-4e69-93c9-3c9b0b2b3812 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008ef64c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.362413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0963e40d-a77c-4e69-93c9-3c9b0b2b3812 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1420 microversion: 2.1 time: 0.056765 Oct 04 18:27:19.367644 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2426/4851] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:19.382343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-651e125c-f867-4303-b75f-24e172ec5cce tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900890dca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.446966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-651e125c-f867-4303-b75f-24e172ec5cce tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 200 len: 1420 microversion: 2.1 time: 0.071165 Oct 04 18:27:19.446966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2427/4852] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:19.469467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6c0cac8-dd81-4d31-9e40-9a70bdc16f7a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900850d8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.553834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ecb6018-81d2-4db0-9136-29b8c3177996 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.677833 Oct 04 18:27:19.557514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2426/4853] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:18 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:27:20.241124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:20.241124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:20.250823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.251320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.251792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.252908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.252908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.253380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.895919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:20.905022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-087d7478-3f42-4818-b1bc-649b567c3163 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.670267 Oct 04 18:27:20.908631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2427/4854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:20 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:21.306681 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6c0cac8-dd81-4d31-9e40-9a70bdc16f7a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 204 len: 0 microversion: 2.1 time: 1.844499 Oct 04 18:27:21.307269 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2428/4855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] DELETE /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 0 bytes in 1851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:21.317262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:21.317835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:21.334963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.335400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.336503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.337263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.337711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.338627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.421410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:27:21.929630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fff2740-85ef-4419-82ad-737c4de07ff3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 204 len: 0 microversion: 2.1 time: 0.617730 Oct 04 18:27:21.930814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2428/4856] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:21 2022] DELETE /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:21.948752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:21.948752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:21.950877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.955608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.955608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.955608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.956732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.957762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.227494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1020964486", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "44b242be-ac7c-410a-8774-aa97ed4572a1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:22.249589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:22.260910 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dc00da0a-52bf-40b3-8654-bf9f52b0688e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.332752 Oct 04 18:27:22.263297 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2429/4857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:21 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:22.336340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] validate_networks() for [('44b242be-ac7c-410a-8774-aa97ed4572a1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:27:23.016169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beee5a1-5483-47fe-97ae-e8147663d18a", "name": "network-vif-unplugged", "status": "completed", "tag": "44699acb-5c85-4b11-816b-7f9da8b5e9dc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:23.037527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.038295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.038846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.079130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] Creating event network-vif-unplugged:44699acb-5c85-4b11-816b-7f9da8b5e9dc for instance 0beee5a1-5483-47fe-97ae-e8147663d18a on n-h1-833090-21 Oct 04 18:27:23.089161 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fd89d62b-377f-4a25-9cfc-45756300a010 req-55f8a47d-49f2-4f3c-b285-c1b75abce5c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077368 Oct 04 18:27:23.089830 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2430/4858] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:23.285892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:23.286609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:23.305387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.305945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.306330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.317767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.317767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.317767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.611135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:27:23.613089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:27:23.613722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:27:23.614284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:27:23.614875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:27:23.634554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.636874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.640546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.641597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:23.648061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:23.648061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.700294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:23.705163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:23.718670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for user 8553f76d0f804314b29e82142e728c71 and project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:23.722353 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc17bb4c-ebdb-4484-bca0-d68fd3e49ecc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1522 microversion: 2.1 time: 0.441547 Oct 04 18:27:23.735564 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2431/4859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:23 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:23.756641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:27:23.763270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:27:24.134904 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-153ebbe8-661d-42d7-aec1-a6c813cffe4e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910464 Oct 04 18:27:24.135620 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2429/4860] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:27:24.147191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b509a69b-6c3a-4a57-8df8-616aabd18a12 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.147843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b509a69b-6c3a-4a57-8df8-616aabd18a12 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.445043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b509a69b-6c3a-4a57-8df8-616aabd18a12 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:24.453775 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b509a69b-6c3a-4a57-8df8-616aabd18a12 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1208 microversion: 2.1 time: 0.310571 Oct 04 18:27:24.474682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2432/4861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:24.749155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.749930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.769740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.769740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.769740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.769740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.769740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.770223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.129874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:25.138602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f71d1fd1-f7b1-4d74-989e-f9704b099337 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1502 microversion: 2.1 time: 0.394667 Oct 04 18:27:25.139198 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2430/4862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1502 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:25.165089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdf7b803-6323-408d-9645-569766ee6d75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'create', calling method: .version_select at 0x7f90083bc940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1883414159", "description": "tempest-description-1489691439"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:25.479656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8786b6ef-53d1-43e6-9bb8-2b409adff912 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:25.480192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8786b6ef-53d1-43e6-9bb8-2b409adff912 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:25.607787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8786b6ef-53d1-43e6-9bb8-2b409adff912 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:25.615781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8786b6ef-53d1-43e6-9bb8-2b409adff912 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1208 microversion: 2.1 time: 0.141295 Oct 04 18:27:25.621512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2431/4863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:25 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:25.655838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beee5a1-5483-47fe-97ae-e8147663d18a", "name": "network-vif-deleted", "tag": "44699acb-5c85-4b11-816b-7f9da8b5e9dc"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:25.685840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.686342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.688162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.719696 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] Creating event network-vif-deleted:44699acb-5c85-4b11-816b-7f9da8b5e9dc for instance 0beee5a1-5483-47fe-97ae-e8147663d18a on n-h1-833090-21 Oct 04 18:27:25.735507 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d01dce44-fba9-4def-a7e3-0200cc1a64b5 req-d42ec612-bb55-44d7-8dbb-677c33b38cb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081270 Oct 04 18:27:25.735507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2432/4864] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:25.802927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-plugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:25.833488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:25.834134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:25.835279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:25.849904 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] Creating event network-vif-plugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:27:25.857159 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f9b2726f-8d9f-4ec6-a3e7-ecf78dd6c875 req-b2036075-6594-4db2-a55f-ccd6588ab7fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065697 Oct 04 18:27:25.858347 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2433/4865] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:26.046330 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdf7b803-6323-408d-9645-569766ee6d75 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.885604 Oct 04 18:27:26.046958 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2433/4866] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 4 18:27:25 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:26.063908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1883414159"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:26.065069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.079226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.080570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.081212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.106462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.109402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.111599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.144974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:26.387426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Adding security group 5a407fb7-89d8-4393-8c66-81a800ab10ce to port 73ce2939-f56a-4b40-8935-77f40a9e9cf6 Oct 04 18:27:26.646201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:26.647691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.655804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.656774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.657594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.658555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.659233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.660418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.735551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:26.744469 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f413c736-7c74-48cc-9099-6bf7a50b2601 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1204 microversion: 2.1 time: 0.104282 Oct 04 18:27:26.754201 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2434/4867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:26 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1204 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:27.163225 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0291a769-b93e-4550-9bd9-973e98c1681e tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action" status: 202 len: 0 microversion: 2.1 time: 1.102524 Oct 04 18:27:27.164985 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2434/4868] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:26 2022] POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:27:27.191830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1883414159"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:27.194684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:27.198294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:27.215703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.218345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.219227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.220774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.221590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.222222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.225206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.225698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.226135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.266923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] Creating event network-changed:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:27:27.286715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bd8af39c-0460-4b16-abc9-74dbf245f825 req-ad809f48-14c5-4df7-bfd6-7e9dbbba490e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104907 Oct 04 18:27:27.290926 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2435/4869] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:27.614267 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.network.security_group_api [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Removing security group 5a407fb7-89d8-4393-8c66-81a800ab10ce from port 73ce2939-f56a-4b40-8935-77f40a9e9cf6 Oct 04 18:27:27.769258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:27.770070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:27.776439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.777931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.778703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.779408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:27.780101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:27.780693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:27.856197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:27.865643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b44e404c-a1e9-42c3-835c-1f72e89f27f9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1260 microversion: 2.1 time: 0.100593 Oct 04 18:27:27.866712 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2436/4870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:27 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1260 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:28.488068 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6110af71-e59c-4bc9-aaea-d37b971b6cd7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action" status: 202 len: 0 microversion: 2.1 time: 1.316838 Oct 04 18:27:28.489650 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2435/4871] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:27 2022] POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action => generated 0 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:28.498523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70537349-d3d0-42a0-a3fd-00d65d85ec96 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'create', calling method: .version_select at 0x7f9009a22550>, body: {"pool": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:28.543101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:28.566828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.570975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.571759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.610215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] Creating event network-changed:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:27:28.624508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e9a4fbd5-2751-4a21-aa5a-bef5c8b565b1 req-c76e698c-38ce-404f-bf72-db6700edb2a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090735 Oct 04 18:27:28.627777 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2436/4872] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:28.895529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:28.896337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:28.905804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=53 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:28.908867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.916014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.916014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.916014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.916014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.917189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.117680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:29.135241 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9b69253-ad40-4052-a184-82b32bde412b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1266 microversion: 2.1 time: 0.243919 Oct 04 18:27:29.135897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2437/4873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:28 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:30.163703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:30.164370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:30.179143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.179721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.180164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.180884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.181560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.186439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.383072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:30.393275 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da9f406f-9394-4890-8461-b9b3f07e2622 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1266 microversion: 2.1 time: 0.234609 Oct 04 18:27:30.395151 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2438/4874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:30 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:31.434802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.456317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.086722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:32.098541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7cf75228-5fb9-4009-bffb-88d5c9918c21 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.681467 Oct 04 18:27:32.119918 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2439/4875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:31 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:32.563897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70537349-d3d0-42a0-a3fd-00d65d85ec96 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.059235 Oct 04 18:27:32.563897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2437/4876] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 4 18:27:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:32.568387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.81"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:32.571533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:32.602866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.606214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.607741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.609071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.610022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.613526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.694925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:27:32.695320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquired lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:27:33.007710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f657fba-0160-42bb-9416-b2db74a900ed", "tag": "231dca9b-588d-4463-94ec-4322117b1216"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:33.015757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:33.024852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:33.025578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:33.026199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.068366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] Creating event network-changed:231dca9b-588d-4463-94ec-4322117b1216 for instance 3f657fba-0160-42bb-9416-b2db74a900ed on n-h2-833090-21 Oct 04 18:27:33.068366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-36ac5eda-eb5d-432d-82c3-53bafccfdb2e req-e29165e2-b8bc-4333-9662-0fa6f2ebff4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046103 Oct 04 18:27:33.068366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2438/4877] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:33.132630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:33.133581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:33.145398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:33.151520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:33.153631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.154343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:33.154343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:33.154575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.615956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:33.630341 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d632a61-da2e-48de-88b4-62e4bb2c31b2 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.500437 Oct 04 18:27:33.652505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2439/4878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:33 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:34.449708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:34.688039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:34.694759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:34.713993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:34.720983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.722395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.743061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.744044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.744568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.745079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.157116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Building network info cache for instance {{(pid=123887) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:27:35.612121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:36.005002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.044429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68a33b82-71bb-4ca0-9709-0e0ec3df4511 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 1.386303 Oct 04 18:27:36.062912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2440/4879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:34 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:36.086221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:36.138076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:36.153985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:36.154471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.220723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] Creating event network-changed:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:27:36.227033 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1fd856e0-2b53-45b6-8b50-5dab6a4a0a1d req-cba4e9eb-d055-42b9-9ea8-b29680908c6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160633 Oct 04 18:27:36.233425 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2441/4880] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:36.946554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Updating instance_info_cache with network_info: [{"id": "73ce2939-f56a-4b40-8935-77f40a9e9cf6", "address": "fa:16:3e:57:40:f9", "network": {"id": "a0b80a12-354f-464d-afaf-f366817e6cf0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-421469320-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6f7856da64d2406f9a966453e13a4de7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73ce2939-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123887) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:27:36.956398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:37.046403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Releasing lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123887) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:27:37.047300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e8b5d4e-af0b-4517-8b27-c6a5a10074b6 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action" status: 202 len: 0 microversion: 2.1 time: 4.483792 Oct 04 18:27:37.047959 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2440/4881] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:32 2022] POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action => generated 0 bytes in 4485 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 18:27:37.059233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.81"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:37.075764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:37.081255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.097395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.098030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.099612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.100673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.101435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.102026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.610131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.629543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.630268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.630880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.631649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.633100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.633853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.675187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:37.698896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6606cc14-1df3-4cb3-a814-512bd641215c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.631594 Oct 04 18:27:37.701327 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2441/4882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:37 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:38.121535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:27:38.122089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquired lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:27:38.731224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:38.732384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:38.743311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:38.744369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:38.744918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:38.745897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:38.746463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:38.746986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:38.925539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.957048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc1a92a8-3c78-4631-bb19-a99189ecede9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.231418 Oct 04 18:27:38.971716 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2442/4883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:38 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:39.546882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Building network info cache for instance {{(pid=123886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:27:39.571272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:39.593990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.594676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.595362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.625058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] Creating event network-changed:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:27:39.632506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-55761aa7-1055-461d-bd55-57fa5192c697 req-3d340a9d-1b30-4ec0-b21b-c6e7b43530e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064789 Oct 04 18:27:39.637378 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2443/4884] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:39.987966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:39.988972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:40.018014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.023833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.025150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:40.028939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:40.047323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:40.070475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.219865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:41.231072 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20d72d97-9a5f-4f2a-bfa9-559b83e068b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 1.249278 Oct 04 18:27:41.247601 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2444/4885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:39 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:42.256100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.256713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:42.267135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.268925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.269514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.270897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:42.272192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:42.273488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:42.574048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:42.590133 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2125fb57-68bf-406e-9567-beace3068e7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.338832 Oct 04 18:27:42.591072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2445/4886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:42 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:42.722703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Updating instance_info_cache with network_info: [{"id": "73ce2939-f56a-4b40-8935-77f40a9e9cf6", "address": "fa:16:3e:57:40:f9", "network": {"id": "a0b80a12-354f-464d-afaf-f366817e6cf0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-421469320-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6f7856da64d2406f9a966453e13a4de7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73ce2939-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:27:42.738261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Releasing lock "refresh_cache-ea28a926-a4ea-4981-b457-c765cd7c9e03" {{(pid=123886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:27:42.739303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de89bcc6-63e9-478b-81eb-0923f1ca7538 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action" status: 202 len: 0 microversion: 2.1 time: 5.686142 Oct 04 18:27:42.752964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03b91c9f-dbdd-47d7-a81e-547fb456ee0d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '.version_select at 0x7f900850dd30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:42.761336 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2442/4887] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:37 2022] POST /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03/action => generated 0 bytes in 5709 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:27:43.622201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:43.622686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:43.633368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.634236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.636442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.643655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.643655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.643655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.913433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.921600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2648be8-2dfe-42c5-9354-d9a66b5d211e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.303318 Oct 04 18:27:43.922460 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2443/4888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:43 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:43.935065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f657fba-0160-42bb-9416-b2db74a900ed", "name": "network-vif-plugged", "status": "completed", "tag": "231dca9b-588d-4463-94ec-4322117b1216"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:43.945604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.946165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.946679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.965621 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] Creating event network-vif-plugged:231dca9b-588d-4463-94ec-4322117b1216 for instance 3f657fba-0160-42bb-9416-b2db74a900ed on n-h2-833090-21 Oct 04 18:27:43.972276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0d7aff55-284a-41ae-9f56-b5a127742f4c req-31e20c91-74f1-4e3b-ae73-d45e1fd5b976 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040861 Oct 04 18:27:43.973216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2444/4889] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:44.490187 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03b91c9f-dbdd-47d7-a81e-547fb456ee0d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/5fb450a9-525c-4518-9f18-d10ebb70df04" status: 202 len: 0 microversion: 2.1 time: 1.742530 Oct 04 18:27:44.490187 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2446/4890] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:27:42 2022] DELETE /compute/v2.1/os-floating-ips/5fb450a9-525c-4518-9f18-d10ebb70df04 => generated 0 bytes in 1744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:44.503860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6c4fb9e-1237-4aa9-a272-4ef0fa587730 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '.version_select at 0x7f9009f25940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.948297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.949213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:44.961683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.962963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.964575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.966053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.966053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.967940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.981554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6c4fb9e-1237-4aa9-a272-4ef0fa587730 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/5a407fb7-89d8-4393-8c66-81a800ab10ce" status: 202 len: 0 microversion: 2.1 time: 0.483227 Oct 04 18:27:44.982160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2445/4891] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 18:27:44 2022] DELETE /compute/v2.1/os-security-groups/5a407fb7-89d8-4393-8c66-81a800ab10ce => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:27:44.992216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.993174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:45.010372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.011662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.014184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.018335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.018335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.028340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.120735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:27:45.390080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.429521 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-19f1673c-2138-4435-9589-e00d0a332eb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1308 microversion: 2.1 time: 0.486020 Oct 04 18:27:45.430629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2447/4892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:44 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:45.682402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b3a00a8-bdd5-41ec-bf71-4007f470445d tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 204 len: 0 microversion: 2.1 time: 0.695291 Oct 04 18:27:45.683169 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2446/4893] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:44 2022] DELETE /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:45.692190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:45.692993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:45.718204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.719234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.720871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.728641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:45.729713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:45.730567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.116921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.125601 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-23b56037-abe5-4746-807f-b2b1dbb22aae tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1508 microversion: 2.1 time: 0.438003 Oct 04 18:27:46.129800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2448/4894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:45 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:46.457234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:46.459224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:46.476314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.477420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.495238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.497479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.500088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.500994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.796400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:46.806584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6f834bed-1e7c-4202-9f9d-73fd1ae9b81c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1488 microversion: 2.1 time: 0.356569 Oct 04 18:27:46.807226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2447/4895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1488 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:46.830802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:46.841270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.841870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.843196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.878707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Going to try to stop instance {{(pid=123887) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:27:47.155521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:47.156163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:47.170088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.170804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.179501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.180292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.181941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.182411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.243710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88cb54a6-0325-4c5e-b0e7-4565021a37fd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed/action" status: 202 len: 0 microversion: 2.1 time: 0.417248 Oct 04 18:27:47.247725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2449/4896] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:46 2022] POST /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:47.258195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:47.263980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:47.294939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.295441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.295913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.296626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:47.304338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:47.305549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.640255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:47.649614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:47.651632 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7544896-1957-4226-b24e-5f150bb44bcc tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1508 microversion: 2.1 time: 0.501305 Oct 04 18:27:47.652723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2448/4897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:47 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:47.670859 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d3df5ee4-83de-4963-b35b-7f8db8ff2c8a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.419811 Oct 04 18:27:47.672281 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2450/4898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:47 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:48.688288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.688288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:48.702679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.703295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:48.722052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.725786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.726291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.727024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.727500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.736080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.738607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.739706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.740318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.745739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.746512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.747594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.162147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.173906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd32a8b4-43a6-493e-b10d-3ac4011894b5 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1508 microversion: 2.1 time: 0.497508 Oct 04 18:27:49.179139 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2449/4899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.207260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.227552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3bf2a225-a24e-49f9-b6cd-6b85f1b7f692 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.528866 Oct 04 18:27:49.228766 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2451/4900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:49.549826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28a926-a4ea-4981-b457-c765cd7c9e03", "name": "network-vif-deleted", "tag": "73ce2939-f56a-4b40-8935-77f40a9e9cf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:49.574901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:49.578558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:49.581657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.627350 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] Creating event network-vif-deleted:73ce2939-f56a-4b40-8935-77f40a9e9cf6 for instance ea28a926-a4ea-4981-b457-c765cd7c9e03 on n-h1-833090-21 Oct 04 18:27:49.645775 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0bf07ca6-c2de-4b9c-b6c9-73397f4df370 req-2ff6ebb0-4b75-46f5-92ad-11d0acb7e8b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109598 Oct 04 18:27:49.647929 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2450/4901] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:50.208659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.209296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:50.232942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.233919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.234719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.239561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.240092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.240524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.257090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.257803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:50.284014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.285047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.285952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.286860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.289300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.292200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.346208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.348176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.349979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.352109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lazy-loading 'fault' on Instance uuid ea28a926-a4ea-4981-b457-c765cd7c9e03 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:27:50.437978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e34d39fa45849a28f9a1bacf9bfb4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7856da64d2406f9a966453e13a4de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:50.452837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79416cce-6561-4a49-aeda-53947c0c9be7 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 200 len: 1312 microversion: 2.1 time: 0.255093 Oct 04 18:27:50.454850 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2452/4902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:50.740941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:50.750578 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73eaeb79-7e7d-4e77-adff-f6aa8ba22872 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.498050 Oct 04 18:27:50.764613 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2451/4903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:51.481230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.482719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] [instance: ea28a926-a4ea-4981-b457-c765cd7c9e03] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.497660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.498312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.500085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.514103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.523736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.531722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.550874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] HTTP exception thrown: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Request method failure captured: Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 HTTP/1.1 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHrUZ0wZhiCSX4XQaMc--wQbmf5cNNkeZBFDGRGS15yNGtVgD4rkfOT4bBO3j6wfrWqC7w_gla5OoGlKfpa1JrxfjysjCJiZjhhcc0aADF6U6MriqoV_5_xzoCJjolJxUIoH78xVoWQqWXiAA53NMlNvbjd_2qFWshJqu0mk2meDoyM Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6f7856da64d2406f9a966453e13a4de7 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-829251106 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6f7856da64d2406f9a966453e13a4de7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f7856da64d2406f9a966453e13a4de7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f7856da64d2406f9a966453e13a4de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6f7856da64d2406f9a966453e13a4de7"}]}] Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-829251106 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6f7856da64d2406f9a966453e13a4de7 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-829251106 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerRescueTestJSONUnderV235-829251106-project Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0e34d39fa45849a28f9a1bacf9bfb4c1 Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-829251106-project Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'ea28a926-a4ea-4981-b457-c765cd7c9e03'} Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.552867 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:27:51.560956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] Returning 404 to user: Instance ea28a926-a4ea-4981-b457-c765cd7c9e03 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:51.563669 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c2adce1a-757b-4544-a907-dde8c0e56131 tempest-ServerRescueTestJSONUnderV235-829251106 tempest-ServerRescueTestJSONUnderV235-829251106-project] 10.222.0.40 "GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03" status: 404 len: 111 microversion: 2.1 time: 0.086755 Oct 04 18:27:51.570652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2453/4904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/servers/ea28a926-a4ea-4981-b457-c765cd7c9e03 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:27:51.740073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.740715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.748603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.749152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.749640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.750817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.751289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.752498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.777216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:51.777830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:51.788411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.788913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.794781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.795852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:51.796500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:51.804929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.028451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.042105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c31daec9-0b83-487e-a1f2-e9b21150b3c1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.269575 Oct 04 18:27:52.042676 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2454/4905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:52.204751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.214370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa8f82c3-3f32-46a9-80d1-83e1411aab61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.478740 Oct 04 18:27:52.219718 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2452/4906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:51 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.066886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.068195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.085624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.088838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.088838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.088838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.088838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.088838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.247444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.248359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.264529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.265718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.266682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.268523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.269245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.270096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.336794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.346977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65d01fcc-f4ee-4f93-b827-b481425148b9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.284184 Oct 04 18:27:53.349812 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2455/4907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.735129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.749641 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d47ff97d-7761-4ddf-88e0-1d5f1030e939 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.506749 Oct 04 18:27:53.751325 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2453/4908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:53.773596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-702647522"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:53.779960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.796647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.797446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.798068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.799030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.799689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.803239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.373318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.373815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.380766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.381406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.381953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.382776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.383342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.383901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.388731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:54.397206 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-952a5e47-9e40-45c0-bd28-161f6fbf09de tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.627781 Oct 04 18:27:54.401926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2456/4909] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:27:53 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:27:54.748615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:54.756599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a18ceb3-6fc2-47e6-b2fd-dfb89ec02f60 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.387626 Oct 04 18:27:54.764293 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2454/4910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:55.792449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:55.793240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:55.808816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.809789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.811270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.812667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:55.813609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:55.815842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.890790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:56.284937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.297162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d342a51-cf28-4929-b012-129cf16aaddc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.509455 Oct 04 18:27:56.313158 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2457/4911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:55 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.674163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-unplugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:56.712636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.719028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.719683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.746990 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] Creating event network-vif-unplugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:27:56.777392 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-897bc099-e787-42a0-b90a-cb42a76832a0 req-74dd701a-8a1f-40db-96c4-031110e2b3cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091854 Oct 04 18:27:56.777392 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2455/4912] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:57.323816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.325150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:57.337290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.338045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.339714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.340635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.342296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.344106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.784966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:57.800347 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20f85b61-f15b-4856-958b-4e3ffe5619e3 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.481783 Oct 04 18:27:57.800957 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2458/4913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:58.824460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:58.827679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:58.833817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.835184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.835883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.836776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:58.837342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:58.837998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.067594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:59.082499 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3575bd9-b517-48bc-8620-08724417e02c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.262559 Oct 04 18:27:59.085795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2456/4914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:58 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:59.393767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d62ac843-4627-4fc4-a7d8-ce1574276bb8 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Action: 'create', calling method: .version_select at 0x7f900d7eeee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-207928097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPlmiStxY/6An+y/m71fmfK6llqsR4UQlGNpeTVQigrUju7Iy4gp4ZR1TeTq2wtmF2wBxJsQsdxJv5ueH7A4awlqZZSmNGikPAlkmtrg0zogQXna6oLHCYjiEXQrGaqng=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:59.419427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d62ac843-4627-4fc4-a7d8-ce1574276bb8 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Getting quotas for project 2bb5d8e2ff974aedae86dc75f5dd0d8e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:59.426590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d62ac843-4627-4fc4-a7d8-ce1574276bb8 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Getting quotas for user 51077921523144938d6520cd0f8215cc and project 2bb5d8e2ff974aedae86dc75f5dd0d8e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:59.561901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d62ac843-4627-4fc4-a7d8-ce1574276bb8 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.173062 Oct 04 18:27:59.563020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2459/4915] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:27:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:00.114421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:00.115031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:00.122603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.123088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.123723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.124412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.124875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.125290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.347192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:00.361523 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8afc3c8-961f-4055-8e02-bed9f5410c61 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.249809 Oct 04 18:28:00.375387 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2457/4916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:00 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.390441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.391718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.397993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:01.399627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.400301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.401377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.402242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.402849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.403649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.577622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:01.601984 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d959c281-9a1a-460a-82b8-f93b402be650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.216296 Oct 04 18:28:01.602912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2460/4917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.613624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-plugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:01.633932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.634429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.636341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.649648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] Creating event network-vif-plugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:28:01.656076 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3ed51c3e-540c-4f3a-a1e6-3661f62e8a00 req-82e26951-ceca-488d-9adc-c3685d0bf34d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049900 Oct 04 18:28:01.656895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2461/4918] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:01.929122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-516920749", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:01.990596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:01.991151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:01.993398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:01.993398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:01.993398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:02.002193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.002992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.003695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.004536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.005235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.005834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.044946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Getting quotas for project fb1133bc0b5644e68fba274b13a364b4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:02.051268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Getting quotas for user 63b552f9db6449738836d3c7a6bbbed4 and project fb1133bc0b5644e68fba274b13a364b4. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:02.065111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:02.067654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:02.240116 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcaac5d5-8a10-4ab4-b15e-ed2b5a094ff7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.703923 Oct 04 18:28:02.240778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2458/4919] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:28:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:28:02.252630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.253339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.327161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.339907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.342503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.346399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6476c57a-92ab-40f4-b820-b63a8d8e9035 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1277 microversion: 2.57 time: 0.098074 Oct 04 18:28:02.346992 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2462/4920] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:02.629622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.630349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.638015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.638515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.638951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.639706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.640160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.640808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.803138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:02.811947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a15b04e9-18ed-4c59-a11a-70202f13d9dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.188177 Oct 04 18:28:02.815575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2459/4921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:02.838095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1612180399", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a76bb9e-39c4-4e8b-a6fa-eaa0487f4c01", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-207928097", "security_groups": [{"name": "tempest-secgroup-smoke-1841031305"}], "networks": [{"uuid": "0d203484-c66c-45b2-ae00-e0884982f1de"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:02.987635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] validate_networks() for [('0d203484-c66c-45b2-ae00-e0884982f1de', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:03.371627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.372817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.395915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:03.395915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:03.395915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:03.395915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:03.395915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:03.405210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.405772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.406216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.407354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.408368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.408812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.429074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Getting quotas for project 2bb5d8e2ff974aedae86dc75f5dd0d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:03.433728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.434664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Getting quotas for user 51077921523144938d6520cd0f8215cc and project 2bb5d8e2ff974aedae86dc75f5dd0d8e. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:03.442886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.444357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.445709 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0b76032-3212-42a1-aa35-5303cf8b6be8 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1277 microversion: 2.57 time: 0.078051 Oct 04 18:28:03.446480 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2460/4922] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1277 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:03.500407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:03.503320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a76bb9e-39c4-4e8b-a6fa-eaa0487f4c01',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:03.838671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.839293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.855220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.855790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.856310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.857226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.857692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.858124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.034926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.043955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5b4d057-acb3-4ef0-a5c7-f089a52ae246 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.209502 Oct 04 18:28:04.044855 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2461/4923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:04.107554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f695acde-5eb9-4f9a-bb40-e3831bc587b3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.273789 Oct 04 18:28:04.108485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2463/4924] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:04.122812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e58cbe44-d5e7-4d9a-9020-762fba85a841 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:04.123720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e58cbe44-d5e7-4d9a-9020-762fba85a841 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.231237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e58cbe44-d5e7-4d9a-9020-762fba85a841 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.243930 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e58cbe44-d5e7-4d9a-9020-762fba85a841 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1098 microversion: 2.1 time: 0.126712 Oct 04 18:28:04.244267 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2462/4925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:04 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1098 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:04.473198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:04.475848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.499172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.499963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.500873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.503230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.504167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.505531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.617359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.630923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.633018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.634439 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9edb115f-f465-4dea-847e-006998d62690 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1329 microversion: 2.57 time: 0.166063 Oct 04 18:28:04.635430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2464/4926] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:04 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1329 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:05.080703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.084900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.107643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.109220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.109867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.111699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.113458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.114165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.272156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aac8da7f-23b9-4189-bacf-ccdf5549bf4d tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.272850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aac8da7f-23b9-4189-bacf-ccdf5549bf4d tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.402454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aac8da7f-23b9-4189-bacf-ccdf5549bf4d tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.414576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aac8da7f-23b9-4189-bacf-ccdf5549bf4d tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1098 microversion: 2.1 time: 0.144338 Oct 04 18:28:05.416584 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2465/4927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1098 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:05.551791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.579077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fb79aff-e447-4eea-b77f-112336e753bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.494965 Oct 04 18:28:05.597742 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2463/4928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:05.674546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:05.675874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:05.687596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.689307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.690439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.693855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:05.695312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:05.696479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.887847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.914389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.916255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.917467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b03c0e2-4f35-4d05-9908-39950e39b6d4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1335 microversion: 2.57 time: 0.250090 Oct 04 18:28:05.919981 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2466/4929] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:05 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1335 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:06.449242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.450047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.460343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:06.479895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.480561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.481113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.481971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.482543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.483081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.597067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.609949 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10749a96-9c37-416c-b03b-dcf4b1a73213 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1148 microversion: 2.1 time: 0.168120 Oct 04 18:28:06.611433 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2464/4930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1148 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.618771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.618771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.621992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.627890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.628588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.629492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.630205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.630782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.954916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.956036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.965464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.965832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.966555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.967215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.969209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.970672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.971370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.977783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4eaa38f3-4df9-4e6c-a9c9-9f6ea47e6fb5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.367094 Oct 04 18:28:06.990039 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2467/4931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:07.137186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.178274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.184669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.187241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88e98748-db81-42a5-a64b-86abdcf40eaa tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1335 microversion: 2.57 time: 0.237083 Oct 04 18:28:07.195665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2465/4932] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:07.635966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.638794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.654181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.657044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.658241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.661323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.662237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.666305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.779399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:07.792164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81109257-9eab-4021-997e-69c93fb72713 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1196 microversion: 2.1 time: 0.161179 Oct 04 18:28:07.799035 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2468/4933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1196 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:08.017244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:08.017861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:08.048724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.050765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.053839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.055700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.058094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.059449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.231823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:08.233239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:08.251158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.254791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.255422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.263501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.267479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.271275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.321222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.338068 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a741174-669a-4fc1-8081-e7eaced9d0fc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.325948 Oct 04 18:28:08.338744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2466/4934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:08 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:08.383905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.414672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.416495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.417953 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a90fa01-bf17-49fc-9099-5ee32b59493e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1335 microversion: 2.57 time: 0.190999 Oct 04 18:28:08.432799 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2469/4935] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:08 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1335 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:08.826467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:08.827452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:08.842958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.843648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.844110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.844895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.845362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.845794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.939261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.950664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-473a4b8d-316a-49f7-ae2a-b1991df9e8c3 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1204 microversion: 2.1 time: 0.128160 Oct 04 18:28:08.951507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2467/4936] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:08 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:09.362769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:09.364594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:09.377200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.383633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.384335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.385461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.387733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.388356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.445543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:09.446944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:09.464788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.466727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.469776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.470780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.471419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.472047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.629256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:09.644073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:09.645996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:09.648002 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3e56d90-7b2c-4e45-8339-d363d6d5899a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1356 microversion: 2.57 time: 0.206393 Oct 04 18:28:09.653156 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2468/4937] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:09 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1356 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:09.684116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:09.687221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:09.696412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.702809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.703547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.704496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.706881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.710094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.843397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:09.844190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:09.845405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:09.846053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:09.846680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:10.132960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:10.161193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.161707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.163811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.167699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.172355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.172956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.230207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.252708 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c12ec392-a14a-44df-8f68-3f568fb0b036 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.888501 Oct 04 18:28:10.259093 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2470/4938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:09 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:10.294646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:10.295308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:10.321121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.321419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.321965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.322695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.323154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.330655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.341848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fae262aa-5cee-4275-baac-cc18a623c3e3 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "POST /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a/action" status: 202 len: 1137 microversion: 2.57 time: 0.663179 Oct 04 18:28:10.355494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2469/4939] 10.222.0.40 () {62 vars in 1320 bytes} [Tue Oct 4 18:28:09 2022] POST /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a/action => generated 1137 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:28:10.368367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:10.369029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:10.383256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.383811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.384263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.384998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:10.387303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:10.387847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:10.638818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.656304 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-efb2b5aa-4288-4436-bd03-08fa94b08673 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1214 microversion: 2.1 time: 0.392265 Oct 04 18:28:10.672299 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2471/4940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:10 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1214 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:10.686081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.699158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.700646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.706556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4ad9aac-d302-41e5-9df7-2358bf6e7603 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.338016 Oct 04 18:28:10.707795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2470/4941] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:10 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:11.285028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.285648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:11.295707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.295955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.297678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.298639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.299254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.299891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.680603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.681478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.703777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.966894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:11.980034 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84ffdeb1-5a89-47a5-aa25-d115f44f24b8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.701291 Oct 04 18:28:11.991941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2472/4942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:12.014353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.019885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:12.027822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:12.039046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:12.041520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:12.044097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:12.045046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:12.045703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:12.048634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:12.212087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.226669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.228484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:12.235181 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bee47d0-d431-41df-a9c2-676ab76a47d0 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.242122 Oct 04 18:28:12.236444 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2473/4943] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:13.011751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.012649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:13.028826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.030655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.034041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.035051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.037607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.038303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.195554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.205724 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dfc4e15-d917-4b13-97d9-fdf9b3138bef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 1.529081 Oct 04 18:28:13.220725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2471/4944] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:13.266218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:13.267424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:13.276511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.280018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.281283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.282332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.283004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.284819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.340766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:13.420898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:13.477742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.511749 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c286b6c-c199-4d71-aae7-4f49274923fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.489339 Oct 04 18:28:13.511749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2474/4945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:13 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:13.540640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.550885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.554281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.556871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dcddadb9-b324-4886-817c-efcd8b429ea9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.294156 Oct 04 18:28:13.573532 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2472/4946] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:13 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:13.735061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:13.765827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:13.766421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:13.766859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.801931 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] Creating event network-changed:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:28:13.831436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-039e3f59-b5af-4190-a6f0-df1ab4090cf6 req-f0dfbc70-b836-4e19-9b83-092f48c11a2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100476 Oct 04 18:28:13.832674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2475/4947] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:14.236286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.237623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.240996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:14.255113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.255664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.256106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.256820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.257271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.257693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.520037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.520758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.531917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.543357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.546774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.552377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.553258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.553709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.875301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:14.886731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0399361a-8843-47fa-80ff-7a7a5785dd23 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 0.654785 Oct 04 18:28:14.887348 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2473/4948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:14.914527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.914672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.946861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.947362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.947823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.948537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.948993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.949419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.103308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.117967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6372b6a-64e8-4abd-b8c1-99c8f063d6bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.599953 Oct 04 18:28:15.119775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2476/4949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:15.194005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.203883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.205332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.219046 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14062ee3-a2f9-414c-963b-c4be341f42eb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.330600 Oct 04 18:28:15.225503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2474/4950] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:15.918368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.919172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:15.921541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:15.947204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.949215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.950570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.953402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.955064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.958136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.146865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.147398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.161190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.161681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.162159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.162809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.163263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.163716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.508274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.517898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ce226bd-369a-448e-a252-7cd61204251f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.374913 Oct 04 18:28:16.521499 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2475/4951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:16.530725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.531341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.543049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.546221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.546898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.550341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.550994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.551633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.601611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.617944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e05646fa-2378-4d98-85cf-33d85812c9a1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 0.706926 Oct 04 18:28:16.618558 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2477/4952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:16.696558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.702072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.704429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.705650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bda9a7b-01e0-4748-b348-5a298531f696 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.182991 Oct 04 18:28:16.706223 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2476/4953] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:17.546142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.548003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.557142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.564577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.567230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.568220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.570728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.571482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.650760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.653757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.667062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.669472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.670351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.674805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.675631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.676377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.016831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.021907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:18.048104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86898b2d-7bb9-47df-90cd-b3c373ac0cfc tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1498 microversion: 2.1 time: 0.490878 Oct 04 18:28:18.050160 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2478/4954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1498 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:18.055243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:18.068372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:18.082511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.083343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.095230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.099596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.099596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.099596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.099596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.105323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84d07639-61a0-4966-90a3-80e27a32424f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 0.458524 Oct 04 18:28:18.105993 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2477/4955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:18.277286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.310456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.321062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.329361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6eaecd9d-6bf1-4c1a-a75e-45cffc8f3540 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.277369 Oct 04 18:28:18.334967 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2479/4956] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:18 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:19.087890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.087890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.088985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.089869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.091622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.092495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.096027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.096514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.132870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.133474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.140628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.141119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.141612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.142324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.142780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.143208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.244220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.253339 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec6f31ec-17d4-4b4b-9492-35c9f4554fd6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 200 len: 1475 microversion: 2.1 time: 0.184964 Oct 04 18:28:19.254992 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2478/4957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:19.278078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1374699195"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:19.281400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.290142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.290750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.290869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.291253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.292205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.293162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.293657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.299823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-293f8f7a-ccd3-4fc0-9081-01752d092f54 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 0.171020 Oct 04 18:28:19.300459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2480/4958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:19.364207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.364819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.371140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.371667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.372135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.372805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.373255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.373678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.441175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.450804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.452771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.454017 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e552c47d-7a15-4ac9-9d69-04990ec3b069 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.094392 Oct 04 18:28:19.467893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2481/4959] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:19.896800 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a522fe21-743d-4215-bc3c-3f4a2f3e8110 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed/action" status: 202 len: 0 microversion: 2.1 time: 0.622602 Oct 04 18:28:19.905921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2479/4960] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:19 2022] POST /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 18:28:19.911288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2a799453-b88c-446a-95da-f9f151976580 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900967c4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.049104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2a799453-b88c-446a-95da-f9f151976580 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.142240 Oct 04 18:28:20.052561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2482/4961] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:20.327067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.327958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.353149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.365520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.368334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.373379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.374098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.374713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.483797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.485112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.494229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.495109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.495792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.496881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.497731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.499484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.583177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.593168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.596246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.598295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:20.599717 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-509b8f2f-d222-45f9-8d79-352d80ea413e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.123628 Oct 04 18:28:20.600832 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2483/4962] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:20.621431 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d3e2eba-1a3c-4c2f-8a4d-41b626a9ca12 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1282 microversion: 2.1 time: 0.295338 Oct 04 18:28:20.631235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2480/4963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:21.067117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-901ea226-bdb8-44ca-a753-79f528771e1f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d867550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.144996 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-901ea226-bdb8-44ca-a753-79f528771e1f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.082428 Oct 04 18:28:21.145812 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2484/4964] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:21.630156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.638517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.644296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.644797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.645237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.646591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.647066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.647516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.658192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:21.660467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:21.696079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.697383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.703218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.706404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:21.707072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:21.708483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.862623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:21.877200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:21.878693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:21.879929 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b49f8afb-31b9-45dd-823c-b88f177c1b0e tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.255116 Oct 04 18:28:21.880559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2481/4965] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:22.082909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:22.095525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-988c3829-243f-436a-a29a-5d3c3405a816 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.443557 Oct 04 18:28:22.113766 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2485/4966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:21 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:22.168601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8bff96f0-3f35-428c-9354-c16711b258fb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d42820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.301814 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8bff96f0-3f35-428c-9354-c16711b258fb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.141934 Oct 04 18:28:22.302445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2482/4967] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:22 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:22.906672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.907121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.917640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.918139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.926942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.927929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.928465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.951492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.086027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.102209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.104397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.111064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0a078e4-06d4-480c-9e12-3889a2cbc811 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.208461 Oct 04 18:28:23.144111 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2486/4968] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:22 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:23.150721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.152102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:23.186756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.187312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.205391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.206651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.207407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.211264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.317870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80f5e429-fdc7-4d0d-a9af-f5b6c9fee90d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d81e280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.433920 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80f5e429-fdc7-4d0d-a9af-f5b6c9fee90d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.119875 Oct 04 18:28:23.435945 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2487/4969] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:23.763236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:23.771164 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e099dc6-494a-4e01-ac76-9d53cf03608b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.645858 Oct 04 18:28:23.776086 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2483/4970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:24.146161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:24.147408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:24.157682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.159904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.161267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.169311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.171523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.172835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.452608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ff725b3-e32b-4d28-be25-70f4afc3916b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d42f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:24.510861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:24.532170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:24.541745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:24.543575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e5f1feb-1955-40ac-862c-c804d8b2bfb4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.404794 Oct 04 18:28:24.545403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2488/4971] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:24 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:24.549331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ff725b3-e32b-4d28-be25-70f4afc3916b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.101995 Oct 04 18:28:24.554187 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2484/4972] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:24 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:24.560781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f657fba-0160-42bb-9416-b2db74a900ed", "name": "network-vif-plugged", "status": "completed", "tag": "231dca9b-588d-4463-94ec-4322117b1216"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:24.585715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.587996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.589955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.635403 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] Creating event network-vif-plugged:231dca9b-588d-4463-94ec-4322117b1216 for instance 3f657fba-0160-42bb-9416-b2db74a900ed on n-h2-833090-21 Oct 04 18:28:24.643998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fd95fab5-ef74-4f3f-ae73-c246a03c4291 req-e105dc39-5143-4b16-b916-fd3aca6b2c41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096347 Oct 04 18:28:24.645084 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2489/4973] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:24.798390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:24.799007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:24.839210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.841970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.842596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.848763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:24.849521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:24.850241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.297600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.309026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4a0cdb6-5958-4dfd-ba96-aa87122569fc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.515024 Oct 04 18:28:25.325115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2485/4974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:24 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:25.569104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34ee8cc5-eb62-45c7-9785-7017ef3709c8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90090b4ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:25.580371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:25.581003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:25.596586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.597310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.597958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.598877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.601803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.602524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.653080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34ee8cc5-eb62-45c7-9785-7017ef3709c8 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.091439 Oct 04 18:28:25.653699 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2490/4975] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:25 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:25.816727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.830246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.831831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:25.833308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b56ed236-df90-46f5-a5a4-f932d7a784b9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.260298 Oct 04 18:28:25.834369 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2486/4976] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:25 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:26.355200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.357380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:26.372067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.372902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.373567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.374568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.376007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.376737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.671141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7220db7f-efd6-4a0b-adf6-a1b65f19d354 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d74160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.706134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:26.721321 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed257a53-975a-4035-b699-7ad6d01bd8cc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.371340 Oct 04 18:28:26.731649 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2491/4977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:26.743818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7220db7f-efd6-4a0b-adf6-a1b65f19d354 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.078143 Oct 04 18:28:26.744597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2487/4978] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:26.865065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:26.865588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:26.894752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.895973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.896426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:26.925916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:26.926775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:26.931035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.404407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:27.405246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:27.408633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:27.413587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.414326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.414959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.416099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.417632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.418485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.455749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52873d49-2764-4f31-898c-04191fce70bf tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/ips" status: 200 len: 146 microversion: 2.1 time: 0.055193 Oct 04 18:28:27.456838 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2488/4979] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:28:27 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:27.464035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:27.466672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:27.504842 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e285ff31-98f9-4f1a-97cc-a02cd12d4733 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.643550 Oct 04 18:28:27.523431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2492/4980] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:26 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:27.750015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:27.751786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:27.766745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.767600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.769165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.770694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.772182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.773596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93a84c9b-cc7b-4586-9cd2-8f2b3b9e2099 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d7ee280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:27.774230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.470989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93a84c9b-cc7b-4586-9cd2-8f2b3b9e2099 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.714412 Oct 04 18:28:28.488725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2493/4981] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:27 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:28.514172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.529288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5de5f48a-d357-4690-835a-1662f9ad5b44 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.783831 Oct 04 18:28:28.535508 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2489/4982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:27 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:28.555059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:28.556119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:28.567790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.568297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.568832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.573445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:28.575615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:28.576387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:28.724300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.744606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.751335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.754830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-472a1838-1fc5-4831-92cf-66b5744481c4 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.204671 Oct 04 18:28:28.783173 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2494/4983] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:28 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:29.494980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3dd3d88-72ed-4c9c-8760-5a704a4bd07c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c79310>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.564492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.568415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:29.608202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.613133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.614845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.618530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.621645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.623788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.939074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3dd3d88-72ed-4c9c-8760-5a704a4bd07c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.448650 Oct 04 18:28:29.940077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2490/4984] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:29.950031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.950654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:29.965170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.968806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.968806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.977697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.978223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.978682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.094676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.118563 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a57df4ec-c12c-4228-935b-ea8aa8700a60 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.557220 Oct 04 18:28:30.118563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2495/4985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:30.137301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.140445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.164927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.168276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.169026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.169985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.172211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.174037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.202197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.206660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:30.221336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.230184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.231563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3036581-2bf8-4dfa-b9f4-94be2617c336 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.290428 Oct 04 18:28:30.236728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2491/4986] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:30.688916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.704054 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5834ffba-dbb8-429c-81cb-98e33d8c10ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.590946 Oct 04 18:28:30.733866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-228644162"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:30.735673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2496/4987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.742481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.758558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.763782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.764460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.766306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.769392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.774021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.961232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-420ea4f9-d849-4fa4-8ea5-1b6eb24453bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900890d3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.290363 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-420ea4f9-d849-4fa4-8ea5-1b6eb24453bb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.339684 Oct 04 18:28:31.292826 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2497/4988] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:31.321434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.323601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:31.354411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.360360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.360360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.360360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.363440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.364935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.494834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-231c946e-0362-4de1-904d-8cc18a3fe633 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.764512 Oct 04 18:28:31.494834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2492/4989] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:28:30 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 04 18:28:31.508988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.509580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:31.551173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.551709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.558405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.559455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.560148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.560746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.619745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:31.631452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd617a55-2f99-44e4-b344-8346348b2862 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.337118 Oct 04 18:28:31.633075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2498/4990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:31.657721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:31.671534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.741994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:31.755160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:31.775724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:31.784911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8975d62-72a9-489f-b32b-a392579c2e91 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.280339 Oct 04 18:28:31.785497 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2493/4991] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:32.310079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03188b2d-7d07-48a5-b562-0331b1223c2d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009895af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:32.369707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:32.379926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d54dbcd-2d6f-4f08-b1dd-d8b13b65364a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.727617 Oct 04 18:28:32.388277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2499/4992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:31 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:32.460732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "863ea27f-4e06-4060-b5cd-0edf46bdbfc8"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:32.464289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:32.497177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03188b2d-7d07-48a5-b562-0331b1223c2d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.178361 Oct 04 18:28:32.497177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2494/4993] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:32 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:32.504652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.505215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.505675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.511554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.512064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.512523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.528359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "name": "network-vif-plugged", "status": "completed", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:32.556361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.556854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.580973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.618603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] Creating event network-vif-plugged:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:28:32.636136 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dc768a2c-83ad-4a3b-a16f-52330550d561 req-97bb54c0-064e-4bb7-bc59-2950aef92608 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111716 Oct 04 18:28:32.638360 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2495/4994] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:32.662375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:32.664243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:32.685108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.689344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.690028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:32.690929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:32.692346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:32.694815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.359244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:33.382044 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb658097-dab6-46cd-b443-7f76782fcbe1 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.721809 Oct 04 18:28:33.401860 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2496/4995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:32 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:33.412343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.413394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:33.427322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.428279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.429987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.434803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.436573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.438426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.604985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:33.732620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:33.746774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:33.748259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:33.767745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-876125b2-6f86-4f7f-95c5-8db6b26790f9 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.349063 Oct 04 18:28:33.767745 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2497/4996] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:33.767745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.773989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:33.787119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.787867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.789210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.790416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.791541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.792138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.860780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-267ca018-9d30-4ba7-b24b-13621d64ad1d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.405138 Oct 04 18:28:33.864805 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2500/4997] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:28:32 2022] POST /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 194 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:33.895636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7aa45311-24cc-450e-8563-f34612ee8584 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d7ee4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:33.996486 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7aa45311-24cc-450e-8563-f34612ee8584 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.126961 Oct 04 18:28:33.996486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2501/4998] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:34.409956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.411170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:34.433807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:34.448119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.456118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.457287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.461489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.463636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.473343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.861926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:34.875760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e2a029d-09b8-426a-a296-4095f499bf5b tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1270 microversion: 2.1 time: 0.469675 Oct 04 18:28:34.893495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2502/4999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1270 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:34.899224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-unplugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:34.913056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.914120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.914813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.933145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] Creating event network-vif-unplugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:28:34.948638 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-296796ca-8d5c-465d-b7e7-9a5c7491760b req-f712d0ac-7306-47e8-8c9b-5f541df4f8ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048613 Oct 04 18:28:34.949590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2503/5000] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:34.964433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:34.965164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:34.980977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.981489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.981936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:34.982652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:34.983111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:34.983568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.183179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.194865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.196643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.198045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-264c84ac-2778-45c1-9036-4bf54ad244f7 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.247187 Oct 04 18:28:35.211498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2504/5001] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:34 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:35.229136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec0a8393-2bd1-4994-b812-a79a894d1f65 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900970fb80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.270349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:35.284865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cdb33871-41f1-4dbc-9a6f-e8b827c4a0b1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 1.524155 Oct 04 18:28:35.285757 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2498/5002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:33 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:35.368973 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec0a8393-2bd1-4994-b812-a79a894d1f65 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.168399 Oct 04 18:28:35.370211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2505/5003] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:35.900573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:35.901186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:35.917273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.920730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.923778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:35.925178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:35.927437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:35.931947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.230329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.231851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.244682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.248237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.249097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.252323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.253095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.254709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.525759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.541231 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de0587fe-6071-4ae3-8db0-fc4c21967660 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1459 microversion: 2.1 time: 0.644507 Oct 04 18:28:36.548071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2499/5004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:35 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1459 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:36.553146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.558887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.570415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.572748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.574642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.583688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37341a48-5aa9-4f84-b240-8b290225abe1 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.358456 Oct 04 18:28:36.585081 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2506/5005] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:28:36.591559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7faa34b6-c4bc-45e2-940b-a1e38d84382b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900970f820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.597316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.598006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.598665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.600713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.601377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.602019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.672085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7faa34b6-c4bc-45e2-940b-a1e38d84382b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.077533 Oct 04 18:28:36.678186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2507/5006] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:36.691098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:36.694579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:36.713042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.717269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.721400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.722544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:36.724546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:36.726598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:36.924433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:36.934653 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-133b0891-42d3-4681-a355-84ebd857e554 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1688 microversion: 2.1 time: 0.385186 Oct 04 18:28:36.938183 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2500/5007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1688 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:37.377954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.387305 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8072d7b4-228b-4347-b87b-a56fbf0068bc tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1459 microversion: 2.1 time: 0.707718 Oct 04 18:28:37.399529 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2508/5008] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:36 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1459 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:37.615619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.616318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:37.629198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.629622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.637197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.638863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.642352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.646692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.693625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08f322c1-9a47-43f0-b885-32b7e9c36ca4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d81ed30>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.797668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08f322c1-9a47-43f0-b885-32b7e9c36ca4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.111385 Oct 04 18:28:37.798258 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2509/5009] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:37.935515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.950269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.966544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:37.989672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:37.997340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:37.997427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84fb5140-e9a1-4efc-8ed8-d2c8ae991e5d tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1365 microversion: 2.57 time: 0.384584 Oct 04 18:28:38.020367 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2501/5010] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:38.374010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:38.385524 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2da04095-a1b3-4366-abfa-781253652d7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1688 microversion: 2.1 time: 0.420380 Oct 04 18:28:38.386908 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2510/5011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:37 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:38.814081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-599e78c4-7515-447e-a471-6df6b71fa938 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008cf6940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:38.889461 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-599e78c4-7515-447e-a471-6df6b71fa938 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.079835 Oct 04 18:28:38.894543 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2502/5012] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:38 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:39.057512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.058432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:39.066513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.067251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.067992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.068989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.069762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.070359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.266534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.286098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.289021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:39.297621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2aeeb2e7-1d28-489d-b5b3-022c4d04856a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1371 microversion: 2.57 time: 0.248520 Oct 04 18:28:39.312678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2511/5013] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:39.422785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:39.423628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:39.438608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=70 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:39.442157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.443177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.444182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.455584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:39.460796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:39.464497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:39.905881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0890ddbd-ecea-499b-a4ac-a6f748b00bb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d7eedc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:40.044175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0890ddbd-ecea-499b-a4ac-a6f748b00bb4 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.142071 Oct 04 18:28:40.045107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2512/5014] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:40.144620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-plugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:40.168358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.169185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.170038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.184583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] Creating event network-vif-plugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:28:40.191453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cf4e6755-88af-4ca7-865b-cb94bd9d5cc7 req-65045592-1005-4084-996b-d529024ae826 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058699 Oct 04 18:28:40.192479 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2513/5015] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:40.338508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:40.339330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:40.361515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.381382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.384341 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-588ed916-9ce1-434a-8be8-40f711fc39a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1688 microversion: 2.1 time: 0.963352 Oct 04 18:28:40.387427 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2503/5016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:39 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1688 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:40.390867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.392951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.393943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:40.397167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:40.397834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:40.563395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.582681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.587886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:40.593142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-234ac7a7-46ef-4306-8dc4-fc23057a40cb tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1371 microversion: 2.57 time: 0.266416 Oct 04 18:28:40.603094 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2514/5017] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:40 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:41.088078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b88f4444-5cdf-47ad-b219-0285f333af5d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1b280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.155563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b88f4444-5cdf-47ad-b219-0285f333af5d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.091285 Oct 04 18:28:41.156931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2504/5018] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:41 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:41.410392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.411125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:41.428480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.428980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.438506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.447573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.450597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.452057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.623972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:41.638125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:41.645619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.646137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.646589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.651762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:41.652288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:41.658246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:41.960182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:41.975759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1c65133-4130-4bab-ad85-c2bdc4fd0ee7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1688 microversion: 2.1 time: 0.569201 Oct 04 18:28:41.977149 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2515/5019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:41 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1688 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:42.025978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.040813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.047971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:42.050519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73aae5d4-0d97-4072-89a7-b7e640e9769c tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1356 microversion: 2.57 time: 0.429953 Oct 04 18:28:42.052024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2505/5020] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:41 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1356 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:42.094575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:42.095087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:42.104106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.104606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.105054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.105772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.106233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.106667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.172838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50b6a1b0-62f6-4231-8078-7a6c44726f13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90098954c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:42.203357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:42.262742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50b6a1b0-62f6-4231-8078-7a6c44726f13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 0.094910 Oct 04 18:28:42.263842 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2506/5021] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:42 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:42.709385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e90d0785-1177-46d2-b302-ab1325df9441 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 204 len: 0 microversion: 2.57 time: 0.621237 Oct 04 18:28:42.710352 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2516/5022] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:28:42 2022] DELETE /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:28:42.720450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:42.721615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:42.756895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.008262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:43.011403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:43.054891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.058861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.061235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.063553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:43.064236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:43.066474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:43.140933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:43.154926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:43.160165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:43.162128 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af4fb8e1-4b8e-411c-8efd-ccb4ead4de12 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1362 microversion: 2.57 time: 0.447346 Oct 04 18:28:43.166676 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2507/5023] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:42 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:43.284915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5b45bfc-20d2-46ba-b7e5-ae92238d371c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1b940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:44.582474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:44.592209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a16e21dc-59b0-418a-8e30-6b27ece4502f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 1.590538 Oct 04 18:28:44.604133 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2517/5024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:42 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:44.609481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:44.657255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:44.694007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.694520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.694968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:44.695719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:44.696187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:44.696619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.055497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.107171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.134258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:45.141031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14f9454b-46e3-419e-aba8-f91a0fce9c0a tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1362 microversion: 2.57 time: 0.530693 Oct 04 18:28:45.141031 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2518/5025] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:44 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:45.507859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:45.552484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.564595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.573419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.639882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] Creating event network-changed:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:28:45.677053 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ca4afb23-928a-4a35-9080-e32562d56417 req-3f88aa0b-0ca1-43be-8e3d-e92e9ac6d231 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158144 Oct 04 18:28:45.678454 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2519/5026] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:45.711531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:45.726804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:45.742475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.748916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.752300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:45.753546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:45.756093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:45.758999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.173014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:47.194966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70c6279a-e0b6-4d6e-aadb-55f79c7127d5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 1.512687 Oct 04 18:28:47.198360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2520/5027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:45 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:47.214358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:47.214358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:47.239544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.240059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.240640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.241378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.241923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.247803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.336087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:47.336997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:47.337657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:47.338373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lazy-loading 'fault' on Instance uuid 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:28:47.576121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:47.590933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:47.594669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b552f9db6449738836d3c7a6bbbed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1133bc0b5644e68fba274b13a364b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:47.596590 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ccda0fc7-1beb-4979-9a16-c27b63e66d09 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 200 len: 1367 microversion: 2.57 time: 0.396779 Oct 04 18:28:47.600806 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2521/5028] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:47 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:28:48.221491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:48.222947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:48.238162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.240163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.240824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.242590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:48.244369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:48.245375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:48.294759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:49.216862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:49.233113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b366b99d-b952-41b6-8abe-de83533e93cc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 1.015744 Oct 04 18:28:49.236209 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2522/5029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:48 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:49.259710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:49.261817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] [instance: 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:49.288894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.293588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.297837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.302015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.303050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.303824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.357071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] HTTP exception thrown: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Request method failure captured: Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a HTTP/1.1 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHsxCLAWJIDHoHDOlpRvQsn0gROSQTHOHx3RymFvP2da0BNzKz6srpkwM8Lg1fwsjEZxto1A5MIlZVgDyyydzxRBCiyfueizcGSRxKvsgyembYlfBzPNejsJjxk09AfuEKcvG_EcaOZBxuSCmupWDd6cBQFaJTUqUK0l-1Q_-T92yLY Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fb1133bc0b5644e68fba274b13a364b4 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerShowV257Test-119808015 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fb1133bc0b5644e68fba274b13a364b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb1133bc0b5644e68fba274b13a364b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fb1133bc0b5644e68fba274b13a364b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fb1133bc0b5644e68fba274b13a364b4"}]}] Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerShowV257Test-119808015 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fb1133bc0b5644e68fba274b13a364b4 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerShowV257Test-119808015 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerShowV257Test-119808015-project Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 63b552f9db6449738836d3c7a6bbbed4 Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerShowV257Test-119808015-project Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '69c83c8e-b1ca-4cb6-b1be-a1737410eb3a'} Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:49.366557 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. Oct 04 18:28:49.371323 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:28:49.379828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] Returning 404 to user: Instance 69c83c8e-b1ca-4cb6-b1be-a1737410eb3a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:49.385097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb18437e-4604-420e-9979-cc56f1f3e976 tempest-ServerShowV257Test-119808015 tempest-ServerShowV257Test-119808015-project] 10.222.0.40 "GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a" status: 404 len: 111 microversion: 2.57 time: 0.143051 Oct 04 18:28:49.398815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2523/5030] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:28:49 2022] GET /compute/v2.1/servers/69c83c8e-b1ca-4cb6-b1be-a1737410eb3a => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:28:49.430143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:49.455475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:49.464476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:49.464476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:49.519832 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] Creating event network-changed:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:28:49.538338 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f0b8271a-7f44-4c8a-9d5b-5c9cac34f6e0 req-fd80aad9-fb49-45fc-931d-a152effaeafb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127398 Oct 04 18:28:49.539716 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2524/5031] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:50.263222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:50.267720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:50.275266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:50.275821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:50.276360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:50.276959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:50.277749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:50.277901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:50.908966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:50.920349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a317ac1-0f15-4a19-8d9b-86fb606b101d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.664900 Oct 04 18:28:50.935713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2525/5032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:50 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:51.959149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.960533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.977747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.981010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.986074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.989297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.991714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.993924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.648941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:52.672952 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fada632-3787-4bba-a71b-c6ce01fac992 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.731805 Oct 04 18:28:52.678621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2526/5033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:52.695147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:52.730307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:52.734257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.738403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.738403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.784543 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] Creating event network-changed:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:28:52.806313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2449b5e9-18cb-415c-b897-4a1bfb5e2a34 req-1b03b2a1-fdd4-439f-8a0d-8072c662b680 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124021 Oct 04 18:28:52.809639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2527/5034] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:52.838698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:52.853215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:52.867340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.867885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.868338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.869074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.869541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.869974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.925752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8a7efb0-cf7e-45ab-8a6f-1b19e410e81b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114530 Oct 04 18:28:52.942987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2528/5035] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:28:52 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:52.954760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:52.955272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:52.969347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.973058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.973058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.973058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.973058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.973058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.044016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3cb4a92d-8163-4f61-8207-98cc4b75fe23 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8" status: 200 len: 194 microversion: 2.1 time: 0.099709 Oct 04 18:28:53.053509 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2529/5036] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 4 18:28:52 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:53.145150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:53.709202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:53.709824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:53.733141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.734346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.734790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.735618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.736082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.736518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:54.958151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:54.958151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59103c6b-9c78-4e5f-8afb-71cc1b353eb3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 1.254213 Oct 04 18:28:54.972890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2530/5037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:53 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:55.986088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:55.990917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:56.007091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.012178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.014512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.019419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.023595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.025244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.635885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:56.646672 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25e5580e-2452-4e2d-8c0b-10185a13d010 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.665084 Oct 04 18:28:56.659867 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2531/5038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:55 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:56.668419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01012ac2-39a8-415d-bbbf-b4a08fc45948"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:56.682534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:56.693266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.694184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.694861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.695902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.696575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.704163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.428131 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5b45bfc-20d2-46ba-b7e5-ae92238d371c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1412 microversion: 2.1 time: 14.150287 Oct 04 18:28:57.430607 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2508/5039] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:43 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1412 bytes in 14154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:57.676575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:57.677188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:57.687600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.688103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.688579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.689262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.700039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.700540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.835137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c1712b8-df79-4fbe-8a5a-5ecd827a88f2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "POST /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.173505 Oct 04 18:28:57.836196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2532/5040] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:28:56 2022] POST /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:58.473959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18ace712-28e3-4ba9-a7c1-9f1d704a938d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90090b4790>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.600603 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18ace712-28e3-4ba9-a7c1-9f1d704a938d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1421 microversion: 2.1 time: 0.138833 Oct 04 18:28:58.623681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2533/5041] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1421 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:58.678362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f45d178-b6cb-4e07-bc06-b0f2e5468eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009070a60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.776504 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f45d178-b6cb-4e07-bc06-b0f2e5468eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 200 len: 1421 microversion: 2.1 time: 0.102825 Oct 04 18:28:58.794691 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2534/5042] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:58.802952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.809813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afc3321d-e4d3-4907-ba76-46bc57962947 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900963e4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.815740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5b17f91-d117-460f-8086-6caf878c0059 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 1.143246 Oct 04 18:28:58.819149 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2509/5043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:57 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:59.845744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.847835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.876445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.885617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.885617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.885617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.910427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.916755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.742761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.766304 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-980708af-cf24-40f3-9ee6-5c2935436bdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.927629 Oct 04 18:29:00.770870 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2510/5044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:00.942988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afc3321d-e4d3-4907-ba76-46bc57962947 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 204 len: 0 microversion: 2.1 time: 2.146641 Oct 04 18:29:00.943648 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2535/5045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:58 2022] DELETE /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 0 bytes in 2148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:00.952452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.953046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.968189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.976816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.980527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.981543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.984999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.988155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.064903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:01.550889 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ff6f8ad-55c0-4596-9e13-2d7f7b473b6b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 204 len: 0 microversion: 2.1 time: 0.602468 Oct 04 18:29:01.553358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2511/5046] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:00 2022] DELETE /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:29:01.796050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.797047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:01.818627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.822303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.824873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.825828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.832947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.833471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.843722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1752317142", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "44b242be-ac7c-410a-8774-aa97ed4572a1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:01.977692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] validate_networks() for [('44b242be-ac7c-410a-8774-aa97ed4572a1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:02.065218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.077354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-842bd516-0fef-464a-9e6c-b6ffb2830988 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.285822 Oct 04 18:29:02.078913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2536/5047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:02.170138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f657fba-0160-42bb-9416-b2db74a900ed", "name": "network-vif-unplugged", "status": "completed", "tag": "231dca9b-588d-4463-94ec-4322117b1216"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:02.204855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.205779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.208344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.243713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] Creating event network-vif-unplugged:231dca9b-588d-4463-94ec-4322117b1216 for instance 3f657fba-0160-42bb-9416-b2db74a900ed on n-h2-833090-21 Oct 04 18:29:02.256609 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-35f004f3-4f64-4096-bba7-b2816b1ea90b req-d26dee83-bc5a-4e9c-b3c6-a007c521d2c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092180 Oct 04 18:29:02.259351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2537/5048] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:03.105410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.106126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.125422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.125935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.126386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.137522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.138038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.138488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.507534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.532486 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f67abc1a-16f3-4edf-bd01-58dbb67bdd41 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.418639 Oct 04 18:29:03.547211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2538/5049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:04.569061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.570642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.588887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.591009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.591773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.595047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.597298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.600098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.107743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:05.120017 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0ac45b6-0ef3-412f-9651-6ef875aa0abd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.559027 Oct 04 18:29:05.127515 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2539/5050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:06.146409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.152191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.153060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:06.182452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:06.185001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:06.185508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:06.186844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:06.187378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:06.193545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.194064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.208303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.209158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.209919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.210362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.222441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.222949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.231129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.231129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.231129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.231449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.325961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:06.364447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for user 8553f76d0f804314b29e82142e728c71 and project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:06.426063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:06.437327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:06.667706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.679937 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbaa079e-41da-46fd-b00f-e2a19f1c4d34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.535523 Oct 04 18:29:06.680968 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2540/5051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:06.696582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7605f130-83b6-4263-b75f-0fe0ef9cbd9b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.860211 Oct 04 18:29:06.707864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2512/5052] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:06.711619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97a4cae1-5b61-4252-bc67-de8066d574c9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.712561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97a4cae1-5b61-4252-bc67-de8066d574c9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.794401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97a4cae1-5b61-4252-bc67-de8066d574c9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.809093 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97a4cae1-5b61-4252-bc67-de8066d574c9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1208 microversion: 2.1 time: 0.101662 Oct 04 18:29:06.810878 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2541/5053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:07.691607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f657fba-0160-42bb-9416-b2db74a900ed", "name": "network-vif-deleted", "tag": "231dca9b-588d-4463-94ec-4322117b1216"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.714683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.716509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:07.725728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.726219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.726651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.746708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.747540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.748151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.749630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.750255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.753000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.802515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] Creating event network-vif-deleted:231dca9b-588d-4463-94ec-4322117b1216 for instance 3f657fba-0160-42bb-9416-b2db74a900ed on n-h2-833090-21 Oct 04 18:29:07.824724 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-72fbd419-7d8e-4c12-acf2-3cc93c23176e req-54ab635e-6c65-4e0d-9d09-70d01f8d3e19 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138547 Oct 04 18:29:07.827833 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2513/5054] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:07.861711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3b11f96-53af-4539-a189-aeeb53e57d68 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.862436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3b11f96-53af-4539-a189-aeeb53e57d68 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.292509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:08.307700 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d30253c-42a2-45b9-8c9f-0b1f12a7640a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.600124 Oct 04 18:29:08.313010 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2542/5055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:08.501466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3b11f96-53af-4539-a189-aeeb53e57d68 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:08.511830 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3b11f96-53af-4539-a189-aeeb53e57d68 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1208 microversion: 2.1 time: 0.674373 Oct 04 18:29:08.513747 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2514/5056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1208 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:09.357601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:09.384086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:09.468818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.473014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.478805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.484184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.491640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.492977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.629955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.769367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.783284 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69e2ee84-f52d-49d1-995c-7a06b16ec683 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1212 microversion: 2.1 time: 0.244878 Oct 04 18:29:09.786629 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2515/5057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:09 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1212 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:09.925028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.935703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de7cdcf9-360b-4d47-b39f-ccbeb14b1b77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.599937 Oct 04 18:29:09.955231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2543/5058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:09 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:10.814027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.814027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.837547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.839755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.840219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.843993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.847005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.847905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.965816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.966434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.980188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.982716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.983801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.984538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.985770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.988341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.043812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:11.066821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:11.077283 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7771b959-7763-4dff-876c-8aadb3cf4411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1260 microversion: 2.1 time: 0.267674 Oct 04 18:29:11.083669 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2516/5059] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:11.274595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:11.287681 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7eda4a90-7d92-45a5-b2ad-4788a75915df tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.326003 Oct 04 18:29:11.288561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2544/5060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:12.105598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:12.106332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:12.116214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.116776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.117218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.121344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.123103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.124166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.235150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:12.247626 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b86d5c56-9f9c-4ec0-8211-7e41dc201448 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1278 microversion: 2.1 time: 0.145455 Oct 04 18:29:12.252365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2517/5061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:12 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:12.314828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:12.315709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:12.326743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.337708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.338253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.339549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.340049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.340475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.865404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:12.884263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5547e76c-a814-4f53-98df-072d19efe620 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1683 microversion: 2.1 time: 0.570359 Oct 04 18:29:12.889580 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2545/5062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:12 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1683 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:13.274502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.275348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.287087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.292761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.296031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.296031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.296031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.296031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.709798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:13.738821 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a45a310-411f-4310-bc49-dfd3004124a6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.447912 Oct 04 18:29:13.740815 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2518/5063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:13.933024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.939829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.949201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.950278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.952419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.953449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.954066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.954647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:14.222221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:14.250412 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37153cff-d02b-41a4-9b49-41754467addf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.340517 Oct 04 18:29:14.262490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2546/5064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:14.770540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:14.771179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:14.791483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.816509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.816982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:14.820809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.822303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.822774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.876280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:15.890090 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a84a3431-174b-430b-bd7b-72130e2ff504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 1.123793 Oct 04 18:29:15.894317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2519/5065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:14 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:16.519998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.520616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:16.533911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.534406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.534849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.535589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.536050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.536475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.565799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:16.694982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2021732607", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:16.780851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] validate_networks() for [('892ecb78-5ea0-44aa-bece-f424f822f8d0', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:16.802216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:17.091136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:17.105015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15ff93ba-37fa-4db2-bf88-af80509fbb3d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.588755 Oct 04 18:29:17.107205 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2547/5066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:17.146711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.147337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.165145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.168823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.169516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.171070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.172442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.173418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.504530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:17.522228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5420859c-123b-4dc5-aa57-7df374970da6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.413743 Oct 04 18:29:17.523933 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2548/5067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:17.529117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57c4dc-9480-43c6-a7b1-eca0b253568a", "tag": "28d1a464-4023-4222-82c6-8ad16dae602f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:17.588970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.589744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.590431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.623882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] Creating event network-changed:28d1a464-4023-4222-82c6-8ad16dae602f for instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a on n-h2-833090-21 Oct 04 18:29:17.633695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4f246a8e-99ce-4c66-b615-ac3bcb8ca6e5 req-61b05a0c-5463-468b-980a-2efbb5227068 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105689 Oct 04 18:29:17.638587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2549/5068] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:17.645134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.650808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.676760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.765610 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd258e2a-4ab7-47fc-9425-5153ee05854e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.124890 Oct 04 18:29:17.770641 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2550/5069] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:17.908863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.909280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.916384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.916505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.921549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.922803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.924796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.925438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.003555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08feac81-0be2-4c64-950e-cf45d19fa547 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8" status: 200 len: 194 microversion: 2.1 time: 0.098731 Oct 04 18:29:18.005067 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2551/5070] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:18.021730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.022919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:18.031142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.031969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.033071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.034011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.034686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.035282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.072822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:18.074258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:18.074884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:18.075457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:18.076036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:18.086454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.087246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.088202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.089107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.089726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.093810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.116230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Getting quotas for project d0e754b46e4a4276a4981f5e8c1b3d4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:18.125645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Getting quotas for user 871e8e873fae44238af5e724fe0c0bbd and project d0e754b46e4a4276a4981f5e8c1b3d4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:18.147721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:18.154008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:18.186750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lazy-loading 'services' on Instance uuid 91487e9f-016c-4ede-b666-50974c0dbca3 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:18.417185 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91036df9-d2de-4853-b4d7-9f98d265e6b6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858198 Oct 04 18:29:18.442532 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2520/5071] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:29:18.464954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8772d3bc-5a17-486a-b44d-88f8a5164c34 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.464954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8772d3bc-5a17-486a-b44d-88f8a5164c34 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:18.564265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-160e3054-4332-4e6f-ad1c-1e9b5ef716c9 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8" status: 202 len: 0 microversion: 2.1 time: 0.534009 Oct 04 18:29:18.578436 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2552/5072] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:29:18 2022] DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/863ea27f-4e06-4060-b5cd-0edf46bdbfc8 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:18.585558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-unplugged", "status": "completed", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:18.603656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8772d3bc-5a17-486a-b44d-88f8a5164c34 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:18.611687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8772d3bc-5a17-486a-b44d-88f8a5164c34 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1217 microversion: 2.1 time: 0.162332 Oct 04 18:29:18.635830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2521/5073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:18.642584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.643206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:18.667006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.667006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.667405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.667806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.674416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.674881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.675683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.676112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.676544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.749898 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] Creating event network-vif-unplugged:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:29:18.789991 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-eb92870a-ab7f-4be6-87a2-cb299d8f2119 req-4825b531-f513-4f88-959a-6b01d7624768 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204336 Oct 04 18:29:18.794178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2553/5074] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:18.979926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:18.993372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-daaf090f-41bd-492d-bda4-0868326920b5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.356334 Oct 04 18:29:18.994857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2522/5075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:19.637822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dccdbe41-6d2d-4c6a-b908-8e60bb06b332 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.639546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dccdbe41-6d2d-4c6a-b908-8e60bb06b332 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.766172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dccdbe41-6d2d-4c6a-b908-8e60bb06b332 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.778183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dccdbe41-6d2d-4c6a-b908-8e60bb06b332 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1217 microversion: 2.1 time: 0.142902 Oct 04 18:29:19.782539 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2554/5076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:20.021295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:20.022620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:20.031842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.034217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.034217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.034217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.034747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.035203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.481983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:20.485314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de0cb66c-acdd-4cbe-8d4a-911ff61f7d63 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.467739 Oct 04 18:29:20.486536 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2523/5077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:20 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:20.814981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:20.820475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:20.837753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.839860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.841795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:20.849353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:20.851617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:20.852077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.279845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:21.293654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f710a322-0a49-4226-a6e6-2940cca0a789 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1221 microversion: 2.1 time: 0.492796 Oct 04 18:29:21.294242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2555/5078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:20 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1221 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:21.395803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.396419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.410176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.420721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.425187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.425187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.425187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.425187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.510843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.511457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.528806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.529881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.530320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.531023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.531499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.531915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.817074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:21.836458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e7450c6-1419-48f4-900e-4637a2fd336b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.443783 Oct 04 18:29:21.837068 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2524/5079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:21.864871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:21.865879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:21.880217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.882789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.883534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:21.884635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:21.885200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:21.886620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.200504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.213441 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef65954e-3893-4613-a06b-5397449ad5c7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.353639 Oct 04 18:29:22.232931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2525/5080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:22.247195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.248643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.262590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.265279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.268923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.270043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.272051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.272737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.395425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.399014 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e51b48a1-adb1-4032-8d9a-259a31962f66 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.892215 Oct 04 18:29:22.406853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2556/5081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:21 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:22.412025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:22.416625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.435293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.436486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.436941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.437640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.438283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.438871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.635980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.664094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c230363f-a298-4261-9247-32c2fa7c4844 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.420914 Oct 04 18:29:22.668342 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2526/5082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:22.706646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:22.710154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:22.719955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0972e3f-e6f5-4fb5-99f5-dcb05d420254 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1269 microversion: 2.1 time: 0.306725 Oct 04 18:29:22.721001 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2557/5083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:22 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1269 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:22.747910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:22.776230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.781348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.782020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.783760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:22.785300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:22.785964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:22.995632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:23.252615 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22d4e3f3-4049-44bd-892f-bf4d59a1f379 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.555048 Oct 04 18:29:23.253292 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2527/5084] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:22 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:23.283152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:23.284033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:23.312355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.316382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.316382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.322823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.323891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.324582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.434361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:23.435457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:23.440288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:23.451708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.453888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.458523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.458523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.459132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.461287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.849667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:23.857906 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-085cea6b-cba3-4393-845f-8a048dd1f217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1672 microversion: 2.1 time: 0.600307 Oct 04 18:29:23.873346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2558/5085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:23 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1672 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:23.873487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:23.874112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:23.892595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.894407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.901191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:23.901191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:23.901191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:23.901683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.214919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.238467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c88d68c-cc5c-4c32-8186-f84057bee3cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1287 microversion: 2.1 time: 0.372867 Oct 04 18:29:24.251673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2559/5086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:23 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1287 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:24.809967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.822094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e77afcc8-493e-4754-b6f2-b7b645ed11ba tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 1.393755 Oct 04 18:29:24.823566 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2528/5087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:23 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:24.885855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:24.886965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:24.896572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.897037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.897545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.898342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.898786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.899224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.087028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:25.096697 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3e3f2827-b96f-4a6c-974d-6f9f25d9a1eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1672 microversion: 2.1 time: 0.215151 Oct 04 18:29:25.096858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2560/5088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:24 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.267184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.267971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.275723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.276429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.277067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.278006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.278626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.279773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.387658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:25.409234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-270e4039-7dab-4f8e-bd9a-c69643c70d5e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1275 microversion: 2.1 time: 0.146264 Oct 04 18:29:25.412294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2529/5089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:25.848912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:25.849790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:25.860523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.860523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.860523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:25.861359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:25.862007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:25.862688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.110616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.123741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbb02d54-acd5-4c67-92eb-70d26dac31dd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.274926 Oct 04 18:29:26.123741 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2561/5090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:25 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:26.124046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.124046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.131368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.131991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.132506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.135610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.136201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.136749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.397971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57c4dc-9480-43c6-a7b1-eca0b253568a", "name": "network-vif-plugged", "status": "completed", "tag": "28d1a464-4023-4222-82c6-8ad16dae602f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:26.424876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.436490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.440925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.465565 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] Creating event network-vif-plugged:28d1a464-4023-4222-82c6-8ad16dae602f for instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a on n-h2-833090-21 Oct 04 18:29:26.472128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.476329 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a4e29fb3-c612-4ca9-a4a2-fb06669b481d req-c8a0458b-0c6c-49cf-be26-eed285ca277a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082201 Oct 04 18:29:26.481060 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2562/5091] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:26.485211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42044992-c745-4e22-b948-2d0da5475a5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1672 microversion: 2.1 time: 0.368389 Oct 04 18:29:26.485675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.486641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.488726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2530/5092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1672 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:26.494287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.494792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.496155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.496909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.497568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.498752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.559980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:26.847260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.860220 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c79b4b02-ea77-410e-9b27-bd2c8a10f317 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.381377 Oct 04 18:29:26.861107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2563/5093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.145354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.145978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.153526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.154875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.155316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.156113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.168390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.168772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.470970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.480081 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-26af5a03-82ed-4ba2-93dd-ecd4d7f2cdf6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.338707 Oct 04 18:29:27.480684 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2531/5094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.516284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.517545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.524486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.532854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.532854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.532854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.532854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.532854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.668631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:27.690545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.691394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.692072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.720492 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] Creating event network-changed:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:29:27.733315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6a57e329-276a-42f1-a93b-6beaff848542 req-6deffce2-51d9-4148-8d2e-7d2bb1e53a8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067741 Oct 04 18:29:27.734329 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2532/5095] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:27.886279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.896364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.905126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.906028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.906759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.907744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.908771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.909562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.106557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:28.188014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.214056 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce556211-2fb7-4ac8-9333-83131728e313 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.333638 Oct 04 18:29:28.218666 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2533/5096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:28.236606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.245209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90d60ef9-01b5-4dbe-a345-92859132c9f5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.734057 Oct 04 18:29:28.246336 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2564/5097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:28.278565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:28.278565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.286717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.287218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.287782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.288767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.289760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.290197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.437204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b40e5f1-71d5-4811-a505-b00aa365311a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 200 len: 324 microversion: 2.1 time: 0.168955 Oct 04 18:29:28.438763 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2534/5098] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:28 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:28.449621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.450688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.467422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.508086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.508903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.527178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.527999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.528450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.529730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.530199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.530890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.608504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:28.698701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.723667 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f5d46f8-a6b6-437a-92e0-0564cc685e19 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.278918 Oct 04 18:29:28.725704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2565/5099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:28.756365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.765300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.781483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.790867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.791434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.797360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.798080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.798717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.851640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:28.861183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ebede36-95d0-418f-b844-8d401a70a768 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1308 microversion: 2.1 time: 0.358768 Oct 04 18:29:28.861820 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2535/5100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:28.946982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.947540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.964916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.965462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.965865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.967111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.967594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.968020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.052684 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-079cadce-6b40-49d2-a875-f52f3b8d3006 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/01012ac2-39a8-415d-bbbf-b4a08fc45948" status: 200 len: 194 microversion: 2.1 time: 0.109647 Oct 04 18:29:29.053930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2536/5101] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/01012ac2-39a8-415d-bbbf-b4a08fc45948 => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:29.068852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.069448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.075796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.079160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.079160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.079160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.079160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.079160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.139341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.151794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-32b0d8f4-c17b-49ba-94ea-2333a7e7c0a9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.399320 Oct 04 18:29:29.152404 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2566/5102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.180537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.188466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.188713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lazy-loading 'services' on Instance uuid 91487e9f-016c-4ede-b666-50974c0dbca3 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:29.191312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.191867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.192380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.193625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.194141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.194729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.462434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.468170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0e55832-04cf-4958-b277-2bb85e9fdd3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.294101 Oct 04 18:29:29.469022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2567/5103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:29.474812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.475889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.485053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.485723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.486367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.491770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.492460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.493076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.637791 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bb72fa4-f255-4d14-ad01-cce9556f3936 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/01012ac2-39a8-415d-bbbf-b4a08fc45948" status: 202 len: 0 microversion: 2.1 time: 0.576767 Oct 04 18:29:29.639503 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2537/5104] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:29:29 2022] DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments/01012ac2-39a8-415d-bbbf-b4a08fc45948 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:29.668728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.669585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.679779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.681295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.681837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.682728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.683369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.684062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.690786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.702010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57220d44-d39e-4caa-9502-b93290e23bf1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.231191 Oct 04 18:29:29.703490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2568/5105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.892071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:29.892736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:29.899140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:29.901255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.906820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.906820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.906820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:29.906820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:29.906820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.956949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.966258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-644ac5d7-67e8-49b0-81c3-42cee194c21e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.324706 Oct 04 18:29:29.967611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2538/5106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:30.112716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1613799439", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "615cdc98-a3fe-4da3-8339-6361f3daab74"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:30.131382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:30.139041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33a9db5e-56f8-4a6c-8589-71b3bc0b4fdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1488 microversion: 2.1 time: 0.256676 Oct 04 18:29:30.139827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2569/5107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:29 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1488 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:30.163764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:30.164296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.171033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.171557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.172003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.172908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.178480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.178480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.179601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] validate_networks() for [('615cdc98-a3fe-4da3-8339-6361f3daab74', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:30.200082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lazy-loading 'flavor' on Instance uuid 6b57c4dc-9480-43c6-a7b1-eca0b253568a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:30.598630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f033b60-2739-4ea9-918e-a7b7540f90d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a/action" status: 202 len: 0 microversion: 2.1 time: 0.438842 Oct 04 18:29:30.599855 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2570/5108] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:30 2022] POST /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:29:30.616657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.622094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.637229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.648739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.651208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.651208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.651208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.651208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.693291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.707516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.708397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.708674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.709477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.710090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.734513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:30.745939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:30.763892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:30.766707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:30.996571 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9257387a-1473-49af-80e4-1c56c073b11c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887729 Oct 04 18:29:31.006010 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2539/5109] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:29:31.011337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.040144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.049533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.050030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.050466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.052105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.052824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.053263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.142877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.155043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5815059-f559-4ee2-abf0-f303c26a6fae tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1496 microversion: 2.1 time: 0.545061 Oct 04 18:29:31.156317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2571/5110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1496 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.201372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1ae59e6-e5a0-47b5-9720-b61422cb23b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.204901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1ae59e6-e5a0-47b5-9720-b61422cb23b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.342096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1ae59e6-e5a0-47b5-9720-b61422cb23b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.355451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.361482 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1ae59e6-e5a0-47b5-9720-b61422cb23b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1215 microversion: 2.1 time: 0.183495 Oct 04 18:29:31.364488 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2572/5111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:31.365897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6092a587-6c69-4856-84cd-abeb77445ce8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.358421 Oct 04 18:29:31.368304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2540/5112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:32.187633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.188900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.216586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.217686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.218398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.219942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.220709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.221353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.388362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21c22c8a-0cfa-4181-ab08-e3762f435b0a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.389896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21c22c8a-0cfa-4181-ab08-e3762f435b0a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.476661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:32.493201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2a4bf8a0-9e03-428d-9173-72296095d86a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 200 len: 1479 microversion: 2.1 time: 0.310824 Oct 04 18:29:32.494628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2573/5113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 1479 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:32.500865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.501759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.509125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.510195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.510790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.512352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.512973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.513649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.717781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21c22c8a-0cfa-4181-ab08-e3762f435b0a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:32.726512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21c22c8a-0cfa-4181-ab08-e3762f435b0a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1215 microversion: 2.1 time: 0.342129 Oct 04 18:29:32.734496 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2541/5114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:32.743208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1664978881"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:32.745684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.773080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.774037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.774680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.775670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.776314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.776922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.816316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:32.856541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6b9e372-7b90-46e5-9c44-cd941508245c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.358249 Oct 04 18:29:32.858454 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2574/5115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:33.519058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df62b105-b483-4c6f-95d4-329e677ba406 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a/action" status: 202 len: 0 microversion: 2.1 time: 0.783148 Oct 04 18:29:33.520744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2542/5116] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:32 2022] POST /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a/action => generated 0 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:29:33.544048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-660fd67f-8384-4fd0-aabb-a44b1cabbbe7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009673af0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.682697 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-660fd67f-8384-4fd0-aabb-a44b1cabbbe7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.112251 Oct 04 18:29:33.702043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2575/5117] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:33.755403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.756259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:33.765829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.770253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.770980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.772040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.772735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.775354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.903155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.904643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:33.944844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.952451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:33.972016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.973028 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aedb31ce-9217-4753-81a1-1b6717fb6947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1267 microversion: 2.1 time: 0.222697 Oct 04 18:29:33.974104 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2543/5118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:33.975898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:33.976979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.978231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.979954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.340425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:34.354791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e9238c1-39b9-4b77-925c-327726a171f3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.471323 Oct 04 18:29:34.355729 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2576/5119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:34.699845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3994ad0-569d-4fd6-ad41-3614d903bb2a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008b09430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:34.775925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3994ad0-569d-4fd6-ad41-3614d903bb2a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.079910 Oct 04 18:29:34.777151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2544/5120] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:34 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:35.001647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:35.002392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:35.018475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.018989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.020554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.029281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.029281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.030414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.147834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:35.156725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c66d224-e2ae-4f7d-a359-f31d75b10033 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1275 microversion: 2.1 time: 0.159908 Oct 04 18:29:35.157322 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2577/5121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:34 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:35.379135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:35.380277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:35.396098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.398069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.399121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.420800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:35.423844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:35.435004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.435004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:35.792840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86a309b7-7785-4791-9a17-f8a882c43549 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90097a0280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:35.879266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86a309b7-7785-4791-9a17-f8a882c43549 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.090189 Oct 04 18:29:35.880220 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2578/5122] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:35 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:36.180999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.182517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:36.197646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.198479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.200367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.201599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.204088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.204878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.214613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:36.226227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48c5fe29-b5b6-41e9-b7da-da7a94b7b745 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.850743 Oct 04 18:29:36.228341 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2545/5123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:35 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:36.444329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:36.469288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d712f71-ba32-4511-b532-422bcb50ee0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1273 microversion: 2.1 time: 0.292470 Oct 04 18:29:36.482345 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2579/5124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:36.899978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f02e713-b08b-4176-8b6d-98b1a197c7a5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083e21f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.971852 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f02e713-b08b-4176-8b6d-98b1a197c7a5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.075157 Oct 04 18:29:36.973094 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2546/5125] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.266870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.266870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.288796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=82 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:37.295094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.297127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.303445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.304750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.315382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.315382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.519158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.700020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.716171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25fd3c0d-8100-414b-99d5-f76e621de79d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.463587 Oct 04 18:29:37.717153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2580/5126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:37.722804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.726597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.742927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.742927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.748358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.749912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.753406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.753902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.807166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:37.844577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.854669 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98753711-3e5b-4c4c-aef9-373eff7be8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.357471 Oct 04 18:29:37.863696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9139325-294f-4fe7-b91a-6f108d114aa2 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145378 Oct 04 18:29:37.865111 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2581/5127] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:29:37.877897 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2547/5128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.991952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-666cb30b-4cb1-4aa1-8d86-57f4cd74ad48 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1b4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.032720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.035011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.045253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.045775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.046204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.046924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.047386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.047848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.105642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee84f44f-39f5-47c7-84c0-2934c0b38697 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080351 Oct 04 18:29:38.106233 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2548/5129] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:29:38 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:29:38.112490 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-666cb30b-4cb1-4aa1-8d86-57f4cd74ad48 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.124973 Oct 04 18:29:38.112490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2582/5130] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:38.226015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.233443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.253200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.253854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.255189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.256380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.257191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.258110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.300550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:38.741519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.743184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.753233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72060638-76ac-49cf-b5fa-589f7345eaf1 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 204 len: 0 microversion: 2.1 time: 0.531908 Oct 04 18:29:38.757775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2583/5131] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:38 2022] DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:29:38.758981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.759901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.768724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.768724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.768724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.768724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.776684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.777671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.786265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.787030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.787746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.788756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.789446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.790182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.947593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:38.961148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2cd6d9f-0b35-44f2-bd05-e21b1394d6a5 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1674 microversion: 2.1 time: 0.188852 Oct 04 18:29:38.961982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2584/5132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:38 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:38.970407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "name": "network-vif-plugged", "status": "completed", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:39.000141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.001526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.002145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.020740 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] Creating event network-vif-plugged:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:29:39.031029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-24c5b208-0d87-4462-acd9-ae9add7de0f7 req-edc8235a-1b53-48fa-b74e-036c9b4dab1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065101 Oct 04 18:29:39.031970 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2585/5133] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:39.043636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.045454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:39.054596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.055349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.056044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.057606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.058244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.058893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.136909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:39.145569 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d16f53c3-668a-4b7e-8135-8b75c4d52d0f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.410838 Oct 04 18:29:39.146725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2549/5134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:38 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.159251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23db2b41-a6ab-4619-a2ac-4307a61fad3f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009bc8820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.212152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23db2b41-a6ab-4619-a2ac-4307a61fad3f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.063678 Oct 04 18:29:39.222644 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2550/5135] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.342560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13960ef-ac3e-45ff-b7e9-3c56cc5389c0", "tag": "9db33b50-27d6-40f6-ac37-4fbbe741885d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:39.364649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.366241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.366857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.388572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] Creating event network-changed:9db33b50-27d6-40f6-ac37-4fbbe741885d for instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 on n-h1-833090-21 Oct 04 18:29:39.394786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7a4b10dc-ee0a-4497-8a7b-d3352e15a5d8 req-19a30ce1-b039-4ce1-870b-ddf850d52500 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057917 Oct 04 18:29:39.396923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2551/5136] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:39.478411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:39.487387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90745245-5aee-4b6a-b695-f742d3ecc59b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.452557 Oct 04 18:29:39.488020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2586/5137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.990112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.990903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.023353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.029656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.030344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.033346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.033512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.033965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.183340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.183340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.183340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.183340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.183340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.198924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.202556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.203225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.434691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.444314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e541160a-2c07-475d-9c27-c6d0db207ad0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1317 microversion: 2.1 time: 0.277833 Oct 04 18:29:40.475730 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2587/5138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:40.487994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68656941-1ac0-4d0f-a518-0e72446e2c81 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90096baee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.546505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68656941-1ac0-4d0f-a518-0e72446e2c81 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.069324 Oct 04 18:29:40.547771 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2588/5139] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.553623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.554509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.565687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.566192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.566638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.567848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.568308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.568918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.722668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:40.734397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.743373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de9b75c7-8118-4514-858e-78bc13fa9903 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.194293 Oct 04 18:29:40.744006 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2589/5140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.798012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.809241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b59755bc-fcfb-4e41-972c-45231f2c7c28 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1674 microversion: 2.1 time: 0.825890 Oct 04 18:29:40.811164 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2552/5141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1674 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:41.102779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57c4dc-9480-43c6-a7b1-eca0b253568a", "name": "network-vif-plugged", "status": "completed", "tag": "28d1a464-4023-4222-82c6-8ad16dae602f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:41.123667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.124468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.125154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.139406 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] Creating event network-vif-plugged:28d1a464-4023-4222-82c6-8ad16dae602f for instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a on n-h2-833090-21 Oct 04 18:29:41.152435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b3def206-6ef5-41d4-8bfb-c2f32c9d63e6 req-7226ccf4-3feb-4bff-a004-7616a2d5a1f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046554 Oct 04 18:29:41.152435 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2590/5142] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:41.470215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.470892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.484650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.485065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.487359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.490326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.494442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.494442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.564755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:41.570946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d10c9c39-f56f-4e56-8438-d41cc857053a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900967cee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.641737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d10c9c39-f56f-4e56-8438-d41cc857053a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.078716 Oct 04 18:29:41.643305 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2591/5143] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:41.779173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.779976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.789680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.790168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.790799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.791722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.792345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.792941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.166485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.181773 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f2c0f60-26c7-4b30-8f39-a78964584e9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.714969 Oct 04 18:29:42.185731 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2553/5144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:42.190985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:42.194122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:42.210365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.210876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.211330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.214153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.214648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.215067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.230253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.251913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5243e587-a37d-4d4d-a21f-65e388c3b814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.478699 Oct 04 18:29:42.252978 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2592/5145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:42.412433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-316663258", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:42.514102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] validate_networks() for [('892ecb78-5ea0-44aa-bece-f424f822f8d0', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:42.640228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.655221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24b373cf-7413-4bd4-beed-e077f1987f63 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1674 microversion: 2.1 time: 0.466097 Oct 04 18:29:42.655900 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2554/5146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:42 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1674 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:42.671055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-581d495a-6949-40d6-9cf9-e12b859d0c70 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d42af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:42.726000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:42.752582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-581d495a-6949-40d6-9cf9-e12b859d0c70 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.094122 Oct 04 18:29:42.756627 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2555/5147] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:42 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.281169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.281794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.295355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.297695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.298378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.303048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.303885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.304659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.782653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.798916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91702be6-75a8-4f78-8139-9caa8e383866 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.520842 Oct 04 18:29:43.799559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2556/5148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.839618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.840239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.853627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.854068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.854506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.855219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.855714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.856127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.142499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:44.143549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:44.144223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:44.144827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:44.145430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:44.163111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.163999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.164611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.173768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.174576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.175195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.219599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Getting quotas for project d0e754b46e4a4276a4981f5e8c1b3d4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:44.226403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Getting quotas for user 871e8e873fae44238af5e724fe0c0bbd and project d0e754b46e4a4276a4981f5e8c1b3d4b. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:44.257037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:44.262160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:44.410050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:44.427068 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b623ddb6-5875-4065-a7af-5ffc42a12b3c tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1606 microversion: 2.1 time: 0.602358 Oct 04 18:29:44.427740 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2557/5149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1606 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:44.452169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-017ad660-0bdd-4272-9c71-ec0579f74fe9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083e21f0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.463168 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3ee0c080-9d77-4a4e-a736-33d96ea2b7be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054907 Oct 04 18:29:44.470735 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2593/5150] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:29:44.475947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91487e9f-016c-4ede-b666-50974c0dbca3", "name": "network-vif-deleted", "tag": "13749059-63b1-40a4-ba2a-2bff559dbfe2"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:44.490274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.491364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.492013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.505844 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] Creating event network-vif-deleted:13749059-63b1-40a4-ba2a-2bff559dbfe2 for instance 91487e9f-016c-4ede-b666-50974c0dbca3 on n-h2-833090-21 Oct 04 18:29:44.511664 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9e81ed96-f14f-4259-8c6c-b40951cbf876 req-3028d8a5-dd2b-4d5a-a0da-230ad40762b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039273 Oct 04 18:29:44.529249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2594/5151] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:44.539396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72dc10d2-91b7-426b-ab25-9a786caf9fb6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.540704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72dc10d2-91b7-426b-ab25-9a786caf9fb6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.552599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-017ad660-0bdd-4272-9c71-ec0579f74fe9 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.123739 Oct 04 18:29:44.559638 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2558/5152] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:44.790886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72dc10d2-91b7-426b-ab25-9a786caf9fb6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:44.804197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72dc10d2-91b7-426b-ab25-9a786caf9fb6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1216 microversion: 2.1 time: 0.272371 Oct 04 18:29:44.808460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2595/5153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1216 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:44.830339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.831582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.849368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.854516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.854516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.854964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.855908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.862327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.159580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.170760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b079d39c-a839-4834-92c1-33077b13eaf0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.345321 Oct 04 18:29:45.183501 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2559/5154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:45.456912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.459008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:45.489701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.493159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.495728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.500494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.501389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.502294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.570414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6433082-751a-42f8-9804-648a15d61395 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d48ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.622602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.626491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.627362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.633321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lazy-loading 'fault' on Instance uuid 91487e9f-016c-4ede-b666-50974c0dbca3 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:45.665587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6433082-751a-42f8-9804-648a15d61395 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.100828 Oct 04 18:29:45.666449 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2560/5155] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:45.838047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-763e7a42-1f87-40de-ae31-46b9f11d38d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.838047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-763e7a42-1f87-40de-ae31-46b9f11d38d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:45.874036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ba22151375420182b815277e8bd12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62fbdf1bd77d4482864a1e4e38bf4f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.889103 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfa53f64-a1ff-45cf-87aa-0414c863aad4 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 200 len: 1327 microversion: 2.1 time: 0.435532 Oct 04 18:29:45.890341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2596/5156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 1327 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:46.041973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-763e7a42-1f87-40de-ae31-46b9f11d38d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.051262 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-763e7a42-1f87-40de-ae31-46b9f11d38d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1216 microversion: 2.1 time: 0.221133 Oct 04 18:29:46.056108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2561/5157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:46.202435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.204241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.249175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.253150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.256784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.262697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.263295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.266716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.627448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.640810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f41fbd3-5d0c-48f6-a734-fe52e120b3aa tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.441678 Oct 04 18:29:46.643676 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2597/5158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:46.683259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-38e48e0f-7463-4ddf-8e57-063ebd0d7411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008d48940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.768813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-38e48e0f-7463-4ddf-8e57-063ebd0d7411 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.090478 Oct 04 18:29:46.778894 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2562/5159] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:46.913414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.914384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.925808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.936912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.936912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.939943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.940412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.940881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.984255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 HTTP/1.1 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '91487e9f-016c-4ede-b666-50974c0dbca3'} Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:46.989983 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:29:46.996650 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:29:47.001046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:47.003221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9881eae6-998c-4b37-a09f-62a768782810 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 404 len: 111 microversion: 2.1 time: 0.094591 Oct 04 18:29:47.004725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2598/5160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:47.013286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc12d0e9-d00a-4188-9b83-0675ec77096a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '.version_select at 0x7f9008402790>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.080495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.081976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.105997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.107930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.109167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.114576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.116424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.117759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.241896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc12d0e9-d00a-4188-9b83-0675ec77096a tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185720946" status: 202 len: 0 microversion: 2.1 time: 0.232533 Oct 04 18:29:47.242964 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2563/5161] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185720946 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:47.248860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.263826 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3462b94a-f51d-4032-9924-b2ee042689a2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1220 microversion: 2.1 time: 0.188437 Oct 04 18:29:47.264776 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2599/5162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:47.666452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.667416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.685600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.689452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.690244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.692311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.695571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.697509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.786954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f041f25-0744-4a19-bff3-4d2dced69a39 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008cc61f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.910108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f041f25-0744-4a19-bff3-4d2dced69a39 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.128192 Oct 04 18:29:47.912845 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2600/5163] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:48.183346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:48.209284 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d79966dd-1824-4eac-8c67-6f65c1ac3a8c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.545391 Oct 04 18:29:48.211377 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2564/5164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.289190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.290443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.313541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.314761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.316323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.318614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.319179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.320857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.471372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:48.483533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3192e18c-21dd-4444-9cb5-5a636d35e4aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1268 microversion: 2.1 time: 0.195245 Oct 04 18:29:48.484527 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2601/5165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.938206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a97bbc6e-9069-4f1f-8de2-4c452ee5e243 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008402ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.013730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a97bbc6e-9069-4f1f-8de2-4c452ee5e243 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.088910 Oct 04 18:29:49.022592 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2565/5166] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:49.240170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.240955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:49.259140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.259712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.260367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.261263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.261986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.262670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.517608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.517608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:49.526173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.526673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.527123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.534140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.535955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.536592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.573870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.594520 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16b59577-591e-4c93-a9a2-f92245f922db tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.358337 Oct 04 18:29:49.601725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2602/5167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:49 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:49.797438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.809236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c44339a1-8e99-40b1-95f8-13242a218f8d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1274 microversion: 2.1 time: 0.303000 Oct 04 18:29:49.825616 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2566/5168] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:49 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.045780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5065c261-5750-4a86-8aba-7cbdc2e22559 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1b8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.101352 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5065c261-5750-4a86-8aba-7cbdc2e22559 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.060826 Oct 04 18:29:50.102502 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2603/5169] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.317086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13960ef-ac3e-45ff-b7e9-3c56cc5389c0", "name": "network-vif-plugged", "status": "completed", "tag": "9db33b50-27d6-40f6-ac37-4fbbe741885d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:50.348640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.369561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.369561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.399054 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] Creating event network-vif-plugged:9db33b50-27d6-40f6-ac37-4fbbe741885d for instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 on n-h1-833090-21 Oct 04 18:29:50.420603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-77144b43-9965-469e-a75c-0dc226bdf346 req-a4f85492-f611-4b01-8339-be2469e78cc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105082 Oct 04 18:29:50.424478 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2567/5170] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:50.648896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.651525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.672322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.675551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.676422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.677554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.678204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.678802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.838074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.838808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.864590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.870481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.871416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.875143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.876395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.877032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.056742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:51.075400 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85b4af44-c092-49ff-9fe4-70fdfd113e8a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1274 microversion: 2.1 time: 0.242567 Oct 04 18:29:51.087522 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2568/5171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:51.109951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:51.119996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99752c7f-114e-4c0f-8bc8-e2423b7bef87 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008402f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:51.139685 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-11885c1d-9bdc-45da-a847-67e93e1f59c2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.490843 Oct 04 18:29:51.140375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2604/5172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:51.215916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99752c7f-114e-4c0f-8bc8-e2423b7bef87 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.102007 Oct 04 18:29:51.224949 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2569/5173] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:51 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.109847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.111178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:52.134584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.136510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.140304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.143737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.144535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.145563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.162313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.164085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:52.182928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.191493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.192165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.193137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.196172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.200966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.244187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:52.561236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.616619 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c1da2d1-a650-4a51-bfae-94188419c357 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.519284 Oct 04 18:29:52.620138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2605/5174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.627818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-495a8373-abd8-4063-b406-1457490b6504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900d81edc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.658217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.669540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd43a227-d4f9-4826-b5c7-4f3d900ca4b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1315 microversion: 2.1 time: 0.511114 Oct 04 18:29:52.674916 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2570/5175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.711975 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-495a8373-abd8-4063-b406-1457490b6504 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.089497 Oct 04 18:29:52.713231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2606/5176] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:53.647848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.649962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.673092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.673601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.674055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.687791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.688430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.688900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.709299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.709876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.743680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.744202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.752566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.755840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.756347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.780107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.186158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:54.252585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:54.269019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d5af5ab-1a5b-4d61-8a18-ae503a735fbd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1502 microversion: 2.1 time: 0.562173 Oct 04 18:29:54.270786 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2607/5177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1502 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:54.285851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f93622c1-8775-4cf3-8f78-9fbb651b8c69 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009070ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.289303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:54.305297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcb3b411-e32b-400c-aed8-4682ae2fbbdf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.662617 Oct 04 18:29:54.306448 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2571/5178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.314580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:54.321618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.322588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.323194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.357983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:29:54.378988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f93622c1-8775-4cf3-8f78-9fbb651b8c69 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.106256 Oct 04 18:29:54.382410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:54.388952 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2608/5179] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.576851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2a11fc7-9a68-4a14-bdae-c1d360b30afe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0/action" status: 202 len: 0 microversion: 2.1 time: 0.268636 Oct 04 18:29:54.577948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2572/5180] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:54 2022] POST /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:29:54.586833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.587524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:54.604618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.605130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.605578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.606337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.614349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.616253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.797654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:55.343961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:55.354371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:55.393672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.395042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.395730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.396649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.399946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.405635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.787324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.802320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef11609b-d46a-4e26-b9d3-d797196ff6a9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.473453 Oct 04 18:29:55.803504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2573/5181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:55 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:55.814464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d06861d-ea93-4a35-b4e7-c47e8c0aecdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008442d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:55.838148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.866101 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb1b61c5-ad65-4e5e-ac56-bda1a7825aad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 1.283226 Oct 04 18:29:55.868010 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2609/5182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:55.891281 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d06861d-ea93-4a35-b4e7-c47e8c0aecdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.086235 Oct 04 18:29:55.892323 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2574/5183] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:55 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:55.909741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e444745-ea56-4353-a7c4-dd7346dfcf13", "tag": "be6ea533-cb92-4ed3-ac4f-bc25539c054f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:55.924526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.925489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.926126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.961785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] Creating event network-changed:be6ea533-cb92-4ed3-ac4f-bc25539c054f for instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 on n-h2-833090-21 Oct 04 18:29:55.971170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d7a2bdf8-829f-452e-addb-b1229a23f125 req-94520ee7-fada-4f95-a225-1ef1ade14f53 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100898 Oct 04 18:29:55.972550 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2610/5184] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:56.833077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:56.833077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:56.850159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:56.854434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:56.865313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.865841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.867681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.867681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.867681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.868104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.895626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:56.896443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:56.919324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.919860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.920309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.923187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.923723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.924162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.139391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:57.150080 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9e0dd1b9-45a6-45e0-997b-b91be5b1e25d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.323628 Oct 04 18:29:57.155414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2575/5185] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:56 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:57.160379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c20bcffe-99e8-4b37-b0f7-6bc56b692425 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c1bdc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:57.232856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c20bcffe-99e8-4b37-b0f7-6bc56b692425 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.075515 Oct 04 18:29:57.239921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2576/5186] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:57 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:57.443681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:57.469947 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51d7606a-246d-4eb7-b260-21b381687178 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.580391 Oct 04 18:29:57.470563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2611/5187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:56 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:58.179995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.181505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:58.193623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.200670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.202122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.204775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.205500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.206446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.249573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e3d0fd9-3659-44de-95b8-67c60106bf85 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90097c14c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.361380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e3d0fd9-3659-44de-95b8-67c60106bf85 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.115940 Oct 04 18:29:58.366476 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2612/5188] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:58.501343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.502260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:58.513449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.521583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.522344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.523369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.528816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.529566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.790551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.805506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77e1fa88-4bdb-4d53-9140-4eee99b750be tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.629158 Oct 04 18:29:58.806814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2577/5189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.380409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.385135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c034155-41c9-459f-a31a-0c3e7b806e95 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009997af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.394552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3771e4bf-fa71-4891-879d-f216e3c8955a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.898148 Oct 04 18:29:59.412540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2613/5190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.476645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c034155-41c9-459f-a31a-0c3e7b806e95 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.103468 Oct 04 18:29:59.492361 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2578/5191] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.831755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.832326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:59.843745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.844565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.845202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.846317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.846951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.847589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.172663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:00.185496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a80b6788-8049-4b37-afe4-28acaf236b04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.357897 Oct 04 18:30:00.190851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2614/5192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.422554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.425880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.446374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.447944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.448612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.451458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.453205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.453853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.493178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0abc75a9-99aa-4257-b7b6-1c59ae5eff2e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008cb4160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.569993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0abc75a9-99aa-4257-b7b6-1c59ae5eff2e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.074623 Oct 04 18:30:00.570645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2615/5193] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.807651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:00.826213 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-338ea574-de00-4597-9b75-ee370a46709e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.401399 Oct 04 18:30:00.826213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2579/5194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:01.218800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:01.219784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:01.276486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.279013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.279681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.281864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.283052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.285596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.588120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee2eae23-bc16-4a9d-a136-27572270e0e0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008cf6d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:01.693678 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee2eae23-bc16-4a9d-a136-27572270e0e0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.109273 Oct 04 18:30:01.694302 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2580/5195] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:01 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:01.790046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.804958 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66183e8e-0f25-434f-b239-bee9c3bc6bcd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.589195 Oct 04 18:30:01.820324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2616/5196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:01 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:01.849391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:01.850039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:01.865875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.866392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.866835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.875588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:01.876265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:01.876726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.563455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.579424 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4f24554-5dac-4f44-a02d-7c5c0522cd15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.734164 Oct 04 18:30:02.598909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2581/5197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:01 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:02.709726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9fe3d52-f55c-4550-bcec-0e94d66bca7a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008c9b160>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.794254 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9fe3d52-f55c-4550-bcec-0e94d66bca7a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.088164 Oct 04 18:30:02.797605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2617/5198] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:02.841723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.843144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:02.871161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.874041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.874541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.875277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.884288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.884786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.227857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:03.261640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.268155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.270662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.311753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:03.319922 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] Creating event network-changed:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:30:03.324042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4392fd0-46dd-4067-a6c4-75e4d7d82e4c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.491975 Oct 04 18:30:03.326376 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2582/5199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:03.333757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5d47043c-fa12-4a2b-9e3f-c0a7757531f4 req-385afafb-a264-47c1-a468-c948dce586ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498349 Oct 04 18:30:03.336138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2618/5200] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:03.357063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:03.371962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:03.396888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.397598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.399085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.403278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.403278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.403278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.441338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:03.612007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:03.613155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:03.621661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.622163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.623260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.624427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.625484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.626298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.940532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d323b3db-0148-473e-b3d2-4de6da13964c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "DELETE /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 204 len: 0 microversion: 2.1 time: 0.611686 Oct 04 18:30:03.944008 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2583/5201] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:03 2022] DELETE /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:03.959998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-112b481d-5bd3-4f19-84b0-19cc1a9bbc3b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900839aa60>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.047602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-112b481d-5bd3-4f19-84b0-19cc1a9bbc3b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.101523 Oct 04 18:30:04.048780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2584/5202] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:03 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:04.070065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.086968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.098484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.098993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.099524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.100265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.112019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.112642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.234091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.272312 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f306bec-3743-4823-b93a-ae99dfbed38d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.667436 Oct 04 18:30:04.284639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2619/5203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:03 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:04.375365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.378300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.400108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.400108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.401333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.401333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.401333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.404768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.726815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.763107 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3346d2d3-c1f5-4c6e-a160-642311606068 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1583 microversion: 2.1 time: 0.712925 Oct 04 18:30:04.765028 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2585/5204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:04 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1583 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:04.781799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.783167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.802515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.803453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.805500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.811241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.824064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.824064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.870113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 HTTP/1.1 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '91487e9f-016c-4ede-b666-50974c0dbca3'} Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:04.874680 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.880372 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.882622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:04.886415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-731528f9-448a-4665-b1ab-efc16a2fb56e tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 404 len: 111 microversion: 2.1 time: 0.117424 Oct 04 18:30:04.888070 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2586/5205] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:04 2022] DELETE /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:04.898401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.899717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 91487e9f-016c-4ede-b666-50974c0dbca3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.909169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.909935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.911068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.915174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.915957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.916570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.941986 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 HTTP/1.1 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '91487e9f-016c-4ede-b666-50974c0dbca3'} Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:04.950688 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. Oct 04 18:30:04.957966 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:04.960113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 91487e9f-016c-4ede-b666-50974c0dbca3 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:04.961205 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46a58d1e-7624-462f-94c2-3ff04ebe052b tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3" status: 404 len: 111 microversion: 2.1 time: 0.066811 Oct 04 18:30:04.966054 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2587/5206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:04 2022] GET /compute/v2.1/servers/91487e9f-016c-4ede-b666-50974c0dbca3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:05.144062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c41e6bf5-96ca-44df-a5f4-77c2d3ac68d1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008f1d670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.159878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.171071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d3ce824-c0ce-4dd7-8e13-ba38ad388511 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.823279 Oct 04 18:30:05.173968 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2620/5207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:04 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:05.258062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c41e6bf5-96ca-44df-a5f4-77c2d3ac68d1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.147836 Oct 04 18:30:05.267143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2588/5208] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:05.302710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.304087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.321286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.324641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.326628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.327413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.334393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.334894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.815434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.816425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.851502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.866385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.869357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.870776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.880961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.882074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.280038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:06.289244 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e164d56-3dc3-4481-a180-7e13b35a67ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.990924 Oct 04 18:30:06.293897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2621/5209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:06.312409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:06.313100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:06.338064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.338557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.342026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.343102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.344188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.347558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.178477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.194041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8a35cde-b8f2-452e-bbf6-b68294040641 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.892670 Oct 04 18:30:07.196984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2622/5210] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:06 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:07.217156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e9f2e71-2096-4f7c-907f-2157f165144c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900850d8b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.322162 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e9f2e71-2096-4f7c-907f-2157f165144c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.123754 Oct 04 18:30:07.322903 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2623/5211] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:07 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:07.338543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:07.348390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:07.365737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.366586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.368027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.368996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:07.372289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:07.372964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:07.754693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.770646 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ac0b4ff-9f5a-4517-9943-9db59d29d67c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1583 microversion: 2.1 time: 1.972947 Oct 04 18:30:07.798551 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2589/5212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1583 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:07.800140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.817580 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9df11118-e12c-401b-aef1-77aa067e64b5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.481545 Oct 04 18:30:07.818257 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2624/5213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:07 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.079565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baec8333-3802-488c-94e4-7a3e0233aff0", "name": "network-vif-deleted", "tag": "922c8e11-ae38-4a36-abfc-091c41b1148b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:08.110330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.111113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.111752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.131726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] Creating event network-vif-deleted:922c8e11-ae38-4a36-abfc-091c41b1148b for instance baec8333-3802-488c-94e4-7a3e0233aff0 on n-h1-833090-21 Oct 04 18:30:08.146321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a8be6c6a-e12b-4062-9e37-6d40ce51f152 req-023236da-5052-412f-82bd-c48114255897 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071505 Oct 04 18:30:08.146929 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2590/5214] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:08.227395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.228065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.255883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.256458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.256912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.263506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.264243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.288274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.340371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-350574fc-9eb7-4900-9ae4-28d62316b6d5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083ee280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.436063 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-350574fc-9eb7-4900-9ae4-28d62316b6d5 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.100850 Oct 04 18:30:08.437580 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2591/5215] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:08.493936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.505625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f232f623-9cfb-4bab-8ce3-35a8323c8bf9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.283193 Oct 04 18:30:08.512390 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2625/5216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.805361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.806749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.832199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.845955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.846797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.861079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:08.870847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.873364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.875246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.876926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.881010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.881739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.155437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.182325 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-025c171f-d97b-4761-a4b8-082697fdcc0f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.381170 Oct 04 18:30:09.184283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2592/5217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:09.452569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a3b6296-070c-4f1e-b055-e506fbaebd6c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083d5160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:09.514359 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a3b6296-070c-4f1e-b055-e506fbaebd6c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.065526 Oct 04 18:30:09.522514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2593/5218] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:09 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:09.532994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:09.533617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:09.547581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.548112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.548600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.549240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:09.554271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:09.554807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.628397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.640371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1833e3e-3292-4df2-a943-3e0b1a27a7b9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.798656 Oct 04 18:30:09.643727 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2626/5219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:09.898891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.907706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2bcae5d-cb80-4353-86a2-6e7a6041e879 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.378610 Oct 04 18:30:09.927342 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2594/5220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:09 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:10.210685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.211314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.235057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.235661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.236260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.237255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.237827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.238380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.446301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.458385 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbf5a7e7-bf5c-4b3a-b97b-5c6836390fef tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.251556 Oct 04 18:30:10.478634 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2627/5221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:10.530161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-526eb9f3-cc67-405a-9400-87b3d0174694 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083d53a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.601216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-526eb9f3-cc67-405a-9400-87b3d0174694 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1438 microversion: 2.1 time: 0.074812 Oct 04 18:30:10.607566 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2595/5222] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:10.662920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e444745-ea56-4353-a7c4-dd7346dfcf13", "name": "network-vif-plugged", "status": "completed", "tag": "be6ea533-cb92-4ed3-ac4f-bc25539c054f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:10.669961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.670581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.689751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.692434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.693674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.696715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.728423 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] Creating event network-vif-plugged:be6ea533-cb92-4ed3-ac4f-bc25539c054f for instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 on n-h2-833090-21 Oct 04 18:30:10.749618 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-43ceb3cc-a252-4163-9f2b-85ec8fdf804d req-85bfb84c-6895-4875-9389-11a24d11304d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209279 Oct 04 18:30:10.750321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2628/5223] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.971774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.977364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.981279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.436311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:11.452558 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1528cf1d-9806-446d-968a-8fb7e5e332bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.525936 Oct 04 18:30:11.454070 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2629/5224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:11.486558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.487663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.494099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.501739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.506135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.506135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.506135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.512750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.548009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:11.685411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:11.691813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:11.700058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fd5b2ec-c553-490d-ad2f-2b1daac760eb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 1.034552 Oct 04 18:30:11.710896 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2596/5225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:11.710896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88f8d3ea-1f89-4b1b-96b3-c99d3a47a078 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083cd160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.722734 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8f7fb5b-10d3-4ea7-af00-0c1b57844492 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.218904 Oct 04 18:30:11.725821 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2630/5226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:11.797436 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88f8d3ea-1f89-4b1b-96b3-c99d3a47a078 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1447 microversion: 2.1 time: 0.095725 Oct 04 18:30:11.798039 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2597/5227] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1447 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:11.820034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-13911e2c-89be-4a34-b056-43d9c0e23234 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009070ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.898212 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-13911e2c-89be-4a34-b056-43d9c0e23234 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 200 len: 1447 microversion: 2.1 time: 0.084796 Oct 04 18:30:11.899490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2631/5228] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 1447 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:11.919159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b754e56-46f6-4516-b92d-915b3e5fe430 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083d55e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:12.493711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:12.493711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:12.507848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.508363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.508959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.509693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.510265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.510704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.831141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:12.841501 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae89ec25-f6f2-450f-b9ab-9956e59fc81f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1316 microversion: 2.1 time: 0.358281 Oct 04 18:30:12.842683 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2632/5229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:12 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:12.863088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:12.869016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:12.889407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.890318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.891100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.900414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.905957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.909796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.249760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:13.263219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd7253bf-b655-464e-b3a0-7b8f4cb33857 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.418408 Oct 04 18:30:13.264904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2633/5230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:12 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:13.271017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.272143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.294839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.296827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.300957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.300957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.300957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.300957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.417697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:13.431103 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d3e0806-decc-4793-b73d-93dc44f4ceaf tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.164603 Oct 04 18:30:13.432052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2634/5231] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:13.568065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.568573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.582867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.583656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.584359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.585245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.585864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.586454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.607096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b754e56-46f6-4516-b92d-915b3e5fe430 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 204 len: 0 microversion: 2.1 time: 1.689750 Oct 04 18:30:13.607096 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2598/5232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] DELETE /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 0 bytes in 1692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:13.614826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.615607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.617998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 HTTP/1.1 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9ccd2e23-0a15-47c2-a277-53cc3673b681'} Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:13.619895 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:13.625726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c56d468e-1f06-4803-8061-79b156ba45b7 tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 404 len: 111 microversion: 2.1 time: 0.062188 Oct 04 18:30:13.629058 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2635/5233] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:13 2022] DELETE /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:30:13.640527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.640527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.640760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.640760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] [instance: 9ccd2e23-0a15-47c2-a277-53cc3673b681] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.641488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.643262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.645088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.645637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.654149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.654649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.655084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.655815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.656317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.656743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.703831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] HTTP exception thrown: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Request method failure captured: Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 HTTP/1.1 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHm4fwcJN08dyTS7KHKkXBfctEoZWFjs5sKcBMF_FhkTiOctUzDFDcpMgjLmYKn3MFT15qXJWZ_xYfRFiq4-wi_wm-o3Ud89ByUdW4zJ1yes_N6-mivLPtaAGQ814ON5igOl2U8UMlpzTNEGxX3K21jyP1ts_hv_ITh3fH7o-CTIRvU Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62fbdf1bd77d4482864a1e4e38bf4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62fbdf1bd77d4482864a1e4e38bf4f66"}]}] Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 62fbdf1bd77d4482864a1e4e38bf4f66 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2140549478 Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 61ba22151375420182b815277e8bd12c Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeTestJSON-2140549478-project Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9ccd2e23-0a15-47c2-a277-53cc3673b681'} Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:13.705880 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. Oct 04 18:30:13.711698 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:13.713278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] Returning 404 to user: Instance 9ccd2e23-0a15-47c2-a277-53cc3673b681 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:13.714342 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a200d429-f218-450e-869d-d3ae9874336d tempest-AttachVolumeTestJSON-2140549478 tempest-AttachVolumeTestJSON-2140549478-project] 10.222.0.40 "GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681" status: 404 len: 111 microversion: 2.1 time: 0.081203 Oct 04 18:30:13.715459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2636/5234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/9ccd2e23-0a15-47c2-a277-53cc3673b681 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:13.726379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:13.781583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:13.869763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:13.878756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:13.878756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.878756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.879275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.880030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:13.884042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:13.884749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.216779 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c21292b1-2af0-4b34-ae9d-20c8bf30084f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 204 len: 0 microversion: 2.1 time: 0.606521 Oct 04 18:30:14.217966 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2599/5235] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:13 2022] DELETE /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:30:14.291305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:14.292084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:14.306360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.306756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.308033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.312406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.313613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.314211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.848248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.860597 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f82fb27a-2f01-4ffc-95c6-d424227d66cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.573940 Oct 04 18:30:14.864785 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2600/5236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:14 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:14.872931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-797072158", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "44b242be-ac7c-410a-8774-aa97ed4572a1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:14.967188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] validate_networks() for [('44b242be-ac7c-410a-8774-aa97ed4572a1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:15.364635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:15.386343 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3110a30e-3611-41be-9de2-26eb8bf0e7d6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1505 microversion: 2.1 time: 1.522019 Oct 04 18:30:15.403390 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2637/5237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:13 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1505 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:15.421794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.422438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.439300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.439778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.440218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.440925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.441374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.441800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.598495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:15.627135 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b2db3060-8223-4705-9732-6e5e258a53c5 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.206079 Oct 04 18:30:15.628555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2638/5238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:15 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:15.633405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57c4dc-9480-43c6-a7b1-eca0b253568a", "name": "network-vif-unplugged", "status": "completed", "tag": "28d1a464-4023-4222-82c6-8ad16dae602f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:15.655659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.656471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.657069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.670830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] Creating event network-vif-unplugged:28d1a464-4023-4222-82c6-8ad16dae602f for instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a on n-h2-833090-21 Oct 04 18:30:15.676745 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9b46c495-e8ac-4545-8d2f-ca68f6d97dee req-6872313c-c0e9-4458-84bd-3f690af554dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046710 Oct 04 18:30:15.681997 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2639/5239] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:15.688903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.689897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.698132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.699790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.700481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.701459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.702530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.702530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.729538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:15.729967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:15.730485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:15.730902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:15.731324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:15.733383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:15.745168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.746391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.747063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.750378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.751151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.751854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.782251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:15.792405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Getting quotas for user 8553f76d0f804314b29e82142e728c71 and project 56cd7fddae8343f29e6c7a308470cb09. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:15.808148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:15.816636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:16.000687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-794cccb5-77c5-4ff5-8ccc-123e62931650 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134411 Oct 04 18:30:16.002574 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2601/5240] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:16.007500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.008795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.017886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.018792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.019686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.020636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.021508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.022134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.175867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d95fc382-70b2-4106-be5c-a2b2cf84cc24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 204 len: 0 microversion: 2.1 time: 0.491128 Oct 04 18:30:16.178877 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2640/5241] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:15 2022] DELETE /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:16.182499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-63bd866b-573a-45e0-8bad-282882a85c22 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.183346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-63bd866b-573a-45e0-8bad-282882a85c22 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.356336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-63bd866b-573a-45e0-8bad-282882a85c22 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.367543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.376635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-63bd866b-573a-45e0-8bad-282882a85c22 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1207 microversion: 2.1 time: 0.198557 Oct 04 18:30:16.384929 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2641/5242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1207 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:16.386241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17b86216-156d-4e56-bad9-43a9d68f996a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.378989 Oct 04 18:30:16.407068 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2602/5243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:16.426004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.428446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.450034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.450543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.450986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.465636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.470189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.470189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.651675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.654615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.669565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.671887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.671887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.671887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.672453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.673086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.898422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.910503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cfad6e66-d093-4909-b742-24ff25a1c27c tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1229 microversion: 2.1 time: 0.262533 Oct 04 18:30:16.915911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2603/5244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1229 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:16.972780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.984410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c168c78-4a79-44d9-bc8b-5d060a400a60 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1511 microversion: 2.1 time: 0.578408 Oct 04 18:30:16.988355 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2642/5245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:17.429584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3460f356-6e1e-4a4d-970b-9f15d562d815 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.430275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3460f356-6e1e-4a4d-970b-9f15d562d815 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.434282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.435392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.452606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.453803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.454425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.455697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.456571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.457261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.577631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3460f356-6e1e-4a4d-970b-9f15d562d815 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:17.588939 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3460f356-6e1e-4a4d-970b-9f15d562d815 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1207 microversion: 2.1 time: 0.163883 Oct 04 18:30:17.591494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2604/5246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1207 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:17.935452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.935452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.957938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.958762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.959709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.960240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.960706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.961146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.030588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.038427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.039160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.039858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lazy-loading 'fault' on Instance uuid baec8333-3802-488c-94e4-7a3e0233aff0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:18.155260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51077921523144938d6520cd0f8215cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb5d8e2ff974aedae86dc75f5dd0d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.165882 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86837ac8-8376-489f-9bca-25b75c6aefdb tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 200 len: 1234 microversion: 2.1 time: 0.235459 Oct 04 18:30:18.173603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2605/5247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 1234 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:18.178965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.185039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.196473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.202087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.203335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.204207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.205792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.206319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.321813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.333561 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61b0272c-c13c-49de-813d-5c0fe15c6b34 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.903751 Oct 04 18:30:18.351346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2643/5248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:18.616236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:18.617123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:18.629980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.630472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.631005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.631834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.637450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.637973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.760781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.780373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-808cea64-2355-4545-839f-8a5d1f4641d0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1259 microversion: 2.1 time: 0.168253 Oct 04 18:30:18.793309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2644/5249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:18.873906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:18.886908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f19793a7-935b-4251-815d-9b330bc73748 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1511 microversion: 2.1 time: 0.711298 Oct 04 18:30:18.892359 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2606/5250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:18 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:18.960253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e444745-ea56-4353-a7c4-dd7346dfcf13", "name": "network-vif-unplugged", "status": "completed", "tag": "be6ea533-cb92-4ed3-ac4f-bc25539c054f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:18.962031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:18.962603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:18.963112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:18.982896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] Creating event network-vif-unplugged:be6ea533-cb92-4ed3-ac4f-bc25539c054f for instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 on n-h2-833090-21 Oct 04 18:30:18.990658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-87eb7d50-ad75-4e69-a1cc-979cef5cdab8 req-0209985c-3955-4689-bea1-cce80205b691 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051412 Oct 04 18:30:18.992945 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2645/5251] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:19.202083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.202695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] [instance: baec8333-3802-488c-94e4-7a3e0233aff0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.248572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57c4dc-9480-43c6-a7b1-eca0b253568a", "name": "network-vif-deleted", "tag": "28d1a464-4023-4222-82c6-8ad16dae602f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:19.257907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.259334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.260466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.263539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.267801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.268542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.281789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.287269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.287269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.292095 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] HTTP exception thrown: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Request method failure captured: Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 HTTP/1.1 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHo7PBSp7G1yPWB3eytPsagvLB3c6L3djKy6DD2IBYg77d-lXfb5UFpChisgt9uTGWbIou6nHmlYjPAneZzqae8YUsULM4hhRh-3nPNKpmZXmUnGAMomHTuilcswhLK8YcpMt7KWJAtGnKDWc9k9YSQT8b6-7axcIsdL09aC4ju5FcE Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2bb5d8e2ff974aedae86dc75f5dd0d8e Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBackupRestore-1942048402 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2bb5d8e2ff974aedae86dc75f5dd0d8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bb5d8e2ff974aedae86dc75f5dd0d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2bb5d8e2ff974aedae86dc75f5dd0d8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2bb5d8e2ff974aedae86dc75f5dd0d8e"}]}] Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBackupRestore-1942048402 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2bb5d8e2ff974aedae86dc75f5dd0d8e Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1942048402 Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBackupRestore-1942048402-project Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 51077921523144938d6520cd0f8215cc Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBackupRestore-1942048402-project Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'baec8333-3802-488c-94e4-7a3e0233aff0'} Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:19.295664 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. Oct 04 18:30:19.300246 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:19.311257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Returning 404 to user: Instance baec8333-3802-488c-94e4-7a3e0233aff0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:19.321311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7da42ae6-0b24-447e-8e2f-3a2a8376c622 tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0" status: 404 len: 111 microversion: 2.1 time: 0.115863 Oct 04 18:30:19.321311 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2607/5252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/baec8333-3802-488c-94e4-7a3e0233aff0 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:19.334723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] Creating event network-vif-deleted:28d1a464-4023-4222-82c6-8ad16dae602f for instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a on n-h2-833090-21 Oct 04 18:30:19.340813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d97de47b-f7ce-4862-be35-8160b17f1ad2 req-505fad1b-50f2-4693-8550-3d71de9fffd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096826 Oct 04 18:30:19.341971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2646/5253] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:19.360400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.361183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.382767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.385065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.385802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.387870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.389149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.393551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.807921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:19.811155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:19.838320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.840266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.861346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:19.862214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:19.862602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:19.864049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.427960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.439389 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc51b2a4-95fa-4704-90f7-2638d5a57891 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 1.084946 Oct 04 18:30:20.456378 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2608/5254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.466268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e444745-ea56-4353-a7c4-dd7346dfcf13", "name": "network-vif-deleted", "tag": "be6ea533-cb92-4ed3-ac4f-bc25539c054f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:20.478004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.479332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.480551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.498394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] Creating event network-vif-deleted:be6ea533-cb92-4ed3-ac4f-bc25539c054f for instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 on n-h2-833090-21 Oct 04 18:30:20.503718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0b0941a5-d3ef-4772-8734-4cd2deb863ad req-1bf65f9b-ba43-49f7-aaef-57f29a68a6bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046764 Oct 04 18:30:20.504243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2609/5255] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:20.511935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.512650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:20.519428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.519958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.520410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.524267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.524267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.524267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.572257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:20.572880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:20.573416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:20.574199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'fault' on Instance uuid 0e444745-ea56-4353-a7c4-dd7346dfcf13 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:20.644438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.658494 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e22a308-93b6-4879-b75a-b15066df6a01 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1306 microversion: 2.1 time: 0.151156 Oct 04 18:30:20.659204 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2610/5256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:20 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1306 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.672627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7478fd37-a0e4-48db-8ffa-120166e3c39f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] Calling method '.version_select at 0x7f9008409b80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:20.715412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:20.732194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1e5ef33-cdb5-41f9-8ccc-d5ceae0e0cdd tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1267 microversion: 2.1 time: 0.924855 Oct 04 18:30:20.738442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2647/5257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:19 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1267 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:20.827037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7478fd37-a0e4-48db-8ffa-120166e3c39f tempest-TestVolumeBackupRestore-1942048402 tempest-TestVolumeBackupRestore-1942048402-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-207928097" status: 202 len: 0 microversion: 2.1 time: 0.166616 Oct 04 18:30:20.829487 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2611/5258] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 4 18:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-207928097 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:21.468657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.468657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.477828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.479503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.481870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.483349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.484029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.485087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.689377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.690001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.705533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.707224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.707700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.711795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.712570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.713289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.812265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.813137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.813802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.814485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'fault' on Instance uuid 0e444745-ea56-4353-a7c4-dd7346dfcf13 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:21.895431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.906863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a4260b5-3b3b-49e4-9723-c4a49518a827 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 200 len: 1306 microversion: 2.1 time: 0.221305 Oct 04 18:30:21.910632 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2612/5259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 1306 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:21.930436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:21.931911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:21.940175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.942117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.942771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.943726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:21.944419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:21.945049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:21.986129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:21.996689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c0c71bf-8f90-49dd-843a-5d740a82e202 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 0.533486 Oct 04 18:30:21.997295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2648/5260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:22.637175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:22.645498 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7eafcc7d-8f22-422d-a481-e7b1aeaa79de tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1265 microversion: 2.1 time: 0.730586 Oct 04 18:30:22.659860 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2613/5261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:21 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1265 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:22.944877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:22.944877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:22.960046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.960046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.962773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:22.962773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:22.964607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:22.966578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.025058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.026338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.055275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.057701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.074931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.074931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.074931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.074931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.078380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 HTTP/1.1 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0e444745-ea56-4353-a7c4-dd7346dfcf13'} Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:23.082379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:30:23.086999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:23.090635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:23.091721 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8751c442-e7a8-4710-bc11-1e4914269da2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 404 len: 111 microversion: 2.1 time: 0.157143 Oct 04 18:30:23.092305 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2649/5262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:22 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:23.104410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.105056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.143169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.143446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.143880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.144596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.151779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.152447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.741352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:23.752883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ebae294-4962-4174-8688-40961f8bdf8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.652313 Oct 04 18:30:23.753681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2650/5263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:23.786904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:23.790521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:23.839040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.841001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.841977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.846081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:23.854220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:23.862707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:23.882815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:24.452640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.461089 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dcf30a9e-dee8-4da2-ba8d-ae76f301d570 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.679980 Oct 04 18:30:24.461618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2651/5264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:24.503349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-599d1af3-be5e-4e5c-b3cc-1a18960bf373 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-599d1af3-be5e-4e5c-b3cc-1a18960bf373 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 163 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": 12345, "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:24.515405 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:30:24.520052 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:24.520895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-599d1af3-be5e-4e5c-b3cc-1a18960bf373 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:24.521647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-599d1af3-be5e-4e5c-b3cc-1a18960bf373 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.036888 Oct 04 18:30:24.524806 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2652/5265] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:24 2022] POST /compute/v2.1/servers => generated 127 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:24.535437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.546123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.581422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.583827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.585219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.587783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.592020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.596662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.665980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.674446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92b44603-2045-4739-bedc-4b70effe0c9a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1512 microversion: 2.1 time: 1.653231 Oct 04 18:30:24.693225 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2614/5266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:23 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1512 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:25.033804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.054081 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a35a8d93-db12-4f61-9faa-ac4ed5ec1b90 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.524251 Oct 04 18:30:25.066625 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2653/5267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:24 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:25.081366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.081989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.102011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.102509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.102982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.103806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.104452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.105072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.488873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.489502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.505894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.506399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.506843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.507581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.509190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.509190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.764395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:25.932490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:25.950045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fcddf11-e323-4a4e-aa70-9251e91b44a3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.869747 Oct 04 18:30:25.952528 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2615/5268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:25.970151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.972183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.993953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.995226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.997823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.998734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:26.000566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:26.001125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.297708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.312963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72c6dad7-c5b9-4c16-b6e3-274a3a665ed7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.824723 Oct 04 18:30:26.328793 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2654/5269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:27.208817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:27.230706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-324f7ba2-cec7-4215-81a7-ab47e4f11841 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1489 microversion: 2.1 time: 1.276896 Oct 04 18:30:27.231306 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2616/5270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1489 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:27.264196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:27.266476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.268580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.295265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.295265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.295265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.299030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.300640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.301651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.347252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.348071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.350146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.381443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.381975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.382432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.387924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.390367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.390825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.500280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7336f069-14ab-4e58-a5e1-1164b477eb72 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 200 len: 144 microversion: 2.1 time: 0.240757 Oct 04 18:30:27.500927 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2655/5271] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:27 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 144 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:27.512291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.513017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.547433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.552995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.553454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.554204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.554655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.557464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.587239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.997943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.009289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.009414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70153ad6-355b-40b8-8f29-1101e383ef13 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.668841 Oct 04 18:30:28.029249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8fda197-b944-46ee-816f-3d01c760a7ef tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.522426 Oct 04 18:30:28.029851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2617/5272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:28.030874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2656/5273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:28.071422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.076338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.092249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.107032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.107032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.107032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.108622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.112117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.142936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:28.690955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.714717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dee48596-4f2c-4773-a051-03cf373b58c9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.650305 Oct 04 18:30:28.715699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2618/5274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:28.742805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.743427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.774503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.775403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.779809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.780763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.784055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.786366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.036221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.036850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.089621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.090320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.090931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.092072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.092864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.093638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.610322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:29.627589 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a51232e-6396-46db-92fa-30d1b07a546f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.888467 Oct 04 18:30:29.628790 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2657/5275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.674734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.676117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.690586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.695229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.697184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.698245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.709771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.709771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.452768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.462856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3efd329d-4a54-4fdf-8e9f-0833c282e173 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 1.433590 Oct 04 18:30:30.464115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2619/5276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:30.545463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b7a97a-1c44-41be-98e0-f53a8a21b4f9", "tag": "17091a38-6f99-48c0-a491-73c790fa8fb3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:30.564491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.566157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.567521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.607749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] Creating event network-changed:17091a38-6f99-48c0-a491-73c790fa8fb3 for instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 on n-h2-833090-21 Oct 04 18:30:30.627203 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0fd8bc2b-cb85-4f90-9ad3-5f90543a396b req-e0c70b56-f28b-4ddb-bed1-aa46034a9145 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091557 Oct 04 18:30:30.633914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2620/5277] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:31.006066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.019566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ccd786e-39ec-453a-9859-4e0eae6fa5f5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-426510516", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0bb9cf05-0722-4e7d-94f9-2bc09a7264b3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:31.023281 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52bce4f7-3311-4fe0-9bae-0e9a33e3a252 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 1.357576 Oct 04 18:30:31.044875 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2658/5278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:31.224776 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9ccd786e-39ec-453a-9859-4e0eae6fa5f5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ccd786e-39ec-453a-9859-4e0eae6fa5f5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 357 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-426510516", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0bb9cf05-0722-4e7d-94f9-2bc09a7264b3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: exception: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-426510516', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0bb9cf05-0722-4e7d-94f9-2bc09a7264b3'}], 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:31.230365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ccd786e-39ec-453a-9859-4e0eae6fa5f5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Block Device 0bb9cf05-0722-4e7d-94f9-2bc09a7264b3 is not bootable. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:31.235530 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ccd786e-39ec-453a-9859-4e0eae6fa5f5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.224489 Oct 04 18:30:31.237152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2621/5279] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:31.241647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.242315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.256247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.258651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.266086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.266847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.269567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.271445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.448813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1847824428", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "615cdc98-a3fe-4da3-8339-6361f3daab74"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:31.607268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] validate_networks() for [('615cdc98-a3fe-4da3-8339-6361f3daab74', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:31.938037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.950298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57b9f4e1-6f02-4ded-bac7-926bc93a8a23 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.709338 Oct 04 18:30:31.952825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2659/5280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:31.969418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.969418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.984284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.985263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.985263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.993219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.993359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.993748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.493295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.497727 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d70fe0b-2b6a-49b2-8ebf-59f67f6492c0 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.543661 Oct 04 18:30:32.498508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2660/5281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:32.507988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.508841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.517447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.518206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.518856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.520037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.520658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.521394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.935296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.966831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07b6a463-124b-400c-8387-3d0491b2471c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.465916 Oct 04 18:30:32.987080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2661/5282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:33.524604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:33.525288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.574195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.583414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.591455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.600377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.602429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.603765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.857578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:33.858715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:33.860477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:33.860957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:33.863134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:33.888281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.888953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.890185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.893347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.896751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.898593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.959523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:33.979683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:34.011953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:34.017615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:34.289764 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9a9ed31-d4a1-4c07-8b78-25affb1b9b6b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.843690 Oct 04 18:30:34.291163 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2622/5283] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:34.303172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a8f4b7c-1b01-4819-b6f3-dd330f299fc9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.304402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a8f4b7c-1b01-4819-b6f3-dd330f299fc9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.721873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.731201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-212fb112-06fb-412c-ac7e-fce02e84827c tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 1.211321 Oct 04 18:30:34.733691 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2662/5284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:33 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:34.781741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a8f4b7c-1b01-4819-b6f3-dd330f299fc9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.798680 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a8f4b7c-1b01-4819-b6f3-dd330f299fc9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1215 microversion: 2.1 time: 0.496044 Oct 04 18:30:34.815350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2623/5285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1215 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:35.759386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.760291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.773895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.781172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.781172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.781172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.781172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.781172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.848116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d53159d-2316-4358-8a63-73422d44ba59 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.848728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8d53159d-2316-4358-8a63-73422d44ba59 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:36.248167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.277635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46fbde18-c653-413d-9cc2-bd263fa0a2e6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.518547 Oct 04 18:30:36.300971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2663/5286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:36.361023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8d53159d-2316-4358-8a63-73422d44ba59 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.386532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d53159d-2316-4358-8a63-73422d44ba59 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1215 microversion: 2.1 time: 0.550494 Oct 04 18:30:36.410857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2624/5287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1215 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:37.315623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.316238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.326388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.326857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.327306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.328040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.339277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.340909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.416726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.418460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.435898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.436441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.437965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.441714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.442402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.443004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.072750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.083600 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60393bde-f86c-4651-a372-a9a5dee6e7be tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.773532 Oct 04 18:30:38.084930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2664/5288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.090264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a36dfbe-af49-49b3-993d-e054a7f9a073 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-885966863", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "destination_type": "local"}, {"source_type": "volume", "uuid": "7d42d342-4f68-4388-af88-854bb46e1f6b", "destination_type": "invalid"}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a36dfbe-af49-49b3-993d-e054a7f9a073 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 494 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-885966863", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "destination_type": "local"}, {"source_type": "volume", "uuid": "7d42d342-4f68-4388-af88-854bb46e1f6b", "destination_type": "invalid"}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-885966863', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7d42d342-4f68-4388-af88-854bb46e1f6b', 'destination_type': 'invalid'}], 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:38.095124 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:30:38.100788 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:38.104753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a36dfbe-af49-49b3-993d-e054a7f9a073 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:38.113088 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a36dfbe-af49-49b3-993d-e054a7f9a073 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019626 Oct 04 18:30:38.113088 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2665/5289] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:38 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:38.120998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.121934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.174151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.176662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.178140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.180513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.181401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.184330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.253452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.264236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ff446a9-c6fa-4d08-ae10-556f0b3bb47a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1267 microversion: 2.1 time: 0.849965 Oct 04 18:30:38.264885 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2625/5290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1267 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.963489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:38.973473 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7022cef0-cf80-4979-9fbf-7c3bca589ed8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.857999 Oct 04 18:30:38.974397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2666/5291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:38.997990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.998613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.009476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.012234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.017335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.017335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.017335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.017335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.106821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.107873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.114520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:39.116120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.116747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.117292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.118129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.118646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.119199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.536951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.552168 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fbcdb576-fe64-4f35-9101-fc3b5c553184 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.558553 Oct 04 18:30:39.567906 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2626/5292] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:39.573026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.600297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.611210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.613469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.613925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.614660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.615095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.615551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.769116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.790164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b697808a-ba22-4503-b40c-a521606fe01a tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.687566 Oct 04 18:30:39.792904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2667/5293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:39.799379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.808323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b7a97a-1c44-41be-98e0-f53a8a21b4f9", "name": "network-vif-plugged", "status": "completed", "tag": "17091a38-6f99-48c0-a491-73c790fa8fb3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:39.810908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24f099f8-fc3e-4a18-a3e2-2feffbcf8c28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1273 microversion: 2.1 time: 0.239658 Oct 04 18:30:39.813219 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2627/5294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:39.818183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9366b6fe-44b1-4bd2-b6ca-755550428b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1071743778", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9366b6fe-44b1-4bd2-b6ca-755550428b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 492 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1071743778", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1071743778', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.836274 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:30:39.842117 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.868464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.868464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.868464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.868980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9366b6fe-44b1-4bd2-b6ca-755550428b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:39.868980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9366b6fe-44b1-4bd2-b6ca-755550428b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.040769 Oct 04 18:30:39.868980 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2628/5295] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:39 2022] POST /compute/v2.1/servers => generated 624 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:39.872309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.873176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.894646 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] Creating event network-vif-plugged:17091a38-6f99-48c0-a491-73c790fa8fb3 for instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 on n-h2-833090-21 Oct 04 18:30:39.903304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.904364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.905027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.906730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.907441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.908157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.908605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a7416b80-487f-4f18-b0c2-922a3193084d req-23582b9c-83d1-4353-97f2-564be40264c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112507 Oct 04 18:30:39.914473 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2668/5296] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:40.282329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.298798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afbc6c5f-3db7-438e-9f63-4ba00f7a24cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.431337 Oct 04 18:30:40.299957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2629/5297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:40.330600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.331566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.343960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.347874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.348593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.350190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.351444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.352257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.796255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:40.804612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f78755fd-3234-4a13-a713-97543ccb84f1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.484903 Oct 04 18:30:40.805850 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2669/5298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:40.833320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.833984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.846909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.850402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.859269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.859919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.860449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.861293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.861870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.862391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.869200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.869674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.870179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.870913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.878449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.878958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.247388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.262024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10cb1c2e-efc1-4972-aaf4-9e7d1a3c992f tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1307 microversion: 2.1 time: 0.432034 Oct 04 18:30:41.263507 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2630/5299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1307 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:41.271681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6f86e73-dfae-4f0d-aa1b-5d7221f2d1aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6f86e73-dfae-4f0d-aa1b-5d7221f2d1aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 416 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.328188 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:41.337076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6f86e73-dfae-4f0d-aa1b-5d7221f2d1aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:41.348381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6f86e73-dfae-4f0d-aa1b-5d7221f2d1aa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.081965 Oct 04 18:30:41.349705 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2631/5300] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:41 2022] POST /compute/v2.1/servers => generated 619 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:41.366014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:41.370930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:41.400218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.401789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.404170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.406355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.407218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.407809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.581273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.597246 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01dc7b6c-b5b5-42fd-8158-74ba23cc8703 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.238389 Oct 04 18:30:41.602194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2632/5301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:41 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:41.644614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:41.645484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:41.660679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.664366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.665459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.668150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:41.668150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:41.669820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.970210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.988099 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-001771a9-7eb0-404a-9685-4c188d16ead5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.358736 Oct 04 18:30:42.014519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2633/5302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:41 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.140591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.150420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:42.158396 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-865b5ffb-dc00-4af2-8a8a-c8777e092e14 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 1.320142 Oct 04 18:30:42.161453 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2670/5303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.241792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-312dc48d-4597-4445-a513-f6a010ccca47 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1028136788", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": -1, "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:42.267642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-312dc48d-4597-4445-a513-f6a010ccca47 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-312dc48d-4597-4445-a513-f6a010ccca47 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 206 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1028136788", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": -1, "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: exception: Flavor -1 could not be found. Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1028136788', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': -1, 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:42.274640 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-312dc48d-4597-4445-a513-f6a010ccca47 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:42.280941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-312dc48d-4597-4445-a513-f6a010ccca47 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.041428 Oct 04 18:30:42.287442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2634/5304] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:42 2022] POST /compute/v2.1/servers => generated 73 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:30:42.300158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.301526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.305974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.308460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.320026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.320807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.320935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.321425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.321915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.322896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.323896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.324645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.325548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.325674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.327206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.327693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.639648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.657403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b111c9e9-c4ca-4324-9a09-f829b5e6dd7c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.366486 Oct 04 18:30:42.664032 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2635/5305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.688249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.689102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.695537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.696036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.696478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.697365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.698045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.698789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.932310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.948770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6bbf5b8-fa15-4898-a063-757fb47f3f34 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1486 microversion: 2.1 time: 0.662379 Oct 04 18:30:42.950892 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2671/5306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1486 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.982883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2063264121"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:42.985350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.998742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.004122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.004122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.004122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.004122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.004122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.272196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.286400 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cd5c3c2-c44b-45e9-852c-77bfaf6e78a8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.602058 Oct 04 18:30:43.287890 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2636/5307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.688998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.690576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.695602 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f117300-e1e7-49ac-96d2-4ddbdba2c081 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "POST /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9/action" status: 202 len: 0 microversion: 2.1 time: 0.713405 Oct 04 18:30:43.696749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2672/5308] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:42 2022] POST /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:30:43.714878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a96fb15c-114a-4d0d-b3ad-801f86ff3d41 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9009754820>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.721157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.723301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.724196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.727751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.728594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.733972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.825785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a96fb15c-114a-4d0d-b3ad-801f86ff3d41 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85" status: 200 len: 1412 microversion: 2.1 time: 0.121714 Oct 04 18:30:43.827452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2673/5309] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:43.839666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d71c3743-7a2a-4fbc-82a8-232d4c4b5fef tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-660118437", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d71c3743-7a2a-4fbc-82a8-232d4c4b5fef tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 172 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-660118437", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-660118437', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:43.853490 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:30:43.859350 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:43.863051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d71c3743-7a2a-4fbc-82a8-232d4c4b5fef tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:43.867211 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d71c3743-7a2a-4fbc-82a8-232d4c4b5fef tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.034384 Oct 04 18:30:43.873015 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2674/5310] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:43.885862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44ac7a66-5b8c-41a2-b1c0-7a1d37778fd7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900846da60>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.932554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:43.958428 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44ac7a66-5b8c-41a2-b1c0-7a1d37778fd7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85" status: 200 len: 1412 microversion: 2.1 time: 0.084167 Oct 04 18:30:43.968557 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2675/5311] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.971776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.972809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.984016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.989071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.989666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.993152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.994028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.994995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.169391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.179293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e7d1d2d-4dc3-4401-bcd7-6506fa0c630c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.889307 Oct 04 18:30:44.180685 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2637/5312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:44.187446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3cd0e5f-69e2-4bbc-9892-ee1bc02ddf53 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f90083238b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.375363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.392985 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33ab59ef-1de9-425c-9509-328cd293c5b1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.432441 Oct 04 18:30:44.393661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2676/5313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:44.421571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.423140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.430780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.431871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.433353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.434457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.435222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.436041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.546679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3cd0e5f-69e2-4bbc-9892-ee1bc02ddf53 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85" status: 204 len: 0 microversion: 2.1 time: 0.364629 Oct 04 18:30:44.547539 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2638/5314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] DELETE /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:44.557497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c34acc8-5c77-4822-925f-4052264a905e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900838d280>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.608734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7c34acc8-5c77-4822-925f-4052264a905e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Image not found. Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c34acc8-5c77-4822-925f-4052264a905e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 HTTP/1.1 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '60ff758f-d7a5-41cf-b550-95e723e87e85'} Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60ff758f-d7a5-41cf-b550-95e723e87e85 Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:30:44.612746 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60ff758f-d7a5-41cf-b550-95e723e87e85 could not be found. Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c34acc8-5c77-4822-925f-4052264a905e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:44.618424 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c34acc8-5c77-4822-925f-4052264a905e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85" status: 404 len: 62 microversion: 2.1 time: 0.061817 Oct 04 18:30:44.622070 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2639/5315] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:44.825183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f30401c-cb2a-4f56-9bf2-5a4a794ce296", "tag": "3e590f37-8826-47c0-95a1-cbe521fb3a5d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:44.858375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.861271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.862085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.877430 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] Creating event network-changed:3e590f37-8826-47c0-95a1-cbe521fb3a5d for instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 on n-h1-833090-21 Oct 04 18:30:44.883149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6e41c77e-5441-487c-b279-de575cabc598 req-4b24697f-cdb0-4ee8-aec6-32aa86e51917 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261283 Oct 04 18:30:44.884007 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2640/5316] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:44.894005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.895734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.911857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.912630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.913308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.915044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.915647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.916184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.951150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:44.964821 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97095a71-98ce-477a-bf48-7e28f2a333c5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.548438 Oct 04 18:30:44.980107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2677/5317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:45.153492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bed36bb-4f00-49cf-9760-153b08518d8f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865320263", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:45.164517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0bed36bb-4f00-49cf-9760-153b08518d8f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bed36bb-4f00-49cf-9760-153b08518d8f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 216 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865320263", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1865320263', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:45.167025 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:30:45.172460 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:45.176768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bed36bb-4f00-49cf-9760-153b08518d8f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:45.177824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bed36bb-4f00-49cf-9760-153b08518d8f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029399 Oct 04 18:30:45.178606 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2678/5318] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:45.187863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.188484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.207962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.208482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.208914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.209622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.210084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.210525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.261953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.272996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7560245d-529d-474f-9b20-e9bee51c4eb1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1498 microversion: 2.1 time: 0.387485 Oct 04 18:30:45.273585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2641/5319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1498 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:45.283963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:45.283963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:45.300319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.300817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.301252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.301959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:45.302410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:45.302831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.555749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.580728 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb48d864-cc0a-4b63-ac23-db64079043ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.303256 Oct 04 18:30:45.598825 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2642/5320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.091889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.100968 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae21ae45-c0da-44cf-95d8-219cfa0fbe53 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.917527 Oct 04 18:30:46.116351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2679/5321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:45 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.132551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.133911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.142299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.142892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.143340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.144083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.144541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.145167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.303121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.305877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.317531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.317767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.323701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.327801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.328511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.330150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.382061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:46.461543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.475885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b80e9a1f-d266-4292-b853-bea8250e342c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.351303 Oct 04 18:30:46.477243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2643/5322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.605521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.606558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.622540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.623288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.623821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.626004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.626484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.630723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.741919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.757447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-361e9818-2b4f-4884-8eca-6a2e5efed948 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1504 microversion: 2.1 time: 0.458814 Oct 04 18:30:46.764147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2680/5323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.781456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136812273", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-key-87059843", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:46.874042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] validate_networks() for [('892ecb78-5ea0-44aa-bece-f424f822f8d0', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:47.300336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.306725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:47.314349 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ee89388e-fca1-4c52-a172-45648d877fc2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.714156 Oct 04 18:30:47.315566 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2644/5324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:47.485210 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 245 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136812273", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-key-87059843", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid key_name provided. Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1136812273', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'key_name': 'tempest-key-87059843', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-87059843 not found for user 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:47.487129 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid key_name provided. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02b695e7-66ee-4a8c-8573-0589024ad2c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.722856 Oct 04 18:30:47.500115 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2681/5325] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 724 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:30:47.504906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.505529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.515152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.515660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.516382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.517358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.524608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.525244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.728863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.740071 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-650e9f53-15c4-4b93-9409-649d389ee186 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.239063 Oct 04 18:30:47.748881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2645/5326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:47.764231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.764972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.771077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.771856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.772504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.773460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.773980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.774474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.794800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.795754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.802612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.803374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.804053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.804977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.805633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.806257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.046069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.055666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bba9ccd5-6a87-49c8-8f99-5438c6c2b3f1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1504 microversion: 2.1 time: 0.264449 Oct 04 18:30:48.061337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2646/5327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.229821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.244432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43e63e03-66a4-4af3-9e1e-bb845e65f8e0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.484534 Oct 04 18:30:48.247044 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2682/5328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.338588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.339379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.347297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.347812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.348250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.348947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.356904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.357603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.400685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-168569665", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:48.660073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.security_group_api [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Neutron security group does_not_exist not found {{(pid=123887) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:30:48.660735 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 257 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-168569665", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-168569665', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:30:48.668208 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:48.672575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:48.683026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51b12ecb-6592-4c36-adee-f78798d126ab tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.273818 Oct 04 18:30:48.683026 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2683/5329] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:48 2022] POST /compute/v2.1/servers => generated 106 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:48.683026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.683026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.696398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.696547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.696945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.698175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.698641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.699074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.932975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.943242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a25f13f-f1e9-4228-b910-667c6617bed1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.609452 Oct 04 18:30:48.953973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2647/5330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.070445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.081591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.087872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.099320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.099855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.100294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.100999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.101450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.101877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.106778 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fd21365-9fc1-456c-8448-950965e56fbd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.431089 Oct 04 18:30:49.110314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2684/5331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.136855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.154114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.172528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.173406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.192124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.193289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.196274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.196911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.571741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.585351 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6aaa9463-829d-4479-8f84-6854efaaf661 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.452800 Oct 04 18:30:49.585971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2685/5332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.598585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b7a97a-1c44-41be-98e0-f53a8a21b4f9", "name": "network-vif-plugged", "status": "completed", "tag": "17091a38-6f99-48c0-a491-73c790fa8fb3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:49.623667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.627134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.629279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.661007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] Creating event network-vif-plugged:17091a38-6f99-48c0-a491-73c790fa8fb3 for instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 on n-h2-833090-21 Oct 04 18:30:49.667742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f359f328-40e9-4a45-8164-97c4fe00f94e req-d0f20cc6-f91f-4e23-8c21-85d8d9ed8ebf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079248 Oct 04 18:30:49.668928 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2686/5333] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:49.676229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.677301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.685738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/1f9e83b9-1a77-4052-b0e8-e9392f33d4bb HTTP/1.1 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1f9e83b9-1a77-4052-b0e8-e9392f33d4bb'} Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.687812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 1f9e83b9-1a77-4052-b0e8-e9392f33d4bb could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2bb355d4-c99e-40db-aabd-2bada43c5c4f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1f9e83b9-1a77-4052-b0e8-e9392f33d4bb" status: 404 len: 111 microversion: 2.1 time: 0.019649 Oct 04 18:30:49.693858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2687/5334] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:49 2022] DELETE /compute/v2.1/servers/1f9e83b9-1a77-4052-b0e8-e9392f33d4bb => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:49.702874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.706952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.715897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.716709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.717318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.718943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.719618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.746822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.963505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:49.977584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50793bac-8edc-4ad4-b73b-6a8f3daa8485 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1504 microversion: 2.1 time: 0.899990 Oct 04 18:30:49.980959 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2648/5335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.988552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.994386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.053279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.061190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.061880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.062564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.062698 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-741f3111-d50d-4764-8a45-b27b8356a7ac tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.367099 Oct 04 18:30:50.063186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2688/5336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.064881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.065536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.066142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.093778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.094756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.101133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.101854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.102731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.103664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.104312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.104896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.363973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.374482 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-83ab1884-e3ed-47ed-89b5-fa5fce79cd00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.394842 Oct 04 18:30:50.375100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2649/5337] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.484358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.500803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07fec803-48ad-45e1-8b68-67e95e6bdd04 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.410763 Oct 04 18:30:50.531280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.536080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Failed to fetch instance by id 9223372036854775808 {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:30:50.536874 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:30:50.537747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2689/5338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9223372036854775808'} Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:50.539434 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:50.545346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:50.545346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:50.545346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:50.545346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:30:50.545346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:50.547021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:50.548295 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d922f6bf-bfd6-4364-9a59-926516beee79 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024095 Oct 04 18:30:50.552986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2650/5339] 10.222.0.40 () {58 vars in 1188 bytes} [Tue Oct 4 18:30:50 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:50.561397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:50.566419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:50.578677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.580083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.580762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.581451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:50.581905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:50.583485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.992286 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:30:50.993168 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 (ip 10.222.0.40) !!! Oct 04 18:30:51.009534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.011106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.020853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.021871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.022570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.023703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.024396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.025081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.368131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.379068 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e8a143b-e1cd-409f-9615-21553bfbff7e tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1486 microversion: 2.1 time: 0.376449 Oct 04 18:30:51.385133 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2651/5340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1486 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.399388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.404236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.415508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.421125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.421954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.422985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.423632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.425913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.581147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.598260 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b963961f-4e7d-45ce-8d25-df15ddbfcb00 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 1.043483 Oct 04 18:30:51.599862 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2690/5341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:50 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.622509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.626924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.647908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.648601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.653219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.653219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.654570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.657868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.742114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:51.820731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.836560 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-535a45e8-6ca1-4af2-853b-121e6bfad392 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.440883 Oct 04 18:30:51.839773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2652/5342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:51.856103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.857236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.870527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.871441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.874139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.876560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.878912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.886156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.206787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.214801 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f9a1c4d-4009-47b7-b1e3-84e345932d92 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.373608 Oct 04 18:30:52.215395 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2653/5343] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.225538 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3bc66351-fd47-4a30-beb8-f3971be1c7b6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 204 len: 0 microversion: 2.1 time: 0.618297 Oct 04 18:30:52.226228 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2691/5344] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:51 2022] DELETE /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:52.242851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.246477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Failed to fetch instance by id -1 {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:30:52.247279 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance -1 could not be found. Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '-1'} Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:52.249750 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:52.254623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:52.254623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:52.254623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:30:52.254623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.259679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58be77c5-679c-44a4-a83d-c45aa00c1298 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f9008323af0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.261731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance -1 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:52.262828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6fb364ff-afc9-4b8a-aae7-dbc826a2f6e5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025025 Oct 04 18:30:52.263614 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2692/5345] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:30:52 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:30:52.273454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.274723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.284963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.285504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.285949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.286686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.287210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.287888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.293409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:52.310459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-58be77c5-679c-44a4-a83d-c45aa00c1298 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Image not found. Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58be77c5-679c-44a4-a83d-c45aa00c1298 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 HTTP/1.1 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '60ff758f-d7a5-41cf-b550-95e723e87e85'} Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 60ff758f-d7a5-41cf-b550-95e723e87e85 to delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60ff758f-d7a5-41cf-b550-95e723e87e85 could not be found. Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.312512 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58be77c5-679c-44a4-a83d-c45aa00c1298 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58be77c5-679c-44a4-a83d-c45aa00c1298 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85" status: 404 len: 62 microversion: 2.1 time: 0.070512 Oct 04 18:30:52.322513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2654/5346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] DELETE /compute/v2.1/images/60ff758f-d7a5-41cf-b550-95e723e87e85 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:52.331197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.333756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.350960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.353402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.354671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.360489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.361147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.361617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.400548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:52.480356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Instance is already in deleting state, ignoring this request Oct 04 18:30:52.481721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e141a7cf-bae8-4de5-b4e8-395c3663e15b tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 204 len: 0 microversion: 2.1 time: 0.154594 Oct 04 18:30:52.482908 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2655/5347] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:52 2022] DELETE /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:52.492216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.493162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.500316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.500902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.501471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.502248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.502772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.503500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.681590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.696689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64bb4bbf-2fb7-478e-b14b-fd938d3c3a35 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.428749 Oct 04 18:30:52.697313 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2693/5348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:52.724281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f30401c-cb2a-4f56-9bf2-5a4a794ce296", "name": "network-vif-plugged", "status": "completed", "tag": "3e590f37-8826-47c0-95a1-cbe521fb3a5d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:52.736470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.737129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.745127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.752513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] Creating event network-vif-plugged:3e590f37-8826-47c0-95a1-cbe521fb3a5d for instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 on n-h1-833090-21 Oct 04 18:30:52.757845 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3ab33c3b-b508-4b09-a52a-3fb608054a92 req-a3d7ac2e-27fe-41a1-9549-630bcef5065f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 Oct 04 18:30:52.758961 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2694/5349] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:52.769890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.770696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.779300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.779977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.787578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.787578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.787578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.788071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.967907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.976430 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a080fdc8-dd29-41e3-b73d-fb6ef3f01efa tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1492 microversion: 2.1 time: 0.488678 Oct 04 18:30:52.977066 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2656/5350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1492 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:52.991148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.991786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.009404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.009903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.011275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.012096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.012554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.012983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.201300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.218017 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5af42933-487e-4ebe-adf4-db410d65e573 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.457598 Oct 04 18:30:53.219803 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2695/5351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.250581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:53.251285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: b976fddc-a85f-4b30-b2bb-3f78f70f7062] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.265645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/b976fddc-a85f-4b30-b2bb-3f78f70f7062/action HTTP/1.1 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 19 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: {"forceDelete": {}} Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b976fddc-a85f-4b30-b2bb-3f78f70f7062', 'body': {'forceDelete': {}}} Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:53.277119 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance b976fddc-a85f-4b30-b2bb-3f78f70f7062 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43848cbc-63b1-4434-aeb1-bed1fb00bd2a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/b976fddc-a85f-4b30-b2bb-3f78f70f7062/action" status: 404 len: 111 microversion: 2.1 time: 0.036813 Oct 04 18:30:53.288149 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2696/5352] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:53 2022] POST /compute/v2.1/servers/b976fddc-a85f-4b30-b2bb-3f78f70f7062/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:53.290914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.305010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.326678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.327179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.332335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.334448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.335421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.336073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.670293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.680354 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2bd12d5-d360-4c6e-a32f-57f448069fdd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1315 microversion: 2.1 time: 0.702142 Oct 04 18:30:53.681076 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2657/5353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.762609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:53.799083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74a421fa-081c-4d40-9ac7-e1e9b6bab2af tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.512508 Oct 04 18:30:53.800027 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2697/5354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.826087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.827138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.849082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.849822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.851244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.852201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.857357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.858054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.005174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.005870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.014582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.020431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.022384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.023373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.025159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.027735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.149923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.159598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a12d870-4dbb-4c30-bd2b-7adf3949c477 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.337709 Oct 04 18:30:54.160969 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2658/5355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.188772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:54.193804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.216362 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/082a4786-1ff7-4c01-a6e1-0f58a8b07a9f/action HTTP/1.1 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 39 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '082a4786-1ff7-4c01-a6e1-0f58a8b07a9f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:54.231272 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 082a4786-1ff7-4c01-a6e1-0f58a8b07a9f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-543fe368-394e-47f8-adb4-43859ce06e3e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/082a4786-1ff7-4c01-a6e1-0f58a8b07a9f/action" status: 404 len: 111 microversion: 2.1 time: 0.051999 Oct 04 18:30:54.240853 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2659/5356] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:54 2022] POST /compute/v2.1/servers/082a4786-1ff7-4c01-a6e1-0f58a8b07a9f/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:30:54.249723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.251440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.268567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.269274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.273137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.273137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.273137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.283345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.476706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.517694 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb73be23-6572-496c-a3f7-d7fee5505920 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1492 microversion: 2.1 time: 0.515366 Oct 04 18:30:54.518978 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2698/5357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1492 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:54.706593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.707908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.718898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.719390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.720740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.721693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.726927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.728211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.805791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.816330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-599e7022-45a8-4008-9fd6-79d685599b1b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.578082 Oct 04 18:30:54.817327 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2660/5358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.842338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.843972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.849111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.849775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.850575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.851453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.851929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.852610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.278997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.289378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0abaaa10-104c-4a9b-beb2-849889b231bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.450844 Oct 04 18:30:55.289963 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2661/5359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:55.326031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b7a97a-1c44-41be-98e0-f53a8a21b4f9", "name": "network-vif-unplugged", "status": "completed", "tag": "17091a38-6f99-48c0-a491-73c790fa8fb3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:55.346681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.355122 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbdeddac-81c0-460c-bcc1-2d8088f527b3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1501 microversion: 2.1 time: 0.654484 Oct 04 18:30:55.355745 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2699/5360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1501 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.365964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.368388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.382297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.383963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.384112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. Oct 04 18:30:55.386919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 HTTP/1.1 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0f96e421-d6a2-4d6a-9aa3-d8414c55cac0'} Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:55.399225 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:55.406295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:55.406295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:55.406295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:55.406295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. Oct 04 18:30:55.406295 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:55.408800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:55.416398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2932db51-e61c-40ba-9d20-03a0a875dccc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0f96e421-d6a2-4d6a-9aa3-d8414c55cac0" status: 404 len: 111 microversion: 2.1 time: 0.053086 Oct 04 18:30:55.416398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2700/5361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/0f96e421-d6a2-4d6a-9aa3-d8414c55cac0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:55.424768 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] Creating event network-vif-unplugged:17091a38-6f99-48c0-a491-73c790fa8fb3 for instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 on n-h2-833090-21 Oct 04 18:30:55.441401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:55.441401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.441808 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-02179aea-a644-40e2-8df2-eb39f9c5b912 req-a19be33c-1574-4ff1-a11a-539622795857 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133135 Oct 04 18:30:55.442737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2662/5362] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:55.449950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.450567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.451078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.451837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.452427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.459095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.468808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.469659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.499257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.506703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.509311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.514014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.518684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.519223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.528388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84bd3fb4-51f7-428e-adaf-4ec6281d5dc6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.114008 Oct 04 18:30:55.533824 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2701/5363] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:55 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:55.543440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.552469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.569633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.570143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.570592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.571342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.571828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.584087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.848084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.864456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:55.874416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.891126 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-886f50e9-7f9c-4739-8da0-f469ea464e16 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1450 microversion: 2.1 time: 0.348103 Oct 04 18:30:55.892757 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2702/5364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1450 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:55.894970 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b190aac4-8bc2-4cae-86bb-8023bc3a3ff9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.449714 Oct 04 18:30:55.915588 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2663/5365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.922192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b7a97a-1c44-41be-98e0-f53a8a21b4f9", "name": "network-vif-deleted", "tag": "17091a38-6f99-48c0-a491-73c790fa8fb3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:55.928964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.929906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.935912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:55.937481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.938011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.938700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.939929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.940762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.941538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.953734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.954481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.954920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.978674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] Creating event network-vif-deleted:17091a38-6f99-48c0-a491-73c790fa8fb3 for instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 on n-h2-833090-21 Oct 04 18:30:55.984890 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-616daf2f-5098-4bd2-91fb-8cfeaf2429c5 req-5470c8e3-8bab-4947-9edc-bb6e2fe00867 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088403 Oct 04 18:30:55.985592 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2703/5366] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:56.212405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.223349 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35e4b68a-20ec-45a4-aaf5-1b19760e770b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.299923 Oct 04 18:30:56.247681 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2664/5367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.440786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-506dc516-2cf1-4f02-b301-b6d303e7a077 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1297738086", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-506dc516-2cf1-4f02-b301-b6d303e7a077 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 238 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1297738086", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1297738086', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.474800 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:30:56.480099 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:56.483997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-506dc516-2cf1-4f02-b301-b6d303e7a077 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:56.485046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-506dc516-2cf1-4f02-b301-b6d303e7a077 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.055350 Oct 04 18:30:56.486204 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2704/5368] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:56.494501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.495381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.508058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.508958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.509402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.510646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.511111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.513846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.544871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:56.547199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.563589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.564094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.564542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.566182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.566655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.567080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.631082 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f84198a-1f3c-4a5c-812a-01ac21300684 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.089684 Oct 04 18:30:56.636066 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2705/5369] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:56 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:56.775710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:56.785197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a251212f-1398-445e-8ad9-8a26c14f1608 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.294700 Oct 04 18:30:56.786939 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2665/5370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.817140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.818679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.834841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.841351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.841840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.844207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.844692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.845133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.917767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.919136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.933047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.934771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.936529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.938571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.940636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.943316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.999841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.000504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.001088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.001845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lazy-loading 'fault' on Instance uuid 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:57.119072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8553f76d0f804314b29e82142e728c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cd7fddae8343f29e6c7a308470cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.128831 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-edeb3b1d-84ad-46be-95ee-78967d861f23 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 200 len: 1297 microversion: 2.1 time: 0.216482 Oct 04 18:30:57.133186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2666/5371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 1297 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:57.615017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.627083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f272fdf5-20ac-4df6-8ff3-de9af92cd5bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.816010 Oct 04 18:30:57.630072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2706/5372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.650636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:57.653034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.678159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.680563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.681238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.684128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.684814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.685521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.732974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c239a70-832f-4d08-a3e8-506468254460 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.086954 Oct 04 18:30:57.733803 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2667/5373] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:57 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:57.820007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5015fb15-67b0-4593-954e-48dd48286196 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732150718", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5015fb15-67b0-4593-954e-48dd48286196 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 234 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732150718", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-732150718', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.830044 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:30:57.835401 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:30:57.837816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5015fb15-67b0-4593-954e-48dd48286196 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:57.839052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5015fb15-67b0-4593-954e-48dd48286196 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024131 Oct 04 18:30:57.840247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2707/5374] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:57 2022] POST /compute/v2.1/servers => generated 133 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:57.848808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:57.854065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:57.867068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.868789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.870334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.874968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:57.875698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:57.876332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.070092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.078426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31b82173-c718-4a39-86b4-ea88ade1aa77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.233771 Oct 04 18:30:58.079269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2668/5375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:57 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:58.107302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.107980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.132089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.133043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.133652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.139969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.139969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.139969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.164684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.165417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 09b7a97a-1c44-41be-98e0-f53a8a21b4f9] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.180496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.180777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.181588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.191980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.191980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.191980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.209619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 HTTP/1.1 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '09b7a97a-1c44-41be-98e0-f53a8a21b4f9'} Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.212473 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 09b7a97a-1c44-41be-98e0-f53a8a21b4f9 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8be42495-61ad-4771-8157-06563b5ca874 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9" status: 404 len: 111 microversion: 2.1 time: 0.054561 Oct 04 18:30:58.224236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2669/5376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/09b7a97a-1c44-41be-98e0-f53a8a21b4f9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.225240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec43bf10-e6b8-497d-8b96-3cb68ba4b023 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900833cb80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.259135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ec43bf10-e6b8-497d-8b96-3cb68ba4b023 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Image not found. Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec43bf10-e6b8-497d-8b96-3cb68ba4b023 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c HTTP/1.1 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a66cbfc5-1154-48f8-8aa4-0840d5268f2c'} Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a66cbfc5-1154-48f8-8aa4-0840d5268f2c to delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a66cbfc5-1154-48f8-8aa4-0840d5268f2c could not be found. Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.261467 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec43bf10-e6b8-497d-8b96-3cb68ba4b023 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.274463 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec43bf10-e6b8-497d-8b96-3cb68ba4b023 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c" status: 404 len: 62 microversion: 2.1 time: 0.050264 Oct 04 18:30:58.277086 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2670/5377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/images/a66cbfc5-1154-48f8-8aa4-0840d5268f2c => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:58.282345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.282833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.291868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.292370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.292802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.293934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.294582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.295220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.312342 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a HTTP/1.1 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6b57c4dc-9480-43c6-a7b1-eca0b253568a'} Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.314501 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.318959 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.321737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.322858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30fe7daa-1ec9-4078-8035-77c7dc9623fe tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 404 len: 111 microversion: 2.1 time: 0.044709 Oct 04 18:30:58.324016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2671/5378] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.337144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.338533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 6b57c4dc-9480-43c6-a7b1-eca0b253568a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.349969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.363747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.364972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.365993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.367085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.367818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.389042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a HTTP/1.1 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6b57c4dc-9480-43c6-a7b1-eca0b253568a'} Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.390989 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. Oct 04 18:30:58.396491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.398257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 6b57c4dc-9480-43c6-a7b1-eca0b253568a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.399348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-328006d2-3ae2-4a73-bbbc-6dc88f162492 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a" status: 404 len: 111 microversion: 2.1 time: 0.067514 Oct 04 18:30:58.408598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2672/5379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/6b57c4dc-9480-43c6-a7b1-eca0b253568a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.417305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a94d31d-7003-4d08-93ab-11155c6a7df7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900833f5e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7a94d31d-7003-4d08-93ab-11155c6a7df7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Image not found. Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a94d31d-7003-4d08-93ab-11155c6a7df7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda HTTP/1.1 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ff17b603-eefa-40b7-9648-e4fb79184eda'} Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ff17b603-eefa-40b7-9648-e4fb79184eda to delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff17b603-eefa-40b7-9648-e4fb79184eda could not be found. Oct 04 18:30:58.450182 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a94d31d-7003-4d08-93ab-11155c6a7df7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a94d31d-7003-4d08-93ab-11155c6a7df7 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda" status: 404 len: 62 microversion: 2.1 time: 0.037673 Oct 04 18:30:58.455658 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2673/5380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/images/ff17b603-eefa-40b7-9648-e4fb79184eda => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:30:58.461528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.466648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.477693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.478667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.478809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.479924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.480437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.480919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.507723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed HTTP/1.1 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3f657fba-0160-42bb-9416-b2db74a900ed'} Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.514453 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49fb4406-77fb-4286-afda-88c7758cce7d tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 404 len: 111 microversion: 2.1 time: 0.062470 Oct 04 18:30:58.520346 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2674/5381] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.538131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.540800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 3f657fba-0160-42bb-9416-b2db74a900ed] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.558988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.561645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.562095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.571658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.573653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.574275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.592512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed HTTP/1.1 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '3f657fba-0160-42bb-9416-b2db74a900ed'} Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.594059 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 3f657fba-0160-42bb-9416-b2db74a900ed could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d026787-726d-4a84-b74a-03c53ff29acb tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed" status: 404 len: 111 microversion: 2.1 time: 0.069573 Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2675/5382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/3f657fba-0160-42bb-9416-b2db74a900ed => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.605114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2fbaf4b-4bf9-4560-9461-b259f53012d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '.version_select at 0x7f900833cdc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.627905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e2fbaf4b-4bf9-4560-9461-b259f53012d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Image not found. Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2fbaf4b-4bf9-4560-9461-b259f53012d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 HTTP/1.1 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: method: Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: exception: Image not found. Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '228a182c-a6e8-4c7d-a406-c2660d59b2b2'} Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 228a182c-a6e8-4c7d-a406-c2660d59b2b2 to delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 228a182c-a6e8-4c7d-a406-c2660d59b2b2 could not be found. Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.629969 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2fbaf4b-4bf9-4560-9461-b259f53012d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Image not found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2fbaf4b-4bf9-4560-9461-b259f53012d6 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2" status: 404 len: 62 microversion: 2.1 time: 0.030784 Oct 04 18:30:58.641491 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2676/5383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/images/228a182c-a6e8-4c7d-a406-c2660d59b2b2 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:30:58.657088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.657588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.676384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.676883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.677335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.678052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.678517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.678952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.716897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a HTTP/1.1 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0beee5a1-5483-47fe-97ae-e8147663d18a'} Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.719281 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.731216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c461220a-caa7-4dbb-8d4e-f514e8e40aa1 tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 404 len: 111 microversion: 2.1 time: 0.081290 Oct 04 18:30:58.732646 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2677/5384] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:58 2022] DELETE /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:58.746594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.748005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] [instance: 0beee5a1-5483-47fe-97ae-e8147663d18a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.789372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.790107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.790641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.792006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.792572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.794220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.812749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] HTTP exception thrown: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Request method failure captured: Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a HTTP/1.1 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHrTWNNfoMe7eBpAJUw4Cj-wCOWStd3MDDkByUssdWBzjFKw__y2aikWawxdZ-RrqMBtqhvOl8R9ZqwbmZ6lGz-hZSz2Lr3O2YRWKINS6t4KoqubZdSvlMmIKHo4eUldRIJX-rYede2LJD8iwjRoqzy_yExYT_D9SfGpmAB0osMdouw Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/56cd7fddae8343f29e6c7a308470cb09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/56cd7fddae8343f29e6c7a308470cb09"}]}] Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 56cd7fddae8343f29e6c7a308470cb09 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ImagesTestJSON-618638323 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 8553f76d0f804314b29e82142e728c71 Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ImagesTestJSON-618638323-project Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0beee5a1-5483-47fe-97ae-e8147663d18a'} Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.815719 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:58.821104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] Returning 404 to user: Instance 0beee5a1-5483-47fe-97ae-e8147663d18a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:58.822593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0350e98-0950-44a9-ab89-d8135e570def tempest-ImagesTestJSON-618638323 tempest-ImagesTestJSON-618638323-project] 10.222.0.40 "GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a" status: 404 len: 111 microversion: 2.1 time: 0.082777 Oct 04 18:30:58.826789 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2678/5385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/0beee5a1-5483-47fe-97ae-e8147663d18a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:30:58.828362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:58.830898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.841187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.841716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.842152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.842885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.843338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.843804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.907915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7dbdabe3-97d6-4a48-80f5-f37c3f0987af tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.083130 Oct 04 18:30:58.911925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2679/5386] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:58 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:58.959198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.972969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a2e2842c-b255-44bb-9c7a-07d0d228ad56 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.872174 Oct 04 18:30:58.973724 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2708/5387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:58.996193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:58.997108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 406ed8c3-bf88-41fb-a7fd-b60555ae4d07] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.003806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/406ed8c3-bf88-41fb-a7fd-b60555ae4d07/action HTTP/1.1 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 13 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: {"pause": {}} Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '406ed8c3-bf88-41fb-a7fd-b60555ae4d07', 'body': {'pause': {}}} Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:59.008993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 406ed8c3-bf88-41fb-a7fd-b60555ae4d07 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3f5bed0-74ea-4fa2-a765-9fb5e6d58cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/406ed8c3-bf88-41fb-a7fd-b60555ae4d07/action" status: 404 len: 111 microversion: 2.1 time: 0.018827 Oct 04 18:30:59.026541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2680/5388] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:58 2022] POST /compute/v2.1/servers/406ed8c3-bf88-41fb-a7fd-b60555ae4d07/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:59.042215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.042909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.060275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.061002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.061464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.062424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.063144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.063828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.461473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.472993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a7fdbc4-f610-4acb-b66b-4bb75033fd6b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.453117 Oct 04 18:30:59.485987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2709/5389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:59.498037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.499582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.509997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.510808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.511882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.512673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.513199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.513854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.747193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.757333 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b81e484-d983-4947-b146-b681df599a7e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.264035 Oct 04 18:30:59.758676 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2681/5390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:59.781742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:59.783859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.794654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.796481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.797593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.798690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.799523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.802442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.921721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:59.923523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.939030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.939745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.940770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.941697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.942329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.944001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.019222 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b1f5540-3500-411f-a26b-5a349c54e8ca tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.101829 Oct 04 18:31:00.023253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2682/5391] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:59 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:00.083146 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86228590-f9f9-4a27-92da-b2be9d5eb50c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.305225 Oct 04 18:31:00.084445 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2710/5392] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:59 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:00.104500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:00.108511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:00.119608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.120687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.121435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.123431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.124120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.124562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.372031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.383996 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85b4d819-89bb-4f18-9cf2-883f1cccc290 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1511 microversion: 2.1 time: 0.293236 Oct 04 18:31:00.383996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2683/5393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:00 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:01.044916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:01.050031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.073347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.075657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.076426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.079209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.080008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.080536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.172623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72d0b71b-b42f-4efb-a164-df0587698203 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.141500 Oct 04 18:31:01.173631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2711/5394] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:01 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:01.412902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:01.416677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.427852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.428353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.432810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.432810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.432810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.433753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.975635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.996134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e25130b5-94b4-4534-9783-b789e2f940bd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1491 microversion: 2.1 time: 0.586568 Oct 04 18:31:01.996134 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2684/5395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:01 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1491 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:02.020643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.021710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.032457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.033190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.033818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.034740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.035378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.036060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'pause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state paused Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 13 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: {"pause": {}} Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'pause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state paused Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'pause': {}}} Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state paused Oct 04 18:31:02.073907 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state paused Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'pause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state paused {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:02.079950 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00b6d214-8e38-46a2-84c8-b9c6d7649772 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 143 microversion: 2.1 time: 0.058024 Oct 04 18:31:02.082482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.083028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.088052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2712/5396] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 143 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:02.089620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.090148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.090595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.091302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.091787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.092216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.184721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:02.186995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.201596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.202108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.206266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.214164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.214801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.216058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.275696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-89576fed-27e1-4213-a6b7-df0f18329305 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.095115 Oct 04 18:31:02.276704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2713/5397] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:31:02.320460 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9a894c7-3a53-48d1-ba9c-0fdc76f28629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.242022 Oct 04 18:31:02.325110 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2685/5398] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:02 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:02.347324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.350402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.388209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.394061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.394061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.394061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.394061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.394061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.668869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:02.680737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d6d7654-aabe-48ff-9e5a-d721384c5c33 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1498 microversion: 2.1 time: 0.350297 Oct 04 18:31:02.681383 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2714/5399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:03.289453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:03.292382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:03.313806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.313806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.313806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.315850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.318751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.319246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.394891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a856eef4-79c4-4ec0-afd2-e83827878b25 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.110017 Oct 04 18:31:03.395935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2686/5400] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:03 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:03.707970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:03.707970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:03.717721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.718211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.718648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.719351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.719826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.720247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.355143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.358790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:04.363804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86d97293-12ff-4129-8e11-59c898638c24 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.662193 Oct 04 18:31:04.364389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2715/5401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:03 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.403119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.404739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.411194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:04.412740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.420756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.420756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.421022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.421330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.421330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.421330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.428253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.435250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.436011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.436870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.437419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.437928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.519208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76e01251-3c15-4a05-b5ab-71775ba61fc5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.116534 Oct 04 18:31:04.520360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2716/5402] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:04 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:05.156530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:05.162039 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32df3d78-19ce-492f-a9da-d64b3f527ac7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.763540 Oct 04 18:31:05.184746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2687/5403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.194806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:05.197402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.205840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.206658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.207318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.208339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.209026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.209692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action HTTP/1.1 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 28 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: {"reboot": {"type": "SOFT"}} Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0e444745-ea56-4353-a7c4-dd7346dfcf13', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:31:05.232690 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:05.237100 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:05.239850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:05.241006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-477d7d64-e575-4b71-9bb9-33559cb98c62 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action" status: 404 len: 111 microversion: 2.1 time: 0.050843 Oct 04 18:31:05.246679 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2717/5404] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:05 2022] POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:05.252481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.254350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.261009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.261507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.262008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.262708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.263188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.265868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.534071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:05.537956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.556608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.562468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.562468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.562468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.562468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.562468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.616365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8270774a-a50d-4af9-8842-2101b8d413c4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.089047 Oct 04 18:31:05.618701 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2718/5405] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:05 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:06.097148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.137928 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5267885d-4bd3-40b7-a86b-4d87b09ce639 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.889950 Oct 04 18:31:06.138930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2688/5406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.162713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.163772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.171918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.172707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.173331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.174234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.174879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.175506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.326295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.339703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa3e009e-3daa-4408-8e97-a31e330c4140 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.181036 Oct 04 18:31:06.343175 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2719/5407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.366641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.372018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 71788d5f-4f16-4112-bc35-199baf00fa53] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.374918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/71788d5f-4f16-4112-bc35-199baf00fa53/action HTTP/1.1 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 28 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: {"reboot": {"type": "SOFT"}} Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '71788d5f-4f16-4112-bc35-199baf00fa53', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. Oct 04 18:31:06.376615 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. Oct 04 18:31:06.383661 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:06.385823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 71788d5f-4f16-4112-bc35-199baf00fa53 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:06.386767 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f009de7d-6528-4a0a-a482-b35a2af0b4d3 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/71788d5f-4f16-4112-bc35-199baf00fa53/action" status: 404 len: 111 microversion: 2.1 time: 0.025229 Oct 04 18:31:06.387441 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2689/5408] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/servers/71788d5f-4f16-4112-bc35-199baf00fa53/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:06.403005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.404243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.410236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:06.412097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.412851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.413540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.414496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.415183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.416001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.629277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.631452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.647143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.651506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.653311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.654304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.655870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.656508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.666891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:06.758705 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0f9fa79-b7dd-4ed8-8f25-3b50b94a8d00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 14 microversion: 2.1 time: 0.133252 Oct 04 18:31:06.759822 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2690/5409] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:31:07.642963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.668038 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ecd4d47-96a4-4dec-a73a-0927064cb998 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 1.269691 Oct 04 18:31:07.671233 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2720/5410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.713547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.715091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.727812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.728700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.729359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.730284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.731061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.731970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.771792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:07.775068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.787750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.792090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.792796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.795139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.795854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.814954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.891635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0497fa81-504c-454a-ada5-b34a7a5404ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action" status: 200 len: 8204 microversion: 2.1 time: 0.124537 Oct 04 18:31:07.896178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2721/5411] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:07 2022] POST /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296/action => generated 8204 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:07.909107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.911460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.930339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.931823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.933008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.935145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.935943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.937514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.049174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.064528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c19d59e3-ff50-436a-8384-27c64f6b0820 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.357308 Oct 04 18:31:08.065215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2691/5412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.090852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:08.093812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.102866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.102866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.102866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.103683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.103683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.104175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.120064 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action HTTP/1.1 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 65 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0e444745-ea56-4353-a7c4-dd7346dfcf13', 'body': {'rebuild': {'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6'}}} Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:31:08.121940 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1167c7a-6118-4602-b6d3-d8301f383f72 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action" status: 404 len: 111 microversion: 2.1 time: 0.042664 Oct 04 18:31:08.131313 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2692/5413] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:08 2022] POST /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:31:08.139275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.139927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.147167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.147689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.148416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.149336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.149979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.150735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.385383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.394747 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dae46ef9-6539-4b5b-94e6-1e4ed1087dbf tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.259955 Oct 04 18:31:08.396912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2693/5414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.429418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.429418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.440275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.441235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.443007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.446040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.446837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.447843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.448934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.460575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8340fe9-dabc-4c57-ad70-09cac4741021 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.559278 Oct 04 18:31:08.480995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2722/5415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.507425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.508488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.530333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.534808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.535296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.536080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.540227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.544776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.768991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.777869 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed33230e-c5f4-40bf-a315-1e9b1ebd2a5b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.357848 Oct 04 18:31:08.791805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2694/5416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.803342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:08.803957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 9997fcaf-60ba-4731-82fe-390961da8ee7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.815193 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/9997fcaf-60ba-4731-82fe-390961da8ee7/action HTTP/1.1 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 65 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9997fcaf-60ba-4731-82fe-390961da8ee7', 'body': {'rebuild': {'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6'}}} Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:31:08.817656 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. Oct 04 18:31:08.823890 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:08.829174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.835171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 9997fcaf-60ba-4731-82fe-390961da8ee7 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:08.840534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77ebe8a9-e644-44cf-a91a-cd50b60e0e7f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/9997fcaf-60ba-4731-82fe-390961da8ee7/action" status: 404 len: 111 microversion: 2.1 time: 0.039335 Oct 04 18:31:08.840534 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2695/5417] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:08 2022] POST /compute/v2.1/servers/9997fcaf-60ba-4731-82fe-390961da8ee7/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:31:08.841911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-00ae65b6-8951-4275-a109-d9dc7e3713c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.344043 Oct 04 18:31:08.848854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.849804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.856308 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2723/5418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.871416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.873272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.874900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.875768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.878452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.879177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.879597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.881641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.903641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.903641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.903641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.913780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.914347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.914797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.231761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.248160 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6803b276-a5ce-4dd6-9cfa-3773be9531e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.404878 Oct 04 18:31:09.248760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2696/5419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.294742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.294742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.304965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.305554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.306044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.308136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.315113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.315113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.599613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.617535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbdacb34-43eb-448e-9a9f-351bb326a9d9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.755574 Oct 04 18:31:09.619912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2724/5420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.646448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.655770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.657691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.663595 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-712a7399-500b-445b-b6be-6eb070b4e967 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.392215 Oct 04 18:31:09.664764 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2697/5421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.679911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.716752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:09.722468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 7695b45a-23b7-4488-a776-0ff20ef4f5e0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.733500 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/7695b45a-23b7-4488-a776-0ff20ef4f5e0/action HTTP/1.1 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 15 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: {"restore": {}} Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '7695b45a-23b7-4488-a776-0ff20ef4f5e0', 'body': {'restore': {}}} Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:09.735283 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 7695b45a-23b7-4488-a776-0ff20ef4f5e0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd0007e0-b68f-4d22-9bbd-a5d2843fd4e8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/7695b45a-23b7-4488-a776-0ff20ef4f5e0/action" status: 404 len: 111 microversion: 2.1 time: 0.040587 Oct 04 18:31:09.741357 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2698/5422] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:09 2022] POST /compute/v2.1/servers/7695b45a-23b7-4488-a776-0ff20ef4f5e0/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:31:09.746226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.746837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.754044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.762599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.885593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.900882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0277f0d4-4631-4943-a512-eca893b7ce70 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.251990 Oct 04 18:31:09.900882 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2725/5423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:09.929321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:09.931031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.941019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.942652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.946601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.948167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.950362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.951195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.221230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Locking {{(pid=123887) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:31:10.224223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.234616 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ac34d0b-5d14-4320-92e3-d5c286404314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.491865 Oct 04 18:31:10.235807 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2699/5424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:10.271696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:10.272855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:10.300861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.301921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.303789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.305299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.308551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.310071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.471505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d719ff4-d816-493c-97e0-f1d2c2e18062 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.548620 Oct 04 18:31:10.472572 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2726/5425] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:09 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:11.087389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-376dd94f-4b84-4a7c-ab0a-e816c02dfd37 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f9008782700>, body: {"keypair": {"name": "tempest-keypair-1026653003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz6jmcgJHmQ7R1pxnaNDxBxTsXe6v724lSSTzhZ72mg1fFNOBOlhNkiSpL7xWS+MKtlI7jn3+CsIaj+Y5wgmFPaojwfV7a5liuZSr22av/XXXMOlWbWdbOH5R3cINTJTg=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.087389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-376dd94f-4b84-4a7c-ab0a-e816c02dfd37 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:11.087389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-376dd94f-4b84-4a7c-ab0a-e816c02dfd37 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7333b16b-3217-484f-bb69-a0b72eb63de2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.502827 Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2700/5426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.092636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-376dd94f-4b84-4a7c-ab0a-e816c02dfd37 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.393465 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2727/5427] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'restore' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 15 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:11.096139 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: {"restore": {}} Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'restore' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'restore': {}}} Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.097950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'restore' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80a3dbf7-6580-44c0-92e6-80124492fe9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 145 microversion: 2.1 time: 0.056311 Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2728/5428] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:10 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 145 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a94d825-df9d-453d-b6c0-ea08e93feaa8 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f9008c9b430>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a94d825-df9d-453d-b6c0-ea08e93feaa8 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1026653003" status: 200 len: 498 microversion: 2.1 time: 0.029023 Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2729/5429] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1026653003 => generated 498 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.101505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.125579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.136666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ea65da7-e8c5-4617-8295-49d23cac43cf tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.362113 Oct 04 18:31:11.166891 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2701/5430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.191291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.196856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce85fa55-a6ed-4fc3-8a40-dab4b0a1d710 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f90084535e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.202336 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b1beebc-d1cb-4b33-9fd4-9c366cbc5286 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.231338 Oct 04 18:31:11.203368 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2730/5431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:10 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.211515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.221044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.221777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.222369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.256347 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action HTTP/1.1 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 15 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: {"os-stop": {}} Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '42b84396-795d-48f1-9c4a-5d58af928c52', 'body': {'os-stop': {}}} Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked Oct 04 18:31:11.258610 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.266122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 409 to user: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 is locked {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:11.266122 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e776cb1d-89d9-408d-8da5-a552593828ad tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 409 len: 107 microversion: 2.1 time: 0.056695 Oct 04 18:31:11.266122 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2731/5432] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 107 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:11.270290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.270909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.277158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.277660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.278100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.278799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.279256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.279718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.303851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce85fa55-a6ed-4fc3-8a40-dab4b0a1d710 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026653003" status: 202 len: 0 microversion: 2.1 time: 0.129773 Oct 04 18:31:11.307110 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2702/5433] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026653003 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:11.314512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.315382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.333335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.334368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.335035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.336141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.336749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.339964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.613005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Unlocking {{(pid=123886) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:31:11.758656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.829742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-130a89a6-27bc-4cee-89a4-7d0a66727e59 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.560314 Oct 04 18:31:11.832893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2732/5434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.844587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d58bcad-de85-46cf-a08e-b41acfd3952e tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f90086b5670>, body: {"keypair": {"name": "tempest-keypair-1541694119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKX2jzaXpQoQTquc6bWuRmGHcKU7d1+wjv4zRLcPgJezk4tbYxRqCArSKBdcZ+qeCQgmAPdJkc6+TKUOVLhTk3GVmE7YA9idlW3Tf+fcqynp+4Ebrf1GWqLH1hUlGB9Ozw=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.858667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22968ff8-cdbf-41f2-8d02-cf9459d3e55b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.550185 Oct 04 18:31:11.859683 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2703/5435] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:11.864491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.865208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 055a8309-c35a-405f-bc2a-19ab66c9f977] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.872014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4d58bcad-de85-46cf-a08e-b41acfd3952e tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:11.878173 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/055a8309-c35a-405f-bc2a-19ab66c9f977/action HTTP/1.1 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 14 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: {"resume": {}} Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '055a8309-c35a-405f-bc2a-19ab66c9f977', 'body': {'resume': {}}} Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:11.887312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:11.890897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:11.890897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:11.890897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. Oct 04 18:31:11.890897 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:11.892420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 055a8309-c35a-405f-bc2a-19ab66c9f977 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:11.893443 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0089bc82-cde8-4a21-8148-918b3d37bc0c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/055a8309-c35a-405f-bc2a-19ab66c9f977/action" status: 404 len: 111 microversion: 2.1 time: 0.032697 Oct 04 18:31:11.894174 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2704/5436] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/servers/055a8309-c35a-405f-bc2a-19ab66c9f977/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:11.911859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:11.924053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4d58bcad-de85-46cf-a08e-b41acfd3952e tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:11.937711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.938466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.942256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.006395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:31:12.061343 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d58bcad-de85-46cf-a08e-b41acfd3952e tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227360 Oct 04 18:31:12.062422 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2733/5437] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:12.068057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.071069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.090963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.091575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.092590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.093487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.093999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.094526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.284112 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75c3f19e-7b18-4883-ae74-81c6985e7a97 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.384996 Oct 04 18:31:12.289560 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2705/5438] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:12.296318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6d6d391-4e58-4871-ad38-7fd299f6b1b4 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f9008361b80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.435052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.446004 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4393dab6-6e56-45ea-a97d-75ffcea65003 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.382391 Oct 04 18:31:12.446604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2734/5439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.455918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6d6d391-4e58-4871-ad38-7fd299f6b1b4 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541694119" status: 202 len: 0 microversion: 2.1 time: 0.164564 Oct 04 18:31:12.457449 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2706/5440] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541694119 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:12.474407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.475260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.480074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27fc4036-00f1-464b-b7b1-4545a9c20464 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f9008323550>, body: {"keypair": {"name": "tempest-keypair-145071229", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.497437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.497934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.498373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.502370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.507625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.507625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.513014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-27fc4036-00f1-464b-b7b1-4545a9c20464 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:12.529887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-27fc4036-00f1-464b-b7b1-4545a9c20464 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:12.547158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.661814 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27fc4036-00f1-464b-b7b1-4545a9c20464 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.192441 Oct 04 18:31:12.664132 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2707/5441] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:12 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:12.675695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.684478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.690100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.691119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.691803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.697155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.697839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.698280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.801537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.811522 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21b21dc2-9ea0-4faa-b055-f5c86f8f4954 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.350357 Oct 04 18:31:12.812299 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2735/5442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.817371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6822622-ced4-49a7-94cc-5f3b5f8c9576 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f900977c9d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.908023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.912663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9940ccfb-d9ba-47b4-932e-7930e2a81570 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.246919 Oct 04 18:31:12.913611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2708/5443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:12.936270 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6822622-ced4-49a7-94cc-5f3b5f8c9576 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145071229" status: 202 len: 0 microversion: 2.1 time: 0.122755 Oct 04 18:31:12.937457 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2736/5444] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145071229 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:12.946228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.947821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.949674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bc5c7f6-2904-4ec1-9427-0ca88504df07 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f90083b8b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1084160906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7VKHHwlNKkD01d2zO/7UMgxz07AwtnHN56PRoKiIGjGkWGAuDkj2pvM+NSGEcAu4u/DyP1bKHnJ6C/MC4UlxaChID6b394gp+5sYJ0bT5EQ/vf12BjmdlkVylriBJeEQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.950727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:12.960142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.960255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.960714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.963408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.964141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.965221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.002675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'resume' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 14 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: {"resume": {}} Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot 'resume' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'resume': {}}} Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:13.004624 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:31:13.016836 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:31:13.017290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8bc5c7f6-2904-4ec1-9427-0ca88504df07 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:13.017371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'resume' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:13.017371 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ccef084b-baee-4399-9bfd-77d387295a27 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 144 microversion: 2.1 time: 0.074863 Oct 04 18:31:13.017371 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2709/5445] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:12 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 144 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:31:13.020897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8bc5c7f6-2904-4ec1-9427-0ca88504df07 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:13.022796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.023804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.033160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.033676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.035016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.035749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.036368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.036971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.153870 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bc5c7f6-2904-4ec1-9427-0ca88504df07 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.202179 Oct 04 18:31:13.154530 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2737/5446] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:13.168547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-13e68f20-a337-4051-a7a0-7455d737c4bb tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f900849a5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-634379545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVv8XEw13hZjW9GOLNl7HbGmUBdpQY/iCcsTPJDjn2krBurX9JumdySEfVnhdxIEb2WZUlq5r1eW5I7HXVc00NgNQNpIp3jv8oiCJj5URc+TCWSHdfGmG2g+Ak38EVcEA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:13.215702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-13e68f20-a337-4051-a7a0-7455d737c4bb tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:13.240097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-13e68f20-a337-4051-a7a0-7455d737c4bb tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:13.345242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-13e68f20-a337-4051-a7a0-7455d737c4bb tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.172324 Oct 04 18:31:13.345242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2738/5447] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:13 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:13.350833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3ee62162-79f9-46f6-9866-176bcfd025af tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Action: 'create', calling method: .version_select at 0x7f9008703940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1401665073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk7kcAn5zDblcvHgzrUcv1TBlqHjhARsQbPGUjVDXkCZ0LvWug32W11OVo9shFxuIKKajJDzi6XFBXpKQFpzXhXPW7L95Q343ixhRDBKISYTFykpTfo7SlBqILgGm1HBQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:13.376017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3ee62162-79f9-46f6-9866-176bcfd025af tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:13.387706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3ee62162-79f9-46f6-9866-176bcfd025af tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Getting quotas for user c3dcfc264c6f4896b3df60e2248be2a3 and project 4f0d295351e2402999271d8d129fd9ef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:13.475500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.478752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:13.489177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-440a38a7-0bbe-418c-823a-05a7806c5560 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.473718 Oct 04 18:31:13.495143 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2710/5448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:13.516235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.516856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.537039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.537670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.538068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.538676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.539135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.548752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.638445 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3ee62162-79f9-46f6-9866-176bcfd025af tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.291818 Oct 04 18:31:13.644195 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2739/5449] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:13.656694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-854d795d-6ee2-4fec-adac-85e2566dfa25 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f90083e4940>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.672683 n-d-833090-21 devstack@n-api.service[123887]: WARNING oslo_db.sqlalchemy.utils [None req-854d795d-6ee2-4fec-adac-85e2566dfa25 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:31:13.682118 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-854d795d-6ee2-4fec-adac-85e2566dfa25 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.035134 Oct 04 18:31:13.683865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2740/5450] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:13.695441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a216031-ba21-4443-9ecd-d5de387d1aca tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f9008703310>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.788869 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a216031-ba21-4443-9ecd-d5de387d1aca tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1401665073" status: 202 len: 0 microversion: 2.1 time: 0.096806 Oct 04 18:31:13.791385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2741/5451] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 4 18:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1401665073 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:13.804529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3129c4c2-da5a-48c4-a000-6ca93895dd68 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f90086e3280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.826233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:13.861424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.869795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d9b42f1-797f-454c-a9be-f31bee56f594 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.357338 Oct 04 18:31:13.870807 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2711/5452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:13.887675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.892203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.909255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.909751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.910584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.911300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.912367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.913611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.924249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3129c4c2-da5a-48c4-a000-6ca93895dd68 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-634379545" status: 202 len: 0 microversion: 2.1 time: 0.129632 Oct 04 18:31:13.924842 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2742/5453] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-634379545 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:13.934114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d67201b8-f44a-45db-8b11-c0fa342b9448 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] Calling method '.version_select at 0x7f900844ff70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.045232 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d67201b8-f44a-45db-8b11-c0fa342b9448 tempest-KeyPairsV2TestJSON-454205587 tempest-KeyPairsV2TestJSON-454205587-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1084160906" status: 202 len: 0 microversion: 2.1 time: 0.115843 Oct 04 18:31:14.046442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2743/5454] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 4 18:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1084160906 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:14.131613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f545bb23-9fbf-475a-a3bd-14e714caf240 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f545bb23-9fbf-475a-a3bd-14e714caf240 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 160 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "892ecb78-5ea0-44aa-bece-f424f822f8d0"}]}} Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': '', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'networks': [{'uuid': '892ecb78-5ea0-44aa-bece-f424f822f8d0'}]}}} Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '' Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:31:14.143896 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:31:14.148004 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.152080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f545bb23-9fbf-475a-a3bd-14e714caf240 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:14.153018 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f545bb23-9fbf-475a-a3bd-14e714caf240 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023387 Oct 04 18:31:14.155540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2744/5455] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:14 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:31:14.189324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.190332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.218708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.221006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.223254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.224435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.226753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.228195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.349845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.370766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67abf813-ffbd-4f29-90a5-2f7da9d7f6d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.498886 Oct 04 18:31:14.392567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2712/5456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.529315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.537664 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c88c15d-11ea-49f2-9905-a41b4f9795a7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.368984 Oct 04 18:31:14.538471 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2745/5457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.566044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.566668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.581649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.600082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.600082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.600082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.600082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.600082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.889348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:14.906911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbe99c0b-0310-41fe-ab74-8f882e6fdef2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.343540 Oct 04 18:31:14.909889 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2713/5458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:14.935061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:14.935904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.952166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc/action HTTP/1.1 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 14 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: {"shelve": {}} Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc', 'body': {'shelve': {}}} Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:14.964700 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-861e559c-1ddd-49fb-8ee3-15bdd659a997 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc/action" status: 404 len: 111 microversion: 2.1 time: 0.034843 Oct 04 18:31:14.967999 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2746/5459] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:14 2022] POST /compute/v2.1/servers/31a3fd8b-ae0a-45c2-b965-9dfdab9db6cc/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:14.973786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.974436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.981382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.982175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.983337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.984095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.984555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.984979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.401662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.403285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.444517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.457788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-238f9623-d4f2-418b-bdd7-1dbf581c4837 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.484965 Oct 04 18:31:15.458509 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2714/5460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:15.461195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.461888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.462512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.463641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.464426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.465039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.486184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:15.486184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:15.502302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.503027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.503711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.504600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:15.508029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:15.510650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:15.998672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.013289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a750fb98-cead-4b1f-bca1-3de605da9271 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.616658 Oct 04 18:31:16.015693 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2747/5461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.067714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.077448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68cf601c-8116-4a0f-b109-e297620ed8c6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.597816 Oct 04 18:31:16.087913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2715/5462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:15 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.107273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:16.107273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.117091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.117276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.117640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.119034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.119254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.119719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.151307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'flavor' on Instance uuid d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:16.930060 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59566832-cf7a-49dc-8d10-3a2943dfdd9b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.830712 Oct 04 18:31:16.932607 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2748/5463] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:16 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:31:16.940733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.941762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.957829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.958424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.963004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.964069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.964768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.965410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.050606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.051346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.084214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.085717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.090078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.090903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.091773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.092517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.227341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.237695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb5f06bd-9c60-4ca2-a003-549f5e100b78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.301040 Oct 04 18:31:17.238841 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2716/5464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:18.166517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.166517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82451946-b237-44c6-a5c1-dc18a707a24a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 1.068974 Oct 04 18:31:18.166517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2749/5465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.266380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.271316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:18.285980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.288041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.289156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.290060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.290932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.291562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.493381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:18.506683 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-619af36b-0298-4dea-9b1e-e57da253b54f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.246283 Oct 04 18:31:18.512280 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2717/5466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:19.132771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.133578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.146559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.149241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.151775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.151775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.155562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.156397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.534886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:19.535523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.551790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.553848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.553848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.553848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.553848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.554283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.667692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.696288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb396058-32a7-4d78-846e-6d4fbd621a3f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.565880 Oct 04 18:31:19.709706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2750/5467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.228699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.242075 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-552b1145-1e83-4276-a611-6b225de62eb1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.710922 Oct 04 18:31:20.262902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2718/5468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:19 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.726477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.727091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.741011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.747282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.748176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.749120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.750048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.750668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.265164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.271688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:21.272925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:21.278716 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-721c08d8-d349-41d5-b7ce-307fcae6b30b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.556328 Oct 04 18:31:21.293576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.296008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.296871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.298661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2751/5469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:21.300300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.303263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.303817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.831960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:21.848611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f765824c-0eb1-4c96-a3b9-90109be7f75c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.581447 Oct 04 18:31:21.851749 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2719/5470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:21 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:22.330269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.330885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.343121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.357571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.361755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.364412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.365071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.365646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.871705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:22.883424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:22.885053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:22.888059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:22.893677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.893935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e21d327c-e14b-4c17-874e-199132cd3c3a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.567638 Oct 04 18:31:22.894448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.909076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.909917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:22.913479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:22.913623 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2752/5471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:22.914850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.215707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1691919674", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "3e3b8e76-7722-4c9a-85a1-977bcc86ff9f"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:23.295794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] validate_networks() for [('3e3b8e76-7722-4c9a-85a1-977bcc86ff9f', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:23.405393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=20 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:23.673095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:23.710244 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f295786c-0c10-4817-9a9d-45527de82314 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.828347 Oct 04 18:31:23.713085 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2720/5472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:22 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:23.922169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.922801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.942598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.945170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.945651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.946476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.947365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.949028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.282526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:24.283047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:24.283624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:24.284102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:24.284584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:24.298242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.299504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.300209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.307443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.307443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.307443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.345165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Getting quotas for project f188b140d1414e75a427c2d4fd2e0a61. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:24.353932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Getting quotas for user 4f996014b8694de987601af0e06d848e and project f188b140d1414e75a427c2d4fd2e0a61. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:24.376418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:24.376418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:24.564048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14200870-8b5a-4804-a717-4486bfdd073b tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352209 Oct 04 18:31:24.565423 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2753/5473] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:24.583119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fc2578f-80aa-49a8-9577-09b80c315c7e tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.583875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fc2578f-80aa-49a8-9577-09b80c315c7e tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.609400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.619208 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73416e77-71ee-424a-a3ab-0614553a7174 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1657 microversion: 2.1 time: 0.700691 Oct 04 18:31:24.623391 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2721/5474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:23 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1657 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:24.651403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:24.659538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.670090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.670090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.670258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fc2578f-80aa-49a8-9577-09b80c315c7e tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.676702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fc2578f-80aa-49a8-9577-09b80c315c7e tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1219 microversion: 2.1 time: 0.102788 Oct 04 18:31:24.696747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2754/5475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:24.707557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Going to try to start instance {{(pid=123886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:31:24.736297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.738534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.749466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.750047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.751381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.755052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.755619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.757094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.037089 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33cc5f21-e5da-48ae-9f69-bae1eb4c2708 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.389489 Oct 04 18:31:25.042850 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2722/5476] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:24 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:25.049758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.050684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.065468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.066062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.066444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.072992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.072992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.072992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.883854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:25.900582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2af7cd0a-c045-4df1-b907-1d87a2162f33 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.849406 Oct 04 18:31:25.902211 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2723/5477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.914624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1218120-5817-4f43-8178-20860af7623d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.922108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1218120-5817-4f43-8178-20860af7623d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.989223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.000504 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c669b57f-4a3f-4e31-ae11-3bb5f2fdee30 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 1.268064 Oct 04 18:31:26.001217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2755/5478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.087932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e1218120-5817-4f43-8178-20860af7623d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.097922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1218120-5817-4f43-8178-20860af7623d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1219 microversion: 2.1 time: 0.193095 Oct 04 18:31:26.100938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2724/5479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:26.926705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:26.927664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:26.936715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.937531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.938188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.939105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:26.939800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:26.940420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.023992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.024644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.038662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.043881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.044338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.045083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.045544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.045974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.328622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.342434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b02770c7-0bd1-41a0-8a0c-99020d9b1927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.419955 Oct 04 18:31:27.343331 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2756/5480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:26 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.353321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.353942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.367751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.368453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.368886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.369591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.370032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.375715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.524790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.538476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2be2a09-5cd1-466b-b7b9-d5518f895369 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1271 microversion: 2.1 time: 0.189498 Oct 04 18:31:27.553085 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2757/5481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:27.733513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.743754 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ba2f2b6-6623-426d-9ca6-3d1b1b313a9f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.723372 Oct 04 18:31:27.766637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2725/5482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.371286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.372638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.392560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.393073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.393510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.394224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.394677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.395093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.583684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.584292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.593085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.593921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.594621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.595594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.596473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.597117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.732675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.743386 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0913356d-5b6a-4677-8560-135d101407e4 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1277 microversion: 2.1 time: 0.164866 Oct 04 18:31:28.767329 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2726/5483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.776879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.783399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.792465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.808214 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9a4845d9-c362-4145-8b8a-c0a26abe3f79 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.440798 Oct 04 18:31:28.820587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2758/5484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.824548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.827097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.830171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.831181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.832925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.833874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.894096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:29.332425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:29.345134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-178e0e3d-5349-4403-99bd-6b68625af940 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.575607 Oct 04 18:31:29.346539 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2727/5485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.778186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.778804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.786784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.794317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.795019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.796165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.799082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.799785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.845961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.847151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.859401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.862825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.863510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.864414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.865087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.865746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.130745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.147372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-769f6103-a4fe-406a-b703-c82b4a025468 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.369839 Oct 04 18:31:30.148619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2759/5486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.336428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.354701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-65768d4c-bcac-401d-9dc1-b95a40b0b38b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.509305 Oct 04 18:31:30.355944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2728/5487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.378086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.378786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.379134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:30.381987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.386343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.386883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.387681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.388141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.388867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.389329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.389754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.391436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.391931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.392673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.393165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.393580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.788692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.804656 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0507090-48e3-4c0a-a319-fd5efe0ac862 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.430671 Oct 04 18:31:30.820459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2760/5488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:30.913531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.922504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f65ec71b-04ca-4597-9e96-71f6d5565217 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.547054 Oct 04 18:31:30.930566 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2729/5489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:30 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:30.957504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:30.958239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:30.967050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.972409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.973224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.974174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:30.974835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:30.975500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.050897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:31.171049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.171978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.183617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.185909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.186499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.187944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.191986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.193568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.212494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Unlocking {{(pid=123887) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:31:31.521751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-debc5db8-18fa-4841-a447-0149526bf2a6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.568399 Oct 04 18:31:31.523196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2761/5490] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:30 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:31.533830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.536016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.549139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.550036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.550696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.556234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.557037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.558443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.673888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.687254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-917e82e1-7ba1-41c3-bfa8-87d03c4890c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.520246 Oct 04 18:31:31.688166 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2730/5491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.832955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.835206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.852075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.854424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.856027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.860521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.875117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.875117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.169608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.204214 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61b0d113-0537-4cb7-8259-5289fba94d51 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.670151 Oct 04 18:31:32.220195 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2762/5492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:32.248932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.249558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.266661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.267979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.271231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.272223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.274247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.275721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.726361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.735760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd22bed0-05eb-4651-a6b1-df3aa536d8f6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.506597 Oct 04 18:31:32.736362 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2763/5493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.740997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a898a7b-59d3-41bc-9303-055c2a3a35c3", "tag": "c373f621-3f2b-4e38-a89a-88b29be77ecb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:32.754073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.754845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.758715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.767622 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] Creating event network-changed:c373f621-3f2b-4e38-a89a-88b29be77ecb for instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 on n-h2-833090-21 Oct 04 18:31:32.782713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-374b8c4d-7140-409e-8c3b-b7a436fa3d8c req-130b0a02-43ec-47a4-9604-a2ac45b0ba87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038938 Oct 04 18:31:32.782713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2764/5494] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:32.801249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.802046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.832862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.833363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.841170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.842404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.842932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.843378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.932395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.942920 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf7a403c-233a-4592-aa0e-fd2771695f51 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 1.114030 Oct 04 18:31:32.947217 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2731/5495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.953448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.954282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.964111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.964937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.965661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.966554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.967353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.967985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.371137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.393852 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3fa9de0-71b1-4a9f-9780-8135f765c7c1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.446376 Oct 04 18:31:33.394464 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2732/5496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.432057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:33.432598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.449918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.464284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.464284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.464284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.464284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.464284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.489379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:33.498579 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08f683eb-bf3d-4618-814f-ebed2e507921 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.719866 Oct 04 18:31:33.502296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2765/5497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.756807 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d47818f-cb04-4a60-8a40-b520a6f22688 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.330166 Oct 04 18:31:33.760683 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2733/5498] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:33 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:33.767011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.767983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.777849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.779837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.783720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.784572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.785163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.786470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.975875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.978962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.988175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.989015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.989716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.990657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.991562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.992218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.332999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:34.392069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.400638 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73cc2c65-f2a6-4624-a571-0b01bdee68d2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1533 microversion: 2.1 time: 0.430486 Oct 04 18:31:34.401829 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2734/5499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1533 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:34.662009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1392211581", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:34.673091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:34.797158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:35.185490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.199891 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0290bc4e-8fe0-4496-aae5-726ea04da149 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1675 microversion: 2.1 time: 1.436500 Oct 04 18:31:35.203638 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2766/5500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1675 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.220017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.221624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.235458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.239413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.240144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.241414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.242140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.242812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.564731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.577022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62995f14-5ea2-4d3a-9cce-f321dbf95dfb tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.370506 Oct 04 18:31:35.581828 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2767/5501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.595429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.598067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.615699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.616199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.616643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.621257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.621734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.623554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.807411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:35.807927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:35.808360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:35.808936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:35.809756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:35.831108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.831641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.832086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.834770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.835358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.835830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.881145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:35.900466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:35.939152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:35.941779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:36.111647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.121262 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77559e85-ed78-42ab-88ba-301de8086872 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.538190 Oct 04 18:31:36.122156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2768/5502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.126254 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f795db80-7730-4dd5-8c45-11a92e3d5dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722314 Oct 04 18:31:36.128780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2735/5503] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:36.147047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f1ae7dc-aa38-4d0f-a6ee-d9b461c30769 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.147047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f1ae7dc-aa38-4d0f-a6ee-d9b461c30769 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.232889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.232889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.245125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.245770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.246059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.247191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.247686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.250544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.278379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f1ae7dc-aa38-4d0f-a6ee-d9b461c30769 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.299503 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f1ae7dc-aa38-4d0f-a6ee-d9b461c30769 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1215 microversion: 2.1 time: 0.159866 Oct 04 18:31:36.304323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2769/5504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.586013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:36.605317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.606201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.610479 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6c2aa693-1c52-49dc-a225-ae06e9f413e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1655 microversion: 2.1 time: 0.377177 Oct 04 18:31:36.622476 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2736/5505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1655 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:36.624953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.625733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.626734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.627540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.629301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.630840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.650027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:36.650932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.668978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.673082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.673743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.679366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.680717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.681614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.082697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.094437 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-714c648d-0f04-477d-b14a-9887ec701349 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.448802 Oct 04 18:31:37.097330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2737/5506] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:36 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:31:37.101442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a1ea409-2dad-4cf1-82c1-83e971085f6d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.501485 Oct 04 18:31:37.103511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2770/5507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.126020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.127111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.135883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.139920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.140776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.143544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.144213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.146494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.148621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.150540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.164800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.165933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.167704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.176514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:37.176514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:37.176514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.618035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.626004 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d7bac86-65bd-4efe-8e69-f8b2921658f4 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1662 microversion: 2.1 time: 0.519289 Oct 04 18:31:37.631225 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2738/5508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1662 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:37.646518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a69b4f98-c961-4c8e-ac8a-ac07f91a5036 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:37.647432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a69b4f98-c961-4c8e-ac8a-ac07f91a5036 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:37.787043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a69b4f98-c961-4c8e-ac8a-ac07f91a5036 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.795309 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a69b4f98-c961-4c8e-ac8a-ac07f91a5036 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1215 microversion: 2.1 time: 0.162918 Oct 04 18:31:37.796396 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2739/5509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.127704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.129081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.143736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.144234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.144843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.145559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.146019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.146451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.446295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.460717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ed51b3b-87fa-4a4e-8edb-eff7b2a64d63 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.335909 Oct 04 18:31:38.469724 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2740/5510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.657360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.666400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.688973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.690471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.691241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.693939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.695388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.718952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.929280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.948246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cca3e0cc-b515-4afd-95b7-c4a736a50513 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 1.804076 Oct 04 18:31:38.964323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2771/5511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:37 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.978590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.979782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.006780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.007281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.011963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.012760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.013265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.015860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.275218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.287948 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7bea791-ec05-4eeb-a2ff-4e0380db8e39 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1211 microversion: 2.1 time: 0.320212 Oct 04 18:31:39.295255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2772/5512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1211 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:39.485355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:39.486313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:39.505347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.505893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.506527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.507269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:39.507748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:39.508160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:39.975785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:39.992118 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1df98730-0a91-42b5-b2a5-67d6d3bcfe06 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.504150 Oct 04 18:31:40.011096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2773/5513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:39 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.022838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.026056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.045311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.045987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.047241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.049309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.049785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.050227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.085779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.099887 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d97e2ea-cc94-4d19-98c6-ef13796b5bc3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 1.449406 Oct 04 18:31:40.100488 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2741/5514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:40.132764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.137972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.165859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.167144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.167826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.170420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.176077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.176712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.392053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.414830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81de09c0-24f6-4f43-a784-02b59683b15c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.401581 Oct 04 18:31:40.419070 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2774/5515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.436629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:40.437553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:40.456757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.457272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.457725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.458449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:40.462479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:40.463085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:40.747419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:40.764613 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-30b4f7be-a608-411e-a843-c3981b8aecc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1275 microversion: 2.1 time: 0.339096 Oct 04 18:31:40.766661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2775/5516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1275 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.017885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.019124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.042775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.043707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.044309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.045307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.048201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.048808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.088097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.105751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3ba9239-77b3-45e1-9e8e-2f79fd7c2b40 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.976640 Oct 04 18:31:41.127630 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2742/5517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:40 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:41.140324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.152355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.170527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.171032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.175540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.182266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.182760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.191725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.848503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:41.851630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:41.866282 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13468dc8-be91-4ef3-b9a3-7ee5728982ed tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.733487 Oct 04 18:31:41.871071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2743/5518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:41.887092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:41.892997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:41.906294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.910668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.911459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:41.912599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:41.914183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:41.916389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.012457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.030857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eea1c7ae-5723-4f64-b0dc-e86a8a6cfc19 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 1.017042 Oct 04 18:31:42.039231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2776/5519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.046175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.047063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.056718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.057521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.058279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.059214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.060060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.060729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.103883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:42.671256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.681031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1f4413a-468c-4822-a475-c77a3bd71d05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1273 microversion: 2.1 time: 0.639045 Oct 04 18:31:42.686502 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2777/5520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1273 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.711619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:42.720729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:42.737750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:42.749756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.750528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.755900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.758427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a37faa5-c5f9-46d9-a715-c7edac1232e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.885873 Oct 04 18:31:42.759347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.763512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.774336 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2744/5521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:41 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:42.774539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.783158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "name": "network-vif-plugged", "status": "completed", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:42.837658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.843072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.843072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.900954 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] Creating event network-vif-plugged:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:31:42.916867 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c2d11430-4660-4d2e-952d-68a745732e8d req-9f8ebe33-bdff-48d3-86cc-a69f2cade92f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150869 Oct 04 18:31:42.919354 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2745/5522] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:43.064404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.065404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.081003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.085211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.086878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.089717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.090522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.091183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.548687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.565010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b220d267-45e6-4990-947f-40649c761d58 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.506313 Oct 04 18:31:43.568585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2746/5523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:43.728785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.729555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:43.749813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.752172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.754000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.756253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:43.759254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:43.760928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:43.917471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:43.945236 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af9c6d01-58b0-49bf-a9b9-3b9a67c5112d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1273 microversion: 2.1 time: 0.233924 Oct 04 18:31:43.949855 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2747/5524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:43.971251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:43.981217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.001139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.003655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.004202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.006608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.007459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.011318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.569052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.580770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea3b9876-1276-4594-9636-5a872af1d263 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.627168 Oct 04 18:31:44.594860 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2748/5525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:43 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.599891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.610634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.630383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.631123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.636492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.637254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.637733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.638179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.879608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:44.893376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4343e73-0c83-42d3-ba10-42136605ad7a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 2.202739 Oct 04 18:31:44.908223 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2778/5526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:42 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:44.918042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:44.919158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:44.926348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.927205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.930428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:44.931585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:44.932786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:44.933478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.191459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:45.203730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e323fb0-a461-48d9-bf91-63a861de9397 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.607364 Oct 04 18:31:45.204983 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2749/5527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:45.210670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:45.213019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:45.218264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:45.220105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.220830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.221596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.223082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:45.224186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:45.224864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:45.849007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:46.108625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.123273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f02d683a-0895-4b7b-bb7e-27ea6f04e95a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.916635 Oct 04 18:31:46.148145 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2750/5528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:45 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.169865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a898a7b-59d3-41bc-9303-055c2a3a35c3", "name": "network-vif-plugged", "status": "completed", "tag": "c373f621-3f2b-4e38-a89a-88b29be77ecb"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:46.191607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.194497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.197662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.226212 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] Creating event network-vif-plugged:c373f621-3f2b-4e38-a89a-88b29be77ecb for instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 on n-h2-833090-21 Oct 04 18:31:46.236263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dfdade93-d29e-4cc2-a208-0a22a5a2762d req-c89fa388-3482-4677-bdb3-fa85e803d77f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084194 Oct 04 18:31:46.237951 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2751/5529] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:46.267332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.283098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:46.291613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.330763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.331646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.332317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.334264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.335084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.337535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.474054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.490522 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-800213f9-3c3d-40bf-911f-33b1ed4f8c24 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 1.572707 Oct 04 18:31:46.495445 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2779/5530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:44 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.503521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.504147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.531925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:46.536290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.537150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.537877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.538843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.541634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.542352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.809159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:46.817226 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28db55e8-8888-4032-9ebd-16de84fd4d29 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.577910 Oct 04 18:31:46.817804 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2752/5531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:46.827824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:46.832250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:46.846285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.851264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.851264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:46.851264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:46.851264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:46.855761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.319819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.335613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17bc12f3-be99-4db3-aa53-2a0fff298e94 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.511768 Oct 04 18:31:47.336448 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2753/5532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.341445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.342289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.352300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.353023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.353619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.354562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.355283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.355947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.517872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.532670 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf5f1c13-8c94-460b-b49d-30efeab0e2f9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 1.034673 Oct 04 18:31:47.536577 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2780/5533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:46 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.629697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:47.644212 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f6c6eb4-e51e-4cc3-b4c5-00986dc6eca1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.306473 Oct 04 18:31:47.660403 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2754/5534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:47.846477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.861522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.870769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.871766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.872515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.873644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.875030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.875931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.565800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.566836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:48.585489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:48.600178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.600178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.600178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.600178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.600608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.600812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.730150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:48.743538 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-56ea7fdf-20c7-4644-953e-17ff76e68d78 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.902776 Oct 04 18:31:48.761627 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2781/5535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:48.772580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:48.776093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:48.791170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.792106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.792721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:48.793764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:48.794444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:48.795071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.101840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.115770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3aace49a-7c14-4cb8-bdcd-2230ff99acf7 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1319 microversion: 2.1 time: 0.555017 Oct 04 18:31:49.119427 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2755/5536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.331631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:49.340369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf9dbc14-e51a-4973-b2e3-191169a02c75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.576393 Oct 04 18:31:49.341515 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2782/5537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:48 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:49.780749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:49.782363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:49.795957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.796940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.798061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:49.799230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:49.800078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:49.800792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.143573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.144728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.157231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.158636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.165616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.167078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.167432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.167892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.743642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.756418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19427748-c0f8-4e3c-97d0-8fbf34e96038 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.986999 Oct 04 18:31:50.768296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2756/5538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:49 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.768296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6fd890-da65-47ea-8b1a-c09be44bd2e4", "tag": "e477d1dd-ba20-4fbd-805f-e82eaf9136c6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:50.795394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.796068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.796333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.802643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:50.815830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3408b1b-b681-460f-a483-ffff20ab0dc6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1508 microversion: 2.1 time: 0.677345 Oct 04 18:31:50.816501 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2783/5539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:50.845269 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] Creating event network-changed:e477d1dd-ba20-4fbd-805f-e82eaf9136c6 for instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 on n-h1-833090-21 Oct 04 18:31:50.849906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.852717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.860290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f94aaaf5-3442-4f64-be3e-a9118d53c921 req-8abdfa67-d303-413d-8123-9c1b3963690a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101889 Oct 04 18:31:50.863757 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2757/5540] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:50.891539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.892716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.896495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.897621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.898403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.899246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.343166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.365768 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07948384-b935-4b43-9c08-64084e492387 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.533321 Oct 04 18:31:51.366493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2784/5541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:51.786545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:51.787346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:51.805357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.807700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.816694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:51.816694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:51.816694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:51.816694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.392747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.393495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.405986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.407819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.408493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.409887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.410843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.411593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.534429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.546965 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c99e27d-5e95-4896-882d-452309290b85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.766678 Oct 04 18:31:52.568759 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2758/5542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:51 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.463484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.479371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9cdc70bc-9559-4266-9e95-6efd5047ac77 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 1.087175 Oct 04 18:31:53.491881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2785/5543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:53.575409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.576050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.596863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.597690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.598320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.609796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.609796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.609796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.103848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.118356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cecbb756-f77a-490d-861c-c466bc371b40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.547635 Oct 04 18:31:54.126373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2759/5544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.509557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.510894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.524515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.525404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.526230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.527926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.528617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.529274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.151147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.153138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.165436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.168791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.168791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.168791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.171387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.175530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.221019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.237220 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66e6bb91-a0bc-4512-9730-3c0c26f59529 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.733880 Oct 04 18:31:55.245439 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2786/5545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.559619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.575041 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e54b5273-4827-4a43-a440-5be7cede04b9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.431939 Oct 04 18:31:55.576458 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2760/5546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:56.268178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.268869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.287320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.287888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.289707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.291032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.294819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.295445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.607693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.608311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.624987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.632030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.632548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.633877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.634356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.634792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.685798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:56.703882 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0165bcdf-a668-4021-8f88-9be542b6bb3e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.440858 Oct 04 18:31:56.707008 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2787/5547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.206705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.229936 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-392357df-6f65-4346-b534-d5cd8071ec2e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.626040 Oct 04 18:31:57.231101 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2761/5548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.728805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.729434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.757141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.757900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.758474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.759355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.760211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.766334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.983248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.996969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0ee4005-bf3b-4457-8b28-47b22697d38f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.272524 Oct 04 18:31:57.998427 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2788/5549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:58.255877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.256873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.274091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.274603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.275049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.275821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.276449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.277053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.314400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:58.357311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6fd890-da65-47ea-8b1a-c09be44bd2e4", "name": "network-vif-plugged", "status": "completed", "tag": "e477d1dd-ba20-4fbd-805f-e82eaf9136c6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:58.377434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.379450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.380289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.408079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] Creating event network-vif-plugged:e477d1dd-ba20-4fbd-805f-e82eaf9136c6 for instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 on n-h1-833090-21 Oct 04 18:31:58.422422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0a95c487-cdea-4b49-88ef-60aa1b684e42 req-0430c448-aa93-41e4-961a-204319e36fb4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066441 Oct 04 18:31:58.427548 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2789/5550] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:58.861492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.871048 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0cb27ba4-c42e-4745-906f-c9573b00f612 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.619135 Oct 04 18:31:58.893670 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2762/5551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.023854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.025361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.049566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.050157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.050672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.051520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.052046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.052545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.550325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:59.572765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69b0d702-fba5-426a-af47-e05f73dfd1c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.552866 Oct 04 18:31:59.582789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2790/5552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.908975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.909716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.950548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.951134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.953960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.958849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.960079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.960533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.441766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.475442 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3775106c-e7de-4c1e-869b-f2ffc4187564 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.573083 Oct 04 18:32:00.495182 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2763/5553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.603758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:00.607154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:00.647070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.649393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.655294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.655294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:00.655294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:00.655294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.475385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.494201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6865951-1b65-4814-86df-5abc422f4255 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1315 microversion: 2.1 time: 0.895390 Oct 04 18:32:01.495425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2791/5554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:00 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:01.502662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.503361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.515871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.516388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.516838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.518743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.519564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.520211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.825036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:01.842203 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e8c25ab-1962-4072-9cda-247f220cd6ec tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.341501 Oct 04 18:32:01.845830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2764/5555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:02.525044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.527274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.541280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.542080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.543631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.544674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.545295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.545743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.865627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:02.866244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:02.874284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.878206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.878206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.878206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:02.878206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:02.878206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.999026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.012690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2f36990-3a23-4de2-8c21-be6cabbdfb2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1501 microversion: 2.1 time: 0.495120 Oct 04 18:32:03.014413 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2792/5556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.043267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.053424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.060792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.061352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.062037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.063483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.064144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.064753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.102025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:03.203930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:03.214459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:03.225438 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa478c47-3f50-414c-af55-173cc4fbe6cb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1528 microversion: 2.1 time: 0.363617 Oct 04 18:32:03.227800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2765/5557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:02 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.756077 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-535ade49-3895-437d-a905-fe56a38e5749 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 204 len: 0 microversion: 2.1 time: 0.720346 Oct 04 18:32:03.762439 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2793/5558] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:03 2022] DELETE /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:03.766609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.767389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.787759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.791083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.793534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.794286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.797558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.803157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.256296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:04.257765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:04.265009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.265942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.266672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.269396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:04.270153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:04.270816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.472468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.482622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a9285c6-a2b8-40a3-87b9-a3c09205bd67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1507 microversion: 2.1 time: 0.721348 Oct 04 18:32:04.484704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2766/5559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1507 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:04.903234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.911519 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd0880e5-f553-4c83-a22e-8f63f9b6012d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1510 microversion: 2.1 time: 0.661415 Oct 04 18:32:04.927314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2794/5560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:04 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.518277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.518277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.524319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.525449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.525977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.527674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.528363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.528948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.776428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.784856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-609375a9-bb75-4c90-aedc-96f5f2a669d5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1507 microversion: 2.1 time: 0.276853 Oct 04 18:32:05.785447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2767/5561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:05.935001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.935890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.947620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.949769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.949769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.949769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.950011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.950364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.097293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6fd890-da65-47ea-8b1a-c09be44bd2e4", "name": "network-vif-deleted", "tag": "e477d1dd-ba20-4fbd-805f-e82eaf9136c6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:06.112871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.113616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.114250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.128790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] Creating event network-vif-deleted:e477d1dd-ba20-4fbd-805f-e82eaf9136c6 for instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 on n-h1-833090-21 Oct 04 18:32:06.149969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-080ca2f8-1682-4d65-a4ba-df6db8c1905f req-4d7da5b4-d4e0-4f3e-9dec-718da5a4c172 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056326 Oct 04 18:32:06.151980 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2768/5562] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:06.521458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.545052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60d71dce-8609-4f81-8b3d-2d4d78510662 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1510 microversion: 2.1 time: 0.611621 Oct 04 18:32:06.559771 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2795/5563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1510 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:06.810147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.811897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.822895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.855817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.856300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.856895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.857558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:06.983648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:06.999434 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3eaf30b6-161b-4b65-a7d6-110b5592e2af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1305 microversion: 2.1 time: 0.193385 Oct 04 18:32:07.000760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2769/5564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1305 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:07.572034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:07.572709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:07.588573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.589070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.589510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.590218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.590666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.593678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.842813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.852934 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d56023e-d287-4203-9e8b-526a8927b8e4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1510 microversion: 2.1 time: 0.287655 Oct 04 18:32:07.854051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2796/5565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:07 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.023345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.024803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.038448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.039135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.040655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.043901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.045422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.046030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.148263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.148992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.149586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.150192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:08.227356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "name": "network-vif-unplugged", "status": "completed", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:08.248861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.254955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.259552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.277577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] Creating event network-vif-unplugged:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:32:08.283436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.284722 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-112f5b01-6372-4519-b020-08433c29d339 req-e3ab31d7-9808-482b-8ea1-4809791127af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061603 Oct 04 18:32:08.286247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2797/5566] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:08.294697 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b5b4789-c5c2-4b0a-aebd-20ca2b0f68c7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1305 microversion: 2.1 time: 0.276122 Oct 04 18:32:08.296037 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2770/5567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1305 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.880928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.893160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.901045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.901614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.902394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.903181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.903729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.904227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.319063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.320402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.341606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.342839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.343540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.344465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.345152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.345786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.396154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.396859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.397545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.398581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:09.502794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.530661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5b4baa9-6478-449b-b410-38c8244b825e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1510 microversion: 2.1 time: 0.654685 Oct 04 18:32:09.532266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2798/5568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1510 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:09.556120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:09.565864 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0aafd6d-f889-4ee7-9e12-a5140a86a17e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 200 len: 1305 microversion: 2.1 time: 0.250939 Oct 04 18:32:09.577432 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2771/5569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 1305 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:10.558858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.559526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.587871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.588551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.591003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.591729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.591889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.592584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.593074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.593481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.603982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.604524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.605243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.608626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.609308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.611570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.640603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 HTTP/1.1 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9a6fd890-da65-47ea-8b1a-c09be44bd2e4'} Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:10.646292 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4379f7a-8cb2-47d7-bc04-a64a94d91d65 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 404 len: 111 microversion: 2.1 time: 0.061194 Oct 04 18:32:10.650466 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2772/5570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:10.946664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-482743648", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:11.029323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:11.072332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.082929 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5736855c-fedb-4b99-ab77-c39062c1092f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1453 microversion: 2.1 time: 0.532111 Oct 04 18:32:11.086134 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2799/5571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1453 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:11.110211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:11.112253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.121112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.121840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.122379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.123801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.124773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.125309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.440205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:11.462023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43bb649a-7436-457b-9807-b1fb992d4b9c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1453 microversion: 2.1 time: 0.355472 Oct 04 18:32:11.464677 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2800/5572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:11 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1453 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:11.536685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:11.538749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.550250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.554570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.555403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.556407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.557631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.558172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.616305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'flavor' on Instance uuid d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:11.659258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'shelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state shelved_offloaded Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 14 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: {"shelve": {}} Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'shelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state shelved_offloaded Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'shelve': {}}} Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:32:11.662479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state shelved_offloaded Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state shelved_offloaded Oct 04 18:32:11.667435 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:11.669501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'shelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state shelved_offloaded {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:11.670639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa40a6f6-b3fb-4638-a69a-94764d5f3fd0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 155 microversion: 2.1 time: 0.139847 Oct 04 18:32:11.675689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2801/5573] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:11 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 155 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:11.687541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:11.688624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:11.697758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.698483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.701017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.702519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:11.704031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:11.704615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:11.793149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123887) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:32:11.999806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:12.001057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:12.001602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:12.002181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:12.002605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:12.021772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.023710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.025022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.026067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.026719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.027352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.056326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:12.063810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:12.081951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:12.086628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:12.138944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74ece496-8fcc-49b3-9cb5-c4f5f7768232 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.461775 Oct 04 18:32:12.142098 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2802/5574] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:11 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:12.158869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.158869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.169259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.169879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.170196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.170906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:12.173046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:12.173046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:12.235419 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c36deed-5c85-4ab3-b886-2a96cab6e34e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292769 Oct 04 18:32:12.238722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2773/5575] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:32:12.261182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bad55df5-f88f-4e98-879d-5f83bfe42485 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:12.261182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bad55df5-f88f-4e98-879d-5f83bfe42485 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:12.435770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bad55df5-f88f-4e98-879d-5f83bfe42485 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.442924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bad55df5-f88f-4e98-879d-5f83bfe42485 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1214 microversion: 2.1 time: 0.196203 Oct 04 18:32:12.452078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2774/5576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:12.634921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:12.655561 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f882b08d-6fb4-4a69-b9b7-1ee7e2b3b8c2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1461 microversion: 2.1 time: 0.509715 Oct 04 18:32:12.657986 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2803/5577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:12 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1461 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:13.471682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a441f5e-e5b3-4da7-b4fd-5be19a7b2dc4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.473895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a441f5e-e5b3-4da7-b4fd-5be19a7b2dc4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.612764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a441f5e-e5b3-4da7-b4fd-5be19a7b2dc4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:13.620518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a441f5e-e5b3-4da7-b4fd-5be19a7b2dc4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1214 microversion: 2.1 time: 0.153400 Oct 04 18:32:13.637778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2775/5578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:13.684970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:13.686129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:13.699102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.702124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.704577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.705553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.706585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.708568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.127237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.142674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f0815f1-d772-4b9c-a3ed-7dc94ed71d19 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1461 microversion: 2.1 time: 0.462176 Oct 04 18:32:14.156883 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2804/5579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:13 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1461 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:14.649529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:14.650151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:14.671149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.671796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.672368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.673080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:14.674656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:14.675092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:14.866240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:14.893891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3785dfbb-bd6e-42f6-a0b7-810043ffdda2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1266 microversion: 2.1 time: 0.250922 Oct 04 18:32:14.899419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2776/5580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:14 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.170669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.171392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.182675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.183422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.184235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.185087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.185691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.186410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.857611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:15.880103 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee96981e-44b5-411e-8ad7-ecc6ea8949bc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1461 microversion: 2.1 time: 0.713590 Oct 04 18:32:15.885058 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2805/5581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1461 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:15.924928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:15.926310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:15.929675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:15.940234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.940734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.941178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:15.948684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:15.949202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:15.949658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.123584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:16.139376 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-512ecd77-8acc-4bec-aab3-9ecbe3273d0b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1284 microversion: 2.1 time: 0.219429 Oct 04 18:32:16.155696 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2777/5582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:15 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:16.908987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.909600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.913907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.925426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.925930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.926373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.927084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.930932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.931450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.170472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.171356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.182907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.189600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.190061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.190807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.193235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.193547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.323686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.379644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c7a9e57-0c95-4806-952c-e5256c332395 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.433635 Oct 04 18:32:17.380402 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2806/5583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:17.870290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:17.901503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c48df25-926c-41a3-ba0d-74111ff196c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.716823 Oct 04 18:32:17.903124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2778/5584] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:18.411525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.412709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:18.424228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.430412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.431056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.431977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.432806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.433735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.797371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:18.806516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78c20dcf-d718-44e2-9169-4b1aaaa87fd9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.400294 Oct 04 18:32:18.807120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2807/5585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:18.907782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:18.908399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:18.925230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.925920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.926354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:18.928766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:18.929976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:18.935243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.270979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.279162 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9242df26-6b64-40be-a074-ca34c5056a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.375432 Oct 04 18:32:19.285893 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2779/5586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:18 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:19.834091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.834696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.856537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.857453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.867404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.868538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.869065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.869512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.130497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12eefdc-e81f-4627-9113-db8857b824ab", "tag": "daf61bcd-3884-4599-ba06-f82a73084c8e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:20.196572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.197126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.197571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.211290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] Creating event network-changed:daf61bcd-3884-4599-ba06-f82a73084c8e for instance b12eefdc-e81f-4627-9113-db8857b824ab on n-h1-833090-21 Oct 04 18:32:20.229954 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a1fa8bd1-9635-4bc4-a187-dc41602c7459 req-356f0ce5-8956-450c-8b8a-a404733e10ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111540 Oct 04 18:32:20.247977 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2780/5587] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:20.310690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.311575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.336021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.350016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.354294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.357457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.358613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.359398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.741766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.752142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45aceb03-df2b-4abc-b7a6-17a8cbd931df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.922264 Oct 04 18:32:20.754657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:20.759429 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2808/5588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.768960 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2633d88-ef83-498d-a1da-4c9ca38ab280 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.467581 Oct 04 18:32:20.771285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2781/5589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:21.786270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.786943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.800945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.802067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.802782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.807659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.807659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.807659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.812739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.814132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.829090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.830721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.831434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.832611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.833339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.833979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.846472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:22.043809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:22.108009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.111138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:22.127268 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20325726-f787-428e-93f3-071acd12efa7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.326639 Oct 04 18:32:22.128830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2782/5590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:22.650546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.674171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87e2f651-8e70-43fa-8e70-19bee18e3ea1 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.891614 Oct 04 18:32:22.696175 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2809/5591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.159762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.161185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.173719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.174791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.175527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.176727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.180260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.186242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.479246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.499547 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08217f54-6fae-4259-b8d9-5f42b0deb0f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.349842 Oct 04 18:32:23.500847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2783/5592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.707329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.709195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.717802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.719132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.719926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.721060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.721712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.722719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.107062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.118941 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-063b15c2-39ba-4328-bbe4-2f21e5169431 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.413003 Oct 04 18:32:24.119613 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2810/5593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:24.539372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.540024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.558123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:24.568321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.568931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.569441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.571791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.571791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.571791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.826042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:24.836860 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a98db54-139e-49fd-895e-7eac2194b606 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.311251 Oct 04 18:32:24.855138 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2784/5594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.148237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.148861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.160491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.161338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.166494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.167678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.168320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.168919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.880698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.884829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.895040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.896393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.897061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.898604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.900328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.900933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.195437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.228706 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfe51770-b682-4bba-9ea9-e0bba0ecb14b tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 1.085209 Oct 04 18:32:26.236463 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2811/5595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:26.516612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.532685 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c84c4980-8f5a-4bee-9201-32a4e8d6bcdb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.662948 Oct 04 18:32:26.540522 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2785/5596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:27.255130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.255761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.280553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.289089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.291690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.292559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.295817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.300392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.562584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.563104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.585457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.585965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.596221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.596989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.597529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.598313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.019735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.043348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8634dde6-6ae4-4788-b756-de5a4929c9ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.485605 Oct 04 18:32:28.047423 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2786/5597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:28.171693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:28.187566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5225d8e5-a792-4578-922d-86f7629a9684 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.935366 Oct 04 18:32:28.193067 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2812/5598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:28.723365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12eefdc-e81f-4627-9113-db8857b824ab", "name": "network-vif-plugged", "status": "completed", "tag": "daf61bcd-3884-4599-ba06-f82a73084c8e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:28.790135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.790135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.790135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.800811 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] Creating event network-vif-plugged:daf61bcd-3884-4599-ba06-f82a73084c8e for instance b12eefdc-e81f-4627-9113-db8857b824ab on n-h1-833090-21 Oct 04 18:32:28.813161 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e6d111f8-c406-4651-8b85-aff3623212d6 req-de1a7903-ad80-4be6-acc0-c7be79b56f79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103949 Oct 04 18:32:28.815294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2787/5599] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:29.078345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.079573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.107140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.108069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.108871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.110153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.110990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.111786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.224525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:29.230045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:29.269894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.283074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.284186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.286514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.287417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.288779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.620998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.640354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c077dd11-5f0f-4ba1-8abb-dd7b7310b7a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.562040 Oct 04 18:32:29.652630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2813/5600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:29.884244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.932260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd5ae355-40da-4fd5-9f78-8d5a7fbfe5f6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.716435 Oct 04 18:32:29.961401 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2788/5601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:29 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:30.028615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "116a58e8-9cbd-45ea-9bd5-7b6f5a1dd14c", "device": "/dev/sdb"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:30.033836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.041940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.042786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.043652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.044647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.045311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.045958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.666583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.667202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.683105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.683637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.684078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.684983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.685448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.685884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.936169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.942948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e25455b0-6734-46fb-b254-97fa51fe7a3a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1314 microversion: 2.1 time: 0.280645 Oct 04 18:32:30.960974 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2789/5602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:30.967040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:30.971128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.979356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.980168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.981099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.982288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.983531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.983635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47472ec8-b58a-4bd4-adc7-5597b45dc053 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "POST /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960561 Oct 04 18:32:30.984014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.990212 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2814/5603] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:32:30 2022] POST /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:31.016224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.016955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.054747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.055898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.058314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.059380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.060355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.061364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.264490 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82a96e24-68e6-4249-b052-e91b1ef31191 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.301809 Oct 04 18:32:31.268714 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2790/5604] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:30 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:31.292766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.294265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.316637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.317829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.320700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.324734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.327852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.329133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.963686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:31.977411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c605903-a9b6-428f-ae42-eb5fb52ccc71 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.991156 Oct 04 18:32:31.983188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2815/5605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:31.996494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.998226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:32.005199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.006131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.008423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.020608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.022001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.022753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.229223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.254501 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c61bf623-32e1-4fc1-8a9a-71d8d968a93f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1672 microversion: 2.1 time: 0.978565 Oct 04 18:32:32.273935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2791/5606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1672 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.953232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:32.961430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29de9008-63a9-429b-b4e3-6db9ab93cef5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1500 microversion: 2.1 time: 0.980152 Oct 04 18:32:32.972645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2816/5607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1500 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:33.012767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.013289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.039950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.040436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.043709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.046024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.047908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.051141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.291913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.294109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.343323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.346246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.346855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.354563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.355274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.356759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.860034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.873479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db09dd15-b05a-4332-9d21-b4f321f8c797 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1672 microversion: 2.1 time: 0.583707 Oct 04 18:32:33.874122 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2817/5608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1672 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.264099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.273610 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1be3205-da47-481c-bfe6-1d4cdab5d35e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 1.267187 Oct 04 18:32:34.274066 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2792/5609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.899460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.900136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.910245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.915314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.916035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.917436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.917720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.918339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.229733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.239869 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66f0049b-0d64-4c66-9f0e-4803797c2910 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1677 microversion: 2.1 time: 0.344885 Oct 04 18:32:35.258785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2818/5610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1677 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.301168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.306532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.314574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.315271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.316245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.317165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.317780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.318368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.624863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.636487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5acaac0d-aa76-4a03-9154-bf21a265b462 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.339132 Oct 04 18:32:35.648493 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2793/5611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.268383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.269580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.302308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.304636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.305270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.306515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.307159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.307942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.489446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.505253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03348174-3647-4f65-9cdc-e4f3d9fc2947 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.242399 Oct 04 18:32:36.506884 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2819/5612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.663455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.664124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.675845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.677515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.677515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.677734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.678157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.678640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.918954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a5f7a02-2ad0-453b-9654-475432ea912b"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:36.922431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.924666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.935703 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-090ade58-2475-41a7-ae33-2875ecbf14e9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.277124 Oct 04 18:32:36.936919 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2794/5613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.956194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.956755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.957125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.964287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.964287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.964287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.960656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.961818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.984980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.985629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.986867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:37.987635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:37.988144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:37.988532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.364578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.372953 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15a89dfb-0637-4f19-9fc3-69b90c75d16a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.417086 Oct 04 18:32:38.373546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2795/5614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.989676 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95459771-fe3a-44ea-8a0d-9097ea4fa705 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.078323 Oct 04 18:32:38.992256 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2820/5615] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:32:36 2022] POST /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab/os-volume_attachments => generated 194 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:39.405099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.405099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:39.434508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.436500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.437122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.439798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.441356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.443983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.667728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.676234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52cb6609-270c-435a-abf7-51d6c1162117 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.281893 Oct 04 18:32:39.677878 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2796/5616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.703681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.704406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.714336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.715838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.716486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.717520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.718466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.719059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.960340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:40.975581 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9c7028f-1924-4842-b548-7af7e6f0ece9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.273040 Oct 04 18:32:40.983933 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2821/5617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:41.579992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "name": "network-vif-plugged", "status": "completed", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:41.595801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.596289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.596896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.610360 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] Creating event network-vif-plugged:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:32:41.615837 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a6592e37-9ab9-4a88-bf23-111e1d8dce04 req-0fafb16f-4330-48e2-980e-1b31609430f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041063 Oct 04 18:32:41.618918 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2797/5618] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:41.994621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.995266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.014370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.014792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.015221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.016317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.017013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.017583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.888751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:42.907456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ed54736-2cba-421e-acd4-5cf38a188d03 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.917113 Oct 04 18:32:42.937630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2822/5619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:43.941253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:43.941959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:43.956098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.956098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.956098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.957724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:43.959981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:43.961382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.746162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:44.758074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3274a97e-d810-4931-9920-24f56df90cc4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.820797 Oct 04 18:32:44.759529 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2798/5620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:43 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.786407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.790537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.804275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.812111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.813066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.815251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.819043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.819937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.873513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:46.297487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.317623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aab11d30-ad32-4170-986b-1a8c0fb1ce99 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1519 microversion: 2.1 time: 0.536453 Oct 04 18:32:46.320656 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2823/5621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1519 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.341491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.342056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.353581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.361287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.361988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.368468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.368986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.369484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.835170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:47.838342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:47.846752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7badc29-a212-4e7b-b371-b78e2b520b77 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.509734 Oct 04 18:32:47.878713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.880196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.887045 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2799/5622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:47.897166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.904634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.905107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.905879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.906537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.906762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.403593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.423511 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-026f328e-d102-42e3-bf73-5822eda7fa91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.544850 Oct 04 18:32:48.424178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2824/5623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:48.457871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:48.458548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:48.493802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=46 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:48.498215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.500492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.501154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.503421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:48.506750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:48.509261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.120254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.143633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ff141a0-665a-4895-9f69-3d81db1becda tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.683714 Oct 04 18:32:49.143633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2800/5624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:48 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.166121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-053a9d78-a17e-453b-9b8d-430781876165 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:49.169113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=38 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:49.183490 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-053a9d78-a17e-453b-9b8d-430781876165 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-053a9d78-a17e-453b-9b8d-430781876165 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/3248e3ef-aeac-4de5-8fab-262a1288c101/action HTTP/1.1 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 15 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: {"os-stop": {}} Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '3248e3ef-aeac-4de5-8fab-262a1288c101', 'body': {'os-stop': {}}} Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:49.199654 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-053a9d78-a17e-453b-9b8d-430781876165 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 3248e3ef-aeac-4de5-8fab-262a1288c101 has no mapping to a cell. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-053a9d78-a17e-453b-9b8d-430781876165 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/3248e3ef-aeac-4de5-8fab-262a1288c101/action" status: 404 len: 117 microversion: 2.1 time: 0.039339 Oct 04 18:32:49.204822 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2825/5625] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:49 2022] POST /compute/v2.1/servers/3248e3ef-aeac-4de5-8fab-262a1288c101/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:49.211778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.212668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.220559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.222178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.222178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.222731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.223985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.231592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.653533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.662014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7af9a78a-112a-4431-ac54-97af588fe2df tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.454890 Oct 04 18:32:49.662610 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2801/5626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.687441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.688352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.699503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.700370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.701212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.704409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.704409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.704409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.179903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:50.191757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62f06a98-0da3-4de5-a87d-944697cc24fc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.509075 Oct 04 18:32:50.193366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2826/5627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:50.216547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:50.217107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0d9df953-5694-43d7-9f76-2b1bd1525fc5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.223592 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/0d9df953-5694-43d7-9f76-2b1bd1525fc5/action HTTP/1.1 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 15 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: {"suspend": {}} Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0d9df953-5694-43d7-9f76-2b1bd1525fc5', 'body': {'suspend': {}}} Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:50.225279 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0d9df953-5694-43d7-9f76-2b1bd1525fc5 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3caec86-14d0-4ce3-87ba-d6988449d152 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/0d9df953-5694-43d7-9f76-2b1bd1525fc5/action" status: 404 len: 111 microversion: 2.1 time: 0.014261 Oct 04 18:32:50.232563 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2802/5628] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:50 2022] POST /compute/v2.1/servers/0d9df953-5694-43d7-9f76-2b1bd1525fc5/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:50.241865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.242481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.251590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.252078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.252516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.253218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.253673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.254082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.595517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:50.606305 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd22b8d5-221e-47a3-b744-ab596fb38b3f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.374412 Oct 04 18:32:50.607280 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2827/5629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:50 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:50.634649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:50.640663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.655460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.656721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.657710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.659079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.660352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.661713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.924078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:50.941113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-200e81e6-e1b6-4312-a4f6-2b06995a21cd tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.314508 Oct 04 18:32:50.953667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2803/5630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:50 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:50.969125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:50.973138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:50.981713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.982210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.982695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:50.983422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:50.983905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:50.984348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.022554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'flavor' on Instance uuid d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:51.478458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-724897c1-2f35-4f8a-bf34-3b33a97fcceb tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.514724 Oct 04 18:32:51.479036 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2828/5631] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:50 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:51.492002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:51.492824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:51.509750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.512039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.512864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.513915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.514679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.515778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.816482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:51.833919 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-be54093c-1cb6-4c26-a3e6-e5cca67fc629 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1514 microversion: 2.1 time: 0.348917 Oct 04 18:32:51.834515 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2804/5632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:51 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:52.868529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:52.869507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:52.881886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.886117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.886117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:52.886117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:52.886117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:52.890146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.093282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:53.105865 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdcb2218-6f2d-4017-a169-bb55343e4926 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1497 microversion: 2.1 time: 0.246745 Oct 04 18:32:53.107231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2829/5633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:52 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:53.130070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.130829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.138931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.139427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.139951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.140663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.141125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.141698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.171175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lazy-loading 'flavor' on Instance uuid d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:53.185434 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'suspend' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state suspended Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 15 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: {"suspend": {}} Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: exception: Cannot 'suspend' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state suspended Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'suspend': {}}} Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:32:53.187289 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state suspended Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state suspended Oct 04 18:32:53.191708 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:53.192553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'suspend' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state suspended {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:53.193199 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-110e12a0-3563-4075-942f-f5848a3943dc tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 148 microversion: 2.1 time: 0.067136 Oct 04 18:32:53.193906 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2805/5634] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 148 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:53.203575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:53.204150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.212728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.212728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.212728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.213386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.213847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.214276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.484004 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1aacc206-f962-4afe-b056-bf1d38aa76f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 202 len: 0 microversion: 2.1 time: 0.285334 Oct 04 18:32:53.487903 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2830/5635] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:53 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:32:53.493835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:53.494418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:53.501599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.502131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.502599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:53.503310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:53.503813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:53.504450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:54.082580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:54.091221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48576a92-3300-485f-b9c3-f38afb9d6c91 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1503 microversion: 2.1 time: 0.602078 Oct 04 18:32:54.091851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2806/5636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:53 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1503 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.117099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.119070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.126941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.127775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.128440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.129349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.130026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.130704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.361360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:55.377736 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c800758-6bfa-4426-9aba-bd59d574de70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1503 microversion: 2.1 time: 0.266469 Oct 04 18:32:55.379573 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2831/5637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:55 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:55.870437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:55.871964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:55.879326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.880090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.881219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.882357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:55.882984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:55.883691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:55.915257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:56.401809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.402612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.426900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.428624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.430832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.431938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.436132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.439936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.481984 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cef0a86a-c3b3-40a5-9655-99741221baec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 204 len: 0 microversion: 2.1 time: 0.615573 Oct 04 18:32:56.488700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2807/5638] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:55 2022] DELETE /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:56.494760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.495585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.517471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.517471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.517471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.524574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.524845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.525293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.907802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:56.921748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88d9b32d-3a43-4d9e-9da3-d63a0a34a002 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.523593 Oct 04 18:32:56.922350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2832/5639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:56.950650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:56.951562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:56.959088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.959857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.960565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:56.961273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:56.961724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:56.962311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.147300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.149770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.159059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90e1573e-50a6-45a8-8d60-e6e71bd654b5 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.213278 Oct 04 18:32:57.168051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-222c9cd9-21de-42bf-993d-45639fde062e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1552 microversion: 2.1 time: 0.668745 Oct 04 18:32:57.168051 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2808/5641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1552 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.168332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2833/5641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:56 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.183536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:57.184092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.189857 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2/action HTTP/1.1 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 15 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: {"unpause": {}} Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2', 'body': {'unpause': {}}} Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:57.191515 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:57.196265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:57.196265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:57.196265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. Oct 04 18:32:57.196265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.197243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:57.198252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a5498ea-b824-46f9-9416-38973f12cb55 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2/action" status: 404 len: 111 microversion: 2.1 time: 0.018715 Oct 04 18:32:57.198990 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2809/5642] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:57 2022] POST /compute/v2.1/servers/0f694ee0-7a3e-4342-ba7a-4ac8d90d7dd2/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:57.210062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.211711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.222373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.222994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.223660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.225526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.226280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.227384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.453063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.472498 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cc463aa9-ee41-4a90-aee5-ebe2bce6fcc9 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.267849 Oct 04 18:32:57.477100 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2834/5643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.506310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.507010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.520391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.522227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.522901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.523960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.525161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.525764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.847016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:57.889249 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-debb60f7-6f37-4197-9fed-807d15210c40 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.392388 Oct 04 18:32:57.890373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2810/5644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:57.917831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:57.918642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:57.929758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.930401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.930995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.931776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:57.940480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:57.940480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:57.976838 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'unpause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 15 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: {"unpause": {}} Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'unpause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'unpause': {}}} Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:57.978504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'unpause' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:57.984597 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82396400-0608-47ff-a112-e8f6bd75024d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 145 microversion: 2.1 time: 0.068189 Oct 04 18:32:57.989450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2835/5645] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:57 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:32:57.991779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:57.992539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.002991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.003502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.003944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.006414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.006414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.006414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.182793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.187182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.206495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.207448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.207906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.211284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.211844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.212499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.323268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.326782 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce41983e-839d-49ec-be4c-2426e716ad70 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.340451 Oct 04 18:32:58.331607 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2811/5646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:57 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.357358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.358214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.367434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.368111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.368398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.369117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.369575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.370010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.580987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.586318 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad3dea01-2a95-4ae2-ba03-b8874b430e16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1552 microversion: 2.1 time: 0.407421 Oct 04 18:32:58.605979 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2836/5647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1552 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:58.902752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.928715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6456bb55-1c02-4d87-a88c-9b80b9377012 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.574004 Oct 04 18:32:58.932438 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2812/5648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:58.955452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:58.956156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: fcc9251d-f84f-42d7-b5e2-8f738a3ef59b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.969520 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/fcc9251d-f84f-42d7-b5e2-8f738a3ef59b/action HTTP/1.1 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 18 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: {"unshelve": null} Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'fcc9251d-f84f-42d7-b5e2-8f738a3ef59b', 'body': {'unshelve': None}} Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:58.980786 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance fcc9251d-f84f-42d7-b5e2-8f738a3ef59b could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4e3cc21-7001-454f-b2fe-92cb49a25f18 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/fcc9251d-f84f-42d7-b5e2-8f738a3ef59b/action" status: 404 len: 111 microversion: 2.1 time: 0.021221 Oct 04 18:32:58.985528 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2837/5649] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:58 2022] POST /compute/v2.1/servers/fcc9251d-f84f-42d7-b5e2-8f738a3ef59b/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:58.986264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.986264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.002178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.002960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.004323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.005219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.008223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.012400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.618295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.619757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.637663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.638430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.639051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.639962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.640734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.643054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.674652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.727994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d6fa8dc-fbd5-4599-af73-b3a41aaa7cd6 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.725583 Oct 04 18:32:59.730283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2813/5650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:59.776650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.777537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.790954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.796969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.796969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.796969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.796969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.797873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.833612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:59.866546 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74cee0b8-d951-4160-a021-2f9eff8ceccb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1510 microversion: 2.1 time: 0.252459 Oct 04 18:32:59.872259 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2838/5651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:00.003118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12eefdc-e81f-4627-9113-db8857b824ab", "name": "network-vif-deleted", "tag": "daf61bcd-3884-4599-ba06-f82a73084c8e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:00.027286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.032340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.032340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.051953 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] Creating event network-vif-deleted:daf61bcd-3884-4599-ba06-f82a73084c8e for instance b12eefdc-e81f-4627-9113-db8857b824ab on n-h1-833090-21 Oct 04 18:33:00.060756 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-364941e7-2b58-4de1-805c-86963dccac7d req-5d4c4cf4-21d9-46c5-81d5-c494b85ddc6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068503 Oct 04 18:33:00.062175 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2839/5652] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:00.149896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.169795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7c06d49-02a6-43e4-b6c1-2deb712af3a4 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.405136 Oct 04 18:33:00.175135 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2814/5653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.199981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:00.204056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.214649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.219158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.219323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.220096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.220550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.221655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.256434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:00.276121 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Cannot 'unshelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action HTTP/1.1 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 18 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: {"unshelve": null} Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: exception: Cannot 'unshelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'unshelve': None}} Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:33:00.281559 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 409 to user: Cannot 'unshelve' instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 while it is in vm_state active {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:00.286316 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-883825a1-ba42-4058-9413-d573ac06c957 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action" status: 409 len: 146 microversion: 2.1 time: 0.088575 Oct 04 18:33:00.292747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.293106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.295889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2840/5654] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:00 2022] POST /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94/action => generated 146 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:33:00.301651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.303839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.305633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.306594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.310561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.311974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.582861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.594082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9efc7d95-59d0-49e2-9821-f6acc493b0fa tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.305326 Oct 04 18:33:00.604686 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2815/5655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.631486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.632099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.639962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.646090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.646090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.646090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.646090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.646090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.896787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:00.897281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.909933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.910628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.911227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.912225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:00.913784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:00.915167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.916618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.925109 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01141fb9-f0b5-4360-bca0-94e57e7a922e tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.298210 Oct 04 18:33:00.934145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2841/5656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:00.956192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248715398_updated"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:00.963024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: c4a41ee4-99d5-4578-b419-68f8a866136a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:00.969621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/servers/c4a41ee4-99d5-4578-b419-68f8a866136a HTTP/1.1 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 81 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248715398_updated"}} Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c4a41ee4-99d5-4578-b419-68f8a866136a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1248715398_updated'}}} Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:33:00.972973 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. Oct 04 18:33:00.979765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:00.983626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance c4a41ee4-99d5-4578-b419-68f8a866136a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:00.984945 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1341963c-20c1-445f-a5d9-9bf34ecc7410 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "PUT /compute/v2.1/servers/c4a41ee4-99d5-4578-b419-68f8a866136a" status: 404 len: 111 microversion: 2.1 time: 0.033628 Oct 04 18:33:00.990150 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2842/5657] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:33:00 2022] PUT /compute/v2.1/servers/c4a41ee4-99d5-4578-b419-68f8a866136a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:01.003602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.004682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.020013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.020953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.027434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.029052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.029172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.031843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.135369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.138303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:01.155135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e88fb52-d06f-415e-9512-8c8c07dbea20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.262385 Oct 04 18:33:01.158162 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2816/5658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.239314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.253538 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-72c4838d-4ddb-4284-968e-d036e15a0a9a tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.254944 Oct 04 18:33:01.255947 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2843/5659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:00 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.285252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.285871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.294471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.295247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.295899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.297023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.302206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.305051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.759624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.770415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a30e4e85-5732-4edf-8a41-59b8faf530b2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.489063 Oct 04 18:33:01.771058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2817/5660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.794806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5e35858-0d17-4dc2-941a-77ed37fa94b7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5e35858-0d17-4dc2-941a-77ed37fa94b7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 HTTP/1.1 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 280 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.801479 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5e35858-0d17-4dc2-941a-77ed37fa94b7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:01.805626 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5e35858-0d17-4dc2-941a-77ed37fa94b7 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 400 len: 619 microversion: 2.1 time: 0.013085 Oct 04 18:33:01.811532 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2844/5661] 10.222.0.40 () {60 vars in 1257 bytes} [Tue Oct 4 18:33:01 2022] PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:01.818569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.820335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.833711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.837698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.838525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.839735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.840413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.841060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.180463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.181124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.203618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.210747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.222771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.223255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.224032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.227171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.227665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.231128 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c80fd47c-8c49-4d4f-84a2-6a9d91e1661d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.417545 Oct 04 18:33:02.245199 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2818/5662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.265447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.266110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.276614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.277118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.277559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.297923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.297923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.297923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.430556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.444891 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1a0c9b2f-365d-4d72-a2fa-eb90108373e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.270357 Oct 04 18:33:02.445412 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2845/5663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.819643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.821933 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d44516f9-b980-4b5b-ad29-2bdfe80851f0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.560371 Oct 04 18:33:02.840226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2819/5664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.852261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8271ce84-3ae1-42b9-b92b-63d9690f4a8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8271ce84-3ae1-42b9-b92b-63d9690f4a8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: request: PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 HTTP/1.1 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 24 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": ""}} Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94', 'body': {'server': {'name': ''}}} Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '' Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:33:02.857541 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:02.863953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8271ce84-3ae1-42b9-b92b-63d9690f4a8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:02.867647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8271ce84-3ae1-42b9-b92b-63d9690f4a8c tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 400 len: 108 microversion: 2.1 time: 0.020121 Oct 04 18:33:02.872737 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2846/5665] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 18:33:02 2022] PUT /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:33:02.890049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.897251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.917772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.929214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.929683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.930447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.931043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.931341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.202772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.227248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fdb5b22-1622-4f61-8f4a-02674f98a0d0 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1506 microversion: 2.1 time: 0.351955 Oct 04 18:33:03.250499 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2820/5666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:03.471999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.472887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.485502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.485999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.486445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.487152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.487666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.488385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.608300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.638189 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6956512c-95e5-4a94-ae35-1713ab2a1ed5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.165044 Oct 04 18:33:03.641253 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2847/5667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.673118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.673744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.685336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.690536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.691251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.692210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.692912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.693996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.877452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.886149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40f55fe9-8f4b-40a5-9447-df83444a35fb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.216860 Oct 04 18:33:04.892596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2821/5668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.925242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.932260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.936312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.936312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.936725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.941316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.948168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.948841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.155688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:06.165604 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8c3cefa-48cb-4538-9592-fa8d62e48913 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.250373 Oct 04 18:33:06.166206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2848/5669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:07.191313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:07.197543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:07.221518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.461277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.479633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f20571c-4a16-4a71-ad41-1f070893f3d6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1345 microversion: 2.1 time: 0.291968 Oct 04 18:33:07.481307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2822/5670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:07 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.506798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.507421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.529588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.530177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.540223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.541161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.541649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.542086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.676325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.677192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.677636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.678371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid b12eefdc-e81f-4627-9113-db8857b824ab {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:08.693169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.694275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.716575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.717085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.717530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.718252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.718708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.719131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.794618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.810143 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-896cb9b5-793c-45b5-8ef1-952e3ac2eaaf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 200 len: 1350 microversion: 2.1 time: 0.307242 Oct 04 18:33:08.811051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2849/5671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 1350 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.985647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lazy-loading 'services' on Instance uuid 2a898a7b-59d3-41bc-9303-055c2a3a35c3 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:09.306349 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09709cb0-7d3b-4fea-901a-e12c18e4758f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3/os-volume_attachments/116a58e8-9cbd-45ea-9bd5-7b6f5a1dd14c" status: 202 len: 0 microversion: 2.1 time: 0.622857 Oct 04 18:33:09.307436 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2823/5672] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:33:08 2022] DELETE /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3/os-volume_attachments/116a58e8-9cbd-45ea-9bd5-7b6f5a1dd14c => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:33:09.835832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.837800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.845954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.846644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.847141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.847917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.848381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.848830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.871381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab HTTP/1.1 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b12eefdc-e81f-4627-9113-db8857b824ab'} Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:09.873990 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3d39614-32e3-4278-9176-505abc118d37 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 404 len: 111 microversion: 2.1 time: 0.046393 Oct 04 18:33:09.885615 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2850/5673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:10.093213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.097277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.125336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.134733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.136180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.138144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.138630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.147594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.207748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab/os-volume_attachments HTTP/1.1 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': 'b12eefdc-e81f-4627-9113-db8857b824ab'} Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:10.215424 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:33:10.219348 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:10.225286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:10.229836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ee8a830-3f1a-4205-bad1-ad429d5684ca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.146845 Oct 04 18:33:10.247393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2824/5674] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab/os-volume_attachments => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:10.553071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-423399399", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:10.697175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:11.608762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:11.609877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:11.610514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:11.611082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:11.611684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:11.624931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.625886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.626530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.627537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.628212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.628846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.679511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:11.702883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:11.746668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:11.751970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:11.971637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5b23ed6-e465-4426-bbd0-3b7240198158 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422810 Oct 04 18:33:11.972560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2851/5675] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:11.984026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70ac35a7-befd-41ab-9811-c11d0aa38042 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.984780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70ac35a7-befd-41ab-9811-c11d0aa38042 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.198069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70ac35a7-befd-41ab-9811-c11d0aa38042 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.210520 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70ac35a7-befd-41ab-9811-c11d0aa38042 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d" status: 200 len: 1214 microversion: 2.1 time: 0.230427 Oct 04 18:33:12.233283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2825/5676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d => generated 1214 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:12.238128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.238634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.282993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:13.028167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.029400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.062920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.063573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.064036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.064784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.065236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.075606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.121555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 HTTP/1.1 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0e444745-ea56-4353-a7c4-dd7346dfcf13'} Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:13.123370 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d952a9db-023a-4946-9496-28e2cac975c8 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 404 len: 111 microversion: 2.1 time: 0.101213 Oct 04 18:33:13.127066 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2826/5677] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:13 2022] DELETE /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:13.144072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.146389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: 0e444745-ea56-4353-a7c4-dd7346dfcf13] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.173915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.174437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.174886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.184549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.187157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.188187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.244434 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 HTTP/1.1 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0e444745-ea56-4353-a7c4-dd7346dfcf13'} Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.255757 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. Oct 04 18:33:13.259804 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.263083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance 0e444745-ea56-4353-a7c4-dd7346dfcf13 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.267832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ada49e9b-297d-4953-8113-3f4e910e7d85 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13" status: 404 len: 111 microversion: 2.1 time: 0.133281 Oct 04 18:33:13.274289 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2827/5678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/0e444745-ea56-4353-a7c4-dd7346dfcf13 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.286129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.291413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.303981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.305320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.306068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.307450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.308168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.308833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.345428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:13.405456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.scheduler.client.report [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Deleted allocations for instance f1b881b7-6b70-4f06-816e-29b79040c50d Oct 04 18:33:13.416634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.api [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:33:13.417478 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-94cf408d-3847-4063-8554-c56fe61178d9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d" status: 204 len: 0 microversion: 2.1 time: 1.183484 Oct 04 18:33:13.419293 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2852/5679] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:12 2022] DELETE /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:13.440482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.441939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.455741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d HTTP/1.1 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'f1b881b7-6b70-4f06-816e-29b79040c50d'} Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:13.459539 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:13.467685 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5243c2c2-b733-4f73-a160-e23f5b34c200 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d" status: 404 len: 111 microversion: 2.1 time: 0.040349 Oct 04 18:33:13.470914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2853/5680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:13.631830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1078318879", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.738631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:13.773147 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-419132a4-a7fb-453f-8260-d5312864090d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 204 len: 0 microversion: 2.1 time: 0.496043 Oct 04 18:33:13.775259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2828/5681] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:13 2022] DELETE /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:13.788276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.803517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.819688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.820430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.821043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.821971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.822660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.826057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.253184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:14.253611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:14.254194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:14.254609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:14.255600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:14.267362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.267886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.268323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.269211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.269665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.270274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.362057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:14.381757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:14.408360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:14.413383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:14.481856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.485268 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-642c302f-a816-4edf-9c83-ea61e1c19cd2 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.704821 Oct 04 18:33:14.485867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2829/5682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.602427 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb70e0a8-9385-47bf-95f3-9862e9f487c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974760 Oct 04 18:33:14.605509 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2854/5683] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:33:14.630806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6546258c-b3fb-4068-bc41-5fa5b0a40169 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.631452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6546258c-b3fb-4068-bc41-5fa5b0a40169 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.857456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6546258c-b3fb-4068-bc41-5fa5b0a40169 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.886004 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6546258c-b3fb-4068-bc41-5fa5b0a40169 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1215 microversion: 2.1 time: 0.270120 Oct 04 18:33:14.889160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2830/5684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:15.515285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.516628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.531012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.533700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.534157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.534937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.537022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.537729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.849167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.857873 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f85330d-9ae9-41ee-b594-867773007924 tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1512 microversion: 2.1 time: 0.347402 Oct 04 18:33:15.871752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2855/5685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:15.917288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.920368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.949189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.953579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.956924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.960290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.962765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.965928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.132024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.148551 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01755643-bb78-44f6-8180-3b5f38bdb5d2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1219 microversion: 2.1 time: 0.236450 Oct 04 18:33:16.153549 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2831/5686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.695835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca299b-3bbc-4c30-ab33-e66e9af5aa94", "name": "network-vif-deleted", "tag": "03de6713-95f3-45d9-b1eb-ecc3bdabf76a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:16.708570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.709399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.710862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.725590 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] Creating event network-vif-deleted:03de6713-95f3-45d9-b1eb-ecc3bdabf76a for instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 on n-h1-833090-21 Oct 04 18:33:16.733071 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1ce33741-e98a-46f8-aef5-7a679a417ebc req-9f107a13-fd97-4862-9db1-3d274d8b9f0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043715 Oct 04 18:33:16.734559 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2856/5687] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:16.894582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.895207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.903442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.904499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.905291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.906438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.907331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.908168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.011747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e8e873fae44238af5e724fe0c0bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e754b46e4a4276a4981f5e8c1b3d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.021384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1f1cfe1-96e7-49d4-a740-8ddc2c79920d tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 200 len: 1302 microversion: 2.1 time: 0.131056 Oct 04 18:33:17.022283 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2832/5688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:17.173423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.173994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.181131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:17.183285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.184107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.184761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.185890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.188552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.189311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.308191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:17.319795 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-924de920-e579-4106-ace8-ba72fb3d178b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1267 microversion: 2.1 time: 0.151058 Oct 04 18:33:17.336122 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2857/5689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.047794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.049028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] [instance: d1ca299b-3bbc-4c30-ab33-e66e9af5aa94] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.057052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.057827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.058506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.059417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.060110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.060761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.077876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] HTTP exception thrown: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Request method failure captured: Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 HTTP/1.1 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHt8O3QDl3Nxhp0xuih2JnaN3enTYhg6FJ5wAda8kOUXfPgOEvLeC3A4X9PtXXI7kE_UHrg2FKf4tEAdoR2KI87X55aBD2YYJvTwSvoIKh1YkjHdYMwqiP6pFCliZeHxgRcfYDKLk0eE1op6ma6-ks42MculYpLRFChqp0V1BJs6ZTg Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d0e754b46e4a4276a4981f5e8c1b3d4b"}]}] Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d0e754b46e4a4276a4981f5e8c1b3d4b Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1679432552 Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 871e8e873fae44238af5e724fe0c0bbd Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1679432552-project Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd1ca299b-3bbc-4c30-ab33-e66e9af5aa94'} Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:18.079923 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:18.084768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] Returning 404 to user: Instance d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:18.087422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e3601a8-4171-44a3-96d1-12490b7ed72f tempest-ServersNegativeTestJSON-1679432552 tempest-ServersNegativeTestJSON-1679432552-project] 10.222.0.40 "GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94" status: 404 len: 111 microversion: 2.1 time: 0.043818 Oct 04 18:33:18.088699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2833/5690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/d1ca299b-3bbc-4c30-ab33-e66e9af5aa94 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:18.355210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.355841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.363304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.363854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.365090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.365961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.366582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.367172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.468042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:18.468550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:18.475323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.481279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.481779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.482224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.482933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:18.483393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:18.486944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29b2666b-ee84-47e2-b094-309528f14c78 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1273 microversion: 2.1 time: 0.135915 Oct 04 18:33:18.487555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2858/5691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:18 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:18.499234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.547188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:18.619674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:18.822647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:19.041966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d92b8799-f884-49c6-8667-4197124966fd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 204 len: 0 microversion: 2.1 time: 0.577412 Oct 04 18:33:19.045387 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2834/5692] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:18 2022] DELETE /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:19.053718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.054320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.061762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.062596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.063101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.063929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.064569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.065173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.355017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.372197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-156eb7a7-f9b5-4687-a51b-55a48d636f03 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1514 microversion: 2.1 time: 0.319115 Oct 04 18:33:19.375024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2859/5693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:19.532832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.533950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.556117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.559662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.560285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.563957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.565703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.566363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.834461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.851230 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cb1779e-7cbc-42fb-a54e-1ef28dc02678 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1273 microversion: 2.1 time: 0.332977 Oct 04 18:33:19.852493 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2835/5694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.398789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.398789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.428112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.428622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.429077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.430254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.430380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.430797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.881591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.883425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.904898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.906177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.910273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.911284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.911944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.912566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.009820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.041362 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8fb39573-3d99-4f06-ac6a-7b574d520f22 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1514 microversion: 2.1 time: 0.648160 Oct 04 18:33:21.079451 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2860/5695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1514 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.807282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.823375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7fb31171-e6c1-438e-babb-b6d1ae42b11b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.947746 Oct 04 18:33:21.824780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2836/5696] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.089324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.090682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.101741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.105357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.112155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.113626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.115044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.115776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.853747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.854485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.869709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.882334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.884031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.885783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.888131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.890158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.091132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.111313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7008218d-19f3-4675-a170-9c7711b693c9 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1514 microversion: 2.1 time: 1.026664 Oct 04 18:33:23.127962 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2861/5697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1514 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.326402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a898a7b-59d3-41bc-9303-055c2a3a35c3", "name": "network-vif-deleted", "tag": "c373f621-3f2b-4e38-a89a-88b29be77ecb"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:23.345564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.346043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.346476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.376253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] Creating event network-vif-deleted:c373f621-3f2b-4e38-a89a-88b29be77ecb for instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 on n-h2-833090-21 Oct 04 18:33:23.398484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-feafce8a-41c8-41c6-a53a-e2a50f8b860f req-1b6b9c7f-6abd-4fdb-9ece-cf49c8434809 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075958 Oct 04 18:33:23.399490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2862/5698] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:24.132680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.140971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.141611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.148578 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66972053-36bf-4a18-9037-7487b0a42e9d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 1.300150 Oct 04 18:33:24.157132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.157622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.160114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2837/5699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:24.161437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.165052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.169643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.170254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.276717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.277386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.283027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.283743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lazy-loading 'fault' on Instance uuid 2a898a7b-59d3-41bc-9303-055c2a3a35c3 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:24.338716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:24.396657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:24.464612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.474523 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f99da55a-4b6b-4488-80ce-06f4c64a5176 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 200 len: 1309 microversion: 2.1 time: 0.338765 Oct 04 18:33:24.478746 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2863/5700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 1309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:25.182827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.184144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.197904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:25.206348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.207116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.209220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.210095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.213341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.214062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.501943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.502602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 2a898a7b-59d3-41bc-9303-055c2a3a35c3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.518482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.519056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.519684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.524104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.524104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.524104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.544253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] HTTP exception thrown: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Request method failure captured: Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 HTTP/1.1 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHtj6eQ7-pzLXzUbEjJXmLcfz0vbBlkYxMnh1tW-G8Lg5QdyDSvWbCpTyFtMG69RxtPk5anMhURRTo9z9DDeorDjbHCryAm_JMbBufgxsnnkwu6a3q8O9VctLvcttfohMHR9YSNI3oKOZo4-2uzYW1_vSMY9Q2xba87C6J2IkfuyFTY Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f188b140d1414e75a427c2d4fd2e0a61 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f188b140d1414e75a427c2d4fd2e0a61"}]}] Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f188b140d1414e75a427c2d4fd2e0a61 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesSnapshotTestJSON-1659397688-project Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 4f996014b8694de987601af0e06d848e Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesSnapshotTestJSON-1659397688-project Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2a898a7b-59d3-41bc-9303-055c2a3a35c3'} Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:25.546359 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. Oct 04 18:33:25.554964 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:33:25.562177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Returning 404 to user: Instance 2a898a7b-59d3-41bc-9303-055c2a3a35c3 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:25.566808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de21cd15-9172-4441-852c-1f9361560ff8 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3" status: 404 len: 111 microversion: 2.1 time: 0.069016 Oct 04 18:33:25.572541 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2864/5701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/2a898a7b-59d3-41bc-9303-055c2a3a35c3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:25.767201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3d8724-5e47-4a27-a98b-7f2a28cc85ae", "tag": "e156e895-7d6d-4b8c-bc65-efb5a87b7a4d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:25.787040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.787040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.787040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.824509 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] Creating event network-changed:e156e895-7d6d-4b8c-bc65-efb5a87b7a4d for instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae on n-h1-833090-21 Oct 04 18:33:25.831345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8060dab4-5abd-4f7f-9b6a-c6017a27edc9 req-72653ae5-2dc8-40f1-ba05-d6d30230249a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067609 Oct 04 18:33:25.834346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2865/5702] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:25.852592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.867617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99008d2e-253c-432e-b3cc-336898f19fe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.695649 Oct 04 18:33:25.869340 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2838/5703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.893561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.895080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.908382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.925046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.925827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.929811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.934635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.934635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.010769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:27.628611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.639184 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a2d780a-0734-4232-b47f-34c0e5399dcb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.750710 Oct 04 18:33:27.646876 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2866/5704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:28.674164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.674688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.689290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.689290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.701003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.701003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.701003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.701003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.155976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:29.168526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23dd824a-d685-48ba-a298-a5633b725a56 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.498343 Oct 04 18:33:29.170238 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2839/5705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.203719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:30.211503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.227251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.228170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.232754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.233738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.234220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.234655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.550630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.573674 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5dc032bd-142d-49c3-8d88-22e23a5b67d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.382648 Oct 04 18:33:30.577141 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2867/5706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:30 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:31.611210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.612118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.662323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.667847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.668444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.669444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.670108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.670728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.963448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.975024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64332bc4-04bc-4201-b83f-54a8ed99fba0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.375161 Oct 04 18:33:31.976416 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2840/5707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:32.965682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3d8724-5e47-4a27-a98b-7f2a28cc85ae", "name": "network-vif-plugged", "status": "completed", "tag": "e156e895-7d6d-4b8c-bc65-efb5a87b7a4d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:32.983353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.983865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.984292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.999526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.000278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.011218 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] Creating event network-vif-plugged:e156e895-7d6d-4b8c-bc65-efb5a87b7a4d for instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae on n-h1-833090-21 Oct 04 18:33:33.015046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.017176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.017742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.021591 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b656d8c9-fb5e-4c0e-a1e3-03a22a05a965 req-d7a7cac4-a0ea-43a6-9f50-a9a1ec4d01f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059721 Oct 04 18:33:33.022210 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2868/5708] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:33.050299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.056331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.057054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.786252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.801322 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0877b9a-3396-401c-ad87-e7229599679e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.806958 Oct 04 18:33:33.833271 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2841/5709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:34.833281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:34.833976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:34.842608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.843098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.845592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.846302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:34.846765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:34.847191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.182026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.189868 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5108c1c-e4d1-459b-b94b-91647b790065 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1315 microversion: 2.1 time: 0.361225 Oct 04 18:33:35.203929 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2869/5710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:34 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:36.215022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.215715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.223996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.224498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.225017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.225960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.226580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.227174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.620699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.630060 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-613c87b3-399b-44e4-9f66-a1f46db0caca tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1501 microversion: 2.1 time: 0.420594 Oct 04 18:33:36.632244 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2842/5711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1501 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.655931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:36.657143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.665544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.666351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.668858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.668858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.668858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.669315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.983278 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f26061a-f93d-426c-9b80-f0ac2fe39400 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae/action" status: 202 len: 0 microversion: 2.1 time: 0.331121 Oct 04 18:33:36.984031 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2870/5712] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:36 2022] POST /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:36.992647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.993601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.002531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.008118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.009105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.010051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.010720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.012640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.033887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2101380952", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "3e3b8e76-7722-4c9a-85a1-977bcc86ff9f"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:37.163771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] validate_networks() for [('3e3b8e76-7722-4c9a-85a1-977bcc86ff9f', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:37.806798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:37.822050 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6d7b0e9-0d97-426b-81ce-1f1f0afac632 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1506 microversion: 2.1 time: 0.833207 Oct 04 18:33:37.823899 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2843/5713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.573919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:38.574386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:38.575051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:38.575477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:38.575885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:38.592923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.593035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.593476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.594383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.594954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.595382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.644210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Getting quotas for project f188b140d1414e75a427c2d4fd2e0a61. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:38.659146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Getting quotas for user 4f996014b8694de987601af0e06d848e and project f188b140d1414e75a427c2d4fd2e0a61. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:38.695191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:38.698902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:38.852371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.854182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:38.866717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.867673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.868314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.869999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.870675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.871928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.933207 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41b044e7-8fbb-422e-a219-29c3b52fa9b3 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901783 Oct 04 18:33:38.938118 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2871/5714] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:33:38.963928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76f5f1ac-988b-4e19-a09e-50448e5ff6ae tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:38.965534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76f5f1ac-988b-4e19-a09e-50448e5ff6ae tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.143220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76f5f1ac-988b-4e19-a09e-50448e5ff6ae tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.155177 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76f5f1ac-988b-4e19-a09e-50448e5ff6ae tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1219 microversion: 2.1 time: 0.201095 Oct 04 18:33:39.156897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2872/5715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.375093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.390224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e9055396-a581-430a-84c8-510761e75dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1486 microversion: 2.1 time: 0.543145 Oct 04 18:33:39.408721 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2844/5716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:38 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1486 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:39.415915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.419653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.425769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.426554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.427564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.429345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.430157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.430871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.471969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:39.670345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.679095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.700744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.706144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.706144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.706144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.706144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.706144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.982075 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc8d08bc-31aa-42b8-93a7-f415e535a294 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 204 len: 0 microversion: 2.1 time: 0.570071 Oct 04 18:33:39.982916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2873/5717] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:39 2022] DELETE /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:39.996595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.997637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.026252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.026252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.026252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.026252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.026690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.027141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.148355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.158029 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f13a077a-4974-4fc3-a949-9a763275284e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.491750 Oct 04 18:33:40.165567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2845/5718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.188534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-134902a7-cf09-4d7c-9024-7cf5450e6560 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.189577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-134902a7-cf09-4d7c-9024-7cf5450e6560 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.254574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-134902a7-cf09-4d7c-9024-7cf5450e6560 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.262105 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-134902a7-cf09-4d7c-9024-7cf5450e6560 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1219 microversion: 2.1 time: 0.083890 Oct 04 18:33:40.262685 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2846/5719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:40.282827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.283457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.291833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.292336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.292854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.293527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.294206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.294703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.508551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.524436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.526018 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf60252c-cd9a-43d3-9ba7-39983a72242d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1492 microversion: 2.1 time: 0.530420 Oct 04 18:33:40.528744 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2874/5720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1492 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:40.538958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02385364-79bc-437d-8cb2-fb3978edbfd8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.262327 Oct 04 18:33:40.541158 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2847/5721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.568312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.569013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.576166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.576774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.577286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.578144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.578738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.579273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.177619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.195964 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40e2997e-e9cf-4969-a711-13bc07854c5d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.631629 Oct 04 18:33:41.197605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2875/5722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.219350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.220112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.233479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.233995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.234548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.235278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.235778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.236212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.290738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.291656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.308133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.313010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.313010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.323817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.325045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.332738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.488734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.497888 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-759828bd-b8fc-4cdd-b2b9-f2129636d6a1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1271 microversion: 2.1 time: 0.211293 Oct 04 18:33:41.502911 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2876/5723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.560894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.561968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.573093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.576206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.576910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.577877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.578559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.579914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.629604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.644543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27a102ee-ebb7-4fff-a5e5-d224095d88ec tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.425380 Oct 04 18:33:41.647738 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2848/5724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.791756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1080176161", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "615cdc98-a3fe-4da3-8339-6361f3daab74"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:41.928984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] validate_networks() for [('615cdc98-a3fe-4da3-8339-6361f3daab74', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:42.245881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.263351 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93a38ce5-9695-4238-8b70-2eda8b08a67f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1492 microversion: 2.1 time: 0.706443 Oct 04 18:33:42.264389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2877/5725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1492 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:42.528759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.529831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.536725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.537580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.538234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.539246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.540101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.540837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.632239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.652495 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c74926b-f4f5-4ce9-a3d9-9ddf5845f801 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1277 microversion: 2.1 time: 0.116295 Oct 04 18:33:42.667563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2878/5726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:43.289936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.290790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.302758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.305662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.307590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.308488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.311411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.311887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.852719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.865442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62ad7ca7-df0b-4bef-ac7c-6c50efc83ea3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1450 microversion: 2.1 time: 0.580000 Oct 04 18:33:43.885736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2879/5727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1450 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:43.890750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.904507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.912702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.917756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.917756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.917756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.917756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.924229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.158102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.170506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bbda18b1-309e-4309-995a-b62c2a636d40 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1277 microversion: 2.1 time: 0.283513 Oct 04 18:33:44.174759 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2880/5728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.193931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3d8724-5e47-4a27-a98b-7f2a28cc85ae", "name": "network-vif-deleted", "tag": "e156e895-7d6d-4b8c-bc65-efb5a87b7a4d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:44.238967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.244084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.244084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.274770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] Creating event network-vif-deleted:e156e895-7d6d-4b8c-bc65-efb5a87b7a4d for instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae on n-h1-833090-21 Oct 04 18:33:44.288752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-741cf34e-811d-4e4c-ba02-104aaf08c139 req-3877be25-7499-4136-b2fe-0001d051bdd4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094579 Oct 04 18:33:44.290389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2881/5729] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:44.691677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:44.693081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:44.694062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:44.694637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:44.695214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:44.734273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.741092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.741826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.742649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.743904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.749289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.778248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:44.801536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:44.818318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:44.820406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:44.892269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.892874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.910539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.915095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.916418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.917334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.918152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.918819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.026181 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-65732b23-d53b-4e2d-9316-0e67d27dd2ac tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.235634 Oct 04 18:33:45.033204 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2849/5730] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:45.043390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4da14581-0970-4bcb-98fe-8f441ed07bcc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.048698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4da14581-0970-4bcb-98fe-8f441ed07bcc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.055694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.058070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.058748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.059417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:45.221516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4da14581-0970-4bcb-98fe-8f441ed07bcc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.231663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4da14581-0970-4bcb-98fe-8f441ed07bcc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1215 microversion: 2.1 time: 0.197223 Oct 04 18:33:45.237053 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2850/5731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:45.247695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.260911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.289039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.289782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.290380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.293912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.294612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.296042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.875166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.885104 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6585d67-4b92-4b7f-b807-2a75baad4fff tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.646734 Oct 04 18:33:45.885919 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2851/5732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.264485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed8e9435-28ad-41c3-b4ee-3a7b5262b792 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.265271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed8e9435-28ad-41c3-b4ee-3a7b5262b792 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.352648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.361605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-541d79aa-ba96-4b8e-bfe2-2408405b7434 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 200 len: 1305 microversion: 2.1 time: 1.474992 Oct 04 18:33:46.375096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2882/5733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 1305 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.885918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed8e9435-28ad-41c3-b4ee-3a7b5262b792 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.896502 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed8e9435-28ad-41c3-b4ee-3a7b5262b792 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1215 microversion: 2.1 time: 0.636341 Oct 04 18:33:46.914989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.916058 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2852/5734] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1215 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.916338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.931559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.932904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.936026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.937253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.938386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.939347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.955060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:47.392455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.393529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.410776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.412175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.416660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.419615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.420211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.422474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.451767 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae HTTP/1.1 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '1f3d8724-5e47-4a27-a98b-7f2a28cc85ae'} Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:47.455312 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:33:47.459648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:47.481940 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce9b67e1-3959-4b1f-82a0-53db5c1a36b8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 404 len: 111 microversion: 2.1 time: 0.068835 Oct 04 18:33:47.484798 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2853/5735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:47.752901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-169986549", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:47.867527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:48.204496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.220335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b1cb0da7-b2b7-4c6d-a4d4-49cd244f0772 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 1.311559 Oct 04 18:33:48.226878 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2883/5736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.241737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.242839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.262954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.264708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.264708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.272056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.272889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.276112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.475578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.510288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7886b00-1bb3-49c4-8cf9-41ef77a1cb49 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1267 microversion: 2.1 time: 0.281980 Oct 04 18:33:48.511662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2884/5737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.049184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:49.049637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:49.050207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:49.050630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:49.051134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:49.064953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.065813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.068204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.069048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.069522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.069957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.138097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:49.148128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:49.185404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:49.190609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:49.246288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.246888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.258968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:49.260770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:49.262300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.262794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.264032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.264954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.272197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.272845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.437410 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0e9a879-9f10-43e6-9cec-70c666ef4561 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703775 Oct 04 18:33:49.438892 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2854/5738] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:49.454216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4ca5522-800a-4bc3-b02e-5edcf5e8c54e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.457069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4ca5522-800a-4bc3-b02e-5edcf5e8c54e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.602849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4ca5522-800a-4bc3-b02e-5edcf5e8c54e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.618324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4ca5522-800a-4bc3-b02e-5edcf5e8c54e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1214 microversion: 2.1 time: 0.167902 Oct 04 18:33:49.627504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2855/5739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.676606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.678976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.719681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.719681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.720460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.725793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.730739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.732107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.895285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.902700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:49.922924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4dec1c9-7378-4d0a-b399-25410e5ed02d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1273 microversion: 2.1 time: 0.292001 Oct 04 18:33:49.924923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2856/5740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.931074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eff3815-4ef0-41d5-a107-a65f8f4048ae", "tag": "f1a363a7-2231-4589-bf12-4a7360f6a011"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:49.947371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:49.962159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-986b7ded-5a1d-4e77-b49a-5035e97682cd tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.719678 Oct 04 18:33:49.965431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2885/5741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:49.968973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.970144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.972121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.011910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] Creating event network-changed:f1a363a7-2231-4589-bf12-4a7360f6a011 for instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae on n-h2-833090-21 Oct 04 18:33:50.031980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c8c14486-5140-43a8-8902-d1933a65b22a req-6e43a0e5-f0b9-433c-abe0-8509da8c4fa7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103858 Oct 04 18:33:50.032924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2857/5742] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:50.324132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82591a29-9ef0-4460-9933-a3ddf89ca951 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: .version_select at 0x7f900825c430>, body: {"keypair": {"name": "tempest-keypair-201307511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYTdXg7+0LXwL/e9myApENLFA/Wgrcc/p1MHNTAqtNRcYYGt3ZtVDXySVrV80c4lLeQQv4Y4KwCRZrzvDoN+8yP0+xNwVP3xAkN0LfC9n90moNz/8kd+KugP6F2u0ce6A=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:50.374339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-82591a29-9ef0-4460-9933-a3ddf89ca951 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:50.386292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-82591a29-9ef0-4460-9933-a3ddf89ca951 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:50.403976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:50.558889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82591a29-9ef0-4460-9933-a3ddf89ca951 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.591381 Oct 04 18:33:50.560073 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2886/5743] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:33:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:50.650190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c089791e-1b6a-4809-bf8c-259043f46870 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.652768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c089791e-1b6a-4809-bf8c-259043f46870 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.947697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.948602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.960249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.961040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.961701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.962653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.965288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.965950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.084258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c089791e-1b6a-4809-bf8c-259043f46870 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.096212 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c089791e-1b6a-4809-bf8c-259043f46870 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1214 microversion: 2.1 time: 0.454048 Oct 04 18:33:51.096432 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2858/5744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1214 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.189008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.189859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.192577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:51.210224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.211023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.211735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.212611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.213236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.213823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.576413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.584949 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5bef3560-c88b-4d1e-8a1f-30002094b39d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.641566 Oct 04 18:33:51.595600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2887/5745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.750742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.761015 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b5969ac-ea15-4fbd-9bae-982049c7581d tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.663333 Oct 04 18:33:51.761612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2859/5746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.123089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.130303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.138378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.139878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.140590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.141479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.142105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.143027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.246663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.261672 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-63b3aab8-aa02-4a40-aa5d-bc6d70b31203 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1266 microversion: 2.1 time: 0.145295 Oct 04 18:33:52.262852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2888/5747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.609844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.613836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.619350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.620223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.620864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.621842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.622544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.623371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.786914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.787573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.809649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.811384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.812193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.813211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.814879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.818584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.926829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.945700 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d139ff19-cd61-488a-8632-a08a8011db08 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.340961 Oct 04 18:33:52.948994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2860/5748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.023256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03de6099-e18e-4aea-abe8-df31d05aa472", "tag": "659bf139-1366-4c2b-ab86-05087ec40315"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:53.046346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.049237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.049942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.084248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] Creating event network-changed:659bf139-1366-4c2b-ab86-05087ec40315 for instance 03de6099-e18e-4aea-abe8-df31d05aa472 on n-h1-833090-21 Oct 04 18:33:53.091554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-47361899-0d33-40a5-939d-3231bb6a07db req-182275fc-cd41-40cc-a6ce-9bb0eeb6700c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074077 Oct 04 18:33:53.093464 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2861/5749] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:53.165109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.173602 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8f99a0b-d13d-4a39-ad8f-4f726f9df985 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.391136 Oct 04 18:33:53.207262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2889/5750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.288072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.288976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.298946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.302595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.303204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.318382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.319282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.320421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.785506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.800692 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a580dbf-6279-4dd6-9830-aac5ce35ad0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1266 microversion: 2.1 time: 0.517838 Oct 04 18:33:53.801310 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2862/5751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1266 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.970906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.972108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.981842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.986479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.987127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.988580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.990513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.991108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.214436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.214958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.223112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.228506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.232828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.234681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.246963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.250096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.856440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:54.867739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06341493-98a2-40fe-8943-6c566b4edb90 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.657128 Oct 04 18:33:54.883492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2863/5752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.894454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.896296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.916362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.917074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.919136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.922985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.924181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.924798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.239752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.250336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52191547-cfc9-42d8-ba57-eb125c0c6a32 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1274 microversion: 2.1 time: 0.375966 Oct 04 18:33:55.260935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2864/5753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.389860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.399632 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a64e0c7c-d297-4da3-a725-20356bb2290e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 1.433257 Oct 04 18:33:55.404266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2890/5754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.899775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.900718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.911403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.915425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.918528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.935681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.936423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.937026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.284685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.285984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.294792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.295600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.296247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.297164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.297799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.298430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.418168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.429696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed15a402-a9e0-4d77-ae4b-b9f378316f09 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1272 microversion: 2.1 time: 0.149362 Oct 04 18:33:56.451678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2891/5755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:56.463310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.463957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.479032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.479556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.480001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.480710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.481167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.481594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.585433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.597891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7735ec7c-9aa4-4f52-b631-406227b205b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.704133 Oct 04 18:33:56.601261 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2865/5756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:55 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:56.722530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff3815-4ef0-41d5-a107-a65f8f4048ae", "name": "network-vif-plugged", "status": "completed", "tag": "f1a363a7-2231-4589-bf12-4a7360f6a011"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:56.722978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.734013 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-579e52e3-d20d-48ad-a560-2ef86ac9431c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.280365 Oct 04 18:33:56.737273 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2892/5757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:56.742013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.744181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.744837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.774428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] Creating event network-vif-plugged:f1a363a7-2231-4589-bf12-4a7360f6a011 for instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae on n-h2-833090-21 Oct 04 18:33:56.786115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0925ddb4-0e5d-4ac5-9faf-9dc88efdc9ad req-0f0431fa-59eb-4762-9623-67d0c13f14a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067360 Oct 04 18:33:56.786987 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2866/5758] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:57.461625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.462920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.472593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.473398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.474188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.475149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.476651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.478347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.625480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.629206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.638438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.639228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.639930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.640796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.642042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.642570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.982838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.994372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a032c89-b896-4dd7-a4b3-717e3293cd2f tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1319 microversion: 2.1 time: 0.375098 Oct 04 18:33:57.995048 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2867/5759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.000673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.001524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.014767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.015627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.016897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.017969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.031058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.032058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.203563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.213500 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa906dcf-e09c-4756-afc0-ee61b616d5ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.756593 Oct 04 18:33:58.214226 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2893/5760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.318094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1417677663", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c"}], "security_groups": [{"name": "tempest-securitygroup--36922410"}], "key_name": "tempest-keypair-201307511", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:58.427879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:58.438494 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d52ef7cb-a1f6-4c45-ae4d-f4bf406d36b2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.442095 Oct 04 18:33:58.440945 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2868/5761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.524719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] validate_networks() for [('b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:59.018881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.020898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.044114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.045536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.046004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.046751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.047200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.047668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.064836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:59.065411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:59.065986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:59.066476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:59.066963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:59.083699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.084916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.085375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.089859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.089859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.089859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.120003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:59.130736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:59.130952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:59.142789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:59.146121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:59.297828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9656743-6bf8-430c-9ae0-38e114420901 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.984059 Oct 04 18:33:59.298529 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2894/5762] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:58 2022] POST /compute/v2.1/servers => generated 400 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:33:59.308475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.309097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.327389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.328148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.331493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.331493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.331493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.331493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.535667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.546903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-173be0e9-eafb-40a1-baa7-dabb11c4803a tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1508 microversion: 2.1 time: 0.531676 Oct 04 18:33:59.563847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2869/5763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:59.585165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-766a3f85-2d6f-47fc-9c3e-2c8ed6bc0115 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.587148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-766a3f85-2d6f-47fc-9c3e-2c8ed6bc0115 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.697206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-766a3f85-2d6f-47fc-9c3e-2c8ed6bc0115 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.716907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-766a3f85-2d6f-47fc-9c3e-2c8ed6bc0115 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1241 microversion: 2.1 time: 0.149533 Oct 04 18:33:59.718567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2870/5764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.726159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:59.727391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.738474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.739393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.740208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.741386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.741986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.742697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.873327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.883197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-052f25b5-90f3-4891-a750-a71bb573e560 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.583587 Oct 04 18:33:59.883914 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2895/5765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:59.890470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c09af6c-cf30-43b0-8fcb-c19c51f319e1", "device": "/dev/sdb"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:59.895753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:59.901900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.902635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.903251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.903978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:59.904601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:59.905189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.134499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.143372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f4eb7b7-32f7-4e56-887c-e24bdaace803 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.423324 Oct 04 18:34:00.144443 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2871/5766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:59 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.167861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8a038e-6b44-452d-b4cf-e2a323597282", "tag": "75c7fa78-8a39-44f7-beda-0447c9a145ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:00.178766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.179572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.180018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.192397 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] Creating event network-changed:75c7fa78-8a39-44f7-beda-0447c9a145ad for instance 4f8a038e-6b44-452d-b4cf-e2a323597282 on n-h2-833090-21 Oct 04 18:34:00.198388 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cb107bec-5a6f-4994-a80d-dec66e38db47 req-80bad4c1-94c6-43b0-8853-71d7b65c6004 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Oct 04 18:34:00.199542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2872/5767] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:00.743197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bfe71784-c25b-43a4-8693-abe69abb537b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.743925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bfe71784-c25b-43a4-8693-abe69abb537b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.879127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bfe71784-c25b-43a4-8693-abe69abb537b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.888338 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bfe71784-c25b-43a4-8693-abe69abb537b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1241 microversion: 2.1 time: 0.149411 Oct 04 18:34:00.889576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2873/5768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.924760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.928215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.937804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.938399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.939040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.940024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.940639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.941114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.154839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.162994 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad5f6ef2-c5bd-4aa6-be5c-fc7b5a667713 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.260479 Oct 04 18:34:01.165452 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2874/5769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.169610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03de6099-e18e-4aea-abe8-df31d05aa472", "name": "network-vif-plugged", "status": "completed", "tag": "659bf139-1366-4c2b-ab86-05087ec40315"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:01.179959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.180661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.181267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.195170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3df0d02-62c0-4c50-94f3-4afc572d238c tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "POST /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308161 Oct 04 18:34:01.196184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] Creating event network-vif-plugged:659bf139-1366-4c2b-ab86-05087ec40315 for instance 03de6099-e18e-4aea-abe8-df31d05aa472 on n-h1-833090-21 Oct 04 18:34:01.199014 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2896/5770] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:33:59 2022] POST /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae/os-volume_attachments => generated 194 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:01.213859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.215105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.216600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d4ce1b97-ec66-4f86-a791-99eca60e93ab req-a882de95-0000-4ec7-8fe0-a265004911c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Oct 04 18:34:01.217766 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2875/5771] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:01.225031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.225454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.226201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.227319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.227884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.228586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.471017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.480393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-881854eb-b4ec-41e6-ad4b-458b584af814 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.279650 Oct 04 18:34:01.497000 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2897/5772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.914543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.915250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.922146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.922647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.923086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.924192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.924822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.925960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.008052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.016555 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b4feeea-31ca-4fea-93ea-2918438e0e04 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1237 microversion: 2.1 time: 0.106781 Oct 04 18:34:02.017136 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2876/5773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:02.193322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.194220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.225107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.225880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.227162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.227938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.228405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.230766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.508762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.509395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.518681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.519217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.519701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.520555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.521190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.521985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.554051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.568286 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41fa2893-c832-41e7-8088-f4916d569944 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.381724 Oct 04 18:34:02.568996 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2898/5774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:02.980886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.991514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-258bc663-3630-4978-b7b5-f44cc24a359e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1315 microversion: 2.1 time: 0.487896 Oct 04 18:34:03.006005 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2877/5775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:03.042343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:03.042343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:03.048238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.049084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.049535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.050758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.051221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.051826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.170555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:03.181098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0ce0185f-bc8d-436e-b521-fef5ab2ee513 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1293 microversion: 2.1 time: 0.144509 Oct 04 18:34:03.181704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2899/5776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:03 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:03.608557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:03.609929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:03.635050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.636629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.639755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.643282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.645969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.647327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.021377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.023267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.046231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.047229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.055708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.056759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.057425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.058045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.084264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:04.277542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.307231 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4e6cdab-bdac-44ba-aaee-9b730c02b3ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.718274 Oct 04 18:34:04.308915 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2878/5777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:03 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.322160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:04.341750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.355673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.366240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.372301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41e8f75f-6eaf-4a3b-bc98-8ad30f05ba8a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1501 microversion: 2.1 time: 0.358096 Oct 04 18:34:04.377554 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2900/5778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1501 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.402608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:04.403738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:04.420311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.420852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.429197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.430257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:04.430886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:04.431525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.553387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.561188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:04.570103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e28bfe2c-c602-44a1-b8c1-e2887e748a9d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1299 microversion: 2.1 time: 0.250515 Oct 04 18:34:04.587131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2879/5779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:04 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:04.655749 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.network.security_group_api [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Removing security group f52069b2-f060-4eb5-b441-2a4132710263 from port 659bf139-1366-4c2b-ab86-05087ec40315 Oct 04 18:34:05.226641 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0a647dc-cf1a-4181-a987-de7ab45a913a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472/action" status: 202 len: 0 microversion: 2.1 time: 0.828371 Oct 04 18:34:05.230511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2901/5780] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:04 2022] POST /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:34:05.241023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.243056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.260342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.261524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.264151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.275402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.275402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.275402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.279957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03de6099-e18e-4aea-abe8-df31d05aa472", "tag": "659bf139-1366-4c2b-ab86-05087ec40315"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:05.300458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.305277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.305728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.344732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] Creating event network-changed:659bf139-1366-4c2b-ab86-05087ec40315 for instance 03de6099-e18e-4aea-abe8-df31d05aa472 on n-h1-833090-21 Oct 04 18:34:05.351361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8394ceca-70ac-4a29-89e5-d33345b8b6a3 req-e3b8a8e2-fb27-4474-a4c7-1ff118f8b205 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078621 Oct 04 18:34:05.352443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2902/5781] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:05.359057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.361433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.373026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.373026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.374641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.375588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.376462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.377158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.485584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.496365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a0eef73-9f08-4ba7-862e-1d4249c3378a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1459 microversion: 2.1 time: 0.262529 Oct 04 18:34:05.501279 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2880/5782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1459 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.523643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.523643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.535300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.535938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.536585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.538976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.539604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.540148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.802514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.815644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db9f0398-8bda-44cd-99fd-74b757d851ce tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.461613 Oct 04 18:34:05.816603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2903/5783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.823575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.824950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.836934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.837440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.837881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.839783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.840785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.841538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.096254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.108006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4932bf64-e143-42ce-a863-b78454cf18b6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1299 microversion: 2.1 time: 0.289515 Oct 04 18:34:06.108615 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2904/5784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1299 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.302110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.312385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d68dfa6-f4e5-4680-aeb2-24a2bc095ea2 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.794062 Oct 04 18:34:06.317449 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2881/5785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:06.352457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.353094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.365552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.366333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.366949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.367856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.368502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.369078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.669690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.680855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c472e71-d862-432d-8d5a-c516310c1615 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.334320 Oct 04 18:34:06.682104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2905/5786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:06.713755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.714561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.722701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.723638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.724100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.724867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.725699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.726135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.843718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.844338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.861526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.862307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.863424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.864366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.865013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.865819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.152492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.171617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84b046c1-fbe5-48eb-be2d-24a3d6a0cab9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.331750 Oct 04 18:34:07.176406 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2906/5787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:07.187922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.189959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.210548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.213724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.213724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.213724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.213724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.214683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.310457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.321799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c66130bc-a8c1-4ea8-8e30-d586cacd9013 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1299 microversion: 2.1 time: 0.144064 Oct 04 18:34:07.322946 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2907/5788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.328170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a038e-6b44-452d-b4cf-e2a323597282", "name": "network-vif-plugged", "status": "completed", "tag": "75c7fa78-8a39-44f7-beda-0447c9a145ad"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:07.338517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.339002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.339434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.355046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] Creating event network-vif-plugged:75c7fa78-8a39-44f7-beda-0447c9a145ad for instance 4f8a038e-6b44-452d-b4cf-e2a323597282 on n-h2-833090-21 Oct 04 18:34:07.358194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f04b248a-4972-4499-af91-9d696796cc97 req-0d91e91a-dd86-4897-a30c-e02018090957 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Oct 04 18:34:07.359283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2908/5789] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:07.717881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.736856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b32f934-0a25-43e2-a293-326138be9b9e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 1.028632 Oct 04 18:34:07.737470 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2882/5790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.760892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.762585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.771328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.772105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.772719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.773596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.774277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.774871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.163745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.181767 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38c70a47-18a8-4f7c-95e6-7834af8f8b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.425048 Oct 04 18:34:08.182318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2909/5791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.214160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.214997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.225608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.229106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.230137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.232027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.233179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.234998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.350431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.351307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.369331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.654472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.668279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-981ae835-7cbe-4172-96fc-ed2677bd78f6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1314 microversion: 2.1 time: 0.458880 Oct 04 18:34:08.669472 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2883/5792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.674394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1434004752", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "615cdc98-a3fe-4da3-8339-6361f3daab74"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:08.782469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] validate_networks() for [('615cdc98-a3fe-4da3-8339-6361f3daab74', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:08.932768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.973393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ef72acb-1b38-4be4-af70-daef017f0560 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.627439 Oct 04 18:34:08.980052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2910/5793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:09.563174 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:34:09.563369 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 18:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 18:34:09.705986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:09.708221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:09.720849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:09.723138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:09.727326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.739299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.739299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.739299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.739299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.739299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.490646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:10.491985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:10.492659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:10.493241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:10.494094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:10.531197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=27 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:10.541138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.551688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.553176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.555426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.556593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.558742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.591139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:10.600332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Getting quotas for user d999ff9b16f84082b0036ed8e67d011c and project 5eb61fd3a99d40e3a8895e08bae46bd9. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:10.615850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:10.618671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:10.643906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.656146 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fec9a654-ca7a-4b57-95dd-d937a9f3a04e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1501 microversion: 2.1 time: 0.954049 Oct 04 18:34:10.657414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2911/5794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1501 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:10.663049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.663890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.670828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.671792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.672613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.673521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.674283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.675597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.809664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5238a147-47de-44ab-9fa4-7467cc8629bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138796 Oct 04 18:34:10.816530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2884/5795] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:10.821618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:10.822181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.835670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.842825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.843623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.845288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.846183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.847501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.909099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'flavor' on Instance uuid 4f8a038e-6b44-452d-b4cf-e2a323597282 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:11.076518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.102885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-858b4fba-ad1d-4de5-85f6-d41eab590d5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.427912 Oct 04 18:34:11.102885 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2912/5796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:10 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.102885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f4a899c6-c2a3-470b-94cb-50d1b3d1066a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.102885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f4a899c6-c2a3-470b-94cb-50d1b3d1066a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.230479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f4a899c6-c2a3-470b-94cb-50d1b3d1066a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.239169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f4a899c6-c2a3-470b-94cb-50d1b3d1066a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1215 microversion: 2.1 time: 0.148893 Oct 04 18:34:11.239796 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2913/5797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.253363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59426015-202a-416b-8604-dca27c4b4a57", "tag": "08418a0e-34fe-4be4-b5db-78e1cf77546d"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:11.275556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.277049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.279129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.310988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] Creating event network-changed:08418a0e-34fe-4be4-b5db-78e1cf77546d for instance 59426015-202a-416b-8604-dca27c4b4a57 on n-h1-833090-21 Oct 04 18:34:11.320988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-be6446f0-c2b2-4572-83b3-ff5ceba675de req-edb4a540-1b5b-486a-aaf3-48a8675af820 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077663 Oct 04 18:34:11.324535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2914/5798] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:11.762636 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-799a5aa1-2337-4bc4-872e-5ff066458665 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282/action" status: 202 len: 0 microversion: 2.1 time: 0.950855 Oct 04 18:34:11.764664 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2885/5799] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:10 2022] POST /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282/action => generated 0 bytes in 954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:11.779318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.780107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.801066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.801578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.802027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.803719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.804265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.804608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.111025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.111917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.132454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.133020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.133487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.134268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.134736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.135178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.136387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.147272 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d126d717-16bf-43c7-b807-08db69e955e0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.374429 Oct 04 18:34:12.149687 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2915/5800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.265931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d120dd1-3ada-4c60-87a7-75cb7e1ec19d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.266549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d120dd1-3ada-4c60-87a7-75cb7e1ec19d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.291992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.304102 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3eecafd-6f35-4369-b50c-411efd6481cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.196459 Oct 04 18:34:12.304295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2886/5801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:12.386087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d120dd1-3ada-4c60-87a7-75cb7e1ec19d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.395009 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d120dd1-3ada-4c60-87a7-75cb7e1ec19d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1215 microversion: 2.1 time: 0.133019 Oct 04 18:34:12.395692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2916/5802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:13.173092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.174435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.186862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.187686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.188371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.194129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.194129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.194129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.330115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.331984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.342855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.343869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.344538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.345871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.346661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.347279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.452769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.475211 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a6b8c79-f36f-4c2e-b301-7359ae3bdcf5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.306164 Oct 04 18:34:13.491500 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2887/5803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:13.497579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.503880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.516356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.516945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.517926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.519896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.520382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.520820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.685031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.693891 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-625fe43d-6891-4cba-9dd8-7a6365885364 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1267 microversion: 2.1 time: 0.200933 Oct 04 18:34:13.694481 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2888/5804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:13.701597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:13.711577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9558b87-1ba8-4295-beaf-6c0e2648b4c8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.389219 Oct 04 18:34:13.712172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2917/5805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:14.508191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.508809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.520829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.522373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.529596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.530750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.531400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.532024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.719396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.720872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.736904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.738008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.738679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.742360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.743136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.744644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.892297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.907980 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92e9ad7b-c2c2-4196-8805-63a9677ede60 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1285 microversion: 2.1 time: 0.192602 Oct 04 18:34:14.910714 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2918/5806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:14.917637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:14.921018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:14.942105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.942768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.943260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.944568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:14.945113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:14.948083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.116945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.126634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2a93e4e-8661-44a3-a69c-6d231f2fa3ea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.624403 Oct 04 18:34:15.127655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2889/5807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:15.295050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.305732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab1c7328-f0eb-41d4-b82d-042f45f52785 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.393721 Oct 04 18:34:15.320949 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2919/5808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:14 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:15.935945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.937670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.952399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.954430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.956945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.959199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.961002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.961880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.163606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:16.165428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:16.180141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.181682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.183005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.184902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.185887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.188588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.402356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:16.406512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:16.420654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4dc4ac3e-eab0-4e33-8640-2216da954756 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.267100 Oct 04 18:34:16.422065 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8584eafc-fd97-4d97-bbcb-a28e8433163a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.491174 Oct 04 18:34:16.439432 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2920/5809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:16 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:16.445060 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2890/5810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:16.454006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:16.454006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:16.454321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.454648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.455896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.456816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.457404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.458018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.462923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:16.615552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:16.623894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2a0e3894-1aec-42aa-b3d2-dc41ea67601d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.183187 Oct 04 18:34:16.628659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2921/5811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:16 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.236255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59426015-202a-416b-8604-dca27c4b4a57", "name": "network-vif-plugged", "status": "completed", "tag": "08418a0e-34fe-4be4-b5db-78e1cf77546d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:17.251460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.252125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.252627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.264718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] Creating event network-vif-plugged:08418a0e-34fe-4be4-b5db-78e1cf77546d for instance 59426015-202a-416b-8604-dca27c4b4a57 on n-h1-833090-21 Oct 04 18:34:17.269796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-069daedc-9129-43b2-b2c0-0f6b3a194b04 req-4f836660-dd0c-44f6-b716-86e9d06b440c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037688 Oct 04 18:34:17.270471 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2891/5812] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:17.445692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.446666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.454245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.457429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.457429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.457429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.457429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.457429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.465032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.465927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.472766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.474224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.474860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.475734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.476384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.477599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.668126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.681741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-31b34781-890c-43b6-862e-3da878b5dbe6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.235924 Oct 04 18:34:17.682854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2922/5813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:17.687811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.688879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.695439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.699018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.699714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.700586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.701194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.701771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.907754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:17.918165 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e46ebf9e-6cfa-478d-a5ed-a916cc2b1eff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.234003 Oct 04 18:34:17.919538 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2923/5814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.040332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d72f978-eb06-4107-aaf8-b6c9c4d82542", "tag": "13c2856c-55b0-4cf4-b128-76d69ef914b3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:18.051263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.052043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.052929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.065809 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] Creating event network-changed:13c2856c-55b0-4cf4-b128-76d69ef914b3 for instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 on n-h2-833090-21 Oct 04 18:34:18.072919 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-12d59ea0-d5b7-4cfd-aca7-7cab68b2a0cf req-063d1168-c575-48da-9600-bb2528b35822 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038445 Oct 04 18:34:18.074352 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2924/5815] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:18.133195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.141348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-830b1dfc-0ead-459b-ad4f-e7d791f5efa9 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.682689 Oct 04 18:34:18.141932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2892/5816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:18.706841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.707740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.709806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:18.723115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.723754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.724288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.725093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.725643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.726168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.889553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:18.899351 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51c13969-f5e7-4cfd-a91f-fbe9301a2802 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.196920 Oct 04 18:34:18.901235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2925/5817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:18.942888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:18.943542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:18.950731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.951249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.957211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.957211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.957211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.957211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.171708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.171708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.175662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.176443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.177080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.177980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.178635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.179260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.334465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.347980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f23e3ce9-e5fb-476c-9bb6-5366a48259b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1365 microversion: 2.1 time: 0.409341 Oct 04 18:34:19.363770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2893/5818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:18 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1365 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.443970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:19.453598 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24d31eec-2cda-4332-addd-30e8e31723a7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.291185 Oct 04 18:34:19.465682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2926/5819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:19.925210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:19.925894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:19.932465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.932976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.933420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:19.934216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:19.934679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:19.935112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.153928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.165106 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7ed082e-3859-4318-8a84-01539ae17f84 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.242464 Oct 04 18:34:20.165106 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2894/5820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:19 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:20.371200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.371967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.380551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.381088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.381532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.382331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.383022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.383447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.483740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:20.487968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:20.508141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.509915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.510533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.514023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:20.514668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:20.516587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:20.580985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:20.804196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:20.808054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:20.816705 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-328a7592-8826-41d8-a814-75a13b421e57 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.343434 Oct 04 18:34:20.817471 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2895/5821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:21.188742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.190014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.193293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:21.198539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.199535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.200254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.201197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.201856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.202507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.204412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.213641 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-658b8683-aa3b-4357-a6ec-f13c80d71f82 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1555 microversion: 2.1 time: 0.846563 Oct 04 18:34:21.214608 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2927/5822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:20 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1555 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:21.238602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.239697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.247477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.253589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.253589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.253589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.253589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.253589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.336372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c35f54d-337b-42bd-ad01-3fb1e30ab3f0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103704 Oct 04 18:34:21.336965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2928/5823] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:21.841088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:21.842458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:21.850090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.850767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.851635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.852301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:21.852915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:21.853208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:21.854063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:21.873286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-269a7621-8751-4f6f-bdac-99566e3900b1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.689044 Oct 04 18:34:21.875421 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2896/5824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:22.392719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:22.574302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:22.583612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33f0272b-37d5-4719-b310-105138373e73 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.747410 Oct 04 18:34:22.584193 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2929/5825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:21 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:22.903786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.909034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:22.917578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.918159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.918706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:22.919564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:22.920317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:22.920966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.157835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.168563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e33f825-97a7-4cde-8cbb-60a94ec54d40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.273347 Oct 04 18:34:23.171928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2897/5826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:22 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:23.613163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:23.614304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:23.625472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.625989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.626441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.627251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.627942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.632148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.650776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59426015-202a-416b-8604-dca27c4b4a57", "tag": "08418a0e-34fe-4be4-b5db-78e1cf77546d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:23.662202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:23.663337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:23.664188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:23.678795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] Creating event network-changed:08418a0e-34fe-4be4-b5db-78e1cf77546d for instance 59426015-202a-416b-8604-dca27c4b4a57 on n-h1-833090-21 Oct 04 18:34:23.687569 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-57668811-aeca-4a5d-9ee7-2dff8618968b req-61eeb8a0-714e-45af-bacf-2a778ad8c8ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040593 Oct 04 18:34:23.688260 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2898/5827] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:23.866660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:23.876608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5dbcb017-1f1c-46bd-8721-b4d1d0a8d327 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.270185 Oct 04 18:34:23.877275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2930/5828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:23 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:24.196987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.197812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.217753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.220476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.222941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.226238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.226961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.229438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.537093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:24.551209 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b972203f-ecc0-43b3-8a33-25d2f925f4ef tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.360550 Oct 04 18:34:24.556423 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2899/5829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:24.903857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:24.904493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:24.918374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.918881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.919423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:24.920181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:24.920625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:24.921183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.179253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:25.190184 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-330b2c4a-2699-4264-9250-6c35728d0965 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.290378 Oct 04 18:34:25.195194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2931/5830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:24 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:25.585449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:25.587063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:25.606918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:25.608759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.609572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.610190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.610907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.611369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.611862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.917373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d72f978-eb06-4107-aaf8-b6c9c4d82542", "name": "network-vif-plugged", "status": "completed", "tag": "13c2856c-55b0-4cf4-b128-76d69ef914b3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:25.940965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:25.941474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:25.941923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:25.966354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] Creating event network-vif-plugged:13c2856c-55b0-4cf4-b128-76d69ef914b3 for instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 on n-h2-833090-21 Oct 04 18:34:25.978857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b1a15085-ac4b-4e6a-8069-23dfb9b78441 req-7a6df9b4-dbee-42d2-a143-57dab6e6ca5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065188 Oct 04 18:34:25.983852 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2932/5831] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:26.181578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.192790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19bb06b4-dc3e-435d-bae9-d6a191f7fbcd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.612262 Oct 04 18:34:26.199601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2900/5832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:25 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:26.217903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:26.217903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:26.222652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.223146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.223615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.224320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:26.224778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:26.225208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:26.451916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:26.474790 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08f2152d-3603-4662-90e1-a040497b8bfc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.264405 Oct 04 18:34:26.500395 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2933/5833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:26 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.222585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.223205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.247540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.248010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.248456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.249186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.249640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.250074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.448853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.457863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3bf56021-dc57-4708-a991-338f2b6f6ba9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.243391 Oct 04 18:34:27.458870 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2901/5834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:27.506917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:27.507693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:27.514803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.515597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.516106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.516882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:27.517474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:27.518065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:27.852261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:27.861608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b126d20-94f1-40a4-b6b6-07d5b44b1b89 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1315 microversion: 2.1 time: 0.359009 Oct 04 18:34:27.863539 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2934/5835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:27 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.482122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.483335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.491916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.492467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.492915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.493628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.494088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.494536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.851244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:28.860883 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79578d4e-62c8-49cf-9543-6d94e163e7fd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.383275 Oct 04 18:34:28.867393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2902/5836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:28.897409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:28.898053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:28.912239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.912947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.913763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:28.914660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:28.915508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:28.916097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.156083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.176292 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58e40628-dc83-4815-bd4e-cb7ea092ff7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1502 microversion: 2.1 time: 0.291034 Oct 04 18:34:29.176894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2935/5837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:28 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:29.201864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:29.202407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.209137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.216138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.218054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.218999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.219666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.220259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.560067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03db1c10-76f7-4f9d-a27a-ecbdc4a426e5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542/action" status: 202 len: 0 microversion: 2.1 time: 0.362176 Oct 04 18:34:29.561235 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2903/5838] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:29 2022] POST /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:29.570438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.571219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.583721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.586448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.587700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.588492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.597417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.597942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.896372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:29.898324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:29.906290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.907088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.907718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.911144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:29.911829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:29.912426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:29.948752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:29.960827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e226ea3b-dc50-4300-a220-d25ce216de54 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1507 microversion: 2.1 time: 0.393574 Oct 04 18:34:29.964075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2936/5839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.262907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:30.274572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1f47e17-5157-488d-b137-a36bea5d99cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.385375 Oct 04 18:34:30.275167 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2904/5840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:29 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:30.992535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:30.994170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.003248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.004005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.004647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.016745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.021878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.021878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.249963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.259439 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3c0c1b5-a354-4bfd-8f19-1dbcf8d301cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1487 microversion: 2.1 time: 0.273959 Oct 04 18:34:31.261824 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2937/5841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:30 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1487 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:31.289060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:31.289611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.302367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.304067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.304670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.305221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:31.306311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:31.307194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.309617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.310317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.319354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.320945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.324123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.325080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:31.328379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:31.329031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:31.373599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'flavor' on Instance uuid 0d72f978-eb06-4107-aaf8-b6c9c4d82542 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:31.958862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:31.969957 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8bb08af-53a2-414c-97e7-3a8ce4990f58 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.672577 Oct 04 18:34:31.971960 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2938/5842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:31 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.146600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b993c0a5-186f-4b97-b69c-681d81ca9e06 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542/action" status: 202 len: 0 microversion: 2.1 time: 0.855883 Oct 04 18:34:32.151265 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2905/5843] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:31 2022] POST /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:32.157699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.159588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.180710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.180710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.180710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.180710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.181853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.182396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.210036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.394614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.405020 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b50b33d7-ebe3-4c66-9d49-6679cc4a39cb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1493 microversion: 2.1 time: 0.252410 Oct 04 18:34:32.405932 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2939/5844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1493 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:32.997058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.997825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.006805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.007624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.008241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.009139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.009943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.010367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.227590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.239095 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20bb1548-c467-4605-8cff-628a9b894283 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.246898 Oct 04 18:34:33.262953 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2906/5845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.432298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.432960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.446762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.452202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.456462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.457457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.458267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.459009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.734627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.749903 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb0800a8-6eed-49d5-a829-e807278bc268 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1493 microversion: 2.1 time: 0.321545 Oct 04 18:34:33.753227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2940/5846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1493 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.262986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.264411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.271811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.272694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.273353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.274297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.274971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.275656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.485801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.486361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.496116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.496489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.504279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.511909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.512450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.512912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.516809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:34.530305 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35a4b85a-d05a-442d-96a4-ea774ec5a9b5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.271724 Oct 04 18:34:34.536251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2907/5847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.639077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lazy-loading 'services' on Instance uuid 0eff3815-4ef0-41d5-a107-a65f8f4048ae {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:34.776211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.778664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.786269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.787342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.787999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.788883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.789506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.790110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.926717 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0695d3a-89b6-4bc7-8f2a-c49da772f092 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae/os-volume_attachments/9c09af6c-cf30-43b0-8fcb-c19c51f319e1" status: 202 len: 0 microversion: 2.1 time: 0.444432 Oct 04 18:34:34.927440 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2941/5848] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:34:34 2022] DELETE /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae/os-volume_attachments/9c09af6c-cf30-43b0-8fcb-c19c51f319e1 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:34.949016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.003957 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6719989a-eea4-426c-8e25-e47c1ef85f93 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1514 microversion: 2.1 time: 0.206298 Oct 04 18:34:35.003957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2908/5849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:35.558966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:35.567409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:35.584143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.584143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.587392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.588252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:35.588734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:35.589179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.819279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.830842 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a440a69-ce5b-4680-918a-d2aa20222a45 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.276003 Oct 04 18:34:35.831904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2942/5850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:35 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.011286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.016045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.030852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.031368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.031855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.032589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.037675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.038211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.279330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.291058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35fcd513-7edc-414a-b647-8af9f423d27d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1514 microversion: 2.1 time: 0.284530 Oct 04 18:34:36.291764 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2909/5851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.861455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.866085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.890882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.891405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.891903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.892639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.893173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.893630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.222942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d72f978-eb06-4107-aaf8-b6c9c4d82542", "name": "network-vif-plugged", "status": "completed", "tag": "13c2856c-55b0-4cf4-b128-76d69ef914b3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:37.243395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.244305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.244898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.249419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:37.284884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.291760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] Creating event network-vif-plugged:13c2856c-55b0-4cf4-b128-76d69ef914b3 for instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 on n-h2-833090-21 Oct 04 18:34:37.297841 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64715e8a-cd81-4e9e-9649-d1f117bae66b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.446616 Oct 04 18:34:37.298442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2943/5852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:37.304597 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9b20cadf-56ce-40c9-ba25-4f0bdd066bd3 req-d82664bf-7b04-482d-a623-2d6661ed8bb0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085242 Oct 04 18:34:37.305577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2910/5853] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:37.319445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.320675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.328128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.328735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.329232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.330000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.331149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.331630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.554200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.566956 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c001e95-fad7-4fbc-b462-4245e9f16d76 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1514 microversion: 2.1 time: 0.246892 Oct 04 18:34:37.568055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2944/5854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:38.323054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.324509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.338032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.345273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.345273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.345273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.345273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.345273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.594787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.596564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.618193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.619547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.619547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.620486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.621249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.621996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.709847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:38.719940 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f445dd21-4e24-4e4a-96f1-afd1e928e071 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.400511 Oct 04 18:34:38.721847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2911/5855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.349875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.379567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9561123b-a40b-40b0-af90-9eac63b7a78e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.790336 Oct 04 18:34:39.397735 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2945/5856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:39.751781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:39.753091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:39.774910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.777982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.778816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.779856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:39.780735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:39.782372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.146612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.156757 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-419ceac8-4732-4d60-bb2c-fc3d9b7aa5c2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.413183 Oct 04 18:34:40.160858 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2912/5857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:39 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:40.412125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.412125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.423024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.428198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.428841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.430631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.431457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.432081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.915720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.926565 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-260e535f-fc70-47a8-9d01-1434435d77ba tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.520123 Oct 04 18:34:40.933775 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2946/5858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:41.186661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.187026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.197223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.203211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.203974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.206946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.207623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.218834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.637166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.657760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcacc672-22f2-491a-9e43-ea3254c36b33 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.475236 Oct 04 18:34:41.658394 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2913/5859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.959023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.959838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.974569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.975502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.976200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.977149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.977847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.978729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.685936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.687227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.701209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.710955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-521c4d6d-0299-4d32-afa9-4dbfa71b5c31 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.756744 Oct 04 18:34:42.718766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.744631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2947/5860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:42.746810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.748377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.757576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.759336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.764806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.260963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.274458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ec10ad05-59e6-4703-a0ff-e987413eeaa5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1507 microversion: 2.1 time: 0.593633 Oct 04 18:34:43.279411 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2914/5861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.745380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.745998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.760226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.760730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.766104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.766104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.766104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.766104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.107143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.107771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.128637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.129198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.130757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.136073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.137158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.137989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.190288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:44.281951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.292897 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c951ee2-f9da-46a1-8a22-c3a6f99f7d63 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.551560 Oct 04 18:34:44.297307 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2948/5862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.319719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.322208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.350838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.359536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.360808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.362815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.363784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.366456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.544846 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa51fa9e-79ff-4bd6-aafd-aa9d16d7e008 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 204 len: 0 microversion: 2.1 time: 0.441281 Oct 04 18:34:44.545859 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2915/5863] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:44 2022] DELETE /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:44.556821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.558097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.565524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.566275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.566916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.568100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.568745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.569458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.721365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.742116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b306d0a9-ae8d-49be-b32f-f4f3167ff033 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1528 microversion: 2.1 time: 0.441484 Oct 04 18:34:44.743814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2949/5864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1528 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.896792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:44.912925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48861d4c-def7-4ff8-bb3a-4fbbd9430331 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1514 microversion: 2.1 time: 0.360593 Oct 04 18:34:44.912925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2916/5865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:45.322467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.323343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.334624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.343145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.343980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.350842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.350842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.350842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.774081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.774716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.791446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.793277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.794691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.801195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.801195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.801195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.809948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.832560 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ac3f5c1a-787e-459f-a17a-da5d590617bb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.515045 Oct 04 18:34:45.837619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2950/5866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.937768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.939764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.957598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.959416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.960517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.962648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.963880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.964524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.452023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.476831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-718e2773-b6c6-4d0f-857d-5762ee1af6b1 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1514 microversion: 2.1 time: 0.544987 Oct 04 18:34:46.479771 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2951/5867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:46.825407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:46.843428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1d7eed5-a9d4-40d9-bf37-f350ebca3a71 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1528 microversion: 2.1 time: 1.074139 Oct 04 18:34:46.852004 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2917/5868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1528 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:46.867345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:46.868471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:46.879453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.881925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.882577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:46.883509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:46.888862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:46.889470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.398214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a038e-6b44-452d-b4cf-e2a323597282", "name": "network-vif-plugged", "status": "completed", "tag": "75c7fa78-8a39-44f7-beda-0447c9a145ad"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:47.431243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.432078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.450435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.497884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] Creating event network-vif-plugged:75c7fa78-8a39-44f7-beda-0447c9a145ad for instance 4f8a038e-6b44-452d-b4cf-e2a323597282 on n-h2-833090-21 Oct 04 18:34:47.524242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-87deb8ef-7341-4904-8caf-f189fbce1d9f req-5d694aec-486e-4a8d-8ff4-c3af53240274 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132696 Oct 04 18:34:47.525223 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2918/5869] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:47.540352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.541720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.563667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.566035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.567260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.569288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.571732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.572443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.095292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.109565 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1d16e79-2ec2-4a0d-ade9-816e6619f999 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1514 microversion: 2.1 time: 0.582306 Oct 04 18:34:48.119911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2919/5870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1514 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:48.135337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:48.138470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:48.152049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.152049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.152049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.158690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:48.159209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:48.159714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:48.270013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.281776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44b03ac8-ace6-4dfc-a994-6a8ef3f0a5fd tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.424243 Oct 04 18:34:48.282868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2952/5871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:46 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:48.474731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.487890 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62c67ff8-3551-4cca-a9af-99d4cf979c2d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1528 microversion: 2.1 time: 0.365983 Oct 04 18:34:48.488994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2920/5872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:48 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:49.155090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.155843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.170420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.172241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.175980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.176902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.178840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.179374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.255147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eff3815-4ef0-41d5-a107-a65f8f4048ae", "name": "network-vif-deleted", "tag": "f1a363a7-2231-4589-bf12-4a7360f6a011"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:49.273242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.273981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.274573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.289374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] Creating event network-vif-deleted:f1a363a7-2231-4589-bf12-4a7360f6a011 for instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae on n-h2-833090-21 Oct 04 18:34:49.294507 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f7458c30-02f9-4d0b-a975-fd59db4fc4d0 req-313fcad0-ad6a-4a0f-84b5-c1f9748b62d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042687 Oct 04 18:34:49.296256 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2921/5873] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:49.311697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.323733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.324725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.332360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.333401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.334126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.335056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.335853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.337012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.355359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34fc4a23-b598-44b0-93b7-be4ad2ad30e0 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1472 microversion: 2.1 time: 0.208859 Oct 04 18:34:49.363264 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2953/5874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:49.516521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:49.517260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:49.532122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.534208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.534746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.536306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:49.538706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:49.539924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:49.600599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:49.622326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df7f2017-5c63-4776-a3b8-9c94ad3fcf84 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.299363 Oct 04 18:34:49.644867 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2922/5875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.383249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.386097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.415781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.416254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.416722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.417762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.417870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.418300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.470504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.489567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f712118d-7817-4292-b3ec-556c601baa40 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.978986 Oct 04 18:34:50.490930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2954/5876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:49 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:50.520192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.524095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.525843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.527219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lazy-loading 'fault' on Instance uuid 0eff3815-4ef0-41d5-a107-a65f8f4048ae {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:34:50.653807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:50.654732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:50.663685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=60 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:50.668759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.670760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.671459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.672481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:50.674354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:50.675213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:50.729154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f996014b8694de987601af0e06d848e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f188b140d1414e75a427c2d4fd2e0a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:50.747228 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d08c787e-66b4-47ae-97f6-3796c2e30998 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 200 len: 1309 microversion: 2.1 time: 0.364640 Oct 04 18:34:50.748532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:50.770590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2923/5877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:51.340697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:51.355333 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45d31720-4fd1-412b-9d39-f3f882e7fbc7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.707617 Oct 04 18:34:51.360582 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2955/5878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:50 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:51.515528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.516274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.527405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.527930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.528390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.531838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.534651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.535373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.776449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:51.777063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] [instance: 0eff3815-4ef0-41d5-a107-a65f8f4048ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:51.798176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.798176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.802483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.807796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:51.812196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:51.819648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:51.885044 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] HTTP exception thrown: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Request method failure captured: Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae HTTP/1.1 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHtj6eQ7-pzLXzUbEjJXmLcfz0vbBlkYxMnh1tW-G8Lg5QdyDSvWbCpTyFtMG69RxtPk5anMhURRTo9z9DDeorDjbHCryAm_JMbBufgxsnnkwu6a3q8O9VctLvcttfohMHR9YSNI3oKOZo4-2uzYW1_vSMY9Q2xba87C6J2IkfuyFTY Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: f188b140d1414e75a427c2d4fd2e0a61 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f188b140d1414e75a427c2d4fd2e0a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f188b140d1414e75a427c2d4fd2e0a61"}]}] Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: f188b140d1414e75a427c2d4fd2e0a61 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1659397688 Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesSnapshotTestJSON-1659397688-project Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 4f996014b8694de987601af0e06d848e Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesSnapshotTestJSON-1659397688-project Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '0eff3815-4ef0-41d5-a107-a65f8f4048ae'} Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:51.894168 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. Oct 04 18:34:51.899711 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:34:51.908482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] Returning 404 to user: Instance 0eff3815-4ef0-41d5-a107-a65f8f4048ae could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:51.912608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22e8f903-8fec-463d-8a74-bb3a9c9761a6 tempest-VolumesSnapshotTestJSON-1659397688 tempest-VolumesSnapshotTestJSON-1659397688-project] 10.222.0.40 "GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae" status: 404 len: 111 microversion: 2.1 time: 0.138090 Oct 04 18:34:51.918426 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2956/5879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/0eff3815-4ef0-41d5-a107-a65f8f4048ae => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:52.240551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:52.250148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4697798-156e-4e97-8b45-f29f73a8fe5f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.739075 Oct 04 18:34:52.250737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2924/5880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:51 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:52.386237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:52.386915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:52.414264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.418990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.422110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:52.422110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:52.422110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:52.422110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.287295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:53.288551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:53.304328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.305070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.305831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.306710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:53.307329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:53.307969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:53.916965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:53.943657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-38a3fb47-2d90-459e-bc55-ea242a3b8467 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.663838 Oct 04 18:34:53.960474 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2925/5881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:53 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.110471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:54.129836 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c828985-95e7-44f1-be35-95cf2ffa19c0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.747418 Oct 04 18:34:54.132870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2957/5882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:52 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:54.976945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:54.979389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.036499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.038176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.040885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.042145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.043307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.045296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.160923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:55.162167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:55.188260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.190084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.192695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.196914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:55.198702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:55.199856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:55.964758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:55.984877 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-517d8417-32f5-46d9-8f38-c64c54d240d7 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.828627 Oct 04 18:34:55.987916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2958/5883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:55 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:56.271698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:56.274750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:56.289075 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db3f8cbd-deac-4d00-b53b-db323119ff15 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.317094 Oct 04 18:34:56.289945 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2926/5884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:54 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:57.012574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.013204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.037776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.038627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.039093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.062695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.067650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.067650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.318294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:57.319596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:57.331885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.348288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.349011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.349973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:57.353535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:57.354215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:57.801695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:57.814039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21a4e91a-5a24-4969-a40e-3314f1444896 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.805407 Oct 04 18:34:57.826815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2959/5885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.246064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:58.268035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70fba1fe-8114-4cdd-b5c6-34cc13fefb12 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.952903 Oct 04 18:34:58.275949 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2927/5886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:57 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:58.865997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:58.867072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:58.918920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.921452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.926194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:58.928284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:58.931110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:58.936362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.311416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:59.313397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:59.425921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:59.456844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.463666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.465353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:59.472736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:59.473244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:59.476866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.363044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:00.380258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-882f0d38-0e33-4965-b2ed-bd9244195092 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.517911 Oct 04 18:35:00.380909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2960/5887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:58 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:00.418627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:00.424106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:00.447018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.453340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.455710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.457284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:00.460222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:00.462321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:00.576452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58d17402-7f41-462d-84d4-535ea734f74a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/ips" status: 200 len: 150 microversion: 2.1 time: 0.182759 Oct 04 18:35:00.577048 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2961/5888] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:35:00 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/ips => generated 150 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:01.135642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:01.145445 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9927602-ca26-438b-a28d-6344b6942cfb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.843502 Oct 04 18:35:01.158794 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2928/5889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:59 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:01.427997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:01.428618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:01.456785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.457683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.463099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:01.464182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:01.465323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:01.468200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.169388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:02.170008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:02.196833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.197658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.199816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.200769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:02.209798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:02.210127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:02.227222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.244468 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fd8a584-a478-40aa-bbf5-9c3d4d80226f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 0.815546 Oct 04 18:35:02.246104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2962/5890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:01 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:02.941608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:02.944769 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73a359f2-90e5-4513-9692-cb5264daa505 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.779198 Oct 04 18:35:02.954252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2929/5891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:02 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:03.279396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.280772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.293515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.296768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.296768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.302182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.302760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.303216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.978846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:03.983288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:03.989238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:03.989719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:03.998475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:03.999311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:04.004489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:04.005001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:04.819804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.849584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-153c6f67-5a78-408e-8d38-7be1403ac74c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.559484 Oct 04 18:35:04.853174 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2963/5892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:04.953173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:04.967580 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5d66c7c-476a-47e1-9c05-a063b74f982e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.992365 Oct 04 18:35:04.981473 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2930/5893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:03 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:05.885687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:05.891116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:05.939918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.940468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.942150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:05.942935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:05.948906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:05.951548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.013842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:06.014912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:06.047826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.057415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.057900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.060759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:06.061242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:06.061698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:06.822147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.834395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6360791-96dd-41f3-9c60-faba2ac150f8 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.827503 Oct 04 18:35:06.852319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2931/5894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:06 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:06.865582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:06.893634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-64498479-e3e1-43fb-9db9-10e7d6ecd310 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.018495 Oct 04 18:35:06.910359 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2964/5895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:05 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:06.990263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5890ab68-3de3-419c-86ab-07474c47d90f"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:06.993160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.013082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.014131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.014686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.014960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.023755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.024796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.860625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:07.861801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:07.895213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.895883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.896364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:07.906332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:07.906989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:07.907449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.455558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-982f9160-6eda-4817-b966-d8f94caa81cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.469063 Oct 04 18:35:08.461761 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2932/5896] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:35:06 2022] POST /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:08.493116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:08.500898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:08.521704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.523858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.524742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:08.528294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:08.530490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:08.532112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.091611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.122274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27f33bff-82c2-4777-8705-d8510a75eaba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.265320 Oct 04 18:35:09.126178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2965/5897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:07 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:09.449999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:09.472301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1a1fa53-c13b-4fb2-a016-de2656e464f0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.009537 Oct 04 18:35:09.488032 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2933/5898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:08 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:10.152952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.156093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.174395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.181724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.183808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.186304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.190421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.207043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.434859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b9c4020-b86b-4f60-9138-270ff94cfce7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: .version_select at 0x7f90082585e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1202589386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINC+gWvLKGDsJz9ZDsVYtyo4UEepZQNXmjrC/6JAfHfVmePET+s7Xj1VlUzog65NJxnBmuASg3SihO7mau8eAfOum8Rvh2drELzOXYl7XlG5mEYlKG/MxdO39CZMxnOfA=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:10.513992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3b9c4020-b86b-4f60-9138-270ff94cfce7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:10.525559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-3b9c4020-b86b-4f60-9138-270ff94cfce7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:10.665797 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b9c4020-b86b-4f60-9138-270ff94cfce7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.236346 Oct 04 18:35:10.666543 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2934/5899] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:10.673379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:10.677253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:10.709214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.713107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.716155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:10.721565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:10.722415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:10.731889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:11.622972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.635357 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22eb9e6f-54df-4b1e-b122-78b60adbbfc1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.486814 Oct 04 18:35:11.638913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2966/5900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:11.879343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:11.891153 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e0c6901-6654-4986-aaa9-994811cd5428 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1506 microversion: 2.1 time: 1.222513 Oct 04 18:35:11.894814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2935/5901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:10 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1506 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:12.665967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.666796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.690926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.693672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.696361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.697430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.703235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.708182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.917947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:12.919237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:12.932721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.937469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.940544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:12.941616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:12.946044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:12.950652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:13.604828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.615586 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81e79da1-b2e8-463f-a692-4591e0332b4a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1506 microversion: 2.1 time: 0.701680 Oct 04 18:35:13.621847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2936/5902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1506 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:13.628464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:13.657853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8acf7a74-2fb1-4833-8d18-0e0e95d2bf05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.000312 Oct 04 18:35:13.658464 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2967/5903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:12 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:14.657116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.659863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.681223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.687695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:14.689134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:14.708151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.718215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.718215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.718215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.718215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.722708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.723300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.723850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:14.726076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:14.727523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:14.728911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.219482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.239510 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8b7a98e-e95a-4e24-aa1f-8e628db0e690 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1506 microversion: 2.1 time: 0.586774 Oct 04 18:35:15.249420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2937/5904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:15.763775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d72f978-eb06-4107-aaf8-b6c9c4d82542", "name": "network-vif-unplugged", "status": "completed", "tag": "13c2856c-55b0-4cf4-b128-76d69ef914b3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:15.784261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:15.787252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:15.789962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:15.815840 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] Creating event network-vif-unplugged:13c2856c-55b0-4cf4-b128-76d69ef914b3 for instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 on n-h2-833090-21 Oct 04 18:35:15.842093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-45e27442-22b4-4e83-a3b2-8bb50df9bf01 req-d213685b-dda6-47a8-8cd4-4fd07598ef15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.485191 Oct 04 18:35:15.842955 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2938/5905] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:15.896756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:15.912389 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9a1a1b4-5088-4b27-b614-ce8d31af4cdd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 1.228409 Oct 04 18:35:15.926009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2968/5906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:14 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:16.279339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.280209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.300543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.312811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.315131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.322183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.325478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:16.328265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:16.955050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:16.965625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:16.995811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:16.996792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.009073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.013023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.014416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.016641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.309676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.328845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6aae94aa-0d42-4d98-a326-376403599949 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 200 len: 1509 microversion: 2.1 time: 1.050491 Oct 04 18:35:17.333610 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2939/5907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 1509 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:17.360826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.362974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:17.378030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.378818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.379413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.380318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.380926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.381507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.555518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.567990 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd2c20bb-d8e0-4384-90d7-aaee8bb586e9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.618145 Oct 04 18:35:17.583171 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2969/5908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:16 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:17.910241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:17.924168 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-686f5b3f-0120-489e-bdf8-4b45a5a1152c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.569922 Oct 04 18:35:17.929652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2940/5909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:17.954984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:17.956198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:17.962547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.963044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.963509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:17.964229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:17.964691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:17.965120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.184293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:18.202235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe82a6f8-ebf4-48f4-8bf0-8f8f65f17f1e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.252124 Oct 04 18:35:18.217075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2970/5910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:17 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:18.231664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:18.232796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.247746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.248466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.253736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.254918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.256728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.258541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.607253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:18.607968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:18.634813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.635643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.636274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:18.639790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:18.640907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:18.641515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.030431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.044630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b3a87e7-0dc8-4275-b867-a912b939d5c6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.442803 Oct 04 18:35:19.047612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2971/5911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:18 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:19.195314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.206828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-430fd961-1ad0-422b-b86c-8666c00476c3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.979124 Oct 04 18:35:19.223623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2941/5912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:18 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:19.233548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:19.234439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:19.241566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.243226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.243978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.244898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.245551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.246192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.692273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:19.714404 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c2145186-c666-4db5-9164-faa838642e6c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.485302 Oct 04 18:35:19.716021 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2972/5913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:19 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:19.744954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:19.777205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:19.777719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:19.780525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1938120810", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "75938816-d00b-4844-9f90-d7b8da06f4a4"}], "key_name": "tempest-TestNetworkBasicOps-1202589386", "security_groups": [{"name": "tempest-secgroup-smoke-1434680004"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:19.783495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:19.851212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:35:19.990817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] validate_networks() for [('75938816-d00b-4844-9f90-d7b8da06f4a4', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:20.063103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.206419 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1af786ac-92fd-47d0-bc73-57c5b7edca7e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.464387 Oct 04 18:35:20.225435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2942/5914] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:19 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:20.253434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.254469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.290751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.294536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.296676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.303313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.304838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.309909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.555714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.915496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:20.919415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:20.920324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:20.921451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:20.922116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:20.924567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=40 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.944936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.946862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.948443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.949726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.950496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.951162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.964835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.978318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:20.985648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:21.006437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:21.009555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:21.166699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.178844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9be3c01b-4767-48fa-8029-ec448724590f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1523 microversion: 2.1 time: 0.950144 Oct 04 18:35:21.203661 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2943/5915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1523 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.210141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.211821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.218888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.219614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.220378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.222637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfd00cc3-788f-4ae4-8d1c-91190b175063 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.445995 Oct 04 18:35:21.230130 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2973/5916] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:21.236328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-070c7d46-f8be-43b0-94d6-e75d07a9a81b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.241233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.241627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-070c7d46-f8be-43b0-94d6-e75d07a9a81b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.241718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.241718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.466644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-070c7d46-f8be-43b0-94d6-e75d07a9a81b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.476516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-070c7d46-f8be-43b0-94d6-e75d07a9a81b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1249 microversion: 2.1 time: 0.243819 Oct 04 18:35:21.487512 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2974/5917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1249 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.692383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:21.705535 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44f3466f-8265-48d3-a87a-7f28d0eb68d6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.506841 Oct 04 18:35:21.711768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2944/5918] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:22.247547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.250056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.267599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.270598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.270598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.270598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.270598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.274689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.503126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ec5d510-a6b6-4f18-bf40-cb7bc05fc775 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.504407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ec5d510-a6b6-4f18-bf40-cb7bc05fc775 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.721347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ec5d510-a6b6-4f18-bf40-cb7bc05fc775 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.747723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ec5d510-a6b6-4f18-bf40-cb7bc05fc775 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1249 microversion: 2.1 time: 0.235042 Oct 04 18:35:22.747723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2945/5919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1249 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:22.752370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.753390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.790731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:22.794526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.795042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.795510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.796234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.796945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.797555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.801551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef8baacb-478c-4f1b-9b11-0b8130e3ae86 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1505 microversion: 2.1 time: 0.560181 Oct 04 18:35:22.809085 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2975/5920] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:23.123617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.135705 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4880806-a363-4626-86cd-b1a56a3d70ee tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.400783 Oct 04 18:35:23.152108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2946/5921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:23.407601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a038e-6b44-452d-b4cf-e2a323597282", "name": "network-vif-unplugged", "status": "completed", "tag": "75c7fa78-8a39-44f7-beda-0447c9a145ad"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:23.422509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.423851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.425002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.458888 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] Creating event network-vif-unplugged:75c7fa78-8a39-44f7-beda-0447c9a145ad for instance 4f8a038e-6b44-452d-b4cf-e2a323597282 on n-h2-833090-21 Oct 04 18:35:23.464941 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-93968d25-1229-4959-871f-854fce1ad558 req-aa8fa567-3977-4e84-8b8e-39f892056090 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066334 Oct 04 18:35:23.466122 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2976/5922] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:23.763088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.763849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.776183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.776697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.777622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.778351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.778818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.779251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.833116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:23.834125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:23.849083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.849627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.850086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.850791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:23.851250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:23.856061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.904346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.929790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-edd8b54d-4d51-4090-91e7-1920e78b9d03 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1253 microversion: 2.1 time: 0.170992 Oct 04 18:35:23.939251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2947/5923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1253 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.139008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.151306 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cf08650-e651-4add-b2fd-f2031d1fb3e1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1505 microversion: 2.1 time: 0.323639 Oct 04 18:35:24.161194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2977/5924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:23 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.166234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.167379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.176019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.178012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.196014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.196014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.196014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.196014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.371183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.379489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8ef89cea-9785-4b6c-b3b7-756357ebaf55 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.219068 Oct 04 18:35:24.380275 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2948/5925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.965854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.966486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.980230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.981015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.981702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.982664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.984044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.984747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.118995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.135227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb697ee2-aff1-47e4-b0ff-227d38896ffc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1253 microversion: 2.1 time: 0.174115 Oct 04 18:35:25.148753 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2978/5926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1253 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:25.201675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.203119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.211224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.212103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.212760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.213997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.215041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.215801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.403988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.404606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.411700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.429346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d1a0343-b351-44fd-a4d5-6f679822fb41 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 200 len: 1508 microversion: 2.1 time: 0.233121 Oct 04 18:35:25.431397 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2949/5927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:25.431768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.432631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.434872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.434872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.434872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.438890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.452536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.456965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.466385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.473595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.477990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.479035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.479759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.481045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.529775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:25.542618 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Working on deleting snapshot b52ede65-f04e-4263-bf4f-dcf26666b8d2 from shelved instance... Oct 04 18:35:25.930512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.953168 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d5eb5d1-a6c6-4bf8-9585-5c92c54e773d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.552955 Oct 04 18:35:25.982289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2979/5928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:26.162950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.170332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.181808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.182591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.183397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.185184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.188977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.189653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.392482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:26.404803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fd62baa-ce0c-4467-b31a-2ebe29cc7929 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1309 microversion: 2.1 time: 0.248010 Oct 04 18:35:26.405740 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2980/5929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:27.005817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.006643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.014258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.015058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.015516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.016249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.016749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.017325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.296368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.311839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41ad28ca-a4be-4119-b0a7-5cf3005d3e15 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.309097 Oct 04 18:35:27.327960 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2981/5930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:27.435387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.436777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:27.463769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.468388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.468963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.476550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.477569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.479112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.644536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Doing local delete in cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123886) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:35:27.647935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.649642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.650756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.651310 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:35:27.658381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] deallocate_for_instance() {{(pid=123886) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:35:27.693976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.708506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-058bbbf5-feb4-491e-8d76-ea90d684890b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1307 microversion: 2.1 time: 0.279156 Oct 04 18:35:27.725214 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2982/5931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:28.085004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9077d3e6-d14e-4603-807b-d57ef020d62e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: .version_select at 0x7f90087c1f70>, body: {"keypair": {"name": "tempest-keypair-384328629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHauW/kk2NEdpxox7XI5qKhvzQHCuQ5tVFEFS+ID/b6R5hRLvwLvnAgc8ofU5jx7agBaKOC5plE8NgJTbPq3Sdo5h4KcA7PvCgqzO0oTWu4FQaaP9G3yDzgLSEtskrrRRQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:28.104303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9077d3e6-d14e-4603-807b-d57ef020d62e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:28.110807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9077d3e6-d14e-4603-807b-d57ef020d62e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:28.258159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9077d3e6-d14e-4603-807b-d57ef020d62e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177753 Oct 04 18:35:28.267722 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2983/5932] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:28.347359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.347622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.384730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.385609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.387138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.388008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.390714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.392526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.221574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.232490 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b55622fc-1ffe-43b8-86c7-91403b212ad3 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.894641 Oct 04 18:35:29.235109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2984/5933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:29.240543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.241441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.252173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.253058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.253676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.255702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.256476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.257797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.308375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Updating instance_info_cache with network_info: [] {{(pid=123886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:35:29.612667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.627963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c39b407b-7ea9-447a-bc69-36ba704a311d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.391350 Oct 04 18:35:29.635650 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2985/5934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:29.837790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a038e-6b44-452d-b4cf-e2a323597282", "name": "network-vif-deleted", "tag": "75c7fa78-8a39-44f7-beda-0447c9a145ad"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:29.848748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.849546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.861466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.864377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.compute.server_external_events [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] Unable to find a host for instance 4f8a038e-6b44-452d-b4cf-e2a323597282. Dropping event network-vif-deleted {{(pid=123887) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:35:29.865794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b05abf52-33df-42b2-9475-f120451911bf req-84b3eb7c-45f6-47a1-b23f-70718263dfa6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.227139 Oct 04 18:35:29.867067 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2986/5935] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 237 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:35:30.079131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:30.266617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.268070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.276019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.277069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.277803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.278570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.279251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.279900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.482459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1d3c0aa-7388-45a7-9581-51d5d99d5e6d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 204 len: 0 microversion: 2.1 time: 5.033304 Oct 04 18:35:30.486723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2950/5936] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:25 2022] DELETE /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 0 bytes in 5038 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:30.505178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.507321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.521838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.523321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.524025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.525981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.531662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.533132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.569264 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:35:30.572715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 HTTP/1.1 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4f8a038e-6b44-452d-b4cf-e2a323597282'} Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:30.572857 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:30.577028 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-353916ac-471e-4621-b1f3-1ca51e278b3b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 404 len: 111 microversion: 2.1 time: 0.078216 Oct 04 18:35:30.577637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2951/5937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:30.589131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7", "tag": "3d420b9e-1478-492b-b6ea-2ebeb0fd1f18"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:30.601528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.602338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.602785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.618942 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] Creating event network-changed:3d420b9e-1478-492b-b6ea-2ebeb0fd1f18 for instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 on n-h2-833090-21 Oct 04 18:35:30.629023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0465ae73-ec3e-4176-a638-ff3f76915ee2 req-d3b41253-a4f5-4f67-a7c6-0a7bbc79c705 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046822 Oct 04 18:35:30.629023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2952/5938] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:30.633217 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca172366-1a0f-4599-9863-74630d08c012 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1680 microversion: 2.1 time: 0.371401 Oct 04 18:35:30.633902 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2987/5939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1680 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:30.656734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.658481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.669505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.670366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.671233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.673691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.674530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.675134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.772296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-706558282", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:30.843555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:30.965954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:31.410981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:31.428044 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9600cb64-0a23-47c7-8da4-df43bd2c6eba tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.775858 Oct 04 18:35:31.445576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2953/5940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.662414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.663788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:31.671375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.671906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.672457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.673421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.674095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.674741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.803447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:31.804621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:31.805336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:31.805992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:31.806412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:31.816472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.817276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.817920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.818699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:31.819328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:31.819806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:31.841267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:31.849018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:31.870145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:31.873696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:32.071748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b6448c1-7c7e-4c83-ae5a-287a3e437d8d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305742 Oct 04 18:35:32.073460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2988/5941] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:32.082287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.097334 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18fa2d0a-db3f-4d24-b149-a669e2ffec62 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1657 microversion: 2.1 time: 0.438680 Oct 04 18:35:32.099340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6d066d6-6465-48f2-9e83-5b0b9a8d7316 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.100389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6d066d6-6465-48f2-9e83-5b0b9a8d7316 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.132728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2954/5942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1657 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:32.145909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:32.164383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.171255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.171862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.192835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:32.207688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Going to try to start instance {{(pid=123886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:35:32.323625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6d066d6-6465-48f2-9e83-5b0b9a8d7316 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.333159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6d066d6-6465-48f2-9e83-5b0b9a8d7316 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1214 microversion: 2.1 time: 0.238920 Oct 04 18:35:32.334113 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2989/5943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.443449 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b579cb2-a709-4f06-88d8-9a92032d73e1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.309048 Oct 04 18:35:32.444018 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2955/5944] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:32 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:32.457781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.458243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.461081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.461699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.477028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.481908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.481908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.481908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.481908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.481908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.482316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.482316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.482316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.482316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.482598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.483092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.732974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:32.739277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.747729 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c61951a-610e-4ff4-a579-c5f528979334 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.298628 Oct 04 18:35:32.751447 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2990/5945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.874413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.882964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ade5b3f1-cdbe-469d-b551-f2b45aa8a677 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.430156 Oct 04 18:35:32.888781 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2956/5946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:33.201828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469235572", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c"}], "security_groups": [{"name": "tempest-securitygroup--1849365193"}], "key_name": "tempest-keypair-384328629", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:33.356822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe1c0b4b-6cc8-4055-97dc-e289d77129bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:33.357507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe1c0b4b-6cc8-4055-97dc-e289d77129bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:33.449969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] validate_networks() for [('b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:33.450430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fe1c0b4b-6cc8-4055-97dc-e289d77129bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:33.450430 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe1c0b4b-6cc8-4055-97dc-e289d77129bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1214 microversion: 2.1 time: 0.085639 Oct 04 18:35:33.450430 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2957/5947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:33 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:33.789388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:33.789388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:33.816614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.816614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.816614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:33.816933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:33.817655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:33.826589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.077156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.086506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1be2a60c-8018-44d1-8e32-70efc1f6a7d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.317963 Oct 04 18:35:34.103356 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2958/5948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:33 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:34.111824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.112748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.125827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.132499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.132499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.132499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.132499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.132499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.474428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:34.475740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:34.476515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:34.477289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:34.478033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:34.492466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.493122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.493720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.494664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.501878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.502385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.518498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.533661 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9d79337b-abee-4a9f-86a5-8070956ad284 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.444634 Oct 04 18:35:34.534625 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2959/5949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:34.540700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.541800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.550714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.551307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.552031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.553141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.553673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.554398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.554698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:34.571687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:34.621269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:34.628272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:34.711243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.720159 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b2436e4-547b-4a1e-a8f2-ea5c7957434a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1266 microversion: 2.1 time: 0.183679 Oct 04 18:35:34.720746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2960/5950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:34.819896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e3503b5-d71f-4b5b-a5ea-8fe185da287a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622846 Oct 04 18:35:34.821644 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2991/5951] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:34.834654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e51c4e40-69e6-4b82-80af-8f77bfbc2e4a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.835414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e51c4e40-69e6-4b82-80af-8f77bfbc2e4a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.073795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e51c4e40-69e6-4b82-80af-8f77bfbc2e4a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.081897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e51c4e40-69e6-4b82-80af-8f77bfbc2e4a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1241 microversion: 2.1 time: 0.252085 Oct 04 18:35:35.082528 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2961/5952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.110955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.111612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.133584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.135210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.144398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.155595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.156496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.157530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.562525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.563385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.585672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.590083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.590695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.592470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.593095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.595384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.879908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:35.889195 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad09cb74-4f24-4bec-a34d-0e3161aaff1f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.782169 Oct 04 18:35:35.894051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2992/5953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.908779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:35.909401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:35.923885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.924400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.924897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.925872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.926342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.927284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.999620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.012910 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41f88c16-fbb8-4693-97c5-4b81aee51e61 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1666 microversion: 2.1 time: 0.455550 Oct 04 18:35:36.014204 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2962/5954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1666 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:36.035348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.051317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5419c738-8667-4b3f-84c9-b7e13deeab55 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1272 microversion: 2.1 time: 0.156525 Oct 04 18:35:36.067889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2993/5955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:35 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.110519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95ca3c01-a9b8-4730-965b-d0811ac45f89 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.111153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95ca3c01-a9b8-4730-965b-d0811ac45f89 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.220752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95ca3c01-a9b8-4730-965b-d0811ac45f89 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:36.238257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95ca3c01-a9b8-4730-965b-d0811ac45f89 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1241 microversion: 2.1 time: 0.131814 Oct 04 18:35:36.239186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2963/5956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:36.913919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.914542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.929093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.929646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.930095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.930821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.931283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.931752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.044273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.045429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.068513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.069014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.069453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.070163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.070648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.071075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.487291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.500543 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae72881d-2757-47e3-964d-be8ad1e90fb5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.591231 Oct 04 18:35:37.508262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2994/5957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.513613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.517142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.528256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:37.533494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.536110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.536565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.537312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.537762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.538193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.770084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.779178 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42c720cb-8c3b-410d-8614-3883ce8da3f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.269468 Oct 04 18:35:37.781618 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2995/5958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.803406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.803406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.803406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.807894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.808958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.809244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.809728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.810156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.813483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.815420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:37.825440 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fb79c973-5638-4b01-ad8a-86fff095c952 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.785151 Oct 04 18:35:37.826795 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2964/5959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:37.860872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:37.861519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:37.876978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.878010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.880621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.881548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:37.882198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:37.884931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:37.918910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:37.945465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26c3cb84-cce0-4099-9949-949fdadc8f3a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1293 microversion: 2.1 time: 0.159329 Oct 04 18:35:37.951188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2996/5960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.201649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.213386 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53405e81-4a8f-48b9-bee5-9d9928f64c6f tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.361651 Oct 04 18:35:38.218582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2965/5961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:37 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.251037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.251962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.279129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.282839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.283291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.292739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.293328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.296952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.308984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7", "name": "network-vif-plugged", "status": "completed", "tag": "3d420b9e-1478-492b-b6ea-2ebeb0fd1f18"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:38.335440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.335440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.335440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.365003 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] Creating event network-vif-plugged:3d420b9e-1478-492b-b6ea-2ebeb0fd1f18 for instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 on n-h2-833090-21 Oct 04 18:35:38.391774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-14c91adc-35ad-48fb-a93b-0decfef45980 req-6e9a4cac-f76c-4e35-8ad5-a9cf8a06032c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074708 Oct 04 18:35:38.391774 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2966/5962] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:38.536988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.537757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.550948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.551455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.551931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.557127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.558555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.559115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.734816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:38.758702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc1dce6c-e340-4bd6-8c1f-be32d5abd8d8 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.514735 Oct 04 18:35:38.760979 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2997/5963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:38.790751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:38.791970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:38.816657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.817617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.818286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:38.820162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:38.822811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:38.827796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.155563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.169157 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab110f9b-3bf5-464f-b436-b6ac02b00f64 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.383407 Oct 04 18:35:39.173316 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2998/5964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.188975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.193176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.202597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.204734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.208541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.209406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.210099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.210644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.623503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.632737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-440216d9-c43c-406c-b8e9-cc19d7e6b37d tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.457888 Oct 04 18:35:39.633353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 2999/5965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.640797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.642158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.648521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.649345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.649955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.653322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.656560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.657654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.732995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.746572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.751034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e32ca54b-536d-4435-bdfc-75b60d30951e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 1.219180 Oct 04 18:35:39.751495 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2967/5966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:38 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:39.757135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.758409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:39.762871 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf60c109-9caf-4c6d-ba3e-4589e1ff25ed tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1299 microversion: 2.1 time: 0.128440 Oct 04 18:35:39.767285 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3000/5967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:39.773520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.774850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.775220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.775958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.776413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.776837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.973295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603c08e2-66fd-48b2-99bc-658b62a823be", "tag": "906a776b-170e-4c5e-a3ef-937cf94d6ec3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:39.976734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:39.984952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:39.985337 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2c3f4b0-9a7d-4c3a-821c-78e59990ce1a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.232464 Oct 04 18:35:39.985609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:39.986274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:39.999501 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2968/5968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:39 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.003032 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] Creating event network-changed:906a776b-170e-4c5e-a3ef-937cf94d6ec3 for instance 603c08e2-66fd-48b2-99bc-658b62a823be on n-h1-833090-21 Oct 04 18:35:40.008971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3c66348c-58ac-48d2-bb98-733fab954f21 req-65ee995a-40dd-4242-abd4-89433d349a71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 Oct 04 18:35:40.009616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:40.009779 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3001/5969] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:40.010519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.056669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.057253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.057891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.058694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.059236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.068218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.129067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'flavor' on Instance uuid 42b84396-795d-48f1-9c4a-5d58af928c52 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:40.449086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef0151f2-d523-46f3-b1cc-90e6b3158a07 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.442069 Oct 04 18:35:40.450615 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2969/5970] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:40 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:35:40.460126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.460903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.468286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.468803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.469320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.471771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.471771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.472440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.663360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.665335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.680500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.681222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.681935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.685593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.691131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.692771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.800142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:40.808773 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9256f6ea-90be-46d8-a73a-702c18b5be0e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1678 microversion: 2.1 time: 0.353275 Oct 04 18:35:40.809382 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3002/5971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1678 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:40.834697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:40.835561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:40.842915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.843818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.844445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:40.845357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:40.845965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:40.846812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.145343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.156062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33c05b14-3609-478f-9e6a-73e96f69b562 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.498346 Oct 04 18:35:41.157254 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2970/5972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.162213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.162907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.170060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.171871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.171871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.171871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.172899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.173510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.370036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.381553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7137e219-5883-49b7-be8e-caf5e3b3fc25 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1375 microversion: 2.1 time: 0.554010 Oct 04 18:35:41.382184 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3003/5973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:40 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1375 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.433114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:41.444238 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-477055ba-d1de-4df3-898d-f3c2b07647f5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.283416 Oct 04 18:35:41.445104 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2971/5974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:41.835291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:41.836656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:41.855998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.857327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.860270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:41.863853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:41.866335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:41.870580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.165077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.182445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.182445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.194354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-23e9526e-d6da-4b6a-9e62-c2964ee37f58 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1678 microversion: 2.1 time: 0.362636 Oct 04 18:35:42.194354 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3004/5975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:41 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1678 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:42.196487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.197280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.197748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.198431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.198897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.199327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.408169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.408939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.417774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.418370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.418891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.419852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.420403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.420903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.588362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.601930 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9bd891ee-7993-44bc-b619-ea9253a8d2e6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.424379 Oct 04 18:35:42.616004 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2972/5976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:42.630154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.631059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.649537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.652060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.652762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.654322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.657412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.661367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.675226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:42.783432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:42.792440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3ff60209-8856-4a19-9f44-357657d26461 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1548 microversion: 2.1 time: 0.390195 Oct 04 18:35:42.807964 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3005/5977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1548 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:42.827376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d31af0-6c73-4174-8c2e-e383ea1614cf", "tag": "19c1b382-75fc-4eff-a5f6-0ed39ddb02f5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:42.847152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.847755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.848131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.878631 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] Creating event network-changed:19c1b382-75fc-4eff-a5f6-0ed39ddb02f5 for instance c5d31af0-6c73-4174-8c2e-e383ea1614cf on n-h2-833090-21 Oct 04 18:35:42.889318 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3cd50931-d671-4808-a589-a283f81a2a32 req-9c71887b-b7b6-413c-82f9-77d906bd8a51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079978 Oct 04 18:35:42.892629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3006/5978] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:42.904669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:42.906119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:42.924903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.926166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.926853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:42.928025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:42.929624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:42.930304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.127047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.140736 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-414697b7-f678-43bf-abee-8987124cc16b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.518426 Oct 04 18:35:43.140736 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2973/5979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.226740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.228048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.244031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.244671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.245198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.246000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.246536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.247039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.276097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.306912 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c1d2aad-500b-42a9-81fc-9abc1065581d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1548 microversion: 2.1 time: 0.405764 Oct 04 18:35:43.311936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3007/5980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:42 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1548 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:43.630844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:43.631748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:43.642239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.647189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.648163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.649385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:43.651896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:43.652624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:43.919005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:43.929308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4faa529-b379-49fc-ab8e-75831d88b646 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.304415 Oct 04 18:35:43.934060 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3008/5981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:44.142422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.152817 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5492ebd0-b05f-4282-8c59-f9a7eff3c956 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1661 microversion: 2.1 time: 0.937362 Oct 04 18:35:44.153955 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2974/5982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:43 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1661 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:44.177915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:44.178371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.180614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.181431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.187894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.188319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.188825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.191379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.191379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.191379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.191379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.191379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.194458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.195354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.195880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.196330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.503871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.522020 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc72b7e5-2e02-41ac-a1a1-77891e2fa496 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.344963 Oct 04 18:35:44.523080 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2975/5983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.524371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:44.598407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36af319b-e7d4-4448-b416-08a5bb8a5509 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action" status: 202 len: 0 microversion: 2.1 time: 0.425724 Oct 04 18:35:44.599389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3009/5984] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:44 2022] POST /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:44.607142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.607846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.619311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.620655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.621761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.622754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.623975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.624633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.920966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:44.940487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40a5f29f-d4d6-444a-921f-45f5f1c4f51e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1667 microversion: 2.1 time: 0.336586 Oct 04 18:35:44.941725 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2976/5985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1667 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:44.950946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=26 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:44.959815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:44.960463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:44.967175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.967709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.968544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:44.969411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:44.970752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:44.971373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.221404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:45.232644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28c61872-c12c-4c79-8a34-cf865ee42c8f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.282033 Oct 04 18:35:45.233940 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3010/5986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:44 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:45.547724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.560027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.564522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.565022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.565460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.566170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.566631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.567035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.965701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:45.966978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:45.986370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.987884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.988506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:45.989398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:45.990008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:45.990588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.238255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:46.639710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.667448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16b78c41-edfe-4767-8872-6fbdc763a39a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 1.108225 Oct 04 18:35:46.667448 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2977/5987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:46.671803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603c08e2-66fd-48b2-99bc-658b62a823be", "name": "network-vif-plugged", "status": "completed", "tag": "906a776b-170e-4c5e-a3ef-937cf94d6ec3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:46.684299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.685294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.685980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.699145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] Creating event network-vif-plugged:906a776b-170e-4c5e-a3ef-937cf94d6ec3 for instance 603c08e2-66fd-48b2-99bc-658b62a823be on n-h1-833090-21 Oct 04 18:35:46.719685 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-58536a92-a591-4de3-bc57-2b03be85edab req-11d4ada8-9639-40ae-b93e-704337e8de1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062827 Oct 04 18:35:46.730246 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2978/5988] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:46.745964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:46.747526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:46.751717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:46.756154 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38816b2a-ed06-4401-98b8-2ed1b1d3227e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1667 microversion: 2.1 time: 0.794563 Oct 04 18:35:46.756964 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3011/5989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:45 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1667 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:46.770229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.774525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.774525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:46.774525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:46.774525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:46.774525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.402587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:47.411860 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64c587ea-177b-49c6-80b6-bdcbae241f18 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.678797 Oct 04 18:35:47.412981 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2979/5990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:46 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:47.674283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.675537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.690744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.691564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.692171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.693089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.693716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.696020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.782792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:47.783412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:47.793662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.798576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.799057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:47.799836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:47.800298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:47.800733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.200561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.211104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba4592c8-4c95-4043-b585-d1b8e20b909e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.540797 Oct 04 18:35:48.211727 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3012/5991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.233802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.244164 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c703119b-bc6f-4baf-9b6e-04ab73f61798 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1667 microversion: 2.1 time: 0.465763 Oct 04 18:35:48.245376 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2980/5992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:47 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1667 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.434379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:48.435703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:48.458212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.463260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.467073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.468104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.468733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.475569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.481438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:48.755182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:48.769026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a65a3b35-d693-4d65-a0e7-b28dd29e09a4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1314 microversion: 2.1 time: 0.338649 Oct 04 18:35:48.776306 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3013/5993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:48 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:48.855647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7", "tag": "3d420b9e-1478-492b-b6ea-2ebeb0fd1f18"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:48.874865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:48.880059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:48.880946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:48.931298 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] Creating event network-changed:3d420b9e-1478-492b-b6ea-2ebeb0fd1f18 for instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 on n-h2-833090-21 Oct 04 18:35:48.949979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2d1cf52b-3216-469c-8da2-8ae5fb96be0a req-4d482a4a-acec-45d6-b3c9-e9bab8e8a2ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094863 Oct 04 18:35:48.952421 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2981/5994] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:49.243551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.244484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.264092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.265862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.268162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.269432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.271384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.279340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.280743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.286872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.307339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.310144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.311265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.317773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.319049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.322623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.757252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.766293 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-707aa48b-c4da-4ba8-b84c-7df959c71f39 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.530043 Oct 04 18:35:49.766905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3014/5995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:49.800849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.801487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.832137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.832942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.833611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.834528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.835188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.835510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.836110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.846530 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-332670db-0ae3-4631-92b9-3d094a7f097c tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 0.572534 Oct 04 18:35:49.867615 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2982/5996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:49.878288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.879152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.891328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.895875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.898400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.899710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.900388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.900842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.274009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.288223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1d29191-b8da-4068-8261-eff9c14dd841 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1501 microversion: 2.1 time: 0.492448 Oct 04 18:35:50.310296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3015/5997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1501 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.315424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:50.338124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.338641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.339096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.414282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Going to try to stop instance {{(pid=123887) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:35:50.671430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-029b62b9-8157-4a45-80eb-60ff8ad364a7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be/action" status: 202 len: 0 microversion: 2.1 time: 0.359740 Oct 04 18:35:50.672122 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3016/5998] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:50 2022] POST /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:50.680800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d31af0-6c73-4174-8c2e-e383ea1614cf", "name": "network-vif-plugged", "status": "completed", "tag": "19c1b382-75fc-4eff-a5f6-0ed39ddb02f5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:50.710068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.710562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.711006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.761034 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] Creating event network-vif-plugged:19c1b382-75fc-4eff-a5f6-0ed39ddb02f5 for instance c5d31af0-6c73-4174-8c2e-e383ea1614cf on n-h2-833090-21 Oct 04 18:35:50.777445 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-26be7646-98fc-44f6-a174-777c6551c16c req-856a24a8-c4c8-436c-8c84-2a4cb02db3e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100784 Oct 04 18:35:50.784968 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3017/5999] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:50.790866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.792095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.808106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.808630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.809077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.809823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.810279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.810716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.977120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.989200 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b689ed28-301d-4c43-8627-0d12bde8f308 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1670 microversion: 2.1 time: 1.114813 Oct 04 18:35:50.990465 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2983/6000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1670 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.001789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.003394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.021997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.021997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.021997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.022657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.023280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.023957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.262197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.270666 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-71da6080-7f94-4cb3-8d57-fa071577e209 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.488293 Oct 04 18:35:51.272369 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3018/6001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.280041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.280810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.290632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.292339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.292846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.293860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.294620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.295258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.353574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:51.361058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.api [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Working on deleting snapshot 6a547e95-2354-4b99-aaa6-c82ada55a978 from shelved instance... Oct 04 18:35:51.431328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.440537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b6593bf-690d-4ef9-a599-3ae2fcaa7e31 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.448586 Oct 04 18:35:51.441392 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2984/6002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.296193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.297579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.306898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.307866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.308703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.309597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.310062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.310546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.469600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.481263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70c8cbcb-4674-481a-af62-a1ba26ffddf9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.189619 Oct 04 18:35:52.481857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2985/6003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:52.487030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.487685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.494813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.495299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.495764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.496456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.496909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.497506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.643343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:52.651174 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-308a62fd-57bb-4072-ac2a-7c91cfbe3a6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1367 microversion: 2.1 time: 0.168372 Oct 04 18:35:52.651976 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2986/6004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Doing local delete in cell bf969ffc-a161-4954-be17-eb629cb1623f(cell1) {{(pid=123887) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.api [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:35:53.476316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] deallocate_for_instance() {{(pid=123887) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:35:53.508647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.509302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.516586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.517086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.517551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.518261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.518724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.519163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.690178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.698589 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afb31c3d-0c18-478c-8c7d-374732b62a75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.196506 Oct 04 18:35:53.699299 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2987/6005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:53.704449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.705252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.711648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.712139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.712577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.713273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.713730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.714157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.867995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.883657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3781576b-8c5b-4c0e-b22c-728cf5ceaf6b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1558 microversion: 2.1 time: 0.183022 Oct 04 18:35:53.884827 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2988/6006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.930603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:53.932599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:53.948571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.948571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.948571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.948571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.949911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.950519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.074087 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53cf9be9-c2e9-4b86-86ef-479bfbeb8046 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163699 Oct 04 18:35:54.074807 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2989/6007] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:35:53 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:54.363898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Updating instance_info_cache with network_info: [] {{(pid=123887) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:35:54.573874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d72f978-eb06-4107-aaf8-b6c9c4d82542", "name": "network-vif-deleted", "tag": "13c2856c-55b0-4cf4-b128-76d69ef914b3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:54.590729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.592189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.592684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.614747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_external_events [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] Unable to find a host for instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542. Dropping event network-vif-deleted {{(pid=123886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:35:54.615688 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-18ea16c0-2d5f-4ac0-8735-44e74169c1be req-e02237ea-81fc-4de6-b5c7-b08aed3d5c85 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.319208 Oct 04 18:35:54.620546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2990/6008] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 324 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:35:54.729600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.730704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.739593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.740125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.740569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.741294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.741748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.742897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.928095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.936393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03da1e61-de3f-4cf9-9f3b-b729e998fcd2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.210728 Oct 04 18:35:54.947609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2991/6009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:55.111780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d67cc18-84e1-4812-b44c-d132f2ca370a tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 204 len: 0 microversion: 2.1 time: 3.838044 Oct 04 18:35:55.121301 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3019/6010] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:51 2022] DELETE /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 0 bytes in 3841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:55.129873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.130736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 0d72f978-eb06-4107-aaf8-b6c9c4d82542] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.138873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.139626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.140234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.141137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.141777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.142371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.149482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:55.165948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 HTTP/1.1 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0d72f978-eb06-4107-aaf8-b6c9c4d82542'} Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:55.168668 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. Oct 04 18:35:55.173583 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:35:55.175337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 404 to user: Instance 0d72f978-eb06-4107-aaf8-b6c9c4d82542 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:55.176255 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32313a74-68b5-47a4-ac8c-b7b291b4c442 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542" status: 404 len: 111 microversion: 2.1 time: 0.052813 Oct 04 18:35:55.177773 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2992/6011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/0d72f978-eb06-4107-aaf8-b6c9c4d82542 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:55.185246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.185761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.195117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.195675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.196145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.197100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.197721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.198304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.226619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:55.576877 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be736203-f41c-4e67-8b55-065c0f4e5a88 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 204 len: 0 microversion: 2.1 time: 0.395189 Oct 04 18:35:55.577828 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3020/6012] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:55 2022] DELETE /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:35:55.586911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.592336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.596231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.596837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.597478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.598368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.599007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.599705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.701459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.710375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-58465e41-238e-4b0f-bd98-6bde4cd0cbdb tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1465 microversion: 2.1 time: 0.127326 Oct 04 18:35:55.711170 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2993/6013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1465 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.961984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.962693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.969785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.970278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.970880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.971782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.972386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.972958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.997422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:56.171788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.180463 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e087f4e-65d7-49e7-9d6f-dd785a061d5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.222738 Oct 04 18:35:56.185984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3021/6014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:56.693348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d31af0-6c73-4174-8c2e-e383ea1614cf", "tag": "19c1b382-75fc-4eff-a5f6-0ed39ddb02f5"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:56.731582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.732265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.733361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.737581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.738154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.750640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.751516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.752205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.754997 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] Creating event network-changed:19c1b382-75fc-4eff-a5f6-0ed39ddb02f5 for instance c5d31af0-6c73-4174-8c2e-e383ea1614cf on n-h2-833090-21 Oct 04 18:35:56.763349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.763349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.763349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.763863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ce347ab5-b6fe-4287-9874-e43045f863d6 req-40b7b430-fa11-42d5-811c-40c8240ba94d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073773 Oct 04 18:35:56.763863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2994/6015] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:56.951627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:56.960738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a741711-3b66-4e81-a529-74ee76b90adc tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1465 microversion: 2.1 time: 0.227962 Oct 04 18:35:56.961338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3022/6016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1465 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.211404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.215183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:57.215183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:57.221833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.222745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.223541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.224630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:57.225321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:57.225819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.596711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.605483 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5ffa075-eb28-4629-b2f5-34614c5296bb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.398721 Oct 04 18:35:57.606409 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2995/6017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:57.997509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:57.998222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.021332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.044035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03de6099-e18e-4aea-abe8-df31d05aa472", "name": "network-vif-deleted", "tag": "659bf139-1366-4c2b-ab86-05087ec40315"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:58.057073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.057853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.058464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.083358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] Creating event network-vif-deleted:659bf139-1366-4c2b-ab86-05087ec40315 for instance 03de6099-e18e-4aea-abe8-df31d05aa472 on n-h1-833090-21 Oct 04 18:35:58.092268 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f2921d2e-2273-4351-9eb3-072d5fd823e8 req-a60e058c-2432-47ba-b51e-56d337167a4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055877 Oct 04 18:35:58.093840 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2996/6018] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:58.114321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.123492 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3818dea5-5167-4a6a-a697-e34dbc614ff5 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1465 microversion: 2.1 time: 0.139098 Oct 04 18:35:58.124561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3023/6019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:57 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1465 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.631097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.632036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.641527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.642198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.642819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.643892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.644512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.645568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.908866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.920693 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-545b96ec-e443-4782-b05d-686df6e6dee3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.294015 Oct 04 18:35:58.921408 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2997/6020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:59.149840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.150638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.167942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.168544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.169203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.170139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.170672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.171167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.218687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.219378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.220038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.220681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'fault' on Instance uuid 03de6099-e18e-4aea-abe8-df31d05aa472 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:59.299905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:59.315314 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ba07874-d38a-4f93-bb31-734adfe01f0b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 200 len: 1305 microversion: 2.1 time: 0.169637 Oct 04 18:35:59.316009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3024/6021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:59.953246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.954589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.966947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.240596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.249055 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-742a6005-0279-4aab-9a00-c73a2e05f578 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.308062 Oct 04 18:36:00.252742 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2998/6022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:00.342593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.344515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 03de6099-e18e-4aea-abe8-df31d05aa472] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.362501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.364106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.366709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.368518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.369223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.371634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.391083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 HTTP/1.1 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '03de6099-e18e-4aea-abe8-df31d05aa472'} Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:00.393298 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. Oct 04 18:36:00.397249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:00.399365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 404 to user: Instance 03de6099-e18e-4aea-abe8-df31d05aa472 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:00.400792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8066c9b4-b7eb-495e-bbac-7d1600566034 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472" status: 404 len: 111 microversion: 2.1 time: 0.063177 Oct 04 18:36:00.401611 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3025/6023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:00 2022] GET /compute/v2.1/servers/03de6099-e18e-4aea-abe8-df31d05aa472 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:00.413399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:00.413921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:00.434782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.435774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.436546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.438244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:00.438929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:00.439620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:00.476350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:01.012804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fcde0342-b9b2-4c90-8ee5-52d7fa262c00 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 204 len: 0 microversion: 2.1 time: 0.604497 Oct 04 18:36:01.017679 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 2999/6024] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:00 2022] DELETE /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:01.025287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.025911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.039599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.040113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.040562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.041284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.041748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.042175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.243616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.253725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a50368b7-f989-4fa5-8f3b-26c1de874826 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1507 microversion: 2.1 time: 0.230710 Oct 04 18:36:01.256778 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3026/6025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.277533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.291928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.532666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.545652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42a72790-6e12-439f-bb5a-676105738546 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.276748 Oct 04 18:36:01.546728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3000/6026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.286192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.286805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.306814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.307323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.307798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.308532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.308997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.309431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.329514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f30401c-cb2a-4f56-9bf2-5a4a794ce296", "name": "network-vif-deleted", "tag": "3e590f37-8826-47c0-95a1-cbe521fb3a5d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:02.350107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.350592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.351027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.375923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] Creating event network-vif-deleted:3e590f37-8826-47c0-95a1-cbe521fb3a5d for instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 on n-h1-833090-21 Oct 04 18:36:02.382581 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2d3117e3-1fc2-4440-bbf5-6439b21850f6 req-4e1ebea2-2fd9-4dff-9701-500bd924df38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056656 Oct 04 18:36:02.391129 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3001/6027] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:02.420915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:02.433926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7b032c1-2042-493c-8e9c-0e08b30ad58e tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1465 microversion: 2.1 time: 0.151628 Oct 04 18:36:02.438362 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3027/6028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.574255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:02.575206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:02.591222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.592033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.593165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.594619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.595245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.596914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.995079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.041272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bda8b9c6-6051-4eed-9eae-b866e837021a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.438037 Oct 04 18:36:03.041272 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3002/6029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:02 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:03.464794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.465339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.477680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.478189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.478618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.479530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.480289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.480879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.579384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:03.579914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:03.593725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:03.593725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'fault' on Instance uuid 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:04.036471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.037644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.052149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.054150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.054865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.056906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.057541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.059590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.277515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.303371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0d712f0-26b0-464e-bd67-3ed25ec3e6b0 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 200 len: 1305 microversion: 2.1 time: 0.841481 Oct 04 18:36:04.323423 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3028/6030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 1305 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.384973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.401366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b755f2e-3b64-489d-8fbf-968582936db7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.368685 Oct 04 18:36:04.402442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3003/6031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.335553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.341128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 8f30401c-cb2a-4f56-9bf2-5a4a794ce296] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.349272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.350108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.350770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.351760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.352533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.353199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.384152 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 HTTP/1.1 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '8f30401c-cb2a-4f56-9bf2-5a4a794ce296'} Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:05.387169 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 404 to user: Instance 8f30401c-cb2a-4f56-9bf2-5a4a794ce296 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:05.398560 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-31935b91-74e2-46ee-bd3c-b1f15460c16b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296" status: 404 len: 111 microversion: 2.1 time: 0.062802 Oct 04 18:36:05.409114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.410305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.414484 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3029/6032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/8f30401c-cb2a-4f56-9bf2-5a4a794ce296 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:05.424781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.425626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.426276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.427219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.427942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.428601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.440465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.441560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.469891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.472766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.495111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.495111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.495111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.495111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.536702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:05.901306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.925056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bd35cdb-cddf-4e5e-9a78-8977783bb6e4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.483888 Oct 04 18:36:05.926316 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3030/6033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.097940 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c03b1bd5-cc43-4161-afe0-321898b00775 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 204 len: 0 microversion: 2.1 time: 0.696931 Oct 04 18:36:06.102625 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3004/6034] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:05 2022] DELETE /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:06.115266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.119065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.130475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.137006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.137006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.137006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.137006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.137006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.347744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:06.353161 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8bb0fd9-4bed-4d51-8171-d70e0da0cace tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1495 microversion: 2.1 time: 0.246266 Oct 04 18:36:06.354345 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3031/6035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1495 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:06.956698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.960921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.977714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.980063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.980692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.982282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.983668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.986104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.278069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.287137 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c75df6f-323e-4ccf-8885-87c2f0abc185 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.341413 Oct 04 18:36:07.299910 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3005/6036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.379993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:07.385918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:07.397398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.398829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.399459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.400387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.401007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.401625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.444234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13960ef-ac3e-45ff-b7e9-3c56cc5389c0", "name": "network-vif-deleted", "tag": "9db33b50-27d6-40f6-ac37-4fbbe741885d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:07.463331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.464473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.465226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.498883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.507246 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] Creating event network-vif-deleted:9db33b50-27d6-40f6-ac37-4fbbe741885d for instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 on n-h1-833090-21 Oct 04 18:36:07.507424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b6ed251-1110-40bf-b73a-866357208b28 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1453 microversion: 2.1 time: 0.134568 Oct 04 18:36:07.508034 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3032/6037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:07 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.524840 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-40d2428a-c6c7-42e2-9484-347e8e9547d1 req-1426b6ca-b44e-4f14-8108-b1131d0c36f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084045 Oct 04 18:36:07.525633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3006/6038] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:08.311966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.312744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.319144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.319818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.320315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.321078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.321934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.322586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.537932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.538734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.552543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.552965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.553481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.554280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.554836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.555278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.590015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.590494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.590955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.591387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'fault' on Instance uuid a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:08.641834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.652100 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55217f82-3cc8-4cab-ba01-f7d83f99ce77 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 200 len: 1305 microversion: 2.1 time: 0.121324 Oct 04 18:36:08.653534 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3007/6039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:08.682595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:08.691410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-589c1b74-3fa3-4a18-86d8-fb15a7fd9cea tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.383555 Oct 04 18:36:08.703719 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3033/6040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:09.677243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.680933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: a13960ef-ac3e-45ff-b7e9-3c56cc5389c0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.686073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.686746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.687357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.688369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.689188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.689426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.704412 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 HTTP/1.1 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a13960ef-ac3e-45ff-b7e9-3c56cc5389c0'} Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:09.706086 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 404 to user: Instance a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-372c1aa1-3827-4b36-affc-30ae514f709b tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0" status: 404 len: 111 microversion: 2.1 time: 0.034289 Oct 04 18:36:09.720365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3008/6041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/a13960ef-ac3e-45ff-b7e9-3c56cc5389c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:09.721742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.721742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.722844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:09.722844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:09.723127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:09.724557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.725232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.725825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.726695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.727359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.727964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.737053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.737302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:09.762019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:09.947754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.956960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b895eb3-e94e-494a-adb5-0bd126913f05 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.245357 Oct 04 18:36:09.957625 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3034/6042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:09 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:10.210558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-097eee49-1e20-4866-9e01-df23cc4ac927 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 204 len: 0 microversion: 2.1 time: 0.494160 Oct 04 18:36:10.211498 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3009/6043] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:09 2022] DELETE /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:10.219540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.220258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.226828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.227394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.227948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.228724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.229257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.229759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.411998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.423113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9bbf65f9-35ab-49d2-9f1d-5bd394bd310d tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1676 microversion: 2.1 time: 0.207440 Oct 04 18:36:10.425495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3035/6044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:10.981760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.982474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.991673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.992459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.993092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.994015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.994641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.995244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.297304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.308098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa2c6d5a-488f-41d6-b8a3-a71f33af6ef1 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.330667 Oct 04 18:36:11.308861 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3010/6045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.455242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.460080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.467883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.468987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.469503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.470469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.470995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.471595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.653449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.662436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fa3d8bd-6386-4e60-8df9-516831d7dee6 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1676 microversion: 2.1 time: 0.217097 Oct 04 18:36:11.663211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3036/6046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.339309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.341525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.356940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.358057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.359703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.361900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.362556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.363172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.696522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.697399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.724243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.724761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.725219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.725920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.728688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.729301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.860905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.876413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80192945-1118-4fa5-bebe-fd44efe9c2eb tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.539943 Oct 04 18:36:12.878559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3011/6047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.015024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:13.028529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0cf435e8-2b57-4f37-8c4e-8213c851cea1 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1676 microversion: 2.1 time: 0.345807 Oct 04 18:36:13.036250 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3037/6048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1676 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.902485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.903104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.917945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.918692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.919310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.920202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.920930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.922063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.055295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:14.055295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:14.062638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.063363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.063963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.064822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.065431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.066010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.209429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.217893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:14.223989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7cd47e0-9dfe-4b06-abed-f671e4d14366 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1608 microversion: 2.1 time: 0.173249 Oct 04 18:36:14.224905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3038/6049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:14 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1608 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:14.323791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.344237 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6930ffad-34a2-4427-a3c7-603e5fd0792a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.444753 Oct 04 18:36:14.360953 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3012/6050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:14.416676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b84396-795d-48f1-9c4a-5d58af928c52", "name": "network-vif-deleted", "tag": "beaf4bf2-17eb-4b8b-8996-b17d19013728"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:14.438880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:14.440065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:14.440701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:14.489365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] Creating event network-vif-deleted:beaf4bf2-17eb-4b8b-8996-b17d19013728 for instance 42b84396-795d-48f1-9c4a-5d58af928c52 on n-h2-833090-21 Oct 04 18:36:14.505849 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cdadbf92-f4bf-4f59-b358-e3e359065ece req-3bcccda9-7a35-4868-92a9-15948d015459 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096936 Oct 04 18:36:14.512000 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3039/6051] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:15.250657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.251274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.268237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.269165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.269827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.270774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.271404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.271890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.317555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.318406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.319118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.319877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lazy-loading 'fault' on Instance uuid 42b84396-795d-48f1-9c4a-5d58af928c52 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:15.371136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.371998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.385396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.386404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.387086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.388078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.388900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.389563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.393436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd999ff9b16f84082b0036ed8e67d011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb61fd3a99d40e3a8895e08bae46bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.404149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ea663e6-5743-4d88-9cf9-afce3a3d5016 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 200 len: 1328 microversion: 2.1 time: 0.160113 Oct 04 18:36:15.406603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3013/6052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:15.625388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.634483 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6fd7553-0bee-4359-9f3a-172e4c29cd16 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.269235 Oct 04 18:36:15.652130 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3040/6053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.428242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.428974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] [instance: 42b84396-795d-48f1-9c4a-5d58af928c52] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.439424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.452343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.453412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.454285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.454863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.455398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] HTTP exception thrown: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Request method failure captured: Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 HTTP/1.1 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHqmr9PI56yNl_pwYi5fpFhU0b-Mc39byD7dSk8IpiPn709SAbT_6ghsJK-ftvP3Ld8Wg_H7_80PG5x_AR3r-MxhOtsUnvd3JbBsMBlRwpFUObKKacBqlO4D3o_uAjavBVpSgJjYTW2I72ZykAQmo5Mz4H3MA7lzMVTplZTSKGdLQPk Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5eb61fd3a99d40e3a8895e08bae46bd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5eb61fd3a99d40e3a8895e08bae46bd9"}]}] Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 5eb61fd3a99d40e3a8895e08bae46bd9 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1086773399 Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d999ff9b16f84082b0036ed8e67d011c Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1086773399-project Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '42b84396-795d-48f1-9c4a-5d58af928c52'} Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:16.487088 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Returning 404 to user: Instance 42b84396-795d-48f1-9c4a-5d58af928c52 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:16.491734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-029c7acb-dc81-4d40-9f48-3c46250b49fe tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52" status: 404 len: 111 microversion: 2.1 time: 0.061681 Oct 04 18:36:16.495134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a6e876c-abd3-4fe1-b6b4-53bcc1659b83 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] Calling method '.version_select at 0x7f900d898550>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.495970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3014/6054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/42b84396-795d-48f1-9c4a-5d58af928c52 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:16.622992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a6e876c-abd3-4fe1-b6b4-53bcc1659b83 tempest-ServerActionsTestJSON-1086773399 tempest-ServerActionsTestJSON-1086773399-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114369247" status: 202 len: 0 microversion: 2.1 time: 0.132067 Oct 04 18:36:16.628219 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3041/6055] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114369247 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:16.658824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.659657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.675167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.676016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.676641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.681635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.681635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.681635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.067271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.076622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae93b7a0-b446-4a9f-bab2-b82a8903c4c0 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.422064 Oct 04 18:36:17.078223 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3015/6056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.131289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.388969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:18.397262 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5fce210-df49-449b-b5b0-d3d4d339c106 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.298953 Oct 04 18:36:18.397953 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3042/6057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:19.425139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:19.426037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:19.449027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.449459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.449911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.450652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:19.451118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:19.459977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.795542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.802340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f717b1aa-bb62-48a1-8d53-7089498fb7f4 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.383719 Oct 04 18:36:19.802930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3016/6058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:19 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.486299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:20.490371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.509925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.510480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.510931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.511684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.512147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.512579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.665508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08367857-9fc9-4177-8bed-db50f827babe tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7/action" status: 200 len: 24567 microversion: 2.1 time: 0.182564 Oct 04 18:36:20.665508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3043/6059] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:20 2022] POST /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7/action => generated 24567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:20.829232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.830974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.844791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.845569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.848066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.848986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.849616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.851339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.145414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.156077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-47c0fcda-e39b-4a74-a227-778c860a4a2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1511 microversion: 2.1 time: 0.331795 Oct 04 18:36:21.163721 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3017/6060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.180740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.181458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.200112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.200771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.201287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.202281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.202815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.203318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.388637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.399554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-157645da-2b98-496a-a422-c1afcec9bfba tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1488 microversion: 2.1 time: 0.223258 Oct 04 18:36:22.400745 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3044/6061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1488 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.429728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.430444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.442313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.442830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.443284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.444034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.447508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.448001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.511709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:22.995428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5df1fc3-909f-494f-898d-a09a340c21f9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 204 len: 0 microversion: 2.1 time: 0.569690 Oct 04 18:36:22.998155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3018/6062] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:22 2022] DELETE /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:23.009213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.009878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.021970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.022546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.023004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.025976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.026644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.029762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.968208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:23.988539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93852f1f-9aef-4842-9e03-6f203f08b6ec tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1494 microversion: 2.1 time: 0.980415 Oct 04 18:36:23.990016 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3045/6063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1494 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:25.020108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:25.020108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:25.043067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.043597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.044215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.045087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.045701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.046896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.350901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:25.367567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b93120bb-45ad-4a29-bea2-23e98017774e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1494 microversion: 2.1 time: 0.356825 Oct 04 18:36:25.368432 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3019/6064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:25 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1494 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:25.537811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603c08e2-66fd-48b2-99bc-658b62a823be", "name": "network-vif-deleted", "tag": "906a776b-170e-4c5e-a3ef-937cf94d6ec3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:25.555764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:25.556438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:25.557301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:25.579166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] Creating event network-vif-deleted:906a776b-170e-4c5e-a3ef-937cf94d6ec3 for instance 603c08e2-66fd-48b2-99bc-658b62a823be on n-h1-833090-21 Oct 04 18:36:25.584792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2291dc70-64f3-4ce3-a679-b7837032ed42 req-738cc492-f086-4dee-b6b2-9b8e7452a1b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056221 Oct 04 18:36:25.585783 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3046/6065] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:26.395028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:26.397140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.411861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.412978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.413929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.415324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.416322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.417390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.471039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.471559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.474763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.474763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid 603c08e2-66fd-48b2-99bc-658b62a823be {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:26.519358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:26.528504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1f6ed36-0245-4846-bf6c-a4a06ffa0d22 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 200 len: 1304 microversion: 2.1 time: 0.140631 Oct 04 18:36:26.533350 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3020/6066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:26 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:27.556733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:27.558492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:27.573340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.579915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.579915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.579915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:27.579915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:27.579915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:27.600145 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be HTTP/1.1 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '603c08e2-66fd-48b2-99bc-658b62a823be'} Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:27.602798 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff49e2c7-8249-4017-baeb-bad6d50421ee tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 404 len: 111 microversion: 2.1 time: 0.061968 Oct 04 18:36:27.614704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3047/6067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:27 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:27.749411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-574788934", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ef1052db-ba8a-4a30-9254-e60af77a2da1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:27.816710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] validate_networks() for [('ef1052db-ba8a-4a30-9254-e60af77a2da1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:28.455408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:28.456913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:28.456913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:28.456913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:28.457297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:28.478509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.479547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.480165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.481058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:28.481669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:28.482241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:28.540161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:28.549819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Getting quotas for user 7e25e40f20f94607b6f543e3ef4c2da0 and project af7c7abc768e45e2b490a0ab6d5cdd98. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:28.582771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:28.585850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:28.682500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:28.756690 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddebca98-7b26-4201-b5b9-1ad50a9df0dd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013233 Oct 04 18:36:28.768845 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3021/6068] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:28.769609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4abf4c48-b8dc-4c0c-87de-174798798f20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:28.771322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4abf4c48-b8dc-4c0c-87de-174798798f20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:28.912082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4abf4c48-b8dc-4c0c-87de-174798798f20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:28.921261 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4abf4c48-b8dc-4c0c-87de-174798798f20 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1214 microversion: 2.1 time: 0.156585 Oct 04 18:36:28.925295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3048/6069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:28 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:29.986696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8d8e0c12-e8f8-4fde-81c8-0b7a369aaa5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:29.986696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8d8e0c12-e8f8-4fde-81c8-0b7a369aaa5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:30.143012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8d8e0c12-e8f8-4fde-81c8-0b7a369aaa5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:30.158181 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8d8e0c12-e8f8-4fde-81c8-0b7a369aaa5b tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1214 microversion: 2.1 time: 0.203941 Oct 04 18:36:30.159559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3022/6070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:29 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:31.182494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:31.183106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:31.203049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.203773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.205824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.228652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:31.228652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:31.229011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:31.356573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:31.370154 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9474601d-148a-4cdc-a891-bc07c6eb7caf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1210 microversion: 2.1 time: 0.191692 Oct 04 18:36:31.373528 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3049/6071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:31 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:32.401013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:32.401013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:32.413041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.413841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.415645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.418662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:32.419143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:32.419609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:32.784488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:32.803422 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dced6ac0-2903-4feb-a79a-1d41b91b7ed2 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1266 microversion: 2.1 time: 0.410848 Oct 04 18:36:32.807530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3023/6072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:32 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:33.836342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:33.837444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:33.850878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.860072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.864289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:33.865383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:33.866023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:33.866623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:34.166568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:34.177344 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa8fe302-c0d2-4cae-a870-6fb355122559 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.346314 Oct 04 18:36:34.178495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3050/6073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:33 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:35.607305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:35.610895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:35.668927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.669441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.676477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.677428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:35.677923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:35.679749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:35.708232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:36.080758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:36.098678 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f28445e0-82dc-42c7-b2ce-60536d87b900 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.898827 Oct 04 18:36:36.099402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3024/6074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:35 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:36.787860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Action: 'create', calling method: .version_select at 0x7f900963e160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:36.806829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Getting quotas for project d52865553d2246c7a4de30bb6ba07d45. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:36.813078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Getting quotas for user ada5c05ddb114ecb9a90e721d2204aa1 and project d52865553d2246c7a4de30bb6ba07d45. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:36.891786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b4b105-cbd6-4d69-9e92-2fc3b5df7025", "tag": "346b971c-f129-4dd0-a6ed-597991a7cff8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:36.906880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:36.907685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:36.908301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:36.925704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] Creating event network-changed:346b971c-f129-4dd0-a6ed-597991a7cff8 for instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 on n-h1-833090-21 Oct 04 18:36:36.933152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-77b36dd4-72bf-4d37-a91c-af8e36a1e476 req-8fffaa50-20c4-4d63-85b4-121d19b07496 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043756 Oct 04 18:36:36.934102 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3025/6075] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:36.963526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Getting quotas for project d52865553d2246c7a4de30bb6ba07d45. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:36.970792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Getting quotas for user ada5c05ddb114ecb9a90e721d2204aa1 and project d52865553d2246c7a4de30bb6ba07d45. Resources: {'server_groups'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:36.991336 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-183a081c-c39d-43ed-a3bb-c51f59c471e5 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.281722 Oct 04 18:36:36.992017 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3051/6076] 10.222.0.40 () {62 vars in 1214 bytes} [Tue Oct 4 18:36:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:37.004941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8670d092-98d1-4fd7-a2b9-92160ac1a111 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.015831 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8670d092-98d1-4fd7-a2b9-92160ac1a111 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015142 Oct 04 18:36:37.021030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3026/6077] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 4 18:36:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:37.028943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-657ddcfc-6573-4591-a2ed-09100a668a77 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.039338 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-657ddcfc-6573-4591-a2ed-09100a668a77 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551" status: 200 len: 235 microversion: 2.64 time: 0.015552 Oct 04 18:36:37.042114 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3052/6078] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551 => generated 235 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:36:37.053379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b9063cd-7759-4f12-98c8-479b5a45b337 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.126423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.127334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.138770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b9063cd-7759-4f12-98c8-479b5a45b337 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551" status: 204 len: 0 microversion: 2.64 time: 0.089520 Oct 04 18:36:37.145400 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3027/6079] 10.222.0.40 () {60 vars in 1307 bytes} [Tue Oct 4 18:36:37 2022] DELETE /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:36:37.145531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.146072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.146714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.147561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.148672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.149178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.149935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df133ca2-7565-4e12-8914-f5a1f881a110 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.168516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-df133ca2-7565-4e12-8914-f5a1f881a110 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] HTTP exception thrown: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df133ca2-7565-4e12-8914-f5a1f881a110 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Request method failure captured: Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551 HTTP/1.1 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH00GCBck1PVkzbME0DcP2SWm9llL3IHen-RQJiXyDT7V2TSDdZ2UYha9R1zhX7N1mIzwl7AaUAD3hzRg-QbpPX8ofKC3FODfpp30Q5fdAEfYsLQlJ4KUZegS47IK-CBxfX7vfZfRbULvfg2wFYPZSN37O5AZM3i_q0tLRsHnL1CcvM Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d52865553d2246c7a4de30bb6ba07d45 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerGroup264TestJSON-1312834078 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d52865553d2246c7a4de30bb6ba07d45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d52865553d2246c7a4de30bb6ba07d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d52865553d2246c7a4de30bb6ba07d45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d52865553d2246c7a4de30bb6ba07d45"}]}] Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerGroup264TestJSON-1312834078 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d52865553d2246c7a4de30bb6ba07d45 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1312834078 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerGroup264TestJSON-1312834078-project Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ada5c05ddb114ecb9a90e721d2204aa1 Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerGroup264TestJSON-1312834078-project Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e78eb02b-24eb-42b5-bf5c-dbbd33733551'} Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:37.170338 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df133ca2-7565-4e12-8914-f5a1f881a110 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] Returning 404 to user: Instance group e78eb02b-24eb-42b5-bf5c-dbbd33733551 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df133ca2-7565-4e12-8914-f5a1f881a110 tempest-ServerGroup264TestJSON-1312834078 tempest-ServerGroup264TestJSON-1312834078-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551" status: 404 len: 117 microversion: 2.64 time: 0.026707 Oct 04 18:36:37.175617 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3028/6080] 10.222.0.40 () {60 vars in 1307 bytes} [Tue Oct 4 18:36:37 2022] DELETE /compute/v2.1/os-server-groups/e78eb02b-24eb-42b5-bf5c-dbbd33733551 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:36:37.693783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.715058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ba1b47a-f884-421a-8302-f614722e2c08 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.589909 Oct 04 18:36:37.716807 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3053/6081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:38.750369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.751810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.769389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:38.796226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.802439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.802918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.803717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.807553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.808044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.224058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.235893 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1f67216-d2c1-467c-b650-b4b0fdd4f251 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.499512 Oct 04 18:36:39.247772 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3029/6082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.272996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.273716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.290407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:40.292221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.292726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.293176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.293913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.294374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.294990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.148897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.159869 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8196f5c1-8a9e-4a04-8c6f-dd10a852d9af tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.893170 Oct 04 18:36:41.172370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3054/6083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.036599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b4b105-cbd6-4d69-9e92-2fc3b5df7025", "name": "network-vif-plugged", "status": "completed", "tag": "346b971c-f129-4dd0-a6ed-597991a7cff8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:42.068507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:42.071968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.076752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.081301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.112641 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] Creating event network-vif-plugged:346b971c-f129-4dd0-a6ed-597991a7cff8 for instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 on n-h1-833090-21 Oct 04 18:36:42.125813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-82a5460c-22d1-4d9b-8d0e-c660b8a71547 req-12e17ef6-87d6-4831-bbfe-29602f3f16d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094631 Oct 04 18:36:42.137502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3030/6084] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:42.190625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.191936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.211830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.490245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.499827 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9b2f8c2-b557-4e25-88ff-97b4519e8b8e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.313209 Oct 04 18:36:42.500815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3055/6085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.533088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.535561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.574316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.578364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.578854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.581434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.585675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.585675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.854887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.859671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-953aa8b7-c9ff-4641-8e1b-58315db7cbe9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1314 microversion: 2.1 time: 0.338209 Oct 04 18:36:43.860273 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3031/6086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:44.885204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:44.886458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:44.896261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.897037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.898319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.899745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:44.901540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:44.902206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:44.906598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=65 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:45.056273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.068100 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29283d1e-11e6-4e61-9b47-16f56e8f02b6 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1500 microversion: 2.1 time: 0.188620 Oct 04 18:36:45.071497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3056/6087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:45.105572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:45.106631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.114255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.114759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.115257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.116190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.116813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.117412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.143951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'flavor' on Instance uuid a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:45.590466 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d17cbab3-eb91-43a9-b1fc-8601818a4733 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "POST /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025/action" status: 202 len: 0 microversion: 2.1 time: 0.493475 Oct 04 18:36:45.596108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3032/6088] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:45 2022] POST /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:36:45.600984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.606891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.612037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.612544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.612991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.613972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.614443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.614880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.800262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.817668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41176172-e38d-4fa5-9264-6a8e5e3023ed tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1508 microversion: 2.1 time: 0.220863 Oct 04 18:36:45.818279 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3057/6089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:45 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:46.842963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.844259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.852180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.852739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.853261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.854035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.854499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.855246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.053723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.066756 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd323d50-fa04-4cdd-9412-cb95a0d000cf tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1491 microversion: 2.1 time: 0.228537 Oct 04 18:36:47.071788 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3033/6090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1491 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:47.093482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.100844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.100844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:47.106593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.107093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.107561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.108889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.109413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.109847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.145584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:36:47.547319 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cef4323-0f40-4bd2-b546-e0cf8a0c75d7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 204 len: 0 microversion: 2.1 time: 0.458346 Oct 04 18:36:47.547963 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3058/6091] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:47 2022] DELETE /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:36:47.557558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.558222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.565447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.566444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.566964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.567720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.568189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.568908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.737458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.746098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd493b92-43da-43dd-bd7b-9f9c85a2b0da tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1497 microversion: 2.1 time: 0.193682 Oct 04 18:36:47.751872 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3034/6092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.770283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.770999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.788067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.789496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.789961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.792841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.796377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.797027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.079259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:49.093360 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-25d9cbaf-a281-4656-9d8e-b1ecc551b48e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1497 microversion: 2.1 time: 0.327622 Oct 04 18:36:49.111524 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3059/6093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:50.122429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:50.123053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:50.135218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.135757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.136203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.136926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:50.137388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:50.137816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.415398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.436017 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-993e49ab-05a2-47fc-8b78-11a4bb6ed256 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1497 microversion: 2.1 time: 0.317338 Oct 04 18:36:50.437212 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3035/6094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:50 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:51.400348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b4b105-cbd6-4d69-9e92-2fc3b5df7025", "name": "network-vif-deleted", "tag": "346b971c-f129-4dd0-a6ed-597991a7cff8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:51.417762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.418600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.419193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.434496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] Creating event network-vif-deleted:346b971c-f129-4dd0-a6ed-597991a7cff8 for instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 on n-h1-833090-21 Oct 04 18:36:51.444579 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-28508ab4-4c23-4748-ae22-fecd12090b05 req-bbe64c9d-f78e-4330-8030-e9f5ad71fd8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048720 Oct 04 18:36:51.447250 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3060/6095] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:36:51.474955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.474955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.492338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.494771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.495547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.500383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.500383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.500383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.598588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.620970 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fbd502b9-b975-444e-9ff6-8dfd0f8e3b75 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1455 microversion: 2.1 time: 0.147009 Oct 04 18:36:51.620970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3036/6096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.631215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.632223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.644517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.645508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.645961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.647320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.648098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.648695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.715203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.715203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.715203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.715203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lazy-loading 'fault' on Instance uuid a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:36:52.742279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e25e40f20f94607b6f543e3ef4c2da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7c7abc768e45e2b490a0ab6d5cdd98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.751275 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0551adb-94a3-45ce-90d3-464b5844b219 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 200 len: 1304 microversion: 2.1 time: 0.124630 Oct 04 18:36:52.769188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3061/6097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.781083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.782800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.797837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.799027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.799833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.801402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.807252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.807252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.845051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 HTTP/1.1 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a1b4b105-cbd6-4d69-9e92-2fc3b5df7025'} Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.847091 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.856570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.885659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.885659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-adca7245-d800-4b4b-853e-175d1a64ce4e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 404 len: 111 microversion: 2.1 time: 0.101219 Oct 04 18:36:53.885659 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3037/6098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:53.895918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.897220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.904074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.905659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.906580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.907673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.908361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.909019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.924911 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 HTTP/1.1 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a1b4b105-cbd6-4d69-9e92-2fc3b5df7025'} Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.927536 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.931395 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.933504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.934595 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f95832d6-6a2e-4568-9388-57d14f539a3f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 404 len: 111 microversion: 2.1 time: 0.043598 Oct 04 18:36:53.935486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3062/6099] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:53 2022] DELETE /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:53.944527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.945155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: a1b4b105-cbd6-4d69-9e92-2fc3b5df7025] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.953336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.953672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.954402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.955132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.955702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.956172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.983503 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 HTTP/1.1 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a1b4b105-cbd6-4d69-9e92-2fc3b5df7025'} Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:53.985080 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. Oct 04 18:36:53.993391 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:53.995196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:53.996472 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e76c9f97-e030-4b9b-9115-42f84e6f6f5a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025" status: 404 len: 111 microversion: 2.1 time: 0.056550 Oct 04 18:36:54.010087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.011709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.017459 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3038/6100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/a1b4b105-cbd6-4d69-9e92-2fc3b5df7025 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.026267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.026781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.029799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.030727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.039500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.039500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.064347 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be HTTP/1.1 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '603c08e2-66fd-48b2-99bc-658b62a823be'} Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.066177 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-677320aa-ba44-4001-9cbb-3ae6a23228a3 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 404 len: 111 microversion: 2.1 time: 0.063587 Oct 04 18:36:54.076634 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3063/6101] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:54 2022] DELETE /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:54.084582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.085557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 603c08e2-66fd-48b2-99bc-658b62a823be] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.094869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.095518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.096298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.097256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.097938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.098686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.123906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be HTTP/1.1 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '603c08e2-66fd-48b2-99bc-658b62a823be'} Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.125551 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 603c08e2-66fd-48b2-99bc-658b62a823be could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f5a074c-6541-49b8-b977-e3f080b28d2e tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be" status: 404 len: 111 microversion: 2.1 time: 0.047463 Oct 04 18:36:54.131706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3039/6102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/603c08e2-66fd-48b2-99bc-658b62a823be => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.136348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.136844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.144242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.144242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.150990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.150990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.150990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.150990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.161502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 HTTP/1.1 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4f8a038e-6b44-452d-b4cf-e2a323597282'} Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.163178 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-30572c1d-4058-4e9f-885f-356c76a0ab0f tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 404 len: 111 microversion: 2.1 time: 0.032298 Oct 04 18:36:54.169326 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3064/6103] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:54 2022] DELETE /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.173606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.174223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 4f8a038e-6b44-452d-b4cf-e2a323597282] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.180456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.181134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.181721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.182569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.183168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.183826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.199488 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 HTTP/1.1 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4f8a038e-6b44-452d-b4cf-e2a323597282'} Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.201478 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 4f8a038e-6b44-452d-b4cf-e2a323597282 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29f05dd6-c708-4680-bdfd-9ec633ef7af9 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282" status: 404 len: 111 microversion: 2.1 time: 0.033852 Oct 04 18:36:54.206398 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3040/6104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/4f8a038e-6b44-452d-b4cf-e2a323597282 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.214979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.214979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.224750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.225241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.225679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.226383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.226835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.227265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.248560 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae HTTP/1.1 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1f3d8724-5e47-4a27-a98b-7f2a28cc85ae'} Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.250243 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93eb2242-f482-4c04-a4b8-4ee0f63b163c tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 404 len: 111 microversion: 2.1 time: 0.042660 Oct 04 18:36:54.254689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3065/6105] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:54 2022] DELETE /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.260708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.261569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.276368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.280406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.284974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.284974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.284974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.284974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.311547 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae HTTP/1.1 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '1f3d8724-5e47-4a27-a98b-7f2a28cc85ae'} Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.313410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 1f3d8724-5e47-4a27-a98b-7f2a28cc85ae could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3dc1a696-4d48-46c8-b250-6ca96bfa6dbd tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae" status: 404 len: 111 microversion: 2.1 time: 0.058934 Oct 04 18:36:54.324587 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3041/6106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/1f3d8724-5e47-4a27-a98b-7f2a28cc85ae => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:36:54.326115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.326115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.333553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d HTTP/1.1 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'f1b881b7-6b70-4f06-816e-29b79040c50d'} Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.335567 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.340012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.349104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.350356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-871ea4a5-2502-43e8-81d0-e542728e7d2a tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d" status: 404 len: 111 microversion: 2.1 time: 0.029757 Oct 04 18:36:54.361875 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3066/6107] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:36:54 2022] DELETE /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:54.362738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.363378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: f1b881b7-6b70-4f06-816e-29b79040c50d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.369601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d HTTP/1.1 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'f1b881b7-6b70-4f06-816e-29b79040c50d'} Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:36:54.371134 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance f1b881b7-6b70-4f06-816e-29b79040c50d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f944b601-a6a4-4020-8bd9-7632638efb67 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d" status: 404 len: 111 microversion: 2.1 time: 0.015063 Oct 04 18:36:54.376631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3042/6108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/f1b881b7-6b70-4f06-816e-29b79040c50d => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:36:55.783584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-774500816", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:55.877127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] validate_networks() for [('bb686935-7c23-40ff-9835-4c8003a50eb5', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:56.698566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:56.699272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:56.699705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:56.700129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:56.700579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:56.721474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.722353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.722967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.724021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:56.724481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:56.724913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.759377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Getting quotas for project d1816a7f2a05416a9d95c2bb2a260ae7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:56.772141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Getting quotas for user 7441c846fb384c4f95c18cf6805bcfa4 and project d1816a7f2a05416a9d95c2bb2a260ae7. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:56.787769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:56.790848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:56.999502 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fdc28913-3606-4083-abd1-6ae7d0391881 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661016 Oct 04 18:36:57.003107 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3067/6109] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:57.017818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08074689-448f-4352-a605-66df5ed4fd82 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.020203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08074689-448f-4352-a605-66df5ed4fd82 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.169527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08074689-448f-4352-a605-66df5ed4fd82 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.182279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08074689-448f-4352-a605-66df5ed4fd82 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1223 microversion: 2.1 time: 0.171471 Oct 04 18:36:57.197711 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3043/6110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.211944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b3f3d02-4dfa-443e-b27c-3499f8b6afc5 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:58.212565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b3f3d02-4dfa-443e-b27c-3499f8b6afc5 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:58.271765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b3f3d02-4dfa-443e-b27c-3499f8b6afc5 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:58.287037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b3f3d02-4dfa-443e-b27c-3499f8b6afc5 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1223 microversion: 2.1 time: 0.078780 Oct 04 18:36:58.288308 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3068/6111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:58 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:59.318851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:59.319496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:59.328596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.329398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.330003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.331147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:59.331979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:59.332620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:59.514095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:59.527277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2f2581a-1199-4c15-aeb2-36f2a467d942 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1227 microversion: 2.1 time: 0.212624 Oct 04 18:36:59.538435 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3044/6112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:59 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1227 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:00.278619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.279708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.287923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.288492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.288944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.289667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.290130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.290564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.307980 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab HTTP/1.1 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b12eefdc-e81f-4627-9113-db8857b824ab'} Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:00.309506 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e33e15c-6acf-480e-a50e-2ae875018265 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 404 len: 111 microversion: 2.1 time: 0.037487 Oct 04 18:37:00.314154 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3069/6113] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:00 2022] DELETE /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:00.320518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.321147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: b12eefdc-e81f-4627-9113-db8857b824ab] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.323845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=54,nova_api:DELETE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:00.329512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.330204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.330648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.331366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.332175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.332615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.357631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab HTTP/1.1 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b12eefdc-e81f-4627-9113-db8857b824ab'} Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.359759 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance b12eefdc-e81f-4627-9113-db8857b824ab could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd55c4e1-9333-478e-8c39-e9cfee98f5b7 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab" status: 404 len: 111 microversion: 2.1 time: 0.045498 Oct 04 18:37:00.366141 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3045/6114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/b12eefdc-e81f-4627-9113-db8857b824ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:00.374623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.375130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.381886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.382120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.382566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.383260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.383737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.384159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 HTTP/1.1 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9a6fd890-da65-47ea-8b1a-c09be44bd2e4'} Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:00.409580 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c996803b-51d1-4a4b-97e6-d300210450a5 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 404 len: 111 microversion: 2.1 time: 0.043116 Oct 04 18:37:00.413639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3070/6115] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:00 2022] DELETE /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:00.424908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.426181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] [instance: 9a6fd890-da65-47ea-8b1a-c09be44bd2e4] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.437799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.438809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.439729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.440736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.441461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.442101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.460758 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] HTTP exception thrown: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Request method failure captured: Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 HTTP/1.1 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHwFUbvldjDO2gWVvP0OQ-cXzSJpHZftR6auYbOKFSgFEpb2zzYTzfjnMR-oEvYWYyDS6tJQkJOuVkDJk_fkXuRiOQaS3ujuMkcr5ppyDoYO79QNSmcvxCGsi9cRcij4thSMPo-8A8HTzydKitkvf0FKSrNyWIp4bg_RUs9jFSIq_Po Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af7c7abc768e45e2b490a0ab6d5cdd98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af7c7abc768e45e2b490a0ab6d5cdd98"}]}] Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: af7c7abc768e45e2b490a0ab6d5cdd98 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-290590091 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7e25e40f20f94607b6f543e3ef4c2da0 Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-290590091-project Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9a6fd890-da65-47ea-8b1a-c09be44bd2e4'} Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:00.466317 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. Oct 04 18:37:00.475320 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:00.489454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] Returning 404 to user: Instance 9a6fd890-da65-47ea-8b1a-c09be44bd2e4 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:00.490537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd6780a9-741a-49d0-8ea0-9803b49f4a66 tempest-DeleteServersTestJSON-290590091 tempest-DeleteServersTestJSON-290590091-project] 10.222.0.40 "GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4" status: 404 len: 111 microversion: 2.1 time: 0.072320 Oct 04 18:37:00.491418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3046/6116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/9a6fd890-da65-47ea-8b1a-c09be44bd2e4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:00.585824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:00.586465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:00.596948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.597461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.597910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.598966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.603617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.605812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.739167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:00.750696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2718952a-88cb-499d-a2e4-2b2ff0b87d2c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1275 microversion: 2.1 time: 0.178367 Oct 04 18:37:00.752664 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3071/6117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:00 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:01.776523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:01.778971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:01.795898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.796802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.797725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.799113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:01.801005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:01.801666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:01.883739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:01.901207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e5bfd25-a743-424d-bd8f-d5f58c71dd4c tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1281 microversion: 2.1 time: 0.127867 Oct 04 18:37:01.902800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3047/6118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:01 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:02.926716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:02.927397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:02.949996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.952167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.952630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:02.953372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:02.953841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:02.954279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.422105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3953f6-c21c-4674-90d3-2f2f22526316", "tag": "00304d1d-de3d-4d3e-b976-a26c65f7eb7e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:03.447795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:03.448304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:03.448749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:03.467355 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] Creating event network-changed:00304d1d-de3d-4d3e-b976-a26c65f7eb7e for instance 4b3953f6-c21c-4674-90d3-2f2f22526316 on n-h1-833090-21 Oct 04 18:37:03.476845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dc0e590c-8055-4bfe-8418-2cccf2b6722a req-e511a55b-49f3-4343-b04c-af05baeafca2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058432 Oct 04 18:37:03.477832 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3048/6119] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:03.767008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:03.777555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0022b62e-3c46-4d5b-a4b3-b589d1dfa228 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.855051 Oct 04 18:37:03.789081 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3072/6120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:02 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:04.804440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:04.805664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:04.820614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:05.225315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:05.234896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3285138-b55f-4c77-9a92-a67d2d5d8392 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.436430 Oct 04 18:37:05.256634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3049/6121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:04 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:05.768275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fe4aa8f-e5b6-4091-bccf-c7b436e23ae5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: .version_select at 0x7f90097851f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-986416663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5E2xo78vGklZI9s0v46ZnGIdjt4HLSzAl1rwMipRCCYnpG392SiTAveiLH/zZktmevekjzDSXCrF+17LWK9mabCuyq8VVBb1pgxWwVr7e10S/JtVOBYRq8iGVZGuwiYA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:05.827701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3fe4aa8f-e5b6-4091-bccf-c7b436e23ae5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:05.841902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-3fe4aa8f-e5b6-4091-bccf-c7b436e23ae5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:05.987899 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fe4aa8f-e5b6-4091-bccf-c7b436e23ae5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232090 Oct 04 18:37:05.988529 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3073/6122] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:06.273989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:06.281745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:06.291839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.292525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.293256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.294571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:06.296024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:06.296992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:06.306902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:06.505869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:06.516429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6ab6c72-5f70-4bf3-aa9c-071361c5861a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.257761 Oct 04 18:37:06.531525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3050/6123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:06 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:07.536103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:07.542276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:07.542987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:07.551981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:07.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:07.557425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:07.893110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:07.916149 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-faa6158c-6639-43d8-a4bb-1099d06ad27a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.373529 Oct 04 18:37:07.917183 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3074/6124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:07 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:08.943989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:08.944628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:08.967531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:08.973917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.980360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.988224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:08.989021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:08.989514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:08.990134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:09.350714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:09.363721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57e33d79-6bfa-458c-8894-b4a9596a30d6 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.423965 Oct 04 18:37:09.377067 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3051/6125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:08 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.295456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3953f6-c21c-4674-90d3-2f2f22526316", "name": "network-vif-plugged", "status": "completed", "tag": "00304d1d-de3d-4d3e-b976-a26c65f7eb7e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:10.311096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.317969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.317969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.331115 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] Creating event network-vif-plugged:00304d1d-de3d-4d3e-b976-a26c65f7eb7e for instance 4b3953f6-c21c-4674-90d3-2f2f22526316 on n-h1-833090-21 Oct 04 18:37:10.340134 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8f9791df-44ea-46c5-8e0a-39752995fef7 req-aa1ec2e5-1bb8-4524-80f0-b730d0cb7421 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048101 Oct 04 18:37:10.343319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3075/6126] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:10.386604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.387212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.428922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.429633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.433170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.439893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.441169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.442376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.550196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2053497859", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "241ffd66-f3cb-498e-aef2-51c290e41966"}], "key_name": "tempest-TestNetworkBasicOps-986416663", "security_groups": [{"name": "tempest-secgroup-smoke-1562144586"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:10.681385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:10.690630 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1c3be65-ee5f-4bf8-b71b-be89ffe9937d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.307988 Oct 04 18:37:10.695609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3052/6127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:10.695940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] validate_networks() for [('241ffd66-f3cb-498e-aef2-51c290e41966', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:10.758077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:10.759312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.771722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.773051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.773802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.775773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.776665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.777984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.824041 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa732c8e-fc5f-47f1-81aa-fddb3bb0af7b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/ips" status: 200 len: 151 microversion: 2.1 time: 0.070038 Oct 04 18:37:10.833633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3053/6128] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:37:10 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:10.837535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5890ab68-3de3-419c-86ab-07474c47d90f"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:10.839967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:10.847382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.851334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.851334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:10.851334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:10.851334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:10.851334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.011947 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/os-volume_attachments HTTP/1.1 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 74 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: {"volumeAttachment": {"volumeId": "5890ab68-3de3-419c-86ab-07474c47d90f"}} Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': 'c5d31af0-6c73-4174-8c2e-e383ea1614cf', 'body': {'volumeAttachment': {'volumeId': '5890ab68-3de3-419c-86ab-07474c47d90f'}}} Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:11.013825 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 400 to user: Invalid volume: volume 5890ab68-3de3-419c-86ab-07474c47d90f is already attached to instances: 59426015-202a-416b-8604-dca27c4b4a57 {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:11.018899 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9d2ec526-4a47-44cd-9c44-586c0d304276 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.181755 Oct 04 18:37:11.020245 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3054/6129] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf/os-volume_attachments => generated 174 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:11.025827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.026396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.037144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.037755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.038302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.039123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.040096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.040655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.070942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:11.075070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:11.402007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:11.402007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:11.402007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:11.402007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:11.403417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:11.415325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.416198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.416889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.417734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.418489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.419176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.446613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9673452e-8883-48af-8337-ab4e088424d7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 204 len: 0 microversion: 2.1 time: 0.425726 Oct 04 18:37:11.450926 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3055/6130] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:11 2022] DELETE /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:11.471572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.472327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.491186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.496422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:11.503444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:11.519407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:11.522342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:11.749220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.753160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-307064ed-3e38-49cc-8d9c-37c34b8271ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207184 Oct 04 18:37:11.754143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3076/6131] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:37:11.766462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.768978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.772408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cc7624f-4184-45f7-b7e6-d9824065413f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1683 microversion: 2.1 time: 0.316944 Oct 04 18:37:11.773603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3056/6132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:11.778072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.778630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.779651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.779789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9fa0e65-6315-482f-90f7-fe1964202acc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:11.780682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:11.780890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9fa0e65-6315-482f-90f7-fe1964202acc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:11.781389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:11.781829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:11.911665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9fa0e65-6315-482f-90f7-fe1964202acc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:11.926282 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9fa0e65-6315-482f-90f7-fe1964202acc tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1248 microversion: 2.1 time: 0.148643 Oct 04 18:37:11.927180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3057/6133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.061860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:12.071324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-275e3fe5-9e48-4135-9609-d43efea19ac9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1323 microversion: 2.1 time: 0.315933 Oct 04 18:37:12.071995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3077/6134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:11 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:12.799126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.799615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.813796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.814296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.814744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.815448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.816090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.816678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.954372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:12.955640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:12.963026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.963785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.964425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:12.965301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:12.965915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:12.967244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.043116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.056515 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d63ddb16-b02a-4910-aaf1-404ff3b315ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1252 microversion: 2.1 time: 0.106099 Oct 04 18:37:13.057135 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3078/6135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1252 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:13.094942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.095602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.116503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.117018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.120627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.120627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:13.120627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:13.120627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:13.121616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.138914 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3ad861a-cb1b-4720-94c9-9bc5bda3ec9c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1683 microversion: 2.1 time: 0.343999 Oct 04 18:37:13.139793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3058/6136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:12 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1683 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.487931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:13.494637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f79371c2-91ea-4669-a7ce-081a1367914a tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1519 microversion: 2.1 time: 0.404180 Oct 04 18:37:13.512871 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3079/6137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:13.668247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be2e9a39-7dc2-465f-a3a2-d016f4b5e33b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-985809265", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be2e9a39-7dc2-465f-a3a2-d016f4b5e33b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 242 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-985809265", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-985809265', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'bb686935-7c23-40ff-9835-4c8003a50eb5'}]}}} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.672830 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be2e9a39-7dc2-465f-a3a2-d016f4b5e33b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-be2e9a39-7dc2-465f-a3a2-d016f4b5e33b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011476 Oct 04 18:37:13.678324 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3059/6138] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/servers => generated 175 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:13.686026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:13.686630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 63e80bac-8fad-4dd8-8f9a-21a79e5599a6] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:13.693309 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] HTTP exception thrown: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/63e80bac-8fad-4dd8-8f9a-21a79e5599a6/metadata HTTP/1.1 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '63e80bac-8fad-4dd8-8f9a-21a79e5599a6'} Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.704021 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 404 to user: Instance 63e80bac-8fad-4dd8-8f9a-21a79e5599a6 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.708783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0849442a-d272-4525-ac67-e543e6660902 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/63e80bac-8fad-4dd8-8f9a-21a79e5599a6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024821 Oct 04 18:37:13.716342 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3080/6139] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/63e80bac-8fad-4dd8-8f9a-21a79e5599a6/metadata => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:13.774398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adf487a4-368c-42ee-acd0-ef980e5a9064 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-125599146", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adf487a4-368c-42ee-acd0-ef980e5a9064 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 498 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-125599146", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-125599146', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bb686935-7c23-40ff-9835-4c8003a50eb5'}]}}} Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:37:13.779128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adf487a4-368c-42ee-acd0-ef980e5a9064 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-adf487a4-368c-42ee-acd0-ef980e5a9064 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010537 Oct 04 18:37:13.785071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3060/6140] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/servers => generated 687 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:13.837030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14bc856c-bbea-42b1-821c-beaf473c7631 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1291469230", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14bc856c-bbea-42b1-821c-beaf473c7631 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 500 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1291469230", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1291469230', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bb686935-7c23-40ff-9835-4c8003a50eb5'}]}}} Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:37:13.841481 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14bc856c-bbea-42b1-821c-beaf473c7631 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14bc856c-bbea-42b1-821c-beaf473c7631 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009823 Oct 04 18:37:13.853987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3081/6141] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:37:13.912185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c43401ae-624a-4db4-b375-710da7071b34 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1638031128", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c43401ae-624a-4db4-b375-710da7071b34 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 754 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1638031128", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1638031128', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bb686935-7c23-40ff-9835-4c8003a50eb5'}]}}} Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:13.921410 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:13.924142 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:13.926570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.926570 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.926570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c43401ae-624a-4db4-b375-710da7071b34 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.926570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c43401ae-624a-4db4-b375-710da7071b34 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.015270 Oct 04 18:37:13.927169 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3061/6142] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/servers => generated 1197 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:37:13.981631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2411e7ec-1906-49bf-b654-4ee68404115b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1645509811", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2411e7ec-1906-49bf-b654-4ee68404115b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 1266 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1645509811", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bb686935-7c23-40ff-9835-4c8003a50eb5"}]}} Oct 04 18:37:13.987027 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1645509811', 'imageRef': '60bf0052-3cfd-47a4-b26a-71b79179cfa6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bb686935-7c23-40ff-9835-4c8003a50eb5'}]}}} Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.989749 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:37:13.991092 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:37:13.999780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 18:37:13.999780 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:37:13.999780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2411e7ec-1906-49bf-b654-4ee68404115b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:13.999780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2411e7ec-1906-49bf-b654-4ee68404115b tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012595 Oct 04 18:37:14.000613 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3082/6143] 10.222.0.40 () {60 vars in 1148 bytes} [Tue Oct 4 18:37:13 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 18:37:14.005301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.006045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 24974456-a383-4408-af22-cffbde715fe3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.012198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] HTTP exception thrown: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/24974456-a383-4408-af22-cffbde715fe3/metadata/test2 HTTP/1.1 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': '24974456-a383-4408-af22-cffbde715fe3', 'id': 'test2'} Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:14.013977 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 404 to user: Instance 24974456-a383-4408-af22-cffbde715fe3 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0137e51-df90-4e0d-b6df-421a451868c7 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/24974456-a383-4408-af22-cffbde715fe3/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016577 Oct 04 18:37:14.025388 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3062/6144] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 18:37:13 2022] GET /compute/v2.1/servers/24974456-a383-4408-af22-cffbde715fe3/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:14.040268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.040821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.050032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.050627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.051196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.052323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.052799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.053233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.086617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.086617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.090418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:14.099167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.099778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.100897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.102716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.106484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.107775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.120187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:14.299963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.315505 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a7a556a-d50c-4657-9849-edb6fc99a8b8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1300 microversion: 2.1 time: 0.233248 Oct 04 18:37:14.319697 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3063/6145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:14.335631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.337456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.344683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.350915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.350915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.350915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.350915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.350915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.472207 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04860fb1-e6b3-4943-a638-24df3f84af7d tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 204 len: 0 microversion: 2.1 time: 0.441358 Oct 04 18:37:14.472819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3083/6146] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:14 2022] DELETE /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:14.482433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:14.482433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:14.488414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.488918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.489364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.490083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:14.490545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:14.490979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:14.749837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:14.762031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da393efd-c172-4ef2-adcc-ea93993328af tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1525 microversion: 2.1 time: 0.284881 Oct 04 18:37:14.764962 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3084/6147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1525 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:15.300861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.314966 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b761196d-79df-44d2-b8ec-84b08634aea2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1683 microversion: 2.1 time: 0.986886 Oct 04 18:37:15.315693 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3064/6148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:14 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1683 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.350745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.359967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.373368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.374028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.374951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.375795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.376257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.376693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.467939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:15.477451 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-878f80ce-9abe-4610-b057-1dc0d414dc17 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1306 microversion: 2.1 time: 0.138392 Oct 04 18:37:15.491507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3085/6149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:15.790523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:15.791308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:15.799914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.800514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.801029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:15.802015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:15.802548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:15.803210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.223819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d31af0-6c73-4174-8c2e-e383ea1614cf", "name": "network-vif-deleted", "tag": "19c1b382-75fc-4eff-a5f6-0ed39ddb02f5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:16.243640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.243640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.243640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.277966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] Creating event network-vif-deleted:19c1b382-75fc-4eff-a5f6-0ed39ddb02f5 for instance c5d31af0-6c73-4174-8c2e-e383ea1614cf on n-h2-833090-21 Oct 04 18:37:16.289415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0b16ae8a-5bde-4e3a-8d14-d32cc020c615 req-cd8ba834-5f91-44ec-b0fc-a8277d11e9ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069484 Oct 04 18:37:16.290958 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3086/6150] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:16.309406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.322588 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9779f75a-fcbf-48a0-ba48-eb03755c9dc9 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1525 microversion: 2.1 time: 0.538199 Oct 04 18:37:16.328242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3065/6151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:15 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1525 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:16.352221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.353497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.372197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.390324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.390324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.390324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.390324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.390324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.503993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:16.505161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:16.517072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.519613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.520315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.522002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:16.522732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:16.523976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:16.540634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.555754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0621c48a-8176-4d24-9fd8-2f9141ba09f7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1615 microversion: 2.1 time: 0.208079 Oct 04 18:37:16.556396 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3087/6152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1615 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:16.867384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:16.879204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bf6b14e-4897-4851-9b66-3d97f75eb0c6 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.379490 Oct 04 18:37:16.880135 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3066/6153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:16 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:17.352592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.355404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.367107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.371301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.372024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.373784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.374508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.375610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.544940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:17.554295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0cb7f79-a9b1-4f8a-85a7-30031d9b91f8 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1483 microversion: 2.1 time: 0.205984 Oct 04 18:37:17.561109 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3088/6154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1483 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:17.590159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.591615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.625532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d1c512-8740-4eff-988e-b0d492dcc402", "tag": "8faf58b4-d9b4-405d-9f14-d421a02f72b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:17.647725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.653089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.659799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.660710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.664562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.665013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.678623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.680231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.681881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.743855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] Creating event network-changed:8faf58b4-d9b4-405d-9f14-d421a02f72b9 for instance a9d1c512-8740-4eff-988e-b0d492dcc402 on n-h2-833090-21 Oct 04 18:37:17.764205 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f12896ea-a4f9-487e-9bfc-146653d2e22b req-e48c2e1d-ef40-4e77-a5d0-c0c0e19f81e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145473 Oct 04 18:37:17.765047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3089/6155] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:17.805774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.806621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.807357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.807943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'fault' on Instance uuid c5d31af0-6c73-4174-8c2e-e383ea1614cf {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:17.915570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:17.916329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:17.934658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.935721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.936168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:17.936884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:17.943263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:17.945256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.402081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.420658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-43a77de8-da94-410f-9f53-dab466b7d909 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.507294 Oct 04 18:37:18.421367 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3090/6156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:18.432038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.447882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3953f6-c21c-4674-90d3-2f2f22526316", "name": "network-vif-deleted", "tag": "00304d1d-de3d-4d3e-b976-a26c65f7eb7e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:18.454394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd4f9e61-e862-4fe6-b6cf-b23aaf806489 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 200 len: 1331 microversion: 2.1 time: 0.873061 Oct 04 18:37:18.456843 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3067/6157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:17 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 1331 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:18.518858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.519354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.519818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.549623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] Creating event network-vif-deleted:00304d1d-de3d-4d3e-b976-a26c65f7eb7e for instance 4b3953f6-c21c-4674-90d3-2f2f22526316 on n-h1-833090-21 Oct 04 18:37:18.563063 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b4e6ae71-c6fc-4a4b-b782-2bf9ed930c0b req-ba005c23-7ec6-4abd-b489-1667bd72ffd7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140409 Oct 04 18:37:18.567051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3091/6158] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:18.587261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:18.587261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:18.593062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.593666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.596861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.597992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.600312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.601018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.752657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:18.758264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:18.758264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:18.758264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lazy-loading 'fault' on Instance uuid 4b3953f6-c21c-4674-90d3-2f2f22526316 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:18.860580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7441c846fb384c4f95c18cf6805bcfa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1816a7f2a05416a9d95c2bb2a260ae7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:18.871026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cebc388-5477-479f-b40f-7cf5ab131182 tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 200 len: 1313 microversion: 2.1 time: 0.293359 Oct 04 18:37:18.872055 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3068/6159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:18 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.452047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.452787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.480986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.482534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.489046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.490619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.491077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.491960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.492502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.492924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.511868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.515459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.515459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.528443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.530186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.535532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.555711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf HTTP/1.1 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c5d31af0-6c73-4174-8c2e-e383ea1614cf'} Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.556388 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:37:19.561334 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.561897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:19.562841 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a2553b52-2e39-48f8-98e7-77392d126dcb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 404 len: 111 microversion: 2.1 time: 0.086318 Oct 04 18:37:19.563965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3069/6160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:19.596373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbace5a8-22c0-4673-94be-e38f730c8043 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '.version_select at 0x7f9009a3f160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.714143 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbace5a8-22c0-4673-94be-e38f730c8043 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-384328629" status: 202 len: 0 microversion: 2.1 time: 0.145492 Oct 04 18:37:19.716958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3070/6161] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-384328629 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:19.887192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:19.896040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:19.898093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] [instance: 4b3953f6-c21c-4674-90d3-2f2f22526316] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:19.905052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77c2fbc2-be9c-40e1-8c78-8246f2c8aa95 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.457680 Oct 04 18:37:19.908588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.909365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.909967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.911514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:19.912176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:19.912996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:19.916831 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3092/6162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:19.980274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] HTTP exception thrown: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Request method failure captured: Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 HTTP/1.1 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1HUctz0aJf45HYufexRRNwivDDiUMj3obQzHWi3WVLZvaRbR5Yuk7W7cbniBLmgG4G6l8G5jNR82CNP71x_GHdBtbfp0qof4L6RwnLkC2Nuvbb6d90dVcr0x3bxO0BSpMqrRj37RO3v_hjv_X8UwiwFNLoYnCLkWYyBntZPWek-TQ Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d1816a7f2a05416a9d95c2bb2a260ae7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d1816a7f2a05416a9d95c2bb2a260ae7"}]}] Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: d1816a7f2a05416a9d95c2bb2a260ae7 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1481177312 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7441c846fb384c4f95c18cf6805bcfa4 Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1481177312-project Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4b3953f6-c21c-4674-90d3-2f2f22526316'} Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.981937 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] Returning 404 to user: Instance 4b3953f6-c21c-4674-90d3-2f2f22526316 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:19.986550 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-820544c5-25e2-454d-8de0-d69062ff64ba tempest-ServerMetadataNegativeTestJSON-1481177312 tempest-ServerMetadataNegativeTestJSON-1481177312-project] 10.222.0.40 "GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316" status: 404 len: 111 microversion: 2.1 time: 0.092605 Oct 04 18:37:19.994295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3071/6163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:19 2022] GET /compute/v2.1/servers/4b3953f6-c21c-4674-90d3-2f2f22526316 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:37:20.933466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:20.934580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:20.962868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.963838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.964515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:20.965947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:20.973675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:20.974511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.162381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-563621685", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:21.261256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:21.471126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.515062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.720486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:21.720943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:21.721479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:21.721941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:21.722371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:21.733587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.734181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.734778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.735568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.736099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.736563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.745560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.759233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Getting quotas for project 50a000739fab49d99687c9f7c92d381c. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:21.765675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Getting quotas for user 67e513c54af64d1a87f7388fea33a379 and project 50a000739fab49d99687c9f7c92d381c. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:21.779722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:21.781571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:21.920601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2424fd7f-4eaa-47d6-a7ff-883fec74946e tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762712 Oct 04 18:37:21.927063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:21.930751 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3072/6164] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:37:21.979364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce253bd5-c433-4266-ad0b-9656c1c51b3a tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 1.044553 Oct 04 18:37:21.979364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3093/6165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:20 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:21.996889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.000095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.026224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.027658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.028859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.030142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.032825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.036998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.208929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'services' on Instance uuid 59426015-202a-416b-8604-dca27c4b4a57 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:22.218742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d86a16e6-65e7-4076-b192-d2b4e14bf3ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: .version_select at 0x7f90097835e0>, body: {"keypair": {"name": "tempest-keypair-1136528731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiPSH7laACORCCLb5D9RoTMlThOHlVp2sS3rxzvPmBLUMcDgukDihMy14hsUwYNzFuPrnO72Gmia7iRmF5R+DLzSThvzx7leLvUcXDEVzHUz8hjx5xFpiQenvpqLaqrFQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:22.278903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d86a16e6-65e7-4076-b192-d2b4e14bf3ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for project 7fca84063bd74931ac5b7d6473c38255. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:22.296505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d86a16e6-65e7-4076-b192-d2b4e14bf3ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for user 94e0ec1aeb9d46f48802ddcd78a9e1d5 and project 7fca84063bd74931ac5b7d6473c38255. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:22.446611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d86a16e6-65e7-4076-b192-d2b4e14bf3ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.514434 Oct 04 18:37:22.448780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3073/6166] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:37:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 517 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:37:22.461029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32ec2757-75c7-4f76-89a3-d354f5b05377 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.461029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32ec2757-75c7-4f76-89a3-d354f5b05377 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.558018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32ec2757-75c7-4f76-89a3-d354f5b05377 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:22.570093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32ec2757-75c7-4f76-89a3-d354f5b05377 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1213 microversion: 2.1 time: 0.118825 Oct 04 18:37:22.570835 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3074/6167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:22.625997 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab430662-7d80-4ae9-969a-534f010e674c tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments/5890ab68-3de3-419c-86ab-07474c47d90f" status: 202 len: 0 microversion: 2.1 time: 0.647584 Oct 04 18:37:22.627581 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3094/6168] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:37:21 2022] DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments/5890ab68-3de3-419c-86ab-07474c47d90f => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:22.638603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:22.643149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:22.667415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.673679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.680957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.690067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:22.690909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:22.695961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:22.780981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3953deff-9eff-4049-8258-a8bdd03053aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148938 Oct 04 18:37:22.782266 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3075/6169] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:23.036875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.039872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.066611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.073077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.094245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.097800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.098545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.100029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.598434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-985f0e17-681e-4e88-938a-52e13d413bb7 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.599693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-985f0e17-681e-4e88-938a-52e13d413bb7 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.640264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.654271 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-905caee1-0b14-440a-b8c3-088cc592e40f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.653930 Oct 04 18:37:23.655190 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3095/6170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:22 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.746798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-985f0e17-681e-4e88-938a-52e13d413bb7 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:23.761504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-985f0e17-681e-4e88-938a-52e13d413bb7 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1213 microversion: 2.1 time: 0.167320 Oct 04 18:37:23.762683 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3076/6171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:23.795540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:23.798173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:23.812236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.820296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.820296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.820296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:23.820296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:23.820296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:23.884634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-350d04b7-6ab8-4f96-923c-223cba277b1a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093888 Oct 04 18:37:23.891599 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3096/6172] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:23 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:24.687830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.688514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.689237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d1c512-8740-4eff-988e-b0d492dcc402", "name": "network-vif-plugged", "status": "completed", "tag": "8faf58b4-d9b4-405d-9f14-d421a02f72b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:24.717237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:24.718960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.719476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.719814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.719944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.720619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.720755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.721073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.721365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.721540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.736509 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] Creating event network-vif-plugged:8faf58b4-d9b4-405d-9f14-d421a02f72b9 for instance a9d1c512-8740-4eff-988e-b0d492dcc402 on n-h2-833090-21 Oct 04 18:37:24.744541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d7e59cef-09c1-445b-93f9-4fc59b18e1d5 req-3e73af61-6f9b-4edd-b7e5-f05e0933fdd9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061787 Oct 04 18:37:24.745491 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3097/6173] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:24.806099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:24.813204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:24.846410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.848914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.849582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.854717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:24.857633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:24.859606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:24.996489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.011025 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-087c28dd-44c6-46e4-b042-d8069d834637 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1209 microversion: 2.1 time: 0.225468 Oct 04 18:37:25.016666 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3098/6174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:25.025530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:25.034633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:25.050501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.053621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.054368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.056206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:25.057548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:25.060173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:25.137152 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e2fbcfa-525a-496a-b891-e38a044b25ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118823 Oct 04 18:37:25.147560 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3099/6175] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:25 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:25.465747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:25.478248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0629833-67d0-40f6-a7ec-781b87cf5e35 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.795775 Oct 04 18:37:25.494603 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3077/6176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:24 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:26.042631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.044721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.060815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.061323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.061769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.062523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.062942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.063374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.118159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:26.159295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.164546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.174837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.175567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.176176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.177209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.177866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.178478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.289225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.297914 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07ceb5ef-e14b-4b5d-8491-eeec193088b5 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1273 microversion: 2.1 time: 0.261305 Oct 04 18:37:26.309343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3100/6177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:26.326084 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68e094c4-31f7-4ff0-8125-d460e1699337 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170486 Oct 04 18:37:26.331027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3078/6178] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:26.502805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:26.503516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:26.521857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.524441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.525138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.526120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:26.527606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:26.530120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:26.853354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:26.867304 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9aed4d46-c258-4c37-8cfb-4f4e9f7b6c15 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1374 microversion: 2.1 time: 0.366405 Oct 04 18:37:26.867304 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3101/6179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:26 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1374 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.324973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.326815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.344471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.348280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.362985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.369922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.370629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.371281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.372158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.372701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.373533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.373942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.374382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.375008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.375711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.376157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.457974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65418669-6b41-48c2-ab53-f9f9f0a7a6d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117262 Oct 04 18:37:27.461695 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3102/6180] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:27.476084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-344818193", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "800e6e46-0ac7-45eb-9215-0d82ad834577"}], "security_groups": [{"name": "tempest-securitygroup--853760964"}], "key_name": "tempest-keypair-1136528731", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:27.552757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:27.564301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d2d054f-e568-4aae-b44b-d4bfe7efc0e0 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1271 microversion: 2.1 time: 0.242723 Oct 04 18:37:27.564301 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3079/6181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:27.671965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] validate_networks() for [('800e6e46-0ac7-45eb-9215-0d82ad834577', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:27.893477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:27.894108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:27.905293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.912350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.914240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:27.916404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:27.919662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:27.919662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.329103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:28.329841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:28.330583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:28.339629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:28.341056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:28.366852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.369020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.369656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.375301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.375849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.387548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.390878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.396117 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16778e51-0862-48d9-bf5f-7d383adc6b72 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1546 microversion: 2.1 time: 0.505192 Oct 04 18:37:28.397921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3080/6182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:27 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1546 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.426777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.428470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.439194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.439662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.440107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.440824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.441286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.441715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.444410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for project 7fca84063bd74931ac5b7d6473c38255. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:28.457608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for user 94e0ec1aeb9d46f48802ddcd78a9e1d5 and project 7fca84063bd74931ac5b7d6473c38255. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:28.493702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:28.496134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:28.626673 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bedd2f71-98a2-4d1f-928f-386d00066942 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.163332 Oct 04 18:37:28.628536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3103/6183] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:37:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:37:28.644450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.699728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.716481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.724644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f589d9d-e8a4-43ca-85e3-3bed690c1e79 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1546 microversion: 2.1 time: 0.303537 Oct 04 18:37:28.738371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.738371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.738371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.738371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.739675 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3081/6184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:28.740073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.747477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.757730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.768370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.776283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.777043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.777648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.779046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:28.779708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:28.780295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:28.811100 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f243a72e-5cdd-4598-b45c-b55d4f8b234a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181114 Oct 04 18:37:28.811817 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3104/6185] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:28.822158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:28.822880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:28.893219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.924536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.927498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:28.930004 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de6e4b1f-9fc1-4985-8d2d-6814c25127a8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1281 microversion: 2.20 time: 0.112287 Oct 04 18:37:28.931623 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3105/6186] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:29.167182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:29.176128 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b0ae07a-df39-420e-b5f5-262cdb2604c2 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.434955 Oct 04 18:37:29.176973 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3082/6187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:28 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:29.824422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.826922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:29.844623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.847224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.848294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.849134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:29.850502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:29.851674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:29.894859 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd68ef0e-1287-4277-ae5f-85ee045334a5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075101 Oct 04 18:37:29.895953 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3106/6188] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:29.961849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:29.962631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.046379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.061879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.065781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.067842 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4f06bc12-a0ad-41de-8406-37a6305b9e01 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1281 microversion: 2.20 time: 0.110241 Oct 04 18:37:30.069017 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3083/6189] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:29 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:30.217707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.220151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.242044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.242555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.245526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.248955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.280719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.285301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81c149e-9a2b-47b2-bbf2-391d410d7d41", "tag": "c6492d69-f671-4f52-a7d7-63e5fe49d311"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:30.285803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.305466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.306065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.306669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.332625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] Creating event network-changed:c6492d69-f671-4f52-a7d7-63e5fe49d311 for instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 on n-h1-833090-21 Oct 04 18:37:30.351620 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-76fe0a69-d8bc-470e-a1e9-1e03832dc983 req-641f170a-54ee-47ba-be08-dbf5ee0cd5c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061159 Oct 04 18:37:30.352887 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3084/6190] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:30.689005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:30.702037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdcefdbc-29a7-4a9b-800a-ca9d996ede28 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.503819 Oct 04 18:37:30.703568 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3107/6191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:30.909680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:30.912142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:30.924628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.925891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.927716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.928863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.931915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.931915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.977768 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f115b88-16d0-4148-9276-dfe06a8c40a1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073555 Oct 04 18:37:30.984823 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3085/6192] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:37:30 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:37:31.067045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.067694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.078596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.083722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.084260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.086503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.086503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.086503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.094527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.095149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.110088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.113112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.115019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.115019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.127178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.127836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.144942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:31.236696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.250348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.252601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.254244 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07fda167-5df5-4a35-b491-a6b5191810c1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1333 microversion: 2.20 time: 0.164310 Oct 04 18:37:31.264381 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3086/6193] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:31.375402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:31.448236 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-768b7b1d-b0dd-4c45-af88-04567e580c09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 204 len: 0 microversion: 2.1 time: 0.392725 Oct 04 18:37:31.453299 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3108/6194] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:31 2022] DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:31.459597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.460552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.468841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.469828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.470353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.471438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.472657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.473356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.645483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.654718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-935a5cb9-dde5-4fdf-aad6-b6d0ebeef817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1680 microversion: 2.1 time: 0.200477 Oct 04 18:37:31.656077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3087/6195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:31.736038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.738396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.746865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.747782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.748422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:31.749079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:31.749701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:31.750239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.115942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.138355 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bda79341-9b01-49e7-845a-b0e3df2b121a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.417040 Oct 04 18:37:32.138998 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3109/6196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.282909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.283581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.289437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:32.302277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.304173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.307623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.307623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.307623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.307623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.417210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.426927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.428439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.429724 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d2e3cebc-f133-4e4a-91c1-1e25d7267d25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1333 microversion: 2.20 time: 0.153545 Oct 04 18:37:32.430308 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3088/6197] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1333 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:32.679370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.680344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.688041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.688535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.688981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.689702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.690166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.690595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.911193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.922725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba15439d-9e9e-440d-8687-6e8491f63723 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1680 microversion: 2.1 time: 0.247487 Oct 04 18:37:32.935136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3110/6198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.166366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.167097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.176663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.177176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.181911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.181911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.181911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.181911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.411837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.424288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94888787-1a55-4b4e-8dbc-08089a8793f6 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.261251 Oct 04 18:37:33.426019 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3089/6199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.458292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.458968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.467744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.468489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.469100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.469999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.470753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.471352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.564887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.579735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.606950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.608174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e05cd0a7-614c-40e0-a552-d708a43e8174 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1333 microversion: 2.20 time: 0.154727 Oct 04 18:37:33.609020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3111/6200] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:33.960834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.961807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.970668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.971618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.972509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.973621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.974368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.975063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.448441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.451253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.461235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.462530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.463031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.467920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.468977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.469995 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63ed3852-953d-47a7-b5d9-5230e728e56b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1680 microversion: 2.1 time: 0.514103 Oct 04 18:37:34.470750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.473252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.488497 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3090/6201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1680 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:34.634426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.635300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.646193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.646700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.647147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.648881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.649538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.650746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.090452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.090990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.101630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59e13398-bcbc-4820-bd52-39aa2d5882c3 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.658522 Oct 04 18:37:35.105650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.109896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3112/6202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.125599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.128248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-810f73b7-5634-40bb-b76d-b23b0e6f13cc tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1341 microversion: 2.20 time: 0.496793 Oct 04 18:37:35.128947 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3091/6203] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1341 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:35.495503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.497361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.504491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.505368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.508013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.513774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.514439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.528305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.023093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.032083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38ca76f3-0d27-48ba-99cb-a1a2462228e5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1680 microversion: 2.1 time: 0.540569 Oct 04 18:37:36.036591 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3113/6204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1680 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.135551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.137001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.147187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.148299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.149045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.152065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.152065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.152065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.154519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.155143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.173527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.174043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.174496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.175227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.175719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.179355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.416052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.428727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.431132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.437080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea0af744-6367-43b9-aa64-cbda8bc97602 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1339 microversion: 2.20 time: 0.286379 Oct 04 18:37:36.447164 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3114/6205] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1339 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:36.456739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81c149e-9a2b-47b2-bbf2-391d410d7d41", "name": "network-vif-plugged", "status": "completed", "tag": "c6492d69-f671-4f52-a7d7-63e5fe49d311"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:36.475304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.477057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.477679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.498913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] Creating event network-vif-plugged:c6492d69-f671-4f52-a7d7-63e5fe49d311 for instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 on n-h1-833090-21 Oct 04 18:37:36.521433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ce8a9b82-54c4-4870-b9f0-5d1c6321cfb1 req-66e23162-97cd-4ba9-b866-6b8164572221 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072689 Oct 04 18:37:36.524031 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3115/6206] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:36.657949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.670786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3dfd4228-8572-4c75-839c-979b55b57f17 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.540680 Oct 04 18:37:36.674526 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3092/6207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.077424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.080938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.105324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.106305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.112143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.113016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.114240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.116734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.291517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.299048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59426015-202a-416b-8604-dca27c4b4a57", "name": "network-vif-deleted", "tag": "08418a0e-34fe-4be4-b5db-78e1cf77546d"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:37.307432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1bc74f9a-80e4-4098-81b3-23125ab89546 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1614 microversion: 2.1 time: 0.252590 Oct 04 18:37:37.310586 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3116/6208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1614 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.312456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.312972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.313423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.344487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] Creating event network-vif-deleted:08418a0e-34fe-4be4-b5db-78e1cf77546d for instance 59426015-202a-416b-8604-dca27c4b4a57 on n-h1-833090-21 Oct 04 18:37:37.344487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b1062a6f-0500-4d86-aa21-5523e2a019b3 req-488c7e3c-4bef-405f-9cce-a422517e9404 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045052 Oct 04 18:37:37.344487 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3093/6209] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:37.473034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.474359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.482137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.482919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.484122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.484858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.485368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.485800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.696353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.697268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.711291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.712759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.714014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.716893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.717504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.718759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.800367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.811238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:37.818042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.824487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.824487 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9573a4d-2cc0-4b4c-b4c7-d39bafa59ca1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.354478 Oct 04 18:37:37.824487 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3117/6210] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:38.344778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.345458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.356440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.365864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.370746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.371551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.372566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.373004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.410879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:38.427777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.428522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.429712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.431009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'fault' on Instance uuid 59426015-202a-416b-8604-dca27c4b4a57 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:38.496365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.510170 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebb7875a-d4e7-4aa3-b5fb-2c1fe57ecb19 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 200 len: 1331 microversion: 2.1 time: 0.169600 Oct 04 18:37:38.510948 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3118/6211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:38.551115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.553143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:38.560656 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77832ef7-b26d-4edb-9b18-1b3849d5617b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1313 microversion: 2.1 time: 0.870644 Oct 04 18:37:38.584731 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3094/6212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:38.858484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.859110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.875372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.878657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.879284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.880219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.880841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.882767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.930135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:39.357736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.374516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.376368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.390416 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35c9d536-14c6-42e7-8aec-a09e91fc7394 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.531442 Oct 04 18:37:39.395893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3119/6213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:39.539866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.540650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.558594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.562384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.562978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.572547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.572547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.572547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.584214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.585020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.593433 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 HTTP/1.1 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '59426015-202a-416b-8604-dca27c4b4a57'} Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:39.595743 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:39.607482 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90b265c0-45b4-4c8e-816f-b477dbe6e8a3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 404 len: 111 microversion: 2.1 time: 0.062214 Oct 04 18:37:39.608899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.609019 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3095/6214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:39.609114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.609114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.609114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.609717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.610871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a82329a-df8c-489a-9be5-c9256edc49ad tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '.version_select at 0x7f90082c9f70>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.611275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.761078 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a82329a-df8c-489a-9be5-c9256edc49ad tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-201307511" status: 202 len: 0 microversion: 2.1 time: 0.157672 Oct 04 18:37:39.763814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3096/6215] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-201307511 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:39.798847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:39.829212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.829711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.830157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.854854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] Creating event network-changed:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h1-833090-21 Oct 04 18:37:39.867681 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c97b6f8d-158e-4b9a-bf90-ec215ed67707 req-3426bcdf-339d-48b8-9d78-5abe112a23cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073098 Oct 04 18:37:39.868467 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3097/6216] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:40.025156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.039364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dea12543-aaf5-44b7-8445-b91dfafc620b tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1463 microversion: 2.1 time: 0.458958 Oct 04 18:37:40.042755 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3120/6217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1463 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:40.070320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0a2c119-0262-4be4-b7eb-6516db8fde4f", "device": "/dev/sdb"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:40.075087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.091545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=18 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:40.093615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.094129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.094574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.101946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.103140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.103908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.417278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.417278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.432015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.432532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.432975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.433692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.434140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.435441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:41.213023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ecd28c8a-3226-4df0-a7ac-1cc83f7a39db tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "POST /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.148777 Oct 04 18:37:41.216104 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3098/6218] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:37:40 2022] POST /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41/os-volume_attachments => generated 194 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:41.407170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.422558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.429006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:41.430471 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bb0cfed-bc00-4ee1-92a5-dc3028672afa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 1.017848 Oct 04 18:37:41.443825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3121/6219] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:41.756232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-50490892", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "3a8c9cff-2366-4650-b806-1cf97acb42fd"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:41.845388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] validate_networks() for [('3a8c9cff-2366-4650-b806-1cf97acb42fd', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:41.911864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f833e9a3-98b7-4568-b699-3b5886609f95 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: .version_select at 0x7f9008c9b1f0>, body: {"keypair": {"name": "tempest-keypair-1693746553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKE5jry/+jKTtS4pTS4ACHAtKXK7aX/vFIlMTDXYhI7Lmw7x7Q5D180hTlbfYp9xoD/o5euV3wBS1NNVSwHuSLNn6ETqMfug22FKX4o0/7I+RYITWA+Htgdb+qtkwjDqw=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:41.946198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f833e9a3-98b7-4568-b699-3b5886609f95 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:41.953641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f833e9a3-98b7-4568-b699-3b5886609f95 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:42.089378 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f833e9a3-98b7-4568-b699-3b5886609f95 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181157 Oct 04 18:37:42.102343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3122/6220] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:42.320476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:42.320986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:42.321363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:42.321771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:42.322340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:42.333243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.333926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.335332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.336464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.337073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.337682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.360655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Getting quotas for project f64f902c853c4e45a0eaa92a8ce84482. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:42.371036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Getting quotas for user 1b9e5dd3495c4c369c20558489b767ee and project f64f902c853c4e45a0eaa92a8ce84482. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:42.394030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:42.398028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:42.458127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.459538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.479646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.614741 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffe12962-1bf4-4af0-bdca-8211f7105468 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.986167 Oct 04 18:37:42.615597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3099/6221] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:37:42.627628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:42.628329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:42.791126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.803340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.811191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.812097 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23de15ee-b44a-4992-a280-caf87019ea43 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1260 microversion: 2.26 time: 0.188891 Oct 04 18:37:42.830385 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3100/6222] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:42.874738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.894326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.897936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.908893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1301146-a150-4780-97a9-2d8bbbd07456 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.449428 Oct 04 18:37:42.908893 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3123/6223] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:42 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:43.858455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.859078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.937982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.938591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.940822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.953950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.954441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.954874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.955631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.956348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.956932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.980772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.984056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.991439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1ceedf5-4f17-4bff-ac49-7e1a435f86d2 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1260 microversion: 2.26 time: 0.137499 Oct 04 18:37:43.993691 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3101/6224] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:44.286418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.301708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.303237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.304434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22b82d44-704b-4420-8328-7c314f5bd4ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.371192 Oct 04 18:37:44.305507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3124/6225] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:45.019437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.034789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.043386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.046077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.050728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.050728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.053634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.054265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.263392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.277355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.280892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.285925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6d06d079-29a3-4237-a9ec-a3b2c959db9f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1312 microversion: 2.26 time: 0.270437 Oct 04 18:37:45.288568 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3102/6226] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:45.330711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:45.331581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:45.345236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.354592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.355294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.361421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:45.361934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:45.362379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:45.771206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.781935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.790958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:45.792308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c907f7a5-5c0a-40e9-ac26-97a6ead3534c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.466043 Oct 04 18:37:45.792891 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3125/6227] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:45 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:45.882214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-364116481", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c"}], "security_groups": [{"name": "tempest-securitygroup--68579629"}], "key_name": "tempest-keypair-1693746553", "user_data": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:46.229762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] validate_networks() for [('b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:46.326065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.331562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.345503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.351498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.352201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.355054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.360707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.361459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.522780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.532747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.534478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:46.536038 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c3e49a6-f351-4174-9919-e9d4de0700aa tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1330 microversion: 2.26 time: 0.214988 Oct 04 18:37:46.537145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3126/6228] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1330 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:46.825069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:46.826087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:46.843240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.848658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.849439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:46.850987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:46.855680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:46.857403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.062260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:47.062711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:47.063184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:47.063816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:47.064419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:47.082735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.083210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.089929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.090933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.103926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.104524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.134493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:47.141960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:47.167129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:47.170951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:47.206365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.216258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.217268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.218455 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65c3b8c6-8b1e-44d2-ac43-fd36e7cd51a9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.399812 Oct 04 18:37:47.233125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3127/6229] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:46 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:47.489104 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12803c6b-1499-418f-9594-38ccfb09d0bc tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.612116 Oct 04 18:37:47.489770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3103/6230] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:47.503606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6568d18-86aa-49ca-b5d5-3b803e1f84e2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.504208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6568d18-86aa-49ca-b5d5-3b803e1f84e2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.570911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:47.571924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:47.589601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.589601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.589836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.590689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:47.591147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:47.591688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:47.640000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6568d18-86aa-49ca-b5d5-3b803e1f84e2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.647418 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6568d18-86aa-49ca-b5d5-3b803e1f84e2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1241 microversion: 2.1 time: 0.149605 Oct 04 18:37:47.648495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3128/6231] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:47.846916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.862027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.864595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:47.866447 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c457a83e-c02d-4993-9989-2490bd1f5757 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.300570 Oct 04 18:37:47.880322 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3104/6232] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:47 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:48.246740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.247632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.255528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.256260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.256886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.257784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.258565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.259162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.312069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "name": "network-vif-plugged", "status": "completed", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:48.328912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.331076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.331076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.349669 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] Creating event network-vif-plugged:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h1-833090-21 Oct 04 18:37:48.357331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3a7edeaa-629e-4706-ac34-74746410e54f req-757b7252-343e-4ef8-8b22-cb29e759b473 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049477 Oct 04 18:37:48.359793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3105/6233] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:48.554770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.573601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.575504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.577316 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-979d048b-f1ba-44fd-bc0b-dc27da982684 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.334454 Oct 04 18:37:48.578989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3129/6234] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:48.673564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.674386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.689350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.692314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.697424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.700658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.703329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.705737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.847408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:48.858573 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5d9b0e5-eef5-4c95-84ca-56758367e31d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1245 microversion: 2.1 time: 0.190648 Oct 04 18:37:48.861199 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3106/6235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1245 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:48.883606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a34801-2d7c-4795-9354-40960cc1dfdc", "tag": "1c35bb2b-023f-4038-965a-483b2e560cf6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:48.895241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:48.896292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:48.904616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.905374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.905972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.906909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.907917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.908503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.913124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:48.923559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:48.923559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:48.950300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] Creating event network-changed:1c35bb2b-023f-4038-965a-483b2e560cf6 for instance 76a34801-2d7c-4795-9354-40960cc1dfdc on n-h2-833090-21 Oct 04 18:37:48.966639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b42b38c2-f257-4a33-9941-5eb341f0df02 req-29b8a378-85a5-4ac4-a493-ad93a675809c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092464 Oct 04 18:37:48.968279 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3130/6236] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:49.083267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.092363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.093893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.095014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c23f142-6d50-44b1-9dea-67317f829964 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.204705 Oct 04 18:37:49.095788 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3107/6237] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:48 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:49.609578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.610439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.620688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.626173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.626173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.626173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.626173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.626173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.768860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.777065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.778652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.779661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-55f32f93-ad78-4ef4-9fb7-7a469e00e036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1406 microversion: 2.20 time: 0.177946 Oct 04 18:37:49.780235 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3131/6238] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:49.882857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:49.884129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:49.887950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:49.893998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.894521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.894990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.895738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:49.896215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:49.896757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:49.974589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:49.987034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e61abb24-725d-44a4-a5cd-68abfec6bc09 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1293 microversion: 2.1 time: 0.108505 Oct 04 18:37:49.987704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3108/6239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:49 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:50.125309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.126097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.136392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.137222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.138147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.138915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.139431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.139945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.324842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.333250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.334687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.335887 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81ce0fe4-b042-4254-aaf4-03f8802715b0 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.217676 Oct 04 18:37:50.343604 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3132/6240] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:50.804881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.805477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:50.812257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.812725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.813161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.814063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:50.814690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:50.815122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:50.956216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.964559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.966614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:50.967961 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c82ecae-8a23-4914-8161-da043558cc93 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1596 microversion: 2.20 time: 0.167387 Oct 04 18:37:50.968541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3109/6241] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1596 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:37:50.993200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:50.993709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.000734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.007135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.007135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.007135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.007135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.007135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.012959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.013618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.024525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.025023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.025659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.026384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.026850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.027287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.102289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0088a5c0-b3a7-4386-aff2-3f5824e0bac0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112987 Oct 04 18:37:51.102915 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3133/6242] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:37:50 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:51.104532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.114939 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84bdf3ed-0802-4244-bb62-bb09a8b52d0e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1311 microversion: 2.1 time: 0.107945 Oct 04 18:37:51.115759 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3110/6243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:51.362224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:51.363517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:51.370166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.370887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.371285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.372183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:51.373017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:51.373449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:51.520098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.532085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.533842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:51.535428 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dba54f55-6ba1-4edd-8198-345851960b52 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.177771 Oct 04 18:37:51.536232 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3134/6244] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:51 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:52.138267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.138887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.146258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.146762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.147208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.147947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.148412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.148846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.251205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.270518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4a58ce8-68a9-4e86-a209-d84f8fd0e038 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1311 microversion: 2.1 time: 0.126189 Oct 04 18:37:52.270518 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3111/6245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:52.567323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:52.569989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:52.586739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.587447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.588101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.589478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.591741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.593116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.634973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:52.647084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:52.647853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:52.657326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:52.662696 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] Creating event network-changed:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h1-833090-21 Oct 04 18:37:52.669273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-27232cb9-bb45-4cab-82e0-328113be495c req-5a146785-adbc-4849-9eed-2186ef65c080 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039461 Oct 04 18:37:52.670765 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3112/6246] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:52.944561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.953521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.955600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:52.957003 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4237ff29-696e-4849-aabb-be55cd4325bd tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.395296 Oct 04 18:37:52.967524 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3135/6247] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:52 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:53.297428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.302658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.316503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.317537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.319719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.320612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.324167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.326825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.450894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:53.459173 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d574f20-b01b-49b2-9af8-ff361aac599b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1299 microversion: 2.1 time: 0.176106 Oct 04 18:37:53.460022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3113/6248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:53.984985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:53.985714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:53.994981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.995835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.999891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:53.999891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:53.999891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:53.999891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.483075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:54.483844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:54.491808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.492412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.492862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.493761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:54.495720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:54.507198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:54.520544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.533377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.534884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.536229 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50c8c2ad-eceb-49be-93f6-294efb6a127c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.555497 Oct 04 18:37:54.537284 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3136/6249] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:53 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:54.662138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:54.670385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eaf37474-5f80-420c-8eae-c9e1e62bae3d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.191799 Oct 04 18:37:54.670989 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3114/6250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:54 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:37:55.169380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5746e2-4945-469f-993c-532db1c6c770", "tag": "9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:55.180429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.181029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.181525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.186167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:55.195918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] Creating event network-changed:9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3 for instance fb5746e2-4945-469f-993c-532db1c6c770 on n-h2-833090-21 Oct 04 18:37:55.201463 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-60012ce0-ced4-482d-ac1a-893e91cdb80c req-ffcd325d-3f77-4c0f-afb0-30ab1df1f6a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035863 Oct 04 18:37:55.202376 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3137/6251] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:55.562843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.563530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.570602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.571283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.571814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.572704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.573170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.573767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.695388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:55.696387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:55.704380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.704989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.705430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.708876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:55.708876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:55.708876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:55.759235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.769249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.770776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.771980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10e3a755-59e1-4c79-9e6b-d5acf3951e4e tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.213663 Oct 04 18:37:55.787105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3115/6252] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:55.953534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:55.963709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fabb2ae6-cf90-4f94-9167-df12d91f03c1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.273804 Oct 04 18:37:55.964760 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3138/6253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:55 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:56.191653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a34801-2d7c-4795-9354-40960cc1dfdc", "name": "network-vif-plugged", "status": "completed", "tag": "1c35bb2b-023f-4038-965a-483b2e560cf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.201389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.202052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.202491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.213582 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] Creating event network-vif-plugged:1c35bb2b-023f-4038-965a-483b2e560cf6 for instance 76a34801-2d7c-4795-9354-40960cc1dfdc on n-h2-833090-21 Oct 04 18:37:56.226269 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-29df47d6-9639-494c-8884-738b02c1548a req-d26e52ff-c4b6-4f7d-ba5f-28a8f0f53043 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 Oct 04 18:37:56.226269 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3116/6254] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:56.797762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.798377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.805531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.806019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.806460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.807160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.807646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.808074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.951734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.960564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.962030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:56.963167 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd6171f2-938e-4616-b72c-4f99b90134e3 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.169496 Oct 04 18:37:56.963796 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3139/6255] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:56.988759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:56.989505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:56.996084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.997112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.997552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:56.998236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:56.998688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:56.999143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:57.113585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:57.159268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:57.167793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:57.170052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:57.176256 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd42c255-a356-467f-ba2d-b01c934455ca tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.192629 Oct 04 18:37:57.177812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3117/6256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:56 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:57.989240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:57.989873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:57.992062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:58.002622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.003131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.003785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.004946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.005457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.005898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.184599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.193535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.195256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.196466 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f12bd118-f6df-4991-9dd6-4190ba53b227 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.211454 Oct 04 18:37:58.197224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3140/6257] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:57 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:58.201863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.202498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:58.212335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.212841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.213289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.214017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.214484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.215076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.368396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:58.378950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d8af4966-ac24-4471-99fa-cdaab0197862 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.181607 Oct 04 18:37:58.379998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3118/6258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:59.223502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.225271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.232672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.233164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.233606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.234310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.234818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.235232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.378128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.387592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.389466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.390909 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ac74c4a-4a64-4b64-ac93-a398a483fad9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1360 microversion: 2.26 time: 0.171771 Oct 04 18:37:59.392084 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3141/6259] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:37:59.401877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:59.403269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.411968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.412583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.413628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.414690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:59.415835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:59.416369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:59.566768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.576964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eceb3eaf-70c7-4d62-a725-c3ad52bbfb65 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.179477 Oct 04 18:37:59.579032 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3119/6260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:59 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:00.418432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.419671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.427848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.428354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.429009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.429726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.430191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.430622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.574105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.583443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.584959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.586379 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47077d92-e0c4-4b37-9075-90d9d36d0610 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1545 microversion: 2.26 time: 0.172040 Oct 04 18:38:00.586963 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3142/6261] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1545 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:00.601294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.602504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.611458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.611994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.612433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.613171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.613627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.614056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.628217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9008d0bdc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.644677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.645305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.645815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.646369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.652283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.653478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.653986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.658552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.659242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.659844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.688768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.689543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.690404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.705699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.706187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.706627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.768238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.785601 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-278632a4-8284-4137-92fa-4420bdd8b57a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.188735 Oct 04 18:38:00.786207 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3120/6262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:00.817133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:00.835437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-954421ab-320e-4954-a036-9098987e5a64 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-588726416" status: 201 len: 0 microversion: 2.26 time: 0.222938 Oct 04 18:38:00.836161 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3143/6263] 10.222.0.40 () {62 vars in 1377 bytes} [Tue Oct 4 18:38:00 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-588726416 => generated 0 bytes in 224 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:38:00.847401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3584fe82-27b3-4acc-ad9d-0d1bccc6d050 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9008aadaf0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.861777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3584fe82-27b3-4acc-ad9d-0d1bccc6d050 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.862834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3584fe82-27b3-4acc-ad9d-0d1bccc6d050 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.863745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3584fe82-27b3-4acc-ad9d-0d1bccc6d050 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.884475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3584fe82-27b3-4acc-ad9d-0d1bccc6d050 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-588726416" status: 204 len: 0 microversion: 2.26 time: 0.042244 Oct 04 18:38:00.889253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3121/6264] 10.222.0.40 () {60 vars in 1358 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-588726416 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:00.895129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900d69eee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.903884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.904387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.904832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.905341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.912320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.913403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.918767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.918767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.918767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.918767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.951442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.952021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.952466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.041220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:01.060186 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb90fb77-68f7-4104-a095-81cf2bd82901 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 204 len: 0 microversion: 2.26 time: 0.169644 Oct 04 18:38:01.061098 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3144/6265] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 4 18:38:00 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:01.070777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6830e4c8-a1ff-4080-99bb-78dd897ee14c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9008cf6160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.079505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6830e4c8-a1ff-4080-99bb-78dd897ee14c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.080220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6830e4c8-a1ff-4080-99bb-78dd897ee14c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.080668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6830e4c8-a1ff-4080-99bb-78dd897ee14c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.091735 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6830e4c8-a1ff-4080-99bb-78dd897ee14c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 12 microversion: 2.26 time: 0.025237 Oct 04 18:38:01.097151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3122/6266] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.102668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9009603ca0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.113185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.113590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.114027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.114688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.120204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.120679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.121173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.122522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.122981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.123412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.158122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.158673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.159221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.169182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.169755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.170198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.252060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:01.266523 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b282ca27-b1d9-48e1-9a47-ed3673283b44 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-623951999" status: 201 len: 0 microversion: 2.26 time: 0.168013 Oct 04 18:38:01.267283 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3145/6267] 10.222.0.40 () {62 vars in 1377 bytes} [Tue Oct 4 18:38:01 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-623951999 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:38:01.276888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-71a7da3b-ff6a-4bb1-8905-9435acf11a32 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9008aad820>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.284671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71a7da3b-ff6a-4bb1-8905-9435acf11a32 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.285146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71a7da3b-ff6a-4bb1-8905-9435acf11a32 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.285579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-71a7da3b-ff6a-4bb1-8905-9435acf11a32 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.295130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-71a7da3b-ff6a-4bb1-8905-9435acf11a32 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 35 microversion: 2.26 time: 0.022078 Oct 04 18:38:01.295778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3123/6268] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 35 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.306529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900d69e4c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.315415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:01.317587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.318207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.318792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.320128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.329752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.330257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.330696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.331415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.332710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.332940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.359607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.360097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.360694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.448685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:01.467061 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21f5cc54-aeb2-4b62-a86a-01ab2589f9e1 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-623951999" status: 204 len: 0 microversion: 2.26 time: 0.164852 Oct 04 18:38:01.467934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3146/6269] 10.222.0.40 () {60 vars in 1361 bytes} [Tue Oct 4 18:38:01 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-623951999 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:38:01.476769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-072c1632-b5fe-4874-9894-0f9f4b28f927 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9008f1d790>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.485655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-072c1632-b5fe-4874-9894-0f9f4b28f927 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.486146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-072c1632-b5fe-4874-9894-0f9f4b28f927 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.486587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-072c1632-b5fe-4874-9894-0f9f4b28f927 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.496908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-072c1632-b5fe-4874-9894-0f9f4b28f927 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 12 microversion: 2.26 time: 0.024495 Oct 04 18:38:01.497516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3124/6270] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:01.510136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900d69e700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.519041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.519561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.520191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.520695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.526898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.528196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.528751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.529443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.529903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.530336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.554907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.555393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.555869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.566942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:01.586080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f69e7baa-966a-446c-a7c0-52dc15c24a84 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 204 len: 0 microversion: 2.26 time: 0.081403 Oct 04 18:38:01.586921 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3147/6271] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 4 18:38:01 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:38:01.596707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f90097da8b0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.606885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.607584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.607836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.608313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.615346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.616048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.618244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.618244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.618244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.618244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.647508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.653024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.653024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.658126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.658644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.659082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.762536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:01.779711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d3ba228-3a86-44a6-80ab-716c46934c16 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-1962558450" status: 201 len: 0 microversion: 2.26 time: 0.187076 Oct 04 18:38:01.780412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3125/6272] 10.222.0.40 () {62 vars in 1380 bytes} [Tue Oct 4 18:38:01 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-1962558450 => generated 0 bytes in 188 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:38:01.790470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900963c700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.800624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.801110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.801552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.802050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.807912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.813514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.813514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.813514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.813816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.813912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.813996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.814096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.816993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.817482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.817923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.818612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.819332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.819782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.845799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.846659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.847329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.850940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:01.857085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.857558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.857992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.981106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.002476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f659903-e37e-4aa5-a813-054018da4e0c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-73188622" status: 201 len: 0 microversion: 2.26 time: 0.216067 Oct 04 18:38:02.009021 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3148/6273] 10.222.0.40 () {62 vars in 1374 bytes} [Tue Oct 4 18:38:01 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-73188622 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 04 18:38:02.016554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f90087d44c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.017453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.026357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.026998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.028367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.029223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.029810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4139c892-fc9b-439a-8647-6850d7b5dbef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.224922 Oct 04 18:38:02.030406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3126/6274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:02.036733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.037519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.038174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.039237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.039929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.040548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.067314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.067829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.068267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.228475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.253647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a94d25c7-bdb6-498e-8d69-a1225e46390b tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 204 len: 0 microversion: 2.26 time: 0.241077 Oct 04 18:38:02.254633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3149/6275] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 4 18:38:02 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:02.263703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29e4b972-5909-48f4-a1e1-8cb376c52a30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f90097330d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.271823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e4b972-5909-48f4-a1e1-8cb376c52a30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.272424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e4b972-5909-48f4-a1e1-8cb376c52a30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.272939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e4b972-5909-48f4-a1e1-8cb376c52a30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.282495 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29e4b972-5909-48f4-a1e1-8cb376c52a30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 12 microversion: 2.26 time: 0.023539 Oct 04 18:38:02.283637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3127/6276] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:02.294459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9009070ee0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.302665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.303169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.303627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.304113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.310738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.311228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.311700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.312401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.312863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.313394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.320042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5746e2-4945-469f-993c-532db1c6c770", "name": "network-vif-plugged", "status": "completed", "tag": "9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:02.331826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.332410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.333103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.348541 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] Creating event network-vif-plugged:9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3 for instance fb5746e2-4945-469f-993c-532db1c6c770 on n-h2-833090-21 Oct 04 18:38:02.354202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.354690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.355129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.358018 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b5443cfc-28cb-4dbf-bda5-c54e7fd5a2cb req-474b72c0-2e25-445f-b258-8c8a7e4a3a6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044213 Oct 04 18:38:02.358018 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3128/6277] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:02.367216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.383228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d836e626-3373-4749-a7fc-7de1079af90f tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 204 len: 0 microversion: 2.26 time: 0.092873 Oct 04 18:38:02.383622 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3150/6278] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 4 18:38:02 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:38:02.394934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900973bb80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.405325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.406305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.406928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.407521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.424903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.425489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.425993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.426769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.427312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.427825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.467915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.468405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.468844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.478243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.478720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.479178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.600613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.617010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e6b9cdc-ad73-47da-a65e-77c3f00b85cf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-714484793" status: 201 len: 0 microversion: 2.26 time: 0.226860 Oct 04 18:38:02.617666 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3129/6279] 10.222.0.40 () {62 vars in 1377 bytes} [Tue Oct 4 18:38:02 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-714484793 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 04 18:38:02.630027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9009764c10>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.639894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.640447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.640810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.641294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.647174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.647693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.648161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.648916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.649399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.649829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.677902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.678395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.678838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.688372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.688850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.689291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.798901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.815271 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c74c8b25-ae7f-4808-aa0e-770662568c2c tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-483619297" status: 201 len: 0 microversion: 2.26 time: 0.190651 Oct 04 18:38:02.816389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3151/6280] 10.222.0.40 () {62 vars in 1377 bytes} [Tue Oct 4 18:38:02 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags/tempest-tag-483619297 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:38:02.831017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Action: 'update_all', calling method: .version_select at 0x7f90097da280>, body: {"tags": ["tempest-tag-351583334", "tempest-tag-1498349718"]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:02.836971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.837641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.838245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.838901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.845081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.845572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.846033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.846805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.847295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.847784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.874096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.874582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.875018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.982535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:02.999023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4dfd87a2-a52b-4797-b9e6-c3419e415bdb tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 61 microversion: 2.26 time: 0.176187 Oct 04 18:38:02.999704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3130/6281] 10.222.0.40 () {62 vars in 1312 bytes} [Tue Oct 4 18:38:02 2022] PUT /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 61 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:03.010048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b887ad9-940d-409e-a1e4-0d6839effa30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f9009603b80>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.037691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b887ad9-940d-409e-a1e4-0d6839effa30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.038207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b887ad9-940d-409e-a1e4-0d6839effa30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.038650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b887ad9-940d-409e-a1e4-0d6839effa30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.051274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b887ad9-940d-409e-a1e4-0d6839effa30 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 200 len: 61 microversion: 2.26 time: 0.044958 Oct 04 18:38:03.052541 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3152/6282] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 61 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:03.055636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.056362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.063071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.063605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.064122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.064877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.065696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.065822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '.version_select at 0x7f900d69ef70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.069936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.074784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.075436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.076135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.076832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.082986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.083817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.084485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.085389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.086230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.086871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.118705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.119705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.120545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.220753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:03.228972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'flavor' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:03.229713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f24bfc3-cc04-4687-b70d-fdabf8a72258 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.179725 Oct 04 18:38:03.231768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3131/6283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.257324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5bfc6a2-4fe6-4500-81fb-e1dafdfbb8ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags" status: 204 len: 0 microversion: 2.26 time: 0.196162 Oct 04 18:38:03.258195 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3153/6284] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 4 18:38:03 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc/tags => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:03.268451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.268897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.275446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.276628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.277284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.278680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.279305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.279921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.318715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:03.322505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:03.797399 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b13e2a1b-7546-42dc-b4a3-089d43c64cdf tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 204 len: 0 microversion: 2.26 time: 0.533559 Oct 04 18:38:03.798075 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3132/6285] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:38:03 2022] DELETE /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:38:03.807023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.807681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.814645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.818930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.818930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.818930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.818930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.818930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.035757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.045632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.047107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.048454 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff0eac32-7035-4d07-b2d2-04a105d105d7 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1551 microversion: 2.26 time: 0.246385 Oct 04 18:38:04.049032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3154/6286] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1551 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:04.258701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:04.259393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:04.266132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.266621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.267678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.268393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:04.268848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:04.269267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.408980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.417356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b7cc9a2-f824-4ca9-bef6-749fa8f72c1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1365 microversion: 2.1 time: 0.162872 Oct 04 18:38:04.418001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3133/6287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:04 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:05.075749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.077194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.092169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.092660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.094126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.096053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.097138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.098239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.143230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.143755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.152003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.153231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.153902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.155024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.155692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.156348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.186786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:05.273343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.282467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.283960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.285163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b2af778-0659-4ed7-bc32-51533711d5a9 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1551 microversion: 2.26 time: 0.214351 Oct 04 18:38:05.285926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3155/6288] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1551 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:05.440443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.441066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.448026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.448518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.448964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.449701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.450162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.450600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.622114 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a008f086-c8a4-4865-bf6e-2f68e4cf2247 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 204 len: 0 microversion: 2.1 time: 0.486154 Oct 04 18:38:05.630027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3134/6289] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:05 2022] DELETE /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:05.638428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.639052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.645898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.646639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.647186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.648034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.650116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.650116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.688715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.703059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61cecd37-49b8-4474-8488-ae12a6ad5895 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1556 microversion: 2.1 time: 0.266466 Oct 04 18:38:05.704272 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3156/6290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1556 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:05.744310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.744806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.763382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.763923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.765346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.765346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.770738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.771565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.915164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-854b57ec-4c00-4926-aa16-6606405a92d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180077 Oct 04 18:38:05.922588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.925883 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3157/6291] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:05.931266 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad303f88-8646-4b58-a5eb-fd2bdcf4c173 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1552 microversion: 2.1 time: 0.302740 Oct 04 18:38:05.933281 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3135/6292] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1552 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:06.312993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.314318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.321299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.322109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.322738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.323679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.325013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.325652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.486387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.503067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.504976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.506414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b330e8f3-1c02-4856-a3ca-67696eb8be0d tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1509 microversion: 2.26 time: 0.198575 Oct 04 18:38:06.507043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3158/6293] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:06.633825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a34801-2d7c-4795-9354-40960cc1dfdc", "name": "network-vif-deleted", "tag": "1c35bb2b-023f-4038-965a-483b2e560cf6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:06.669544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.671207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.671976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.691051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] Creating event network-vif-deleted:1c35bb2b-023f-4038-965a-483b2e560cf6 for instance 76a34801-2d7c-4795-9354-40960cc1dfdc on n-h2-833090-21 Oct 04 18:38:06.708391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5a12ab1a-3338-4f7f-b2b7-1014beddc43f req-58616882-494b-4ca3-ae7b-4e7ff47a0999 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077744 Oct 04 18:38:06.709703 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3136/6294] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.979529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.536550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.537415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.545840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.546292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.546881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.550142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.550802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.551381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.593666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.594421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.595011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.595971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lazy-loading 'fault' on Instance uuid 76a34801-2d7c-4795-9354-40960cc1dfdc {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:07.671631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.677587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.680159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b9e5dd3495c4c369c20558489b767ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64f902c853c4e45a0eaa92a8ce84482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.681514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-92286921-0786-434b-8305-47accd1074ee tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 200 len: 1350 microversion: 2.26 time: 0.151720 Oct 04 18:38:07.694764 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3137/6295] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:07.808157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.821658 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86c6b80d-4725-4f12-b75d-4afd918a8282 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1552 microversion: 2.1 time: 0.859225 Oct 04 18:38:07.822467 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3159/6296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1552 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:08.709691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.710421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] [instance: 76a34801-2d7c-4795-9354-40960cc1dfdc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.721946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.722430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.723082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.723830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.724449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.725061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.744244 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] HTTP exception thrown: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. Oct 04 18:38:08.746838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5746e2-4945-469f-993c-532db1c6c770", "tag": "9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3"}, {"server_uuid": "a9d1c512-8740-4eff-988e-b0d492dcc402", "name": "network-vif-deleted", "tag": "8faf58b4-d9b4-405d-9f14-d421a02f72b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Request method failure captured: Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc HTTP/1.1 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH113ECz29ghuxN_rchmAiMffp5djaji2uFqGwEVKTRh_bZlJKW87shZHeADnQcjKfj4IjURzOfDlS7cC298jwqezO3oXgeBU196RRsNe8Ipu6a8rYRO_JCg6H-iV_cRMJsVI8kBGy1--AQtPmN4hxFf7p-__K1HNGftyU-MFWDcihI Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: f64f902c853c4e45a0eaa92a8ce84482 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerTagsTestJSON-1526684394 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f64f902c853c4e45a0eaa92a8ce84482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f64f902c853c4e45a0eaa92a8ce84482"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f64f902c853c4e45a0eaa92a8ce84482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f64f902c853c4e45a0eaa92a8ce84482"}]}] Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerTagsTestJSON-1526684394 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: f64f902c853c4e45a0eaa92a8ce84482 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerTagsTestJSON-1526684394 Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerTagsTestJSON-1526684394-project Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 1b9e5dd3495c4c369c20558489b767ee Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerTagsTestJSON-1526684394-project Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '76a34801-2d7c-4795-9354-40960cc1dfdc'} Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:08.754077 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] Returning 404 to user: Instance 76a34801-2d7c-4795-9354-40960cc1dfdc could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15f0ce34-08c9-431e-aadd-91a872e1e607 tempest-ServerTagsTestJSON-1526684394 tempest-ServerTagsTestJSON-1526684394-project] 10.222.0.40 "GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc" status: 404 len: 111 microversion: 2.26 time: 0.049926 Oct 04 18:38:08.759974 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3138/6297] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/76a34801-2d7c-4795-9354-40960cc1dfdc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:38:08.779037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.779037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.779037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.800363 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Creating event network-changed:9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3 for instance fb5746e2-4945-469f-993c-532db1c6c770 on n-h2-833090-21 Oct 04 18:38:08.800363 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] Creating event network-vif-deleted:8faf58b4-d9b4-405d-9f14-d421a02f72b9 for instance a9d1c512-8740-4eff-988e-b0d492dcc402 on n-h2-833090-21 Oct 04 18:38:08.807391 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b25fc5fb-5039-43d5-921c-40950dec8b59 req-aadf47b0-982e-4957-bd9b-2dc092b8116f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064144 Oct 04 18:38:08.813304 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3160/6298] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:08.849747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.850370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.862326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.862807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.864605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.865603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.869226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.880729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.135801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.146366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad7021a4-1601-4dbc-b7c9-63cd81dfe123 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1333 microversion: 2.1 time: 0.300499 Oct 04 18:38:09.159776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3139/6299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1333 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.174251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.174960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.184999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.185489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.187360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.188340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.188805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.189239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.234578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.235546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.237888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.239058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lazy-loading 'fault' on Instance uuid a9d1c512-8740-4eff-988e-b0d492dcc402 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:10.256133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:10.313387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.329778 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6d8fa29-15cd-4ffc-8040-a24ffed1982f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 200 len: 1338 microversion: 2.1 time: 0.157705 Oct 04 18:38:10.330694 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3161/6300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.358342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.359736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: a9d1c512-8740-4eff-988e-b0d492dcc402] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.367131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.367795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.368338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.369112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.369692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.370127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.387007 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] HTTP exception thrown: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Request method failure captured: Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 HTTP/1.1 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHzEtqEHeIuIDekq0bsD2_86NPzXKepjeb8sryj02JyFnwj155N3CHyUD6a_mWjcNuki-3hsaqk7tKCYl3hxkzKNAYsyLN0C1XdIb0GlwT77dJIcZ5J7btg73HUyqV-6Tc9Q-bWl5B4RKEnQ7DUHZ83X5dVZiuw-waiyJgg_OSllRMw Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}] Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 951ccbba14794d7b9fa02a1620e5af93 Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a9d1c512-8740-4eff-988e-b0d492dcc402'} Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:11.388805 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Returning 404 to user: Instance a9d1c512-8740-4eff-988e-b0d492dcc402 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7803c13-5b7b-47db-b25b-ea3c7df38727 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402" status: 404 len: 111 microversion: 2.1 time: 0.037720 Oct 04 18:38:11.395652 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3140/6301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/a9d1c512-8740-4eff-988e-b0d492dcc402 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:11.800442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08c5cd4a-9fc8-4aa4-b38e-f9f51daddf8f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '.version_select at 0x7f9008ef6670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.975905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08c5cd4a-9fc8-4aa4-b38e-f9f51daddf8f tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-986416663" status: 202 len: 0 microversion: 2.1 time: 0.184517 Oct 04 18:38:11.976511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3162/6302] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 18:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-986416663 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:14.921130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.922158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.924682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7", "tag": "3d420b9e-1478-492b-b6ea-2ebeb0fd1f18"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:14.937252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.937427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.937893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.938337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.938612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.939300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.946786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.946786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.946786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.957007 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] Creating event network-changed:3d420b9e-1478-492b-b6ea-2ebeb0fd1f18 for instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 on n-h2-833090-21 Oct 04 18:38:14.962851 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a22f0ffa-0c14-4ccf-8dcc-f4d31f969617 req-cda40c5d-96f0-4f06-bce8-3b5a4d78650b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043441 Oct 04 18:38:14.964277 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3163/6303] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:14.985132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:15.386316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b095789-5f2a-426f-8adf-756b54f0995b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 204 len: 0 microversion: 2.1 time: 0.470796 Oct 04 18:38:15.387278 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3141/6304] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:14 2022] DELETE /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:15.396344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.397058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.403641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.404185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.404652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.405487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.408787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.408787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.563044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.571567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be557a3d-18c6-4a89-a2fb-eb0a5ee5960d tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1673 microversion: 2.1 time: 0.179609 Oct 04 18:38:15.574517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3164/6305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:16.602360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:16.603438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:16.611062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.613088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.615140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.623705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.623705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.623705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.806775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.815915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ee679ae-b685-4118-bcb7-5a7b52952fb7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1673 microversion: 2.1 time: 0.217885 Oct 04 18:38:16.816634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3142/6306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:16 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:16.878197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-573698112", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:16.937298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:16.937755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:16.938398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:16.938818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:16.939229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:16.949409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.949902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.950347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.951080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.951585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.952042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.970177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Getting quotas for project 33bed7a097b448428214ee79920daa96. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:16.975687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Getting quotas for user ff1a582aff1d4840933edcc205da2196 and project 33bed7a097b448428214ee79920daa96. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:16.989113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:16.991497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:17.118130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca038a97-1940-4517-93bf-fae95589c087 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.389872 Oct 04 18:38:17.119127 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3165/6307] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:38:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:38:17.130282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.131292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.227281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.235832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.237529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.239048 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f76bed9-bd6c-4f4d-af01-8a5ecc5f822f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 200 len: 1277 microversion: 2.47 time: 0.112517 Oct 04 18:38:17.247900 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3143/6308] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:17.335113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-888744278", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:17.391510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:17.391964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:17.392445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:17.392986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:17.393407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:17.405350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.406078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.406750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.407702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.408341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.408932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.435841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Getting quotas for project 33bed7a097b448428214ee79920daa96. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:17.441300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Getting quotas for user ff1a582aff1d4840933edcc205da2196 and project 33bed7a097b448428214ee79920daa96. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:17.458821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:17.458821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:17.598406 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-309834a6-28ea-4016-964c-9fc1de207590 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.269617 Oct 04 18:38:17.599079 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3166/6309] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:38:17.613942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-54bb4e6a-7c46-482d-bd89-fef1c8c862bc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:17.616659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-54bb4e6a-7c46-482d-bd89-fef1c8c862bc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.620814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:17.660785 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-54bb4e6a-7c46-482d-bd89-fef1c8c862bc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "PUT /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 991 microversion: 2.47 time: 0.054317 Oct 04 18:38:17.661695 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3144/6310] 10.222.0.40 () {62 vars in 1297 bytes} [Tue Oct 4 18:38:17 2022] PUT /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:38:17.685221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.685724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.821265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.846866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.846866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.860019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.861588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.861771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.862178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.863077 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a8bca4b-a3fc-494b-9387-9ea7340b829a tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1277 microversion: 2.47 time: 0.182203 Oct 04 18:38:17.863216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.863894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.864361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.864798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.878062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3167/6311] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:17.889447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7", "name": "network-vif-deleted", "tag": "3d420b9e-1478-492b-b6ea-2ebeb0fd1f18"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:17.901190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.901677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.902974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.915374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] Creating event network-vif-deleted:3d420b9e-1478-492b-b6ea-2ebeb0fd1f18 for instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 on n-h2-833090-21 Oct 04 18:38:17.921525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ca1ec2f2-a7e1-46bc-b502-393fb073dd1a req-648af2f5-3ab6-4eb4-99f3-fcb2fd99f6e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Oct 04 18:38:17.922163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3168/6312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:17.958349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:17.966760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb14b815-37c8-45c0-95ae-cbe01030341b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1486 microversion: 2.1 time: 0.130234 Oct 04 18:38:17.967571 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3145/6313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1486 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:18.895822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:18.896471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:18.902930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.903420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.903912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.904605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.905054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:18.905481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:18.975226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.983814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.985500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:18.986666 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d47183a-d08b-44d0-b55c-7b37187ad4da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1281 microversion: 2.47 time: 0.096185 Oct 04 18:38:18.987617 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3169/6314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:18 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:18.990775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:18.991400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:18.998910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:18.999663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.000312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.001220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.001695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.002156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.046635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:19.047151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:19.047619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:19.048102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lazy-loading 'fault' on Instance uuid 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:19.095181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:19.102744 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c6dcde3-e5eb-4739-ba35-d322de6f7251 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 200 len: 1339 microversion: 2.1 time: 0.116535 Oct 04 18:38:19.103322 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3146/6315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:18 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:20.012912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.013560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.021189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.021663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.022116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.022820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.023315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.023860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.097614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.114890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.117052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:20.118246 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03dab056-5457-4885-9f87-d660dc8842b3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1273 microversion: 2.47 time: 0.109478 Oct 04 18:38:20.118973 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3170/6316] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:20.135258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.135918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:20.143178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.143703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.144202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.144892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:20.145371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:20.145792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:20.159818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] HTTP exception thrown: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Request method failure captured: Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 HTTP/1.1 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHzEtqEHeIuIDekq0bsD2_86NPzXKepjeb8sryj02JyFnwj155N3CHyUD6a_mWjcNuki-3hsaqk7tKCYl3hxkzKNAYsyLN0C1XdIb0GlwT77dJIcZ5J7btg73HUyqV-6Tc9Q-bWl5B4RKEnQ7DUHZ83X5dVZiuw-waiyJgg_OSllRMw Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}] Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 951ccbba14794d7b9fa02a1620e5af93 Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7'} Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:20.161533 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Returning 404 to user: Instance 6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c511e8ee-db0e-4d1e-ba46-8e400a6d71b4 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7" status: 404 len: 111 microversion: 2.1 time: 0.032483 Oct 04 18:38:20.172584 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3147/6317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:20 2022] GET /compute/v2.1/servers/6537f2c4-2a6e-4bd0-bf76-70b7870ca8b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:38:20.408308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4b7fa8a-3283-4a4a-bef9-f2c46863709c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '.version_select at 0x7f9008d01040>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:20.422173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:20.484183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4b7fa8a-3283-4a4a-bef9-f2c46863709c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1202589386" status: 202 len: 0 microversion: 2.1 time: 0.079687 Oct 04 18:38:20.484953 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3171/6318] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 4 18:38:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1202589386 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:21.146428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:21.147840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:21.158910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.159415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.159913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.160610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:21.161075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:21.161499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:21.197905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:21.299590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:21.308255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:21.313198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:21.314391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c4f8fc1-4c02-4e6d-a8ba-50b340e4d7f3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1329 microversion: 2.47 time: 0.172738 Oct 04 18:38:21.314958 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3148/6319] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:21 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1329 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:22.352847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:22.353552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:22.361872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.362601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.363206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.364131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:22.364766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:22.365454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:22.473123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.487880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.489640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:22.491009 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60121723-6818-4008-a084-8f622322effc tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1347 microversion: 2.47 time: 0.154915 Oct 04 18:38:22.492733 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3172/6320] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:22 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1347 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:23.523190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:23.524312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:23.545494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.546093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.546611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.547403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:23.548682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:23.549619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:23.645420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.656481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.658076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:23.659379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-719a1ce7-86ee-4383-b09c-7d14c85686d7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1347 microversion: 2.47 time: 0.144836 Oct 04 18:38:23.660082 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3149/6321] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:23 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1347 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:24.688409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.689067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.701700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.702202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.702641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.703357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.704018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.704453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.838817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.857335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.858839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.860079 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-121d4881-758b-4e90-b3e9-92508aa1e4e1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1335 microversion: 2.47 time: 0.175860 Oct 04 18:38:24.860692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3173/6322] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:25.894874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.895533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.903563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.904266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.904884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.905668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.906331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.906834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.998727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.017401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.037742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.040171 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4338b0e-0d43-497d-962f-403f7409cb4d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1335 microversion: 2.47 time: 0.149220 Oct 04 18:38:26.042260 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3150/6323] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:27.070869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.072280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.080930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.081416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.081915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.082616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.083096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.083552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.181296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.216458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.216458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:27.216458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1003861d-cc2e-45b0-b989-59ea4822dbdf tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1335 microversion: 2.47 time: 0.137537 Oct 04 18:38:27.216458 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3174/6324] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1335 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:28.235063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.235954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.239709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.248978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.249466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.249910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.250619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.251078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.258907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.377192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.387453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.389969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.390722 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75ac8cb9-6b97-4664-b749-96b81124c98d tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1335 microversion: 2.47 time: 0.159536 Oct 04 18:38:28.392102 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3151/6325] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:28.963648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:28.963648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:28.964824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.965475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.970284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.971014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.971741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.972413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:28.973026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:28.973778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.042704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41ee538a-c1a3-40d1-b820-33a0d10b3d17 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/ips" status: 200 len: 150 microversion: 2.20 time: 0.091818 Oct 04 18:38:29.043798 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3175/6326] 10.222.0.40 () {60 vars in 1289 bytes} [Tue Oct 4 18:38:28 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:38:29.426666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:29.427918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.442506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.443050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.444577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.445523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.446152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.446736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.519229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.528088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.529545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.531025 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d90e1344-4242-425d-b6b6-348bdd74cf51 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1356 microversion: 2.47 time: 0.108362 Oct 04 18:38:29.531631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3152/6327] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:29.559409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:29.562324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.569194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.569903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.570552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.573172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.574605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.575493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.674655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:29.675301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:29.675996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:29.676609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:29.677365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:29.968043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.003278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.004060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.007741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.011872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.012859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.014061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.100799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3cb0a2e0-b2c6-4fa7-b0bd-0dcb02c3193f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "POST /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d/action" status: 202 len: 1078 microversion: 2.47 time: 0.545805 Oct 04 18:38:30.116478 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3176/6328] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:38:29 2022] POST /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d/action => generated 1078 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:38:30.126487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.127187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.142454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.142975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.143424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.144181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.145629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.146081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.375886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.390713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.392714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.393963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce6051c1-7ac6-499c-b4fe-b46d88c9c0ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.271795 Oct 04 18:38:30.395276 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3153/6329] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:31.426879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.427594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.441631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.445088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.448231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.448231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.449209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.452603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.540444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.556198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.558854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.560402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b82d2a86-e43b-47b3-aa8f-6a769b222cbe tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.139238 Oct 04 18:38:31.562279 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3177/6330] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:32.591395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.593245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.600371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.601258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.601827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.602402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.602861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.603626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.694726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.707750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.715971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:32.722071 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d58c087f-bdb6-41e7-919a-9ee372b450b7 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.131423 Oct 04 18:38:32.722071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3154/6331] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:32.878105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:32.878688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.885691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.886482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.886960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.887848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.888652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.893352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.919002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lazy-loading 'flavor' on Instance uuid 2001502a-a48c-438b-82dc-6e7f2749e8e1 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:33.629712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82830362-9050-4002-927b-ca9165d1c57d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/action" status: 202 len: 0 microversion: 2.20 time: 0.755307 Oct 04 18:38:33.630567 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3178/6332] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:38:32 2022] POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:33.646267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.647687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.658902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.660122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.667164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.667164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.667164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.667164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.774453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.776183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.794111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.796054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.798491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.799378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.799974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.800978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.898442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.908320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.911450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:33.913225 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbef19f2-18fd-44aa-8071-c8b6d52c09f0 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.162350 Oct 04 18:38:33.914479 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3179/6333] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:34.320023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.335719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.338637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:34.342319 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f9fddf36-d509-49bb-81dd-20a3fafb3c7e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.702352 Oct 04 18:38:34.343393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3155/6334] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:34.615122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-286bb8c6-d703-464a-ba74-dc1f732542e5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: .version_select at 0x7f9009096790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-529439734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDrK4HLBVq77iH36V3CXlYWgodtW5LhknkEGqazxBGbwhhSI6T5TR1khIorktRuijplW8mhyOpFW/zL8LvNeih5HpI19Y9nMo0w60Jz7yjR/DCb0tviUsrBpZA2odwNCw=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:34.632560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-286bb8c6-d703-464a-ba74-dc1f732542e5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:34.638342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-286bb8c6-d703-464a-ba74-dc1f732542e5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:34.737086 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-286bb8c6-d703-464a-ba74-dc1f732542e5 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.125903 Oct 04 18:38:34.739016 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3180/6335] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:38:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:34.942003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:34.942732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:34.952727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.953333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.955360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:34.956189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:34.956646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:34.957085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.038329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.047017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.048720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.049839 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-787b388a-5cd3-47f4-9a55-65a2d57d6bc1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.114367 Oct 04 18:38:35.050487 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3156/6336] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:34 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:35.374030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:35.375372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:35.383125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.383690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.384143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.384943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:35.385402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:35.386738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:35.393171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:35.572490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.581536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.583982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:35.585183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-766f1724-6bc1-44ca-ba3c-fec584e700ba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.217182 Oct 04 18:38:35.586247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3181/6337] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:35 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:36.084831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.085570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.101295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.101813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.102260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.102999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.103693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.104520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.192934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.211240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.213379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.215127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd91b06d-585b-4d78-9376-8807e59ebf97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.134715 Oct 04 18:38:36.216400 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3157/6338] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:36.612188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.613400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:36.633897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.634393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.634829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.635569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:36.636555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:36.636979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:36.797863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.806214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.808241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:36.809432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bba889f4-63da-4927-b497-d02922537952 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.201145 Oct 04 18:38:36.810057 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3182/6339] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:36 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:37.250619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.252512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.261351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.262811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.263725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.266721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.267838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.269213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.344418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.350381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.351822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:37.353005 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ef70123-54c7-4b01-bc58-c3ffb08858c3 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.109695 Oct 04 18:38:37.353590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3158/6340] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:37.837109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:37.837816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:37.847758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.848246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.848710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:37.849603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:37.850236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:37.850666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.075515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.084679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.086169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.087786 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f6688966-6d56-4c2d-afbe-ce8fc8ba5def tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.254876 Oct 04 18:38:38.098756 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3183/6341] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:37 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:38.139364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-213258248", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "dbcfa9a3-fae2-45a5-973a-26ee0c6033d3"}], "key_name": "tempest-TestNetworkBasicOps-529439734", "security_groups": [{"name": "tempest-secgroup-smoke-888217666"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:38.266015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] validate_networks() for [('dbcfa9a3-fae2-45a5-973a-26ee0c6033d3', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:38:38.382697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.383451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:38.392742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.393658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.394299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.395218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.396038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.396687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.486725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.496266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.497767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:38.499209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01dbe5ec-b9d8-4e50-b2a0-ceab0332c59e tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.122542 Oct 04 18:38:38.499815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3184/6342] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:38.734300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:38:38.734734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:38:38.735215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:38:38.735674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:38:38.736093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:38:38.747906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.748967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.749652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.750638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:38.752684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:38.752926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:38.792724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:38:38.799202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Getting quotas for user 951ccbba14794d7b9fa02a1620e5af93 and project 6beb5e2f8bc1401f9c603fbf38ed4d4c. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:38:38.815644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:38:38.819135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:38:38.929379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b50a4d3f-92df-4263-9746-32d6581b95db tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793868 Oct 04 18:38:38.929962 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3159/6343] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:38:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:38:38.941908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6043adaf-69fb-478e-87ff-7faf446e5d85 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:38.942523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6043adaf-69fb-478e-87ff-7faf446e5d85 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.001676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6043adaf-69fb-478e-87ff-7faf446e5d85 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.011623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6043adaf-69fb-478e-87ff-7faf446e5d85 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1247 microversion: 2.1 time: 0.073625 Oct 04 18:38:39.012731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3185/6344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:38 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:39.120124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.123955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.141767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.401646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.410411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.411992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.413164 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c12dabc-00c3-4f4d-b49c-fa573beef19f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.298212 Oct 04 18:38:39.413733 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3160/6345] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:39.526260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:39.526892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:39.534330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.534910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.535438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.536356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:39.536821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:39.537254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:39.630053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.640816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.642733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:39.644074 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9254501d-4110-4211-ac17-49b50a7cdb37 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.121879 Oct 04 18:38:39.644659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3186/6346] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:39 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:40.041384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44e6e4d1-86f8-49f9-9628-12a31a7b75a0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.042631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44e6e4d1-86f8-49f9-9628-12a31a7b75a0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.100967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44e6e4d1-86f8-49f9-9628-12a31a7b75a0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.108322 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44e6e4d1-86f8-49f9-9628-12a31a7b75a0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1247 microversion: 2.1 time: 0.070961 Oct 04 18:38:40.108909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3161/6347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:40.439879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.446296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.450642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.451138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.451614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.452452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.452922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.453570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.595307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.605430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.608800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.608800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69538b15-9b1c-4fc0-8ac5-54bbe4a43419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.172725 Oct 04 18:38:40.609254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3187/6348] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:40.669894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:40.670424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:40.680736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.681234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.681679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.682394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:40.683375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:40.683839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:40.748286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.756919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.758613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:40.759592 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-edda4d1d-c3f3-4c2e-8091-54712c6b932f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.093809 Oct 04 18:38:40.760650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3162/6349] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:40 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:41.131401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.132187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.138561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.139048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.139508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.140209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.140663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.141088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.207560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.217459 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66008d54-64d7-4d40-a036-583dc5d2e7d0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1299 microversion: 2.1 time: 0.089878 Oct 04 18:38:41.218063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3188/6350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:41.635338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.636765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.644438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.645311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.645765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.646469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.646932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.647365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.786914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:41.787369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:41.796711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.802224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.802865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.803885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:41.804556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:41.805361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:41.829122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.841756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.843360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.846871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b1f2d2f-9df3-497a-9b58-869f6368bc9d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.216486 Oct 04 18:38:41.848917 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3163/6351] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:41.943738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.958148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.960460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:41.962349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83595bf3-a460-4a29-a335-7b4d9c887567 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.179819 Oct 04 18:38:41.971572 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3189/6352] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:41 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:42.242888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.244125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:42.261411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.261411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.261411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.262149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.262783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.263521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.338140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:42.348209 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-859d2276-49d9-4b34-8de9-7f70c32888d7 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1305 microversion: 2.1 time: 0.110236 Oct 04 18:38:42.350155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3164/6353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:42.890787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.890787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:42.890787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.890787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.891735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.891949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:42.892231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:42.892848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:42.993925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:42.994814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:43.003105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.003682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.004495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.005663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.006336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.007686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.128614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.133575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.145150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.146704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.148331 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fba0e918-5f6f-4a79-bac2-60f523d98b58 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.276101 Oct 04 18:38:43.149801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3190/6354] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:43.155945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.158414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.163323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d84341f0-3ddf-4ace-9256-5b762318d8da tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.176899 Oct 04 18:38:43.165213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3165/6355] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:42 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:43.375375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:43.376373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:43.382432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.382920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.383360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.384091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:43.384662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:43.385095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:43.570442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:43.581109 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41204cf2-fce7-4e17-9833-00188ff6cdb0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.210668 Oct 04 18:38:43.591726 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3191/6356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:43 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:43.985651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637c493d-f037-48eb-9f3f-1b20c54edfe2", "tag": "6a381338-d63a-45d2-ad20-69c5c80bc04f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:44.000138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.001826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.002574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.021147 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] Creating event network-changed:6a381338-d63a-45d2-ad20-69c5c80bc04f for instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 on n-h1-833090-21 Oct 04 18:38:44.025671 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4f5bf1de-4c23-4f25-9576-660773ab2847 req-0be5989c-fac9-42fd-bb30-da427f18673d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044432 Oct 04 18:38:44.028590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3166/6357] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:44.187890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.195962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.199676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.201357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.207296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.207885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.208482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.208625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.209169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.210068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.210524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.211302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.222405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.223258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.225788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.229040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.238947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:44.298016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.306486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.308094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.309358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3027572a-e9ad-4556-9300-50e5b898cb4f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.116104 Oct 04 18:38:44.310003 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3167/6358] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:44.411061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.420999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.422476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.423707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d46b6b15-3ed3-44db-963f-c7da1c22d8aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.250065 Oct 04 18:38:44.430647 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3192/6359] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:44.608116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:44.609071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:44.616278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.622251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.622251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.622251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:44.622251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:44.622251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:44.765448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:44.775964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-494ab405-1038-46e0-b074-3c09f2cab8fb tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.173598 Oct 04 18:38:44.777623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3168/6360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:44 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:45.335594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:45.336265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:45.345102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.345102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.345381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.346112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.346576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.347001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.422673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.431632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.433122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.434313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1983a389-65d7-4a61-84b8-b3b7d8f4a340 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.102767 Oct 04 18:38:45.434960 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3193/6361] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:45 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:45.452293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:45.453558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:45.462364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.464337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.464947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.465847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.466470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.467062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.618094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.627161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.628752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.630079 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9add5729-e7ec-4940-991a-c7bf16b438c6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.184502 Oct 04 18:38:45.630730 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3169/6362] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:45 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:45.801853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:45.802552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:45.809345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.809897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.810338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.811022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:45.811491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:45.811924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:45.977489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:45.985989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce7c02e7-c451-4135-9db5-b6aa3656cb60 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.188029 Oct 04 18:38:45.986586 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3194/6363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:45 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:46.466254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.466875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.473853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.474337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.474775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.475496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.475981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.476408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.549594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.558022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.559484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.560659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e5d15e0-1d46-4e55-a255-077e53c07202 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.098907 Oct 04 18:38:46.561226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3170/6364] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:46.657324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:46.657943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:46.664702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.665191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.665634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.666474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:46.667433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:46.667880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:46.811894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.821399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.822866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:46.824585 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aea9d1c3-5422-421b-b40e-3cb279b477ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.171391 Oct 04 18:38:46.825161 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3195/6365] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:46 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:47.009409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.013575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:47.016077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.016571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.017013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.017746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.018202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.018637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.164091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.173604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c33376db-6884-4531-86d2-a40ae282f62e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.168047 Oct 04 18:38:47.174297 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3171/6366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:47.591684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.592300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:47.598824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.599315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.599824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.600569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.601125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.601567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.671862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.681248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.683525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:47.685048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0d3e9b1-7d88-44e3-8f8a-99d29d1bfa72 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.098083 Oct 04 18:38:47.685770 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3196/6367] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:47.850187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:47.850777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:47.858646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.859559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.860011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:47.860715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:47.861183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:47.861615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.005584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.013919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.015496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.016679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73e88365-ba37-44c6-b90e-72d2cdadbafb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.170523 Oct 04 18:38:48.017258 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3172/6368] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:47 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:48.206245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.206862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.213022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.213514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.214452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.215149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.215633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.216061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.367199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.377987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab4804e0-681b-410c-829e-aebf9024c772 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.173598 Oct 04 18:38:48.378370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3197/6369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:48.711974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:48.712589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:48.720517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.721016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.721570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.722281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:48.722746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:48.723178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:48.781341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:48.805686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.818668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.819199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:48.820596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3337d48f-ff39-453a-bb5c-d3514dee4dfb tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.112866 Oct 04 18:38:48.824313 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3173/6370] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:48 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:49.043900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.044789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.047587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:49.053166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.053572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.054024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.055167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.055873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.056303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.215194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.218255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:49.228010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.230941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.232226 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38fd4bab-bedd-4371-9f5b-566223e36ac1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.193581 Oct 04 18:38:49.233356 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3198/6371] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:49.404537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.405377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.408244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:49.413570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.414137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.414644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.415442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.416027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.416523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.559844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.569497 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d6b9610-5b8a-461b-a9a5-a527b9ed71b0 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.169807 Oct 04 18:38:49.570123 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3174/6372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:49.848170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:49.848828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:49.856101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.856634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.857076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.857777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:49.858239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:49.858713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:49.937339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.947575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.949534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:49.950720 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5751da9-e036-42fe-897c-6e825b44ea97 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.106767 Oct 04 18:38:49.951317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3199/6373] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:49 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:50.258287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.259213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.265398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:50.267011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.267742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.268459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.269338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.270033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.270769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.419555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.430585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.432261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.433453 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6aa9634b-ca66-42f5-8916-7ab1af077db8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1742 microversion: 2.20 time: 0.179176 Oct 04 18:38:50.434056 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3175/6374] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:50.482083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637c493d-f037-48eb-9f3f-1b20c54edfe2", "name": "network-vif-plugged", "status": "completed", "tag": "6a381338-d63a-45d2-ad20-69c5c80bc04f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:50.493289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.494447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.495015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.507616 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] Creating event network-vif-plugged:6a381338-d63a-45d2-ad20-69c5c80bc04f for instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 on n-h1-833090-21 Oct 04 18:38:50.513136 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-855bc380-51fc-4722-bc70-6924a694d432 req-30e3a826-99a0-4ed9-8276-28f622a59323 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035522 Oct 04 18:38:50.513912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3200/6375] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:50.595518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.596204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.627492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.628003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.628448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.632371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.633463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.633910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.828334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:50.832705 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ae0ded0-852f-4395-9392-7fe449b5b271 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.243937 Oct 04 18:38:50.833821 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3176/6376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:50.977964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:50.978711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:50.986354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.987457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.987457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:50.992563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:50.992563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:50.992563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.410283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.428801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.431188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.433072 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-16f8d58e-07b7-4304-8b82-02085bf27eef tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.459346 Oct 04 18:38:51.433653 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3201/6377] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:50 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:51.476182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.477501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.489310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.490097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.490740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.491663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.492291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.492891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.659644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.668135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.669910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:51.671181 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4f419ed-5043-435f-9800-58c6943b3986 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1742 microversion: 2.20 time: 0.199345 Oct 04 18:38:51.671863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3177/6378] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:51.857608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:51.858829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:51.865629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.866056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.866498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:51.867202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:51.867903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:51.868106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.009838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.018614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8438578e-3f3f-44ca-b159-1739afb90d4c tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1372 microversion: 2.1 time: 0.165408 Oct 04 18:38:52.019204 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3202/6379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:51 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:52.466653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.467363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.474031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.481198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.481198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.481198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.481198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.481198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.554645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.566250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.568733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.570272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e9cccd9c-9df2-4324-8662-d7a950263563 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.109799 Oct 04 18:38:52.570845 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3178/6380] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:52.700598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:52.700598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:52.701914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:52.707243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.707748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.716159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.720313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:52.720313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:52.720313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:52.900751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.910623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.912136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:52.915175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-159a23aa-d649-422f-a10d-6bd13e1aa8c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.220488 Oct 04 18:38:52.926050 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3203/6381] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:52 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:53.043619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.047556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.050249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.051363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.051834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.052567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.052991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.053421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.221118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.230439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25e080c9-d204-41bc-9bcf-036236011442 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1544 microversion: 2.1 time: 0.190723 Oct 04 18:38:53.235511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3179/6382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.256379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.257902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.267854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.268481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.269087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.269958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.270593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.271428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.438538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.450237 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b18f7eee-bddb-4650-8c7c-32c9c9d8805e tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1544 microversion: 2.1 time: 0.198997 Oct 04 18:38:53.451046 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3204/6383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:53.617297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.618471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.626771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.627269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.627765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.628507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.628969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.629408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.781117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.795135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.802298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:53.802298 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35e6a0e3-9393-4738-93f0-bc3896277162 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.205090 Oct 04 18:38:53.802298 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3180/6384] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:53.945059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:53.946995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:53.962474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.963848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.964989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:53.966790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:53.968011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:53.968625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.220898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.231733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.237817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:54.237817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6e7c5e3-ad03-4f0b-967c-e39cab189b25 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.297001 Oct 04 18:38:54.243899 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3205/6385] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:53 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:54.498309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "name": "network-vif-plugged", "status": "completed", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:54.510733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.511607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.512218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.525381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] Creating event network-vif-plugged:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h1-833090-21 Oct 04 18:38:54.531317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f1211be2-55d7-42ba-b354-bdd066d847eb req-2d2ceb3c-6244-41fd-9c23-db2a00a959ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Oct 04 18:38:54.531997 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3181/6386] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:54.828023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:54.828882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:54.840143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.840995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.841644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.842576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:54.844068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:54.846208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:54.997976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.039686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.041629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.043918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3929a329-1a8e-4dd6-a42d-0a3a7d665c20 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.219981 Oct 04 18:38:55.060593 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3206/6387] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:54 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:55.263564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.264188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.273053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.273566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.274017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.274976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.275661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.276952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.575982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.588221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.594117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:55.596677 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74b65fe8-8be6-4ff8-8c4e-5949f0723aac tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.338058 Oct 04 18:38:55.599383 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3182/6388] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:56.083320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.084627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.100972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.103534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.104257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.106856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.108145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.108808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.193247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.208646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.211601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.213215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cba116d4-92c8-4035-85a7-db4650ed9266 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.134651 Oct 04 18:38:56.232801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3207/6389] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:38:56.626266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:56.627055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:56.646529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.646818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637c493d-f037-48eb-9f3f-1b20c54edfe2", "tag": "6a381338-d63a-45d2-ad20-69c5c80bc04f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:56.652135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.652947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.653959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.660799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.661497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.682373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:56.682864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:56.683306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:56.737558 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] Creating event network-changed:6a381338-d63a-45d2-ad20-69c5c80bc04f for instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 on n-h1-833090-21 Oct 04 18:38:56.748310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f755b51e-62df-4035-a042-a6124f89c9c0 req-42478742-bc43-4f03-8a97-e2f3ff54ca3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105378 Oct 04 18:38:56.750658 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3208/6390] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:56.962424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.973921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.976104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:56.979730 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4b997fea-ddfc-424d-85ef-b707221e0b8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.354994 Oct 04 18:38:56.982090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3183/6391] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:56 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:57.244975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:57.245871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:57.258379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.259680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.265218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.266382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:57.267200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:57.267848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:57.414075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.429436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.432099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:57.437975 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80fac5c0-3d73-4c4b-8c89-f50666e0a513 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1365 microversion: 2.47 time: 0.196325 Oct 04 18:38:57.439807 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3209/6392] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:57 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:58.016844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.022691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.047873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.051857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.052619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.058171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.058754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.059430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.397968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.402365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.409331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.410893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.412290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a4cc2c8-5d44-4864-b054-50efe8726c16 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.406065 Oct 04 18:38:58.424689 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3184/6393] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:58.475010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.477225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.489807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.497256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.497973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.498905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.499565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.500236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.585420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.596161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.597757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:58.599185 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02be94de-a50f-4ed6-836c-30cac9e5b677 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1371 microversion: 2.47 time: 0.127988 Oct 04 18:38:58.607582 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3210/6394] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:58 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:59.440045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.441282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.451947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.452809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.453449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.454354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.454984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.455615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.629331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:59.630696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:59.645277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.646961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.649404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.652362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:59.653024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:59.655055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:59.668032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.679658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.681435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.683381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b5a2ca1-f464-42bd-baff-69e4133d45e8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.247394 Oct 04 18:38:59.696331 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3185/6395] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:38:59.741778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.750973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.752492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:59.754028 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6097ede2-5f5c-43eb-948d-4eb6c72d9a9f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1371 microversion: 2.47 time: 0.128674 Oct 04 18:38:59.754864 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3211/6396] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:38:59 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:00.710877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.716762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.718929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.719602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.720049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.720982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.721442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.722057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.789280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:00.790071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:00.804574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.806268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.806862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.808491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:00.809161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:00.809803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:00.933633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.933633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.933633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:00.933633 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-66425fb0-dcc7-4904-a3b4-f586479cd5d2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1371 microversion: 2.47 time: 0.150501 Oct 04 18:39:00.952640 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3212/6397] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:00.994940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.011685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.013305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:01.014591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b0ecca0-66da-4325-ad85-0805470abec0 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.308043 Oct 04 18:39:01.015286 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3186/6398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:00 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:01.969366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:01.970080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:01.983176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.984004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.984635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:01.985549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:01.986210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:01.986646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.045227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:02.047952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:02.064125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.066312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.069019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.078276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:02.078276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:02.078276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:02.122109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.139959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.155574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.155574 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed1f8221-eb8f-4254-866d-7b384c4d50f1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1371 microversion: 2.47 time: 0.184843 Oct 04 18:39:02.155574 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3213/6399] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:01 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:02.303836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.313157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.315022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:02.316529 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae0559e9-6bd0-448a-bcff-1622a5129790 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.278748 Oct 04 18:39:02.318105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3187/6400] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:02 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:03.193990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.193990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.201283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.201778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.202215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.202970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.203423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.203865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.285759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.297853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.299817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.301022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c325ae7a-2d49-4b7f-bdc1-e084ba212df1 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1371 microversion: 2.47 time: 0.113623 Oct 04 18:39:03.301667 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3214/6401] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:03.348921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.349799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.367503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.368025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.369083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.374079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.374991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.375654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.560422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.573140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.574907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:03.576504 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08f403f1-89ab-4b11-9568-44400f502297 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.237683 Oct 04 18:39:03.597912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3188/6402] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:03 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:04.337018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.338401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.381133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.381133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.381133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.381133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.381844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.388191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.548356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.558390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.560347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.561539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4575eafa-91bd-4b70-be71-1684407b6801 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1356 microversion: 2.47 time: 0.228631 Oct 04 18:39:04.572331 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3215/6403] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:04.587780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.592228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.593374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Searching by: {'deleted': False, 'project_id': '33bed7a097b448428214ee79920daa96'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:39:04.600334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.601331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.601947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.602934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.603602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.604411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.613731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.614361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.624453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.624956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.625402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.626197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.626713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.627159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.825856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:39:04.867621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.870679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:04.878710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.880960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.882615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-727c634b-0aed-487d-983e-a9744c2691de tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.275657 Oct 04 18:39:04.883740 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3216/6404] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:04.932819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.940830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.941369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.941842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.961772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.966423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.048145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8336b0d-e16c-4911-bb01-07b55933d620 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.464486 Oct 04 18:39:05.049224 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3189/6405] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:05.093985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.094493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.101316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.101880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.102322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.103005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.103838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.103967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.144876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:05.483442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77f8d36c-7ff4-458d-bd90-d613d0ac9983 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 204 len: 0 microversion: 2.47 time: 0.393677 Oct 04 18:39:05.487406 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3217/6406] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:39:05 2022] DELETE /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:39:05.493153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.494288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.506539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.507031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.507481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.508380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.508633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.509058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.696050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.705040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.710002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.711234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a73ad28e-f613-4d7b-b1d8-cb92ab1b5d5f tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1362 microversion: 2.47 time: 0.222092 Oct 04 18:39:05.712172 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3190/6407] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:05.916916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.917921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.928817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.929582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.930215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.931331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.932996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.933624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.097189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.106719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.108859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.110258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3be75528-9893-4f5b-bd75-80b927952939 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.198692 Oct 04 18:39:06.119820 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3218/6408] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:06.745083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.745762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.756759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.762437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.762437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.762437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.762437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.762437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.835825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.845075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.846523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.848027 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75ebfa82-8f72-4e54-b2db-5ab9e7999ba2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1362 microversion: 2.47 time: 0.108014 Oct 04 18:39:06.848655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3191/6409] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1362 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:07.144230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.144230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.145342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.146100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.146668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.160569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.161059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.161501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.305476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.318404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.320386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.323395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad80df54-a4b3-4811-9586-e3eea1642979 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1737 microversion: 2.20 time: 0.190446 Oct 04 18:39:07.339531 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3219/6410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:07.874248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.874975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.882039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.882633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.883234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.883966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.884427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.885384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.924389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.924880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.925322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.925769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lazy-loading 'fault' on Instance uuid 0ff27b5a-e97a-473c-ac18-dc51afd4b29d {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:07.969290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.979410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.981172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:07.982362 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a934c506-c186-4b93-af86-79b705e9c1e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 200 len: 1367 microversion: 2.47 time: 0.112450 Oct 04 18:39:07.983628 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3192/6411] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:08.354471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:08.355086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:08.362256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.362746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.363283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.363981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:08.364445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:08.364881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:08.561809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.578102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.578102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:08.578491 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a6b60ef-be32-4f40-884e-5df0c6e5c0f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1719 microversion: 2.20 time: 0.228434 Oct 04 18:39:08.579032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3220/6412] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:08 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:09.009705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.011910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 0ff27b5a-e97a-473c-ac18-dc51afd4b29d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.026085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.026085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.026085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.029478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.030700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.031537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.053076 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] HTTP exception thrown: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Request method failure captured: Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d HTTP/1.1 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH2YzJj2uOGSvh8KHLfmlCaRrYsP8NqfQBmZbNBLaNhy-7jOVtnwhtSxlK_tgtPnz3OvLGgueFTulNu5qepxEuyRFqeykDGnQ8TRNCXT4DT1ZmbuP__ubYIj6bBV1LJKqirqpKWAE-d_Wd2l7m3nEV-cqDDq2C4FAIi8Djkb_i9s510 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 33bed7a097b448428214ee79920daa96 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_33bed7a097b448428214ee79920daa96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33bed7a097b448428214ee79920daa96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33bed7a097b448428214ee79920daa96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/33bed7a097b448428214ee79920daa96"}]}] Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 33bed7a097b448428214ee79920daa96 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerShowV247Test-1984771791-project Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: ff1a582aff1d4840933edcc205da2196 Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerShowV247Test-1984771791-project Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '0ff27b5a-e97a-473c-ac18-dc51afd4b29d'} Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:09.055193 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Returning 404 to user: Instance 0ff27b5a-e97a-473c-ac18-dc51afd4b29d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6076940a-8f56-4d06-a951-5a71c1f155af tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d" status: 404 len: 111 microversion: 2.47 time: 0.052422 Oct 04 18:39:09.061729 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3193/6413] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/0ff27b5a-e97a-473c-ac18-dc51afd4b29d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:39:09.067212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.068226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.075333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.076341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.077141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.083079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.083079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.083079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.106216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:09.471172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cc2090c8-b4e8-4c36-a18a-80b03eccd8ad tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 204 len: 0 microversion: 2.47 time: 0.407539 Oct 04 18:39:09.474220 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3221/6414] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:39:09 2022] DELETE /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:39:09.482778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.483563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.490452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.491145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.491555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.492354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.492740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.493173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.577845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.588713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.590185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.591865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20dfb4c5-3daa-4c90-8a72-ade6596f04b2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 200 len: 1362 microversion: 2.47 time: 0.113900 Oct 04 18:39:09.592597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3194/6415] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 1362 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:09.618148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:09.618857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:09.629923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.630804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.634918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.642998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:09.645455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:09.647449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:09.875647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.884702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.886495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:09.887746 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82893849-d10d-4c06-96c1-31aa79dbb415 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1719 microversion: 2.20 time: 0.274610 Oct 04 18:39:09.894023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3222/6416] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:09 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:10.618472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.619153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.626817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.627334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.627806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.628507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.628993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.629425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.694602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.703518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.704965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:10.706352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df957c7e-7c65-4297-b27c-e98ba6e349e2 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 200 len: 1362 microversion: 2.47 time: 0.092133 Oct 04 18:39:10.706915 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3195/6417] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 1362 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:10.914177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:10.915214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:10.923594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.924087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.924531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:10.925240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:10.925744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:10.926181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.108144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.116597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.118211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.120048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-086f43bc-c8d4-4476-95c9-5b173529d345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1662 microversion: 2.20 time: 0.209273 Oct 04 18:39:11.120738 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3223/6418] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:10 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1662 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:11.145881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5740e029-f4e0-4425-b287-edffd97496d8"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:11.148333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.155268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.155809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.156252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.156971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.157426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.158073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.735230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:11.735956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:11.744024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.744528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.744973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.745685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.746328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.746943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.785155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:11.785810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:11.786163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:11.786658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lazy-loading 'fault' on Instance uuid 1b3c969b-9fb1-44f0-afa2-26094ccbe592 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:11.828658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.837489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.839745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff1a582aff1d4840933edcc205da2196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bed7a097b448428214ee79920daa96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:11.841124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb2d84fe-6160-4c21-bd24-e2ef5468d258 tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 200 len: 1367 microversion: 2.47 time: 0.109740 Oct 04 18:39:11.841700 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3224/6419] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:11 2022] GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 1367 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:12.342956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4bffe5da-65f7-4d7e-be1b-af0d32a71f9f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.200890 Oct 04 18:39:12.343536 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3196/6420] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 4 18:39:11 2022] POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 188 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:12.482436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "name": "network-vif-unplugged", "status": "completed", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:12.501237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.502038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.502788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.513641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:12.514253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.521134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.521636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.522725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.523459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.523941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.524372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.531234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.compute.server_external_events [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] Unable to find a host for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1. Dropping event network-vif-unplugged {{(pid=123887) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:39:12.532203 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-22a558f4-a517-4e89-98e2-50f1234694e2 req-f8b4c567-4785-44e6-a069-2e433fd5bd8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054662 Oct 04 18:39:12.533211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3225/6421] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:39:12.749411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:39:12.859315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:12.868324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:12.868940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] [instance: 1b3c969b-9fb1-44f0-afa2-26094ccbe592] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:12.875853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.876338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.876774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.877478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:12.877930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:12.878348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:12.893465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] HTTP exception thrown: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Request method failure captured: Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 HTTP/1.1 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH2YzJj2uOGSvh8KHLfmlCaRrYsP8NqfQBmZbNBLaNhy-7jOVtnwhtSxlK_tgtPnz3OvLGgueFTulNu5qepxEuyRFqeykDGnQ8TRNCXT4DT1ZmbuP__ubYIj6bBV1LJKqirqpKWAE-d_Wd2l7m3nEV-cqDDq2C4FAIi8Djkb_i9s510 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 33bed7a097b448428214ee79920daa96 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_33bed7a097b448428214ee79920daa96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33bed7a097b448428214ee79920daa96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/33bed7a097b448428214ee79920daa96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/33bed7a097b448428214ee79920daa96"}]}] Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 33bed7a097b448428214ee79920daa96 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerShowV247Test-1984771791 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerShowV247Test-1984771791-project Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: ff1a582aff1d4840933edcc205da2196 Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerShowV247Test-1984771791-project Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1b3c969b-9fb1-44f0-afa2-26094ccbe592'} Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:12.895136 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] Returning 404 to user: Instance 1b3c969b-9fb1-44f0-afa2-26094ccbe592 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-250e45c1-a306-4a11-af33-ffff676362ac tempest-ServerShowV247Test-1984771791 tempest-ServerShowV247Test-1984771791-project] 10.222.0.40 "GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592" status: 404 len: 111 microversion: 2.47 time: 0.032301 Oct 04 18:39:12.901032 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3226/6422] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:12 2022] GET /compute/v2.1/servers/1b3c969b-9fb1-44f0-afa2-26094ccbe592 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:39:13.053315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a5a4c8d0-9a61-42ff-ad8e-ac05849d978d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/action" status: 202 len: 0 microversion: 2.20 time: 0.544476 Oct 04 18:39:13.054366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3197/6423] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:39:12 2022] POST /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:13.062804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:13.063400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:13.072962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:13.227828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.238236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.239759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:13.240952 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-920ac1c9-67d8-477c-96f1-8c495f9a0a68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1748 microversion: 2.20 time: 0.182228 Oct 04 18:39:13.249748 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3227/6424] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:13 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1748 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:14.269719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:14.271288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:14.286986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.287396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.292156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.292156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:14.292156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:14.292156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:14.702981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:14.927432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:14.954597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.964955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.966856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:14.971539 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a321d6c3-ce59-4309-91fd-6e62276ff9b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1748 microversion: 2.20 time: 0.703940 Oct 04 18:39:14.972152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3198/6425] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:14 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1748 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:15.533714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1918589123", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": "none"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:15.594678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:15.595182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:15.595691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:15.596328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:15.596761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:15.605719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.606204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.606637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.607409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:15.607841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:15.608266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:15.625565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Getting quotas for project c6be52c2194a43099e874807c3f77fe4. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:15.631066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Getting quotas for user e6dc5daa26c940b78259b71cfa7c3108 and project c6be52c2194a43099e874807c3f77fe4. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:15.644122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:39:15.646464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:39:16.001135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.001754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.009510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.010542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.010981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.011834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:16.012246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:16.012677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:16.115208 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-924bf284-7a8a-40c2-91ae-7584b69dc4c2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.765424 Oct 04 18:39:16.116375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3228/6426] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:39:16.133042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:16.133042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:16.199644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.210587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.212428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.214123 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-776053f3-2cfa-474c-844d-47be72cf7eba tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.217518 Oct 04 18:39:16.214959 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3199/6427] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:15 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:16.316441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.333772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.335247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:16.336446 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d08f0620-3950-424e-8cf9-2b187ccfa8b7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1278 microversion: 2.54 time: 0.212295 Oct 04 18:39:16.337017 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3229/6428] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:16 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1278 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:17.246679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:17.248393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:17.274913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.276598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.277256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.281115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:17.281804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:17.282444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:17.364104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:17.365349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:17.472310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.482206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.488120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.494375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f41966ba-8ce8-4bd6-9bab-fe14cbe858c7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1278 microversion: 2.54 time: 0.134368 Oct 04 18:39:17.495224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3230/6429] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:17 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:17.500669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.511550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.513482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:17.515006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6bda5908-f3fe-4fd8-89e8-c31b5825a066 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.272994 Oct 04 18:39:17.515854 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3200/6430] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:17 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:18.520857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:18.522247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:18.538092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.539406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.540012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.541884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.542795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.543457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.544291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:18.549152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:18.564911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.565441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.567996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.572037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:18.572037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:18.575314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:18.696929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.717792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.719572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.720983 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5443c99c-acc8-4cca-a0b7-b0cbcc469e35 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1330 microversion: 2.54 time: 0.204102 Oct 04 18:39:18.722165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3231/6431] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:18 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1330 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:18.801850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.815105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.819880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:18.819880 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50e5a485-8587-4d15-864e-374ad3d9845a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.278696 Oct 04 18:39:18.820618 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3201/6432] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:18 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:19.755202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.757795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.766765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.767867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.769248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.770539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.771827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.772682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.853802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:19.856796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:19.903982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.905399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.906067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.907700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:19.908427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:19.909085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:19.990105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.005477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.009237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.010628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-466d50b7-4ea1-4b88-8cb3-adc6aec52a29 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1348 microversion: 2.54 time: 0.260916 Oct 04 18:39:20.011687 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3232/6433] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1348 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:20.093293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.102445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.104432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:20.105644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e5338fe-6ff6-4d79-a224-d6129c2a0f5a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.261450 Oct 04 18:39:20.106216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3202/6434] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:19 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:21.043539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.044961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.076162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.077004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.077711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.078654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.080308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.081158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.084707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:21.088776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.115147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:21.118137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.119362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.121868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.123952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.126205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.127050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.233931 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-537466b2-ef71-4699-bcf2-ac916063e277 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2/action" status: 200 len: 24574 microversion: 2.1 time: 0.154066 Oct 04 18:39:21.235349 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3203/6435] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:21 2022] POST /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2/action => generated 24574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:21.241717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:21.243063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:21.262260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.263280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.264214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.265579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:21.266230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:21.266960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:21.580494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.596701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.602543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.606893 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-543b5793-9820-40eb-aca1-42ed58573b6b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.370596 Oct 04 18:39:21.610809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3204/6436] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:21.706800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.709249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:21.723069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.727454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:21.729617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62efea7d-65c4-445e-b0a1-9443f1398a96 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1336 microversion: 2.54 time: 0.691298 Oct 04 18:39:21.731255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3233/6437] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:21 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1336 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:22.656346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:22.656346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.661576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.662062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.662496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.664163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.664630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.665201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.761382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:22.762722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:22.786613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.788269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.788926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.792022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:22.798455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:22.798455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:22.939528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.948091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.956438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.957956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.959902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.960045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:22.961235 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ceccb0a3-a31a-4a9a-91bc-fba77fae7051 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1750 microversion: 2.20 time: 0.314897 Oct 04 18:39:22.962094 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4526305e-88fe-4842-b3ad-6c6c0589d2b1 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1336 microversion: 2.54 time: 0.205337 Oct 04 18:39:22.963910 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3234/6438] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:22.967836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3205/6439] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:22 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1750 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:23.991916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:23.992678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.002510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.010111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.011382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.013642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:24.015679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.016497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.018089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.020636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.021351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.026306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.026884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.027401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.031345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.033058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.033058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.110010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-348bf3c6-8ea5-4596-8117-45c474758fff tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/ips" status: 200 len: 151 microversion: 2.1 time: 0.469402 Oct 04 18:39:24.110675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3235/6440] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/ips => generated 151 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:24.125954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:24.126618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:24.143039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.143578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.150727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.150727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:24.150727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:24.150727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:24.162236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.186208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.188345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.189777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69e07834-a1e8-4725-a6b4-6affdeaf37dd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1336 microversion: 2.54 time: 0.204893 Oct 04 18:39:24.203251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3206/6441] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:23 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1336 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:24.366817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.376468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.377906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:24.379117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-468d1726-9d98-4518-ab2b-a0bf64fe0159 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.267256 Oct 04 18:39:24.379719 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3236/6442] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:24 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:25.235005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.235782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:25.252484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.253507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.254716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.256953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.260440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.261708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.386541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.405482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.410070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.410215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:25.410215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:25.412382 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c95ea51e-7d9e-435f-9a1e-ea325e5e2e25 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1357 microversion: 2.54 time: 0.181067 Oct 04 18:39:25.417267 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3207/6443] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:25.419775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.420277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.420721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.425585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.426794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.429170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.447396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b888215f-ed57-4926-9433-18f9238fcb46 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Action: 'create', calling method: .version_select at 0x7f9008230820>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-334322603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvjUlSp0ISlLvJDtYxWekiSiaowRwzVdT2ITt8FpVbvTvTnrs/yngDEdWoMfuq+j5rCbGNMC7ME9owW4Q6cfCIlMO02H5lClLyukqpadTxi672jw1w2TlRjjXa2B+JSLQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:25.490160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b888215f-ed57-4926-9433-18f9238fcb46 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Getting quotas for project c6be52c2194a43099e874807c3f77fe4. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:39:25.506448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b888215f-ed57-4926-9433-18f9238fcb46 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Getting quotas for user e6dc5daa26c940b78259b71cfa7c3108 and project c6be52c2194a43099e874807c3f77fe4. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:39:25.615571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:25.621551 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b888215f-ed57-4926-9433-18f9238fcb46 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.179486 Oct 04 18:39:25.628147 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3208/6444] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:39:25 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:39:25.641406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-334322603", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:25.646753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:25.656677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.657530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.658430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.659424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:25.660160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:25.661312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:25.813916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:39:25.813916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:39:25.813916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:39:25.813916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:39:25.813916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:39:25.814462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.820778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.826647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:25.830113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92e47fee-ecc1-4848-9b99-dfa89183a5ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.427095 Oct 04 18:39:25.831825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3237/6445] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:25 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:26.262715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.287389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.288954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.292094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.293214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.301683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.302649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.349515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01eb0461-a109-4e36-82a8-ceec57d7afea tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "POST /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3/action" status: 202 len: 1139 microversion: 2.54 time: 0.713854 Oct 04 18:39:26.350546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3209/6446] 10.222.0.40 () {62 vars in 1320 bytes} [Tue Oct 4 18:39:25 2022] POST /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3/action => generated 1139 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:39:26.378445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:26.382138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.383049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.391993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.392850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.393538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.395073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.395977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.396258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.398951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.403525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.403525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.434599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] Creating event network-changed:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h2-833090-21 Oct 04 18:39:26.453441 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-77e09ba4-ba40-4586-ae4f-05a9a99c5edb req-3e256b68-e9c0-4ce6-b620-745a84df0fc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079710 Oct 04 18:39:26.454630 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3210/6447] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:26.710371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.727072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.731008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:26.733371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5a3fabb-5769-4fc7-87bd-86e8928bb4e7 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.364028 Oct 04 18:39:26.747951 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3238/6448] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:26.869086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:26.870625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:26.878155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.879111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.879849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:26.883155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:26.884070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:26.885982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.224466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.236997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.238384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.240568 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c43a9de-b632-4636-8b3b-5951b72a149c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.383891 Oct 04 18:39:27.255340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d8d2cd-8d4c-470c-b683-4ca687ab0349"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:27.255340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.260942 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3211/6449] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:26 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:27.271720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.272359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.272866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.273645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.278945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.279640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.477608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:27.777532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:27.778354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:27.798548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.799870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.800576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.801465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:27.802255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:27.803144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:27.894512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.904860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.908980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:27.930238 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4ed3573-3a35-46cc-80d9-7d98b3ae2e77 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.151860 Oct 04 18:39:27.930238 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3212/6450] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:27 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:28.270925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.271725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.299208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.302023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.303457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.307219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.307761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.312008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.444040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6a711274-f5bd-4712-9e10-5f01f66ac89d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207982 Oct 04 18:39:28.444822 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3239/6451] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:39:27 2022] POST /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:28.948933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:28.949963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:28.970815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.971325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.976183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:28.977374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:28.987636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:28.988436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:29.020176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.025307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:29.040393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.051660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.058090 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ebb60beb-c636-4f51-ae2c-1119cb7994e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.789526 Oct 04 18:39:29.060704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3213/6452] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:29.866936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.878476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.888470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:29.894116 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a6f0786-de70-4dff-a09c-2ac5e15a58aa tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.950580 Oct 04 18:39:29.899357 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3240/6453] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:28 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:30.088740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.089513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.100459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.103517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.104140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.105970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.107406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.112587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.453173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.464297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.466460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:30.470104 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b06ff94a-7dd9-47ca-9212-f86fd93d7d36 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.384047 Oct 04 18:39:30.470104 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3214/6454] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:30.929262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:30.930706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:30.964887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.967066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.969139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:30.972685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:30.973423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:30.974197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.184051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.196463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.200538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:31.202862 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b4c10bd-95ee-48ca-a1f7-e375a78cfff8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.280694 Oct 04 18:39:31.203785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3241/6455] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:30 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:31.503078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:31.505094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:31.517882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.517882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.518508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:31.520222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:31.521932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:31.523339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.237652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:32.238907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.260929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.266006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.267883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.273513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.276428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.277164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.464957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.482541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.484624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.486257 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8c1d5ea-3e10-43d4-b995-e8dd54095a2c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.255094 Oct 04 18:39:32.496261 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3242/6456] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:32 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:32.501735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:32.504343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:32.517102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.517993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.521940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.523140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:32.523891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:32.524568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:32.611760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7815aa26-b69f-47fc-b178-624634e060ae tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "POST /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2/action" status: 200 len: 32646 microversion: 2.1 time: 0.113658 Oct 04 18:39:32.612619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3243/6457] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:39:32 2022] POST /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2/action => generated 32646 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:39:32.653980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.678229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.684434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:32.686270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-888e22a3-999e-4df9-853f-2cd9158fdf37 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 1.189872 Oct 04 18:39:32.688080 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3215/6458] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:31 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:33.526442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.526442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:33.624358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.626511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.626973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.627752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:33.628214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:33.628641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:33.799628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-37a8b48c-3047-43f1-8a31-bfe36e64b444 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2107526202", "availability_zone": "foo_zone"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:33.804291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.aggregate [None req-37a8b48c-3047-43f1-8a31-bfe36e64b444 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Generated uuid 49d3d66c-9490-484d-ab04-feff3caf3bda for aggregate {{(pid=123886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:39:33.931380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.948372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.956485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:33.966095 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-950151ac-12f6-40e7-93fe-3fd192e8905f tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.452650 Oct 04 18:39:33.969629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3244/6459] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:33.977252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-37a8b48c-3047-43f1-8a31-bfe36e64b444 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.324152 Oct 04 18:39:33.979330 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3216/6460] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 4 18:39:33 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:33.983807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:33.986491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:34.001633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-685e9451-b2a4-48c4-9d0d-e9aa8b625d74 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.002444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.005107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.005735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.006594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.011024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.011901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.164124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-685e9451-b2a4-48c4-9d0d-e9aa8b625d74 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.167192 Oct 04 18:39:34.164124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3217/6461] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:39:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:34.176011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.191051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.196584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.196584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.196584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.196584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.196584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.306119 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-73340ae7-ac98-41e8-ab6c-56ba09e7a542 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.134913 Oct 04 18:39:34.307088 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3218/6462] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:34.319052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d208a9d5-1f75-4777-93bb-781068f847c2 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.331446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d208a9d5-1f75-4777-93bb-781068f847c2 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016348 Oct 04 18:39:34.332061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3219/6463] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:34.344408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7eeb2a2a-7332-4ca7-9fc1-b7eda1061ca5 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.366083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eeb2a2a-7332-4ca7-9fc1-b7eda1061ca5 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:34.366667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eeb2a2a-7332-4ca7-9fc1-b7eda1061ca5 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:34.371632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eeb2a2a-7332-4ca7-9fc1-b7eda1061ca5 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:34.468782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.490678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.495972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:34.499402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f2f016e-6f32-4266-b3cd-7816a95de04c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.526763 Oct 04 18:39:34.500306 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3245/6464] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:33 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:34.803309 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7eeb2a2a-7332-4ca7-9fc1-b7eda1061ca5 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.462059 Oct 04 18:39:34.804672 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3220/6465] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:39:34 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:34.819079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eeccd156-29d5-4af8-b3b7-fc95824e3a1b tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:34.835880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eeccd156-29d5-4af8-b3b7-fc95824e3a1b tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.014687 Oct 04 18:39:34.836575 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3246/6466] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:34.848946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22163ea9-2dd9-4150-ac59-128a8de73321 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1665794507", "availability_zone": "foo_zone"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:34.999877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.000926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.023349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.038997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.039654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.041023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.041565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.042202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.055275 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22163ea9-2dd9-4150-ac59-128a8de73321 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.210007 Oct 04 18:39:35.066928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3221/6467] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 4 18:39:34 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:35.083510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-698e05b7-d87b-4c4b-85b7-72b8fda0ef89 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:35.223131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.260923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.277521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:35.281663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1030504d-e29a-4f00-8b89-3edae8ce0a04 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.288133 Oct 04 18:39:35.285272 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3247/6468] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:34 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:35.319440 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-698e05b7-d87b-4c4b-85b7-72b8fda0ef89 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.240280 Oct 04 18:39:35.321178 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3222/6469] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:39:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:39:35.409024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5100ba8-98cc-46eb-9bc2-8f030d27fe78 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.432968 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5100ba8-98cc-46eb-9bc2-8f030d27fe78 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.020989 Oct 04 18:39:35.432968 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3248/6470] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 4 18:39:35 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:35.448163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c8d1a28-bb97-48a0-b2bb-a10819af9ebc tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-21"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:35.461794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:35.461794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:35.469601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.472995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a28-bb97-48a0-b2bb-a10819af9ebc tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.473733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.474371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.475042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a28-bb97-48a0-b2bb-a10819af9ebc tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.475983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.476747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c8d1a28-bb97-48a0-b2bb-a10819af9ebc tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.480053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.481750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.537973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:35.538721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:35.930000 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c8d1a28-bb97-48a0-b2bb-a10819af9ebc tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.490045 Oct 04 18:39:35.931069 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3223/6471] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 4 18:39:35 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:35.944135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637c493d-f037-48eb-9f3f-1b20c54edfe2", "tag": "6a381338-d63a-45d2-ad20-69c5c80bc04f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:35.970982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:35.971705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:35.972329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:35.995347 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] Creating event network-changed:6a381338-d63a-45d2-ad20-69c5c80bc04f for instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 on n-h1-833090-21 Oct 04 18:39:36.018769 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-676f2623-559f-4465-ac8d-3bd7037ec9a4 req-c425561d-71a7-4440-b347-a80080ad08a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085549 Oct 04 18:39:36.019768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3224/6472] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:36.026914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.027863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.055865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.056762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.061267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.062227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.062879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.063613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.070254 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcd98acb-b809-4c3f-80b3-cb5ea298ec65 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 204 len: 0 microversion: 2.1 time: 0.616747 Oct 04 18:39:36.074362 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3249/6473] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:35 2022] DELETE /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:36.077170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6027a18c-3b76-4172-84da-2803761169b8 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.186290 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6027a18c-3b76-4172-84da-2803761169b8 tempest-TestAggregatesBasicOps-1300774257 tempest-TestAggregatesBasicOps-1300774257-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.113340 Oct 04 18:39:36.192870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3250/6474] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 18:39:36 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:39:36.196969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.197716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.207339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.214320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.215050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.216050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.216701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.217334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.276712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:36.564333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.576410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a6e4eab-f2af-4db3-b105-efe975c2dc1b tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1669 microversion: 2.1 time: 0.387818 Oct 04 18:39:36.580551 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3251/6475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:36.589723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:36.592038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:36.611932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.612724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.613350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.614644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:36.615383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:36.616004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:36.635286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.651728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.655950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.665009 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a19325c8-b29c-4300-a2d6-2e4877dbc3b6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.636382 Oct 04 18:39:36.683696 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3225/6476] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:36.760259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.770596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.773146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:36.777441 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1bedaf29-87a2-4f3b-a1fc-5a106a9c0e2e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.193984 Oct 04 18:39:36.778964 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3252/6477] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:36 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:37.606248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.607038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.610381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:37.627124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.631950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.631950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.632482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.636064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.636888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.699349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:37.700799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:37.725511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.726193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.726801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:37.727724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:37.728521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:37.729262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.257339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.260624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.302757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.304849 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6c04fec4-a073-4349-93d4-d8b3818b2ea8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1669 microversion: 2.1 time: 0.703175 Oct 04 18:39:38.311994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3226/6478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1669 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:38.318427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.325683 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7f15f80-1de5-4b8c-97de-a46d1cceaa83 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.625814 Oct 04 18:39:38.337467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:38.337467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:38.343379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3253/6479] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:37 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:38.356645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.357228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.362563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.370967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:38.370967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:38.370967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:38.682994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.701404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.711244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:38.717158 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-77313306-743e-4cc6-9108-ae2a16d7cbe8 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.403830 Oct 04 18:39:38.719263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3227/6480] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:38 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:39.334476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.335154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.355252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.355907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.364355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.366592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.372316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.373087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.373610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.374040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.378493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.378995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.379434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.380148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.388344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.390249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.802903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.806651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.812650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbec6155-db7b-449a-a63a-49518a7a0ae2 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1669 microversion: 2.1 time: 0.482580 Oct 04 18:39:39.813024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3254/6481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:39.818669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.825675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:39.827272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b61b079-b105-49a7-a2dd-467fe1fb270f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.476757 Oct 04 18:39:39.831114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3228/6482] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:39.859360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:39.860012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:39.882504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.887203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.889590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:39.898789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:39.899857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:39.900533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.122764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.132408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.134157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:40.148629 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17c2d5a2-2312-4a3d-96e4-99f8a423722d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.311412 Oct 04 18:39:40.160047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3255/6483] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:39 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:40.193685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637c493d-f037-48eb-9f3f-1b20c54edfe2", "name": "network-vif-deleted", "tag": "6a381338-d63a-45d2-ad20-69c5c80bc04f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:40.238610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.241340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.241993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.277911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] Creating event network-vif-deleted:6a381338-d63a-45d2-ad20-69c5c80bc04f for instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 on n-h1-833090-21 Oct 04 18:39:40.294260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bbc59abf-d2c4-4230-8026-a33aa9ca73fe req-1b173b44-100f-4f6b-9b6d-208a5f7c441f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106558 Oct 04 18:39:40.296750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3229/6484] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:40.871307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.871307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.872828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:40.874425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:40.893894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.899571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.899571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.899571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.899571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.899571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.914807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.915365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.915846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.916582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.919795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.931769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:40.993764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:40.996014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:40.998911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.000005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lazy-loading 'fault' on Instance uuid 637c493d-f037-48eb-9f3f-1b20c54edfe2 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:41.079329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951ccbba14794d7b9fa02a1620e5af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6beb5e2f8bc1401f9c603fbf38ed4d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.097645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd073e4e-2659-48aa-8950-9e18e37e01d8 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 200 len: 1337 microversion: 2.1 time: 0.257470 Oct 04 18:39:41.099360 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3256/6485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 1337 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:41.179233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:41.179887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:41.194718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.196296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.197299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.203081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:41.204273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:41.205279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:41.304731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.320134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.325914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.330166 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4f31944a-d061-4b80-abba-16783722b7dc tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.154746 Oct 04 18:39:41.337425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3257/6486] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:41 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:41.466823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.480668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.487413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:41.489839 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12f52f97-9538-462a-a18d-981baca4fa54 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.628686 Oct 04 18:39:41.491344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3230/6487] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:40 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:42.128322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.128322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] [instance: 637c493d-f037-48eb-9f3f-1b20c54edfe2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.133941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.134957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.135402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.136133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.136594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.137022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.151586 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] HTTP exception thrown: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Request method failure captured: Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 HTTP/1.1 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHzEtqEHeIuIDekq0bsD2_86NPzXKepjeb8sryj02JyFnwj155N3CHyUD6a_mWjcNuki-3hsaqk7tKCYl3hxkzKNAYsyLN0C1XdIb0GlwT77dJIcZ5J7btg73HUyqV-6Tc9Q-bWl5B4RKEnQ7DUHZ83X5dVZiuw-waiyJgg_OSllRMw Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6beb5e2f8bc1401f9c603fbf38ed4d4c"}]}] Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6beb5e2f8bc1401f9c603fbf38ed4d4c Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkBasicOps-1062773251 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 951ccbba14794d7b9fa02a1620e5af93 Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkBasicOps-1062773251-project Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '637c493d-f037-48eb-9f3f-1b20c54edfe2'} Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:42.152812 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Returning 404 to user: Instance 637c493d-f037-48eb-9f3f-1b20c54edfe2 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a7ac7cf-0e0f-4d0e-b3ff-2cbcd6dd5511 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2" status: 404 len: 111 microversion: 2.1 time: 0.032383 Oct 04 18:39:42.157910 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3258/6488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/637c493d-f037-48eb-9f3f-1b20c54edfe2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:39:42.361388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.362625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.375325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.377928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.380286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.383758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.384463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.387482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.508802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.520744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.521464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:42.522786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:42.527059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.531796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d686a941-f25e-4396-82d4-df716b0c68b9 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.172762 Oct 04 18:39:42.532394 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3231/6489] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:42.558952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.561574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.563758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.568253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:42.569903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:42.570469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:42.737442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.753536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.755014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:42.756346 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-29cf2ae3-0eea-4f3c-b610-526ee2073267 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.239478 Oct 04 18:39:42.765275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3259/6490] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:42 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:43.474150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5831d5bd-4fce-4c50-8b86-1feb7e7dea81 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] Calling method '.version_select at 0x7f900815bee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.568733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.569931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.578163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.579169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.579860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.580855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.581536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.582185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.641871 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5831d5bd-4fce-4c50-8b86-1feb7e7dea81 tempest-TestNetworkBasicOps-1062773251 tempest-TestNetworkBasicOps-1062773251-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-529439734" status: 202 len: 0 microversion: 2.1 time: 0.172025 Oct 04 18:39:43.646285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3232/6491] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 18:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-529439734 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:43.758777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.783640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:43.786521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:43.788840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.790345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:43.801019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88413a4e-dbf5-4a75-91c8-3d14693cda65 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.237368 Oct 04 18:39:43.805303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.806610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.808077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:43.808411 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3260/6492] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:43.811213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:43.812752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:43.818293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.003619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.014441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.017099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:44.019967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fbc1eab-f969-45c0-a244-b3b5114fa9e7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.241399 Oct 04 18:39:44.020997 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3233/6493] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:43 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:44.847005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:44.847709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:44.855773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.856270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.856709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:44.857439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:44.857879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:44.858327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.049683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:45.050297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:45.052325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:45.058515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.059051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.059509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.060279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:45.060741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:45.061170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:45.155507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.170883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.173390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.174967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d701d00-41aa-4b2d-8587-19cbf2eb57ba tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.332047 Oct 04 18:39:45.176104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3261/6494] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:44 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:45.221323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.231035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.232607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:45.233900 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c03eaac-c0f1-4347-8891-feb07dd94ea7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.188186 Oct 04 18:39:45.234546 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3234/6495] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:45 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:46.202597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.203306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.211111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.211716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.212233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.212949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.213503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.213942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.260335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:46.267177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:46.269403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.269974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.270615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.271350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:46.271829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:46.272284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:46.341459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.350134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.353824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.355184 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-33b5cd53-ca6f-4015-a04b-063d3281887d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.156899 Oct 04 18:39:46.356000 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3262/6496] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:46.427115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.436948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.438475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:46.439695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d3a56333-1805-4be2-95bf-4e2b698634d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.183360 Oct 04 18:39:46.460057 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3235/6497] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:46 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:47.382776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.385021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.393011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.393934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.399825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.400742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.401215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.401886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.471962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:47.478019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:47.486533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.487361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.488017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.489247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:47.490109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:47.490751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:47.524697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.534310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.541280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.550725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-747bac63-181e-48c6-b792-e0eeea4fdfa0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.172264 Oct 04 18:39:47.552714 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3263/6498] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:47.809660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.824752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.834371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:47.837361 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-784855e8-a59c-4c0f-af3b-4b6b8ede8857 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.369052 Oct 04 18:39:47.852157 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3236/6499] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:47 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:48.579883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.581138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.589581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.590293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.590902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.591850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.592527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.593132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.731245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.741659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.743373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:48.744820 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d519cda5-87de-4676-9b48-b2d5ae9ed034 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.170077 Oct 04 18:39:48.745632 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3264/6500] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:48.868581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:48.869463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:48.877494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.878221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.878854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:48.879664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:48.880124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:48.881263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.153966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.164446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.166315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.167853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-189a8b72-307b-4ce6-87b2-13f2995b5478 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.305273 Oct 04 18:39:49.168609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3237/6501] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:48 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:49.774660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:49.775308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.782941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.783450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.783951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.784730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.785372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.785804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.864106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.881217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.883547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:49.885560 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5cbd596-7a0e-43ae-97ca-21aece015dad tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.115392 Oct 04 18:39:49.897759 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3265/6502] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:49 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:49.903765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d8d2cd-8d4c-470c-b683-4ca687ab0349"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:49.906262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:49.913118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.915216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.915216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:49.915216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:49.916148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:49.916356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.042314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments HTTP/1.1 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 74 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: {"volumeAttachment": {"volumeId": "a0d8d2cd-8d4c-470c-b683-4ca687ab0349"}} Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: exception: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': 'fb5746e2-4945-469f-993c-532db1c6c770', 'body': {'volumeAttachment': {'volumeId': 'a0d8d2cd-8d4c-470c-b683-4ca687ab0349'}}} Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:39:50.044823 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 400 to user: Invalid volume: volume a0d8d2cd-8d4c-470c-b683-4ca687ab0349 is already attached to instances: fb5746e2-4945-469f-993c-532db1c6c770 {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae1b1909-acfe-4f8e-895b-f87f4077cd5d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147129 Oct 04 18:39:50.050949 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3238/6503] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:39:49 2022] POST /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:39:50.132062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.132062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.136328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.136819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.141121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.142485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.154141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.154354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.193806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.194425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.206829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.206829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.206829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.206829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.209685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.210757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.216376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:50.277398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'services' on Instance uuid fb5746e2-4945-469f-993c-532db1c6c770 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:50.418734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.428738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.430367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:50.431659 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4410768a-6bc5-4ba5-8d9a-4d339789f2ae tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.242010 Oct 04 18:39:50.434712 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3239/6504] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:50.535029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd5ce7c4-3848-460f-abf8-d9723563a631 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments/a0d8d2cd-8d4c-470c-b683-4ca687ab0349" status: 202 len: 0 microversion: 2.1 time: 0.410391 Oct 04 18:39:50.537960 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3266/6505] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:39:50 2022] DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments/a0d8d2cd-8d4c-470c-b683-4ca687ab0349 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:50.545895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.548478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.554699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.555256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.555792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.558406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.559089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.559548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.592406 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df044c47-f093-4074-ad5d-e2080764ab7e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052189 Oct 04 18:39:50.592988 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3240/6506] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:50.913040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:50.913888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:50.920417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.922122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.922122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.922122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:50.923163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:50.923163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:50.939402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:50.997423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.011180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.013428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.016111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07675e5c-6581-48e1-9b02-6e08e285a8cb tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.108193 Oct 04 18:39:51.019031 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3267/6507] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:50 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:51.458318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.459146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.469166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.469476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.470365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.471137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.471926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.472438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.605682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:51.608454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:51.615711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.616347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.616792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.617490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:51.617944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:51.618443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:51.618582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.629427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.631180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:51.632549 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8968f3c-ae60-4505-8383-3ec197e6a20c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.178601 Oct 04 18:39:51.633263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3241/6508] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:51.652393 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-979654f6-c152-4aa4-9aad-9d51966d5563 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052013 Oct 04 18:39:51.653427 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3268/6509] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:51 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:52.048125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.049060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.057818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.058433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.059133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.060451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.061149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.062105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.092358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.092989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.102038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.102038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.106827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.106827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.106827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.106827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.152734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.161139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.164810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.168740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ba3ecef-d1c2-4173-88b1-611355dc18ac tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.127734 Oct 04 18:39:52.170326 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3242/6510] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:52.236501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lazy-loading 'services' on Instance uuid b81c149e-9a2b-47b2-bbf2-391d410d7d41 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:52.498253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b190b89e-1049-4a0d-8695-59c933d44a43 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41/os-volume_attachments/d0a2c119-0262-4be4-b7eb-6516db8fde4f" status: 202 len: 0 microversion: 2.1 time: 0.411314 Oct 04 18:39:52.499406 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3269/6511] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:39:52 2022] DELETE /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41/os-volume_attachments/d0a2c119-0262-4be4-b7eb-6516db8fde4f => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:39:52.677973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.679491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.680943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:52.691059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:52.703642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.704139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.704770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.705900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.706068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.706693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.707220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.707584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.707972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.709458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:52.710098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:52.710673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:52.791979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7870d0a8-ba00-4d7a-b057-65bc504373cd tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129668 Oct 04 18:39:52.796413 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3270/6512] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:52.970615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.980078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.981733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:52.983289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c4c227f-6da7-4e93-bf67-0ad1b216f345 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.327458 Oct 04 18:39:52.983898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3243/6513] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:52 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:53.200313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.201539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.208656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.213323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.213323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.213323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.213323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.213323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.282826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.293059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.294834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:53.297070 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a29fbd58-9d17-41c0-a296-ec87b6a03db2 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.102644 Oct 04 18:39:53.297646 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3271/6514] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:53.805666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:53.808139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:53.817407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.817407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.817407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.817407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:53.817886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:53.818311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:53.855745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6a3ff06-970b-4f0b-9c21-78e553119da1 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053906 Oct 04 18:39:53.861087 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3244/6515] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:53 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:54.009270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.010603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.017239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.017824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.018332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.019191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.019681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.020116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.172518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.183099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.188729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.188729 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c191bdf-3f22-4fc6-b785-11066bb42057 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.181145 Oct 04 18:39:54.188729 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3272/6516] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:54.324274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.324925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.339696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.340195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.340836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.341547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.342006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.342439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.432437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.440974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.442664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:54.443851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b78d1315-5c12-4a47-bcb0-e66ae322e554 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.123885 Oct 04 18:39:54.444422 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3245/6517] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:54.868228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:54.871235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:54.879750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.879750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.880295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.881266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:54.881949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:54.882599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:54.929584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad2fda6a-b478-4725-8693-83950912dfe7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065434 Oct 04 18:39:54.936012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3273/6518] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:54 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:55.213098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.213871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.221288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.236391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.236897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.237707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.238184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.238621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.471637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.473242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.480534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.481110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.481626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.482952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.483528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.484038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.510281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.519692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.521559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.522781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00a8213c-f439-4a42-9cb6-c8f695adbac7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.314261 Oct 04 18:39:55.538216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3246/6519] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:55.560997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.588465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.592737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:55.600367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdefc9cc-99e7-4b1e-9188-2cf284487d50 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1408 microversion: 2.54 time: 0.133599 Oct 04 18:39:55.602162 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3274/6520] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:55.942633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:55.945286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:55.952104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.952883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.958041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.958041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:55.958041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:55.958041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:55.997654 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-091dccf2-c05c-4f3d-9f8d-6c2b38c202a8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059032 Oct 04 18:39:55.998372 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3247/6521] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:39:55 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:39:56.075194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.076299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.083875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.085137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.085809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.086685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.087347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.087972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.116882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:56.400417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c1e053e-7a4e-474e-82c0-704d9768c2c5 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 204 len: 0 microversion: 2.1 time: 0.328440 Oct 04 18:39:56.401043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3275/6522] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:56 2022] DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:39:56.409692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.410302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.418694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.419195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.419675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.420582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.420831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.421268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.552191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.553113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.555254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:39:56.565533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.566432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.567387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.568395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.569120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.569784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.697382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.717301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d6e2c90-d99e-4666-ab59-f9338bf47ce3 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1681 microversion: 2.1 time: 0.306649 Oct 04 18:39:56.739323 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3248/6523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:56.745017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:56.745948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:56.752868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.753800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.754337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.755266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:56.756001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:56.756649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:56.876460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.892089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.894065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:56.895303 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc869c3f-d122-439c-acbc-24ec96aab657 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.348026 Oct 04 18:39:56.900446 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3276/6524] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:57.162294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.175454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.176950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:57.178133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04fa4ea4-0e9f-4c33-ade5-06cac1f55c9e tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1414 microversion: 2.54 time: 0.437461 Oct 04 18:39:57.178695 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3249/6525] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:56 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1414 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:57.747792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.748646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.756985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.757601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.758331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.759819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.760511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.761133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.938281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:57.940901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:57.952120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.955519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.956255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.957253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:57.957950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:57.958622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:57.996522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.007008 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07bdc28b-ff57-43c3-9a36-571e55b7ab45 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1681 microversion: 2.1 time: 0.264154 Oct 04 18:39:58.027020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3277/6526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:57 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:58.143296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.153743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.156338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.162113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f2423a62-6c94-41b1-8997-89b8fd82e9c4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.229130 Oct 04 18:39:58.162113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3250/6527] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:57 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:58.210875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:58.211895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:58.225113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.226829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.229613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.230624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:58.234605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:58.235494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:58.403850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.417689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.419291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:58.424327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84666f31-ac36-4820-86a2-25475ba1eca5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1414 microversion: 2.54 time: 0.214886 Oct 04 18:39:58.444219 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3278/6528] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:58 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1414 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:59.034409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.035823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.046185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.049508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.050149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.052970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.053622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.064147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.188559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.189578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.201364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.202231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.202936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.204039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.204861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.205490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.297817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.307196 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ab625a5-a636-4683-874b-1d8c82fde00d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1681 microversion: 2.1 time: 0.276659 Oct 04 18:39:59.308454 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3251/6529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:59.420800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.430259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.431994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.433257 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46f7f3cc-df8c-4277-83d2-12fd7508bbed tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.249052 Oct 04 18:39:59.439516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3279/6530] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:39:59.449886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:59.450755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:59.457247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.457978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.458591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.460133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.460771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.461376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.539535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.551894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.553777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:59.555307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-588eac45-489b-4489-9969-bafc116f064b tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1414 microversion: 2.54 time: 0.109945 Oct 04 18:39:59.555921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3252/6531] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:39:59 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:39:59.681411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "name": "network-vif-plugged", "status": "completed", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:59.709363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:59.713670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:59.714396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:59.731359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] Creating event network-vif-plugged:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h2-833090-21 Oct 04 18:39:59.738016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-378edfca-ea53-4344-b52a-4e8f884fd9de req-ae4699b7-cb99-435c-a949-cb1b20e6f7c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060963 Oct 04 18:39:59.739033 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3280/6532] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:00.331683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.332304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.340850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.344010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.344010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.344010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.344010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.344010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.460816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.465435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.473539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.476331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.477004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.478583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.479047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.479496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.566447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.575932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ad0cee3-477b-4fb3-90ef-c69ce2698550 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1681 microversion: 2.1 time: 0.247717 Oct 04 18:40:00.576570 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3253/6533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:00.587961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:00.588798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:00.610181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.610828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.611410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.612206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:00.612676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:00.613118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:00.643400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.657307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.659517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.660954 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-196c1a63-6728-4e97-8830-16d302ca2df4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.204676 Oct 04 18:40:00.662551 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3281/6534] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:00.718941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.728438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.729813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:00.731004 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3d7b15b-ea9b-4f91-99b9-b5ad32097ae5 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1414 microversion: 2.54 time: 0.147074 Oct 04 18:40:00.731914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3254/6535] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:00 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:01.340060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.342398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.348763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.349516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.350145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.350856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.351500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.353033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.370400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.382245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:01.601708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.603270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.615745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.617255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.619778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.622664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.623222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.627430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.725957 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10f0b43c-b4dd-45c0-9472-fbd3169e6956 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 204 len: 0 microversion: 2.1 time: 0.388344 Oct 04 18:40:01.726758 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3282/6536] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:40:01 2022] DELETE /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:40:01.736902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.737621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.750700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.755153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.755674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.756465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.757129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.757568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.845248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:01.848891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:01.855745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e19f4224-11d6-4f2e-8d11-f8b87001cf08 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1681 microversion: 2.1 time: 0.261197 Oct 04 18:40:01.856597 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3255/6537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:01.864347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:01.865252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:01.873411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.874981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.875430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.876377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:01.876847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:01.877345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:01.990670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.001574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.003299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.004873 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6aba7af5-e6a1-40f3-b492-23d023cedaf2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.273116 Oct 04 18:40:02.005451 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3283/6538] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:02.011144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.012008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.018564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.019082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.019874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.020791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.021428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.022038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.120444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.132131 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08e051dd-b5e9-49ac-835f-78aef05e7907 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1469 microversion: 2.1 time: 0.274245 Oct 04 18:40:02.132730 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3256/6539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:01 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:02.455635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.466281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.467789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:02.469215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0c7f22c-2106-4d6a-a333-20de7d8c8d0a tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1399 microversion: 2.54 time: 0.462285 Oct 04 18:40:02.470178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3284/6540] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1399 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:02.498412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-27be46d4-b77b-4687-a1b1-c28b25e7f1a4 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '.version_select at 0x7f900815bc10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.568251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5746e2-4945-469f-993c-532db1c6c770", "name": "network-vif-deleted", "tag": "9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:02.581247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.581929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.582523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.601001 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] Creating event network-vif-deleted:9cfe06e9-6eaf-4d9a-96be-4aadab3eeea3 for instance fb5746e2-4945-469f-993c-532db1c6c770 on n-h2-833090-21 Oct 04 18:40:02.610158 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b886e19a-05dd-44fd-91ca-e8ecc59d9bb3 req-3bc32fa1-765e-4343-b625-bd88aa1ae608 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051463 Oct 04 18:40:02.611858 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3285/6541] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:02.656627 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-27be46d4-b77b-4687-a1b1-c28b25e7f1a4 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-334322603" status: 204 len: 0 microversion: 2.54 time: 0.161979 Oct 04 18:40:02.657979 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3257/6542] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-334322603 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:02.684450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.686405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.697925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.698429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.698864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.699595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.700060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.700960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.740140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:40:02.882635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:02.885103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:02.897510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.898624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.899434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:02.900878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:02.904435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:02.905065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.026823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.040874 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-912deb54-d80d-49f5-ad3d-b8468f59aac9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 200 len: 1326 microversion: 2.1 time: 0.162324 Oct 04 18:40:03.042024 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3258/6543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:02 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:03.047061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.048091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.054883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.056268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.056987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.057936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.058624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.059281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.164663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-107c4074-59f4-4e52-8cbc-8a3559aae01c tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 204 len: 0 microversion: 2.54 time: 0.493655 Oct 04 18:40:03.169295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3286/6544] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:40:02 2022] DELETE /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:40:03.175436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.176333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.193430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.193980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.194474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.195197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.195683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.201960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.449608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.459983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.465389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.467633 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-737e15db-de01-4632-aed4-7f19955f897f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.424185 Oct 04 18:40:03.472236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3259/6545] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:03.492478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:03.494063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:03.505390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.514986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.515786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.517332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:03.518052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:03.518671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:03.667359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.682211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.683681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.687837 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa619630-fce7-47dc-8985-448863ef2cfd tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1405 microversion: 2.54 time: 0.211100 Oct 04 18:40:03.690402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3260/6546] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:03.746222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:03.758253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6fc4df9-fa9e-4639-b770-70794215ce7a tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1469 microversion: 2.1 time: 0.587585 Oct 04 18:40:03.761044 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3287/6547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:03 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1469 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:04.071121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.077835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.083424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.083950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.084919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.085946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.086471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.087508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.115184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 HTTP/1.1 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'fb5746e2-4945-469f-993c-532db1c6c770'} Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:04.118218 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:40:04.126343 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:04.128724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:04.129851 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20137790-63d7-4596-8a57-ab8c35a0c3ef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 404 len: 111 microversion: 2.1 time: 0.065174 Oct 04 18:40:04.131108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3261/6548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:04.144070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d15677f-635e-41c2-b689-e350cfa66323 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '.version_select at 0x7f90082e1dc0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.229022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d15677f-635e-41c2-b689-e350cfa66323 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693746553" status: 202 len: 0 microversion: 2.1 time: 0.091327 Oct 04 18:40:04.230973 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3288/6549] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:40:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693746553 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:40:04.509651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.510852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.529497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.529993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.530743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.531677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.532299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.532895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.668972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81c149e-9a2b-47b2-bbf2-391d410d7d41", "name": "network-vif-deleted", "tag": "c6492d69-f671-4f52-a7d7-63e5fe49d311"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:04.683918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.684588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.685265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.700553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] Creating event network-vif-deleted:c6492d69-f671-4f52-a7d7-63e5fe49d311 for instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 on n-h1-833090-21 Oct 04 18:40:04.706323 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6d0841a1-0289-4b20-ad0d-8fe06a142fb0 req-19f6c786-c302-422d-91aa-867f7b27eb48 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043486 Oct 04 18:40:04.711590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3289/6550] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:04.730427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.731810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.738966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.741031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.741553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.742502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.743777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.744553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.790583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.807987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.809921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.811311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0aadc7d-0d74-4aaf-af1f-3793f6cc94e1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1806 microversion: 2.20 time: 0.309338 Oct 04 18:40:04.813114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3262/6551] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:04.827590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:04.828574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:04.835639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.836490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.837185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.838266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:04.838958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:04.839662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:04.892410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.902663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.904369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.905890 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34657e16-11e3-4ebf-903f-2c737a0e5ac0 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1405 microversion: 2.54 time: 0.192545 Oct 04 18:40:04.918057 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3290/6552] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:04.940275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e513c54af64d1a87f7388fea33a379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a000739fab49d99687c9f7c92d381c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:04.952621 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7b825a8-3694-4e7e-bbff-f2717075c790 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 200 len: 1298 microversion: 2.1 time: 0.138251 Oct 04 18:40:04.956659 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3263/6553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:04 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:05.445036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b275d38-270c-4a82-ad75-363843398c47 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: .version_select at 0x7f9008ef6d30>, body: {"keypair": {"name": "tempest-keypair-1962141459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwZr5M+rfp5L3r8uBEZOQCZaPd4VYYZ/yac0jncoMm6607TXxI94MgKtZE2pFYv5xb5HdFIPbKzWYjVXJFEuWxaaBof5cJ1FMHkhpCTPHms8c751HU+vs9rlu0FXwQ6XA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:05.464463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0b275d38-270c-4a82-ad75-363843398c47 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:05.470614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0b275d38-270c-4a82-ad75-363843398c47 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:05.554335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b275d38-270c-4a82-ad75-363843398c47 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113972 Oct 04 18:40:05.555168 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3291/6554] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:40:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:05.841155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.842573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.856999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.857572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.858038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.859845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.860511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.861150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.938455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:05.939077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:05.957454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.958103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.958736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:05.959786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:05.964076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:05.964076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.002091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.003236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.003721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.004208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lazy-loading 'fault' on Instance uuid d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:40:06.082760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.085002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.096522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.108554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6dc5daa26c940b78259b71cfa7c3108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6be52c2194a43099e874807c3f77fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.108554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba2c5e49-481d-49a1-8162-cf76a5f5fc4d tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 200 len: 1410 microversion: 2.54 time: 0.165715 Oct 04 18:40:06.108554 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3292/6555] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:40:06.108554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:06.108554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] [instance: b81c149e-9a2b-47b2-bbf2-391d410d7d41] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:06.109148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.109148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:06.109148 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8477173-c25f-4d6d-87ec-5897409459b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1793 microversion: 2.20 time: 0.274603 Oct 04 18:40:06.109609 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3264/6556] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:05 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1793 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:40:06.113868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.114460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.115115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.115918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:06.116459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:06.116951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:06.131414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] HTTP exception thrown: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Request method failure captured: Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 HTTP/1.1 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1dRHf8PXPSZfYtkSJXq53LQjizvYSYxr4PZGtx3fExJ2AQPN3zCfxsWZgLlFnPMkUIxmbRR37Y7f0sIVzkWvFJncgmm0y2KfaNv64UDLYVQ_vP4OmGfVlNht5ctG9ngDCOeBJ2YR7bxFUcYtQlnxVIqfkyvAl2pHBnNv6YJjC2J7w Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 50a000739fab49d99687c9f7c92d381c Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesBackupsTest-29762268 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_50a000739fab49d99687c9f7c92d381c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50a000739fab49d99687c9f7c92d381c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50a000739fab49d99687c9f7c92d381c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/50a000739fab49d99687c9f7c92d381c"}]}] Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesBackupsTest-29762268 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 50a000739fab49d99687c9f7c92d381c Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesBackupsTest-29762268 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesBackupsTest-29762268-project Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 67e513c54af64d1a87f7388fea33a379 Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesBackupsTest-29762268-project Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b81c149e-9a2b-47b2-bbf2-391d410d7d41'} Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:06.133102 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] Returning 404 to user: Instance b81c149e-9a2b-47b2-bbf2-391d410d7d41 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3928164-43e7-4770-b2ea-2ad3084d7fb9 tempest-VolumesBackupsTest-29762268 tempest-VolumesBackupsTest-29762268-project] 10.222.0.40 "GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41" status: 404 len: 111 microversion: 2.1 time: 0.033999 Oct 04 18:40:06.139249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3293/6557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:06 2022] GET /compute/v2.1/servers/b81c149e-9a2b-47b2-bbf2-391d410d7d41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:40:07.128688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:07.130995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] [instance: d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:07.153022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.153708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.154337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.155200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:07.155928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:07.156636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:07.180201 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] HTTP exception thrown: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Request method failure captured: Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 HTTP/1.1 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH3TIhwWLjWGCWsV1cPBJ-9_7h8oLXSqj_dLsZRWempIYoNZrW_7C9d84UXcK2L9So58nNHu2oCVSsCN0Hdhlx3C6raaJzcNOZbz_oi4tqdUsw580HnpZcYQjaGZmZlIVce7Etpn9q5e4fBCFfgO4OqSYcF1gTuEMDS4U00GfaqmhVk Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c6be52c2194a43099e874807c3f77fe4 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerShowV254Test-505201491 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c6be52c2194a43099e874807c3f77fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6be52c2194a43099e874807c3f77fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c6be52c2194a43099e874807c3f77fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c6be52c2194a43099e874807c3f77fe4"}]}] Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerShowV254Test-505201491 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c6be52c2194a43099e874807c3f77fe4 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerShowV254Test-505201491 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerShowV254Test-505201491-project Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e6dc5daa26c940b78259b71cfa7c3108 Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerShowV254Test-505201491-project Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd7a06cf5-a91f-4168-ad1f-1b9e8ab407b3'} Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:40:07.183011 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. Oct 04 18:40:07.189488 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:40:07.190528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] Returning 404 to user: Instance d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:40:07.192819 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-df06a9b4-2059-4ed5-8919-26bbad652fc6 tempest-ServerShowV254Test-505201491 tempest-ServerShowV254Test-505201491-project] 10.222.0.40 "GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3" status: 404 len: 111 microversion: 2.54 time: 0.070068 Oct 04 18:40:07.193779 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3265/6558] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:40:07 2022] GET /compute/v2.1/servers/d7a06cf5-a91f-4168-ad1f-1b9e8ab407b3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:40:08.354746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1209588957", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c"}], "security_groups": [{"name": "tempest-securitygroup--1070053756"}], "key_name": "tempest-keypair-1962141459", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:08.491942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] validate_networks() for [('b14b1fa5-4d26-4e63-b6a0-fd6930d9f71c', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:40:08.991031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:40:08.991901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:40:08.992644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:40:08.993943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:40:08.994627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:40:09.019412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.020328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.025056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.025056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:09.025056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:09.025056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:09.085818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:40:09.093406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Getting quotas for user 0885e35eb9ba41a18665239f1b6c3bbe and project c02ed3914fa54a7abbcf20b0dea33b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:40:09.109720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:40:09.112300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:40:09.261136 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.910903 Oct 04 18:40:09.262343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3294/6559] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:40:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:40:09.273504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4ef84580-02eb-4e0c-a2fd-87ac38193051 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.275267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4ef84580-02eb-4e0c-a2fd-87ac38193051 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:09.280781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:09.343939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4ef84580-02eb-4e0c-a2fd-87ac38193051 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:09.352537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4ef84580-02eb-4e0c-a2fd-87ac38193051 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1242 microversion: 2.1 time: 0.082823 Oct 04 18:40:09.353115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3266/6560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:09.726843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:09.728189 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b54e4fa-d5c3-4c3f-8e1e-c1712e92f247 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001669 Oct 04 18:40:09.728529 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3295/6561] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 4 18:40:09 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:40:10.376430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:10.378359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:10.384153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.384774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.385215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.385925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:10.386582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:10.387309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:10.460867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:10.474353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e97f1dab-890b-4742-8c04-636e2bab49b2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1246 microversion: 2.1 time: 0.102665 Oct 04 18:40:10.475429 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3267/6562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:10 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:11.500272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:11.501862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:11.537383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.544553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.545033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.545767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:11.546248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:11.546665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:11.633695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:11.641150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba2022f1-5b1a-42c7-9f79-bceffd30463d tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1302 microversion: 2.1 time: 0.145805 Oct 04 18:40:11.641967 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3296/6563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:11 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:12.406499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-941951d8-d3fc-43af-97e5-ee5e4384cac7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] Calling method '.version_select at 0x7f90080e6550>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.486426 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-941951d8-d3fc-43af-97e5-ee5e4384cac7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.209357 Oct 04 18:40:12.487291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3268/6564] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0/defaults => generated 371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:12.499351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6408e6bc-631b-4d73-b9cd-1d5590f22ff7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] Calling method '.version_select at 0x7f90086b08b0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.598926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6408e6bc-631b-4d73-b9cd-1d5590f22ff7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0" status: 200 len: 371 microversion: 2.1 time: 0.103345 Oct 04 18:40:12.607531 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3297/6565] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:12.614738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97ca0504-4a24-45e9-8f97-e9177dd74ca7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] Calling method '.version_select at 0x7f90080e63a0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.665513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.666510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:12.676512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.677259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.677802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.678613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:12.679315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:12.679885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:12.720315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97ca0504-4a24-45e9-8f97-e9177dd74ca7 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0/defaults" status: 200 len: 371 microversion: 2.1 time: 0.109025 Oct 04 18:40:12.721930 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3269/6566] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0/defaults => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:12.734991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a86dbe9-1829-4cc6-82ba-18e34646982c tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] Calling method '.version_select at 0x7f90080e6b80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.825370 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a86dbe9-1829-4cc6-82ba-18e34646982c tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0" status: 200 len: 371 microversion: 2.1 time: 0.094267 Oct 04 18:40:12.827521 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3270/6567] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:12.839230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-baa0e1aa-ac4a-490f-8b4e-cb50760182c9 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] Calling method '.version_select at 0x7f90080e6430>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:12.922261 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-baa0e1aa-ac4a-490f-8b4e-cb50760182c9 tempest-QuotasTestJSON-172860083 tempest-QuotasTestJSON-172860083-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0?user_id=467de12477034e8592e0525b62167c6b" status: 200 len: 371 microversion: 2.1 time: 0.087758 Oct 04 18:40:12.923288 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3271/6568] 10.222.0.40 () {58 vars in 1323 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/os-quota-sets/4121716e74e8404d86e169af1b52a3b0?user_id=467de12477034e8592e0525b62167c6b => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:13.002799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:13.012900 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bde6e566-0178-4c69-9b2a-038d8aea5b48 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.351691 Oct 04 18:40:13.013626 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3298/6569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:12 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:13.632272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b93c7-09cc-49b5-a0d8-4736317d8f60", "tag": "09e3c404-0740-4bbf-95d6-1171ea9f442a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:13.665157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:13.665157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:13.665157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:13.665157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] Creating event network-changed:09e3c404-0740-4bbf-95d6-1171ea9f442a for instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 on n-h1-833090-21 Oct 04 18:40:13.669946 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7f7490cf-5690-42a1-8601-c44603661041 req-dd436ece-a2b5-4ff1-8519-7aecada0672a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052540 Oct 04 18:40:13.670996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3272/6570] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:14.043404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:14.044684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:14.051403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.053187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.053806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.054692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:14.055309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:14.055925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:14.296059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:14.306143 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5723a1d-a7a6-4fef-b690-463ab26f6e1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.270235 Oct 04 18:40:14.311321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3299/6571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:14 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:15.334316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:15.335026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:15.341548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.342308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.342755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.343450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:15.343934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:15.344629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:15.484580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:15.494394 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1d02085-634e-4dc1-999b-3f6766938f2a tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.164805 Oct 04 18:40:15.497291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3273/6572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:15 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:16.518389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:16.519567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:16.528852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.529346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.529904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.530651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:16.531118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:16.531582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:16.688725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:16.700083 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3bfbd29-d8a6-4a5d-b21b-a4899ed9e73f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.186196 Oct 04 18:40:16.700984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3300/6573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:16 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:17.724096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:17.724759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:17.732771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.733532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.734119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.735091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:17.735572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:17.736003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:17.885740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:17.894415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9d5ebe80-93fe-45c0-89ec-854648236f81 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.174483 Oct 04 18:40:17.895148 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3274/6574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:17 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:18.919525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:18.920241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:18.927366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.927902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.928347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:18.929055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:18.929712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:18.930332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:19.058424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:19.093080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:19.102438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-203005f9-1e47-4013-8317-99a0a9d49816 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.187662 Oct 04 18:40:19.103051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3301/6575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:18 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:20.128207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:20.128831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:20.137543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.138046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.138533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.139245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:20.139814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:20.140248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:20.283858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:20.293687 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b66fdec3-f237-4ed2-85cd-96fb45e07817 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.169878 Oct 04 18:40:20.294301 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3275/6576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:20 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:40:21.000824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9b93c7-09cc-49b5-a0d8-4736317d8f60", "name": "network-vif-plugged", "status": "completed", "tag": "09e3c404-0740-4bbf-95d6-1171ea9f442a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:21.010233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.010712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.011137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.014881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:21.038858 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] Creating event network-vif-plugged:09e3c404-0740-4bbf-95d6-1171ea9f442a for instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 on n-h1-833090-21 Oct 04 18:40:21.044044 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3986dc74-46e5-4d5e-9bf0-e3a72b1e46b4 req-ccc3afda-8b12-4553-a182-c1ba3fdd29ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199476 Oct 04 18:40:21.044931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3302/6577] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:40:21.315786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:21.316982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:21.324288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.324768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.325205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.325908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:21.326395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:21.326791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:21.465753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:21.474121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55acb501-ae98-4345-8d16-bb57b15c9526 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.162340 Oct 04 18:40:21.488884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3276/6578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:21 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:22.502827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:22.505562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:22.512332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.513096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.513732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.514649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:22.515298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:22.516056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:22.584575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=12 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:22.687156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:22.696770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fbd9b93-97ef-45b3-986d-df9133b2398e tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1368 microversion: 2.1 time: 0.199609 Oct 04 18:40:22.697389 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3303/6579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:22 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:23.719988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:23.720748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:23.724084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:40:23.729748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.730293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.730733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.731495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:23.731988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:23.732440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:23.995969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:40:23.995969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28e24a91-f2fe-487e-9b0f-0f366b442a1f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1559 microversion: 2.1 time: 0.174433 Oct 04 18:40:23.995969 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3277/6580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:40:23 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:40:24.016276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:40:24.016889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:40:24.025615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.026097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.026526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.027221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:24.029432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:24.029432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:24.231847 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e9185b0-927b-46f7-b408-eb40f95fa180 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095866 Oct 04 18:40:24.231847 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3304/6581] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 18:40:24 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:40:25.572813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b93c7-09cc-49b5-a0d8-4736317d8f60", "tag": "09e3c404-0740-4bbf-95d6-1171ea9f442a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:40:25.602778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:40:25.602778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:40:25.602778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:40:25.617925 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] Creating event network-changed:09e3c404-0740-4bbf-95d6-1171ea9f442a for instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 on n-h1-833090-21 Oct 04 18:40:25.632194 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-dede8c30-d0e1-4b38-83ba-e78dafb8665e req-c7b2f7fd-109c-4182-ad45-8d0eacfd3871 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063603 Oct 04 18:40:25.632194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3278/6582] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:01.508970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:01.510473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:01.515560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.516984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.525217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.525754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.526811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.528113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.528425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.528994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.565381 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1bcdf38-f474-44cc-8c0d-2f65159b7515 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments/5740e029-f4e0-4425-b287-edffd97496d8" status: 200 len: 194 microversion: 2.20 time: 0.058784 Oct 04 18:41:01.566434 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3305/6583] 10.222.0.40 () {60 vars in 1454 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments/5740e029-f4e0-4425-b287-edffd97496d8 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:41:01.631756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.631756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.631756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=33 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:01.631756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=86 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:01.634960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.634960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.641106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:01.641723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:01.644894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.650641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.651185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.652450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.658339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.658971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.659709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.660623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:01.661293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:01.662149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:01.682303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8762583-3056-4887-ae9b-acc341fc2932 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/ips" status: 200 len: 151 microversion: 2.1 time: 0.068187 Oct 04 18:41:01.684002 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3279/6584] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 4 18:41:01 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:01.751280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lazy-loading 'services' on Instance uuid 2001502a-a48c-438b-82dc-6e7f2749e8e1 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:02.002289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf436514-c8ac-4574-9102-3bcff79d1853 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments/5740e029-f4e0-4425-b287-edffd97496d8" status: 202 len: 0 microversion: 2.20 time: 0.365280 Oct 04 18:41:02.006883 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3306/6585] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 4 18:41:01 2022] DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments/5740e029-f4e0-4425-b287-edffd97496d8 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:02.013122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:02.014855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:02.032740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.033379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.035195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.036178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:02.036654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:02.037100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:02.082168 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43e769e4-e6e5-4e9a-a5cc-d7712bb2e665 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073303 Oct 04 18:41:02.091726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3280/6586] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:02 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:03.096390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:03.099950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:03.107304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.108208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.108871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.110003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:03.110694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:03.111370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:03.145836 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-391a72fe-753c-4324-8844-115e78677b35 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054817 Oct 04 18:41:03.147074 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3307/6587] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:03 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:04.159741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:04.163405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:04.172286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.173145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.174664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.175674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.176366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.177040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.246343 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-007f22d5-689c-4f7e-b040-70d07ac80beb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091917 Oct 04 18:41:04.246986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3281/6588] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:04 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:04.504218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0607b24e-ffcb-4fb5-9587-3e0b48a8fd89"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:04.507484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:04.515295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.516168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.516939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:04.517992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:04.518715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:04.519430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.259522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:05.262513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:05.274279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.277454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.278935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.281209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:05.286101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:05.286712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:05.328098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-021f6a08-bbed-477d-b797-5cc2fc106246 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073681 Oct 04 18:41:05.332960 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3282/6589] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:05 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:41:05.622289 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd949d43-1ecd-41a0-9784-3a4d1d156bef tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "POST /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.126320 Oct 04 18:41:05.625267 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3308/6590] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 18:41:04 2022] POST /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 194 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:06.342138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:06.350214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:06.374655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.375161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.375639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.376355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:06.381980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:06.382462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:06.470566 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e58a619e-b49d-4f1a-adb2-01ec3d4f5036 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132886 Oct 04 18:41:06.471723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3283/6591] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:06 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:07.486332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:07.496403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:07.515323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.522488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.522488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.522488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:07.522488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:07.522488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:07.603709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1617b3ef-0274-4bf3-aa6a-abeeb3fd5d13 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124330 Oct 04 18:41:07.605216 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3309/6592] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:07 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:08.617389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.620479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.629360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.630106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.630709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.631694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.632559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.633164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.681275 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5d13ca0-9c1b-4710-914d-aaff2986ed8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068139 Oct 04 18:41:08.682606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3284/6593] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:41:08 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:08.793417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:08.794933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:08.802995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.803843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.804646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.805908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:08.806583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:08.807279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:08.840609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:09.147618 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0563ee2d-c6fb-4fdb-99a9-8a690bb388b3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 204 len: 0 microversion: 2.20 time: 0.357529 Oct 04 18:41:09.164424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3310/6594] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:41:08 2022] DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:09.173529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:09.174158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:09.184979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.185559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.186078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.186855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:09.187531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:09.188214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:09.356972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.366263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.367733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:09.368916 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd4e4aac-0c5a-4775-8681-af90a2471bbe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.200493 Oct 04 18:41:09.369714 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3285/6595] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:09 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:10.395664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:10.397041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:10.406703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.407190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.407661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.408416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:10.409320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:10.409741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:10.590269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.624514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.626448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:10.627741 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aeb01e18-6da3-4354-aeca-4af6452e2ce8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.236396 Oct 04 18:41:10.628315 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3311/6596] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:10 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:11.654348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:11.655028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:11.672481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.675759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.675759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.676148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:11.676805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:11.677421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:11.902777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.917550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.922715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:11.927400 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a588ccf1-216d-45c9-9216-6fbcf6cb7a4c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1721 microversion: 2.20 time: 0.275262 Oct 04 18:41:11.928983 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3286/6597] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:11 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:12.956348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:12.957686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:12.986762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.989714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.990536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:12.991503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:12.991946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:12.992415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.077957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2001502a-a48c-438b-82dc-6e7f2749e8e1", "name": "network-vif-deleted", "tag": "389f4deb-56c1-40ab-86f9-da9e7fda2cff"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:13.097051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:13.097051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:13.097051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:13.105361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] Creating event network-vif-deleted:389f4deb-56c1-40ab-86f9-da9e7fda2cff for instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 on n-h2-833090-21 Oct 04 18:41:13.112128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0f09533b-1e9b-4cf8-b942-d684e5cb47f0 req-ddc8b538-3c7b-469e-baed-f4642e411366 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355815 Oct 04 18:41:13.116774 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3312/6598] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:13.166427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.178306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.179776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:13.181005 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5582ad32-67c1-46c6-905a-7af29a184578 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 200 len: 1366 microversion: 2.20 time: 0.229517 Oct 04 18:41:13.181491 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3287/6599] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:12 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:14.209110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.212522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:14.223395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.224316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.224999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.226180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:14.226882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:14.228184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:14.247731 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 HTTP/1.1 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2001502a-a48c-438b-82dc-6e7f2749e8e1'} Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.250384 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:14.260797 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f0db103-ce8c-4e7c-86f4-b05970e3645c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 404 len: 111 microversion: 2.20 time: 0.051785 Oct 04 18:41:14.263990 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3313/6600] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:14 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:41:14.272464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-949d41b7-23f8-488c-89de-11a6ed826c90 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '.version_select at 0x7f9008127160>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:14.371320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-949d41b7-23f8-488c-89de-11a6ed826c90 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136528731" status: 204 len: 0 microversion: 2.20 time: 0.102940 Oct 04 18:41:14.379505 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3288/6601] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 4 18:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136528731 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:41:15.461752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2fafbb69-406f-42c3-bef1-5cf90e026ce9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: .version_select at 0x7f90082e1f70>, body: {"keypair": {"name": "tempest-keypair-555830397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH9ZhjLmLELX3LKddZL+qTmlkTS3dPVzbiGRGOhh6bHwbJAdcAmBlPWLvJUuiG30EcU4iB7lu2AcWlMQ2k7sdtZSeFzBr+juttoYcel+i+9ztA0XoBiVUpE3UIlxRgeDQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:15.479755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2fafbb69-406f-42c3-bef1-5cf90e026ce9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for project 7fca84063bd74931ac5b7d6473c38255. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:15.485829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-2fafbb69-406f-42c3-bef1-5cf90e026ce9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for user 94e0ec1aeb9d46f48802ddcd78a9e1d5 and project 7fca84063bd74931ac5b7d6473c38255. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:15.581607 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2fafbb69-406f-42c3-bef1-5cf90e026ce9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.123345 Oct 04 18:41:15.582225 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3314/6602] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 4 18:41:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:41:18.032176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1586696186", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "800e6e46-0ac7-45eb-9215-0d82ad834577"}], "security_groups": [{"name": "tempest-securitygroup--496452886"}], "key_name": "tempest-keypair-555830397", "user_data": "}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:18.260067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] validate_networks() for [('800e6e46-0ac7-45eb-9215-0d82ad834577', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:41:18.587753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:41:18.588454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:41:18.589161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:41:18.589789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:41:18.590415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:41:18.604664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.605162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.605607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.606336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:18.606797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:18.607227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:18.626840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for project 7fca84063bd74931ac5b7d6473c38255. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:41:18.634217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Getting quotas for user 94e0ec1aeb9d46f48802ddcd78a9e1d5 and project 7fca84063bd74931ac5b7d6473c38255. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:41:18.652439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:41:18.655195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:41:18.805447 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aee89fe5-9716-445f-8919-5467d5bf4b64 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.778396 Oct 04 18:41:18.806394 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3289/6603] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 4 18:41:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:41:18.819693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:18.820306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:18.949428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.958644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.962468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:18.964010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de1aa6f4-34d4-4623-99ff-0d567c6aa170 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1281 microversion: 2.20 time: 0.150029 Oct 04 18:41:18.985063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3315/6604] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:18 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:19.290716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.291456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:19.311146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.311737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.312291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.313094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.315991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.316546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.413319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'services' on Instance uuid 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:19.619356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43eba5c0-deb4-45e3-ae1e-abdb51d265d4 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments/0607b24e-ffcb-4fb5-9587-3e0b48a8fd89" status: 202 len: 0 microversion: 2.1 time: 0.332510 Oct 04 18:41:19.622985 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3290/6605] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 18:41:19 2022] DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments/0607b24e-ffcb-4fb5-9587-3e0b48a8fd89 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:19.629597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.632736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:19.640678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.641557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.642223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.643704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:19.644986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:19.645764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:19.680410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-211fd5c5-7ef4-4859-aaa9-64ce50330deb tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055237 Oct 04 18:41:19.681569 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3316/6606] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:19 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:19.994759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:19.995959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.003538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.004232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.005032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.006136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.006985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.007642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.124062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.135191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.136931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:20.138229 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62b61804-b913-4b42-98af-90b480dfc2c8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1285 microversion: 2.20 time: 0.148652 Oct 04 18:41:20.139126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3291/6607] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:19 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:20.693835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:20.702060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:20.703060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.703586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.704033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.704738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:20.705222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:20.706197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:20.747115 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2e59e42-d746-4693-8c16-6e7fd5aff1d9 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057841 Oct 04 18:41:20.748333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3317/6608] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:20 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:21.168277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.168822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:21.175951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.176437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.176875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.177567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.178023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.178452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.264609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:21.273908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:21.275646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:21.276958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05eacb9d-bc21-4c9c-8792-07d08566a261 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1333 microversion: 2.20 time: 0.112813 Oct 04 18:41:21.292422 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3292/6609] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:21 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:21.765395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:21.767532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:21.775801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.776569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.777176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.778056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:21.778652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:21.779223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:21.823831 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1f2277b-8e55-4a54-bef3-4ef2d4974b55 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062376 Oct 04 18:41:21.830342 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3318/6610] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:21 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:22.302719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:22.303912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:22.318262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.318765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.319212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.319963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.320424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.320864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.490653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.501077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.503839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:22.505414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23330e77-3803-497a-8d4b-baa37c3ad78c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1339 microversion: 2.20 time: 0.206961 Oct 04 18:41:22.526780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3293/6611] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:22 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:22.842058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:22.844328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:22.857706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.858190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.860022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.860952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:22.865750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:22.867606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:22.943800 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a04a75fc-00c0-426d-82d4-15d1342896b7 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104880 Oct 04 18:41:22.945186 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3319/6612] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:22 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:23.533825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.534624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:23.549769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.550275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.550727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.551450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:23.561057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:23.561452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:23.837361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.851437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.859796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:23.863839 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af3a09ac-1219-4bbd-833a-6c4108473023 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.334222 Oct 04 18:41:23.868885 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3294/6613] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:23 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:23.961813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:23.964884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.006515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.007711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.008277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.009130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.009719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.010281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.054993 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e26431ce-eb15-42e3-bbb6-c2ecb4b19f99 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102321 Oct 04 18:41:24.060752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3320/6614] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:23 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:24.698760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:24.716743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.720433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.721039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.893726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:24.894436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:24.903682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.905287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.908033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.910682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:24.911278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:24.912371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:24.920568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:25.078879 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] Creating event network-changed:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h2-833090-21 Oct 04 18:41:25.083879 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e366895a-a1d7-4be5-aec6-68749cffb774 req-c953be3c-0db8-47a8-a02d-11e37b3e81cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392430 Oct 04 18:41:25.084857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3295/6615] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:25.091053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:25.093485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:25.101721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.102620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.104033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.104254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:25.104886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:25.105489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:25.150624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-816f464f-449c-45be-9fc1-216923dd02aa tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059064 Oct 04 18:41:25.150624 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3296/6616] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:25 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:25.257810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.267272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.269441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:25.270907 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f145ba7-a6ec-4315-b6bd-6fe2e3227a31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.381481 Oct 04 18:41:25.274153 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3321/6617] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:24 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:26.163788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.166973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.175293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.175903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.176687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.177416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.177968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.178401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.196265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:26.209141 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1554680-24f9-40af-82a1-3fc05803e5e0 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051063 Oct 04 18:41:26.209698 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3297/6618] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:41:26.273652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.274200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.281346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.281935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.282449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.283308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.284413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.284915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.296971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.297797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.304385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.308884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.308884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.308884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.308884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.308884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.315203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:41:26.457605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.466417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.468046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.469178 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18df2526-a435-4327-8c7d-ed3577be25ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.176851 Oct 04 18:41:26.470107 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3298/6619] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:26.614117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3b5d9ae-620b-4ad0-9c02-044e403b4600 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 204 len: 0 microversion: 2.1 time: 0.344328 Oct 04 18:41:26.618979 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3322/6620] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:26 2022] DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:41:26.625857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:26.626478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:26.633410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.633941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.634380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.635170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:26.635729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:26.636077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:26.798330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:26.806747 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-639ed600-dd1a-465d-b5f6-17df1d25ef32 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1684 microversion: 2.1 time: 0.184756 Oct 04 18:41:26.807916 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3299/6621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:26 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:27.504701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.511776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.530465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.534203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.534203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.534203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.534203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.534203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.819155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.828507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.847652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:27.847652 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3634671-f0c0-4389-8689-04e66de529e9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.340480 Oct 04 18:41:27.848042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:27.848042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:27.849936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3323/6622] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:27.853369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.854197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.854871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.856231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:27.856841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:27.857365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:27.999000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:28.007317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ca02f2b-8571-49f6-aac6-6438b55b75d6 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1684 microversion: 2.1 time: 0.178359 Oct 04 18:41:28.011701 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3300/6623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:27 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:41:28.856939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:28.857663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:28.864805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.865630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.866487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.867458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:28.868155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:28.868796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:28.954615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:29.028619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:29.029335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:29.035718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:29.040835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:29.042765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.043493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.043951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.044658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.045361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.045806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.104973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.113990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.115726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.117435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5c1fac8-ba83-4f58-84ab-d994dcb54f88 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.264447 Oct 04 18:41:29.118449 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3324/6624] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:28 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:29.122749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:29.131324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0dd98956-58f4-44cb-b57a-4fe682c6cfe2 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1616 microversion: 2.1 time: 0.103506 Oct 04 18:41:29.132296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3301/6625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:29 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1616 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:29.468938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9b93c7-09cc-49b5-a0d8-4736317d8f60", "name": "network-vif-deleted", "tag": "09e3c404-0740-4bbf-95d6-1171ea9f442a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:29.481610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:29.482351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:29.483013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:29.501022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] Creating event network-vif-deleted:09e3c404-0740-4bbf-95d6-1171ea9f442a for instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 on n-h1-833090-21 Oct 04 18:41:29.511506 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bc98a1a9-225c-4184-9c97-9a2995475987 req-a7e2a821-e97a-4b59-ab59-bbb59ee69395 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046179 Oct 04 18:41:29.512468 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3325/6626] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:30.142275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:30.143822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:30.152868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.162130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:30.162896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:30.166200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.166745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.176549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.177515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.177968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.195777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.243904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:30.244792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:30.245659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:30.246385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lazy-loading 'fault' on Instance uuid 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:41:30.332396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0885e35eb9ba41a18665239f1b6c3bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02ed3914fa54a7abbcf20b0dea33b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.343852 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-907525d0-886e-4aa6-8901-4b40a04fea1b tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 200 len: 1332 microversion: 2.1 time: 0.188565 Oct 04 18:41:30.346878 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3326/6627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:30 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:41:30.370309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.380039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.381662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:30.382946 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2edb49ef-94a4-4d2d-881d-0d6b692b4de7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.244719 Oct 04 18:41:30.383914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3302/6628] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:30 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:31.369533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.370267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.377400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.377809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.378241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.379182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.379662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.380091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.395188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 HTTP/1.1 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2d9b93c7-09cc-49b5-a0d8-4736317d8f60'} Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:31.397030 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c998154a-0091-4b3d-8945-c95f9891b7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 404 len: 111 microversion: 2.1 time: 0.032956 Oct 04 18:41:31.402290 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3327/6629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:31.409504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cfafe75e-856c-49b4-aadc-b1838fcef9af tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '.version_select at 0x7f900850df70>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.409656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:31.410132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:31.417673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.418034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.418475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.419189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.419680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.420322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.484411 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cfafe75e-856c-49b4-aadc-b1838fcef9af tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962141459" status: 202 len: 0 microversion: 2.1 time: 0.079274 Oct 04 18:41:31.485240 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3328/6630] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 18:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962141459 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:41:31.586624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:31.597116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:31.598680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:31.600334 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd92c46a-22bc-4cb4-a2b3-3a69bf0ad6aa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.195227 Oct 04 18:41:31.601013 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3303/6631] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:31 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:31.735252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "name": "network-vif-plugged", "status": "completed", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:31.758367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:31.762189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:31.762768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:31.792893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] Creating event network-vif-plugged:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h2-833090-21 Oct 04 18:41:31.803639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4dd9726b-6836-49f8-88e1-9f2bb7dcf081 req-d6e65953-5383-4722-a77f-0b6a00307055 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072547 Oct 04 18:41:31.805954 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3329/6632] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:41:32.627555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:32.628124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:32.630914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:32.635962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.636441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.636875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.637556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:32.638011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:32.638433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:32.889344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.909067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.910538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:32.911771 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-300f2f0b-1ef3-4103-9ddc-5054bf4938f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1406 microversion: 2.20 time: 0.288727 Oct 04 18:41:32.912470 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3304/6633] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:32 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:41:33.942574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:33.944285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:33.952942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.954369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.954369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:33.955813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:33.956280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:33.956700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.118800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.129090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.130577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:41:34.131776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd3cd86e-dc77-4d71-a67a-9c33e61203ad tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1597 microversion: 2.20 time: 0.195236 Oct 04 18:41:34.132399 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3330/6634] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:41:33 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1597 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:41:34.160907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:34.177770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:34.226147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.226690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.227237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.228009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:34.228484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:34.228928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:34.379289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b06836ae-e099-4264-97d5-8e78776ea095 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.223010 Oct 04 18:41:34.380291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3305/6635] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 4 18:41:34 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:41:36.046355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:41:36.058098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:41:36.060335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:36.061158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:36.061773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:36.080123 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] Creating event network-changed:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h2-833090-21 Oct 04 18:41:36.087434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b73161e3-9e5a-487e-97ba-b544349c348a req-dc4ccfbe-2d63-40f1-8b21-366602da1829 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237041 Oct 04 18:41:36.097293 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3331/6636] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:41:37.482507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.483011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:37.492260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.493062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.493498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.494363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.494823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.495245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.513926 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 HTTP/1.1 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2d9b93c7-09cc-49b5-a0d8-4736317d8f60'} Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:37.515951 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.521738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.523336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:37.524745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51d64d15-29a2-4070-aab1-c2f73b5cbf3f tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 404 len: 111 microversion: 2.1 time: 0.047791 Oct 04 18:41:37.525932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3306/6637] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:37 2022] DELETE /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:37.545146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:37.545146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 2d9b93c7-09cc-49b5-a0d8-4736317d8f60] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:37.555986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.556522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.557126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.560493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:37.561021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:37.561470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:37.586224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 HTTP/1.1 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2d9b93c7-09cc-49b5-a0d8-4736317d8f60'} Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:37.588221 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 2d9b93c7-09cc-49b5-a0d8-4736317d8f60 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d559380d-c132-4c1e-8213-1479eef75b27 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60" status: 404 len: 111 microversion: 2.1 time: 0.058842 Oct 04 18:41:37.600639 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3332/6638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:37 2022] GET /compute/v2.1/servers/2d9b93c7-09cc-49b5-a0d8-4736317d8f60 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:41.238437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.239031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.247948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.248712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.249311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.250086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.250668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.251246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.277195 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 HTTP/1.1 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'fb5746e2-4945-469f-993c-532db1c6c770'} Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:41.279027 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-609f7161-ec93-48d8-8bbe-0533c4863307 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 404 len: 111 microversion: 2.1 time: 0.046899 Oct 04 18:41:41.282389 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3307/6639] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:41 2022] DELETE /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:41.290149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.291276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: fb5746e2-4945-469f-993c-532db1c6c770] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.300099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.300648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.301340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.302150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.302750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.303274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.322277 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 HTTP/1.1 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'fb5746e2-4945-469f-993c-532db1c6c770'} Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.324623 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance fb5746e2-4945-469f-993c-532db1c6c770 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e2600e4-71b8-42dd-b9e5-36c6b84328cf tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770" status: 404 len: 111 microversion: 2.1 time: 0.039723 Oct 04 18:41:41.332447 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3333/6640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:41 2022] GET /compute/v2.1/servers/fb5746e2-4945-469f-993c-532db1c6c770 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:41.335383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.335931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.342168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.342668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.343110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.343857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.344317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.344749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.360510 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf HTTP/1.1 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c5d31af0-6c73-4174-8c2e-e383ea1614cf'} Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:41.362677 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-993dc90c-9c15-4316-b3aa-edfff4ee4088 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 404 len: 111 microversion: 2.1 time: 0.032802 Oct 04 18:41:41.366516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3308/6641] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:41 2022] DELETE /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:41:41.373131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:41.373737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: c5d31af0-6c73-4174-8c2e-e383ea1614cf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:41.382332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.383153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.383153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.383880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:41.384342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:41.384767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:41.401487 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf HTTP/1.1 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c5d31af0-6c73-4174-8c2e-e383ea1614cf'} Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:41.403142 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance c5d31af0-6c73-4174-8c2e-e383ea1614cf could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:41.408699 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cd87b59e-df92-4412-b655-75287a14f7f8 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf" status: 404 len: 111 microversion: 2.1 time: 0.035790 Oct 04 18:41:41.418590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3334/6642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:41 2022] GET /compute/v2.1/servers/c5d31af0-6c73-4174-8c2e-e383ea1614cf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:44.927763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.929518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.938522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.940673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.941642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.942586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.943427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.944071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.961742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 HTTP/1.1 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '59426015-202a-416b-8604-dca27c4b4a57'} Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:44.964175 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:44.967883 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:41:44.969577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:44.970679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90956eb1-cbe7-4cb1-aa60-b184543dc721 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 404 len: 111 microversion: 2.1 time: 0.047958 Oct 04 18:41:44.972392 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3309/6643] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:41:44 2022] DELETE /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:41:44.984002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:41:44.986535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] [instance: 59426015-202a-416b-8604-dca27c4b4a57] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:41:44.996004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.996790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.997434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:44.998391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:41:44.999282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:41:44.999805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:41:45.015675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] HTTP exception thrown: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Request method failure captured: Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 HTTP/1.1 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPHyNZjtTiaQvIMWztl3LISxIoEF85Mnwfz4NtF9YDjait9LeRGWgy3gFEsaIOBt_5ixvSDbmBzheUsZ6FiFGGDJxJF8z8toZ7e9T0zW0m4g0rjsxnu7VySfviW4Ld3N3y8fI5TC3dj3QLIji-44zSf4HBulnhyjbXwvRbesVWYNj7J4 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c02ed3914fa54a7abbcf20b0dea33b6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c02ed3914fa54a7abbcf20b0dea33b6d"}]}] Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c02ed3914fa54a7abbcf20b0dea33b6d Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866651475 Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 0885e35eb9ba41a18665239f1b6c3bbe Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeNegativeTest-866651475-project Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '59426015-202a-416b-8604-dca27c4b4a57'} Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:41:45.017707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] Returning 404 to user: Instance 59426015-202a-416b-8604-dca27c4b4a57 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3c137308-0791-4a90-8a19-cdb18895f640 tempest-AttachVolumeNegativeTest-866651475 tempest-AttachVolumeNegativeTest-866651475-project] 10.222.0.40 "GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57" status: 404 len: 111 microversion: 2.1 time: 0.042900 Oct 04 18:41:45.020866 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3335/6644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:41:44 2022] GET /compute/v2.1/servers/59426015-202a-416b-8604-dca27c4b4a57 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:42:40.707643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=11 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:40.708604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=56 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:40.949649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:40.950242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:40.961208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.961718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.962165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.962883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:40.963350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:40.963821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:40.993113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d5929c1-a969-42c9-803c-6967d5965b08 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/ips" status: 200 len: 151 microversion: 2.20 time: 0.290999 Oct 04 18:42:41.000826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3310/6645] 10.222.0.40 () {60 vars in 1289 bytes} [Tue Oct 4 18:42:40 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/ips => generated 151 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:42:44.249337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:42:44.249903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.252260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=9 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:44.252931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:44.258435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.265402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.265402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.265402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.265402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.265402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.284987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lazy-loading 'flavor' on Instance uuid a82404fd-a622-4ca4-9c67-36d44bf076fe {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:42:44.897148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2572cd38-5ec4-4132-b331-fe42280c14f8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/action" status: 202 len: 0 microversion: 2.20 time: 0.652535 Oct 04 18:42:44.897827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3336/6646] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:42:44 2022] POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:44.913533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:44.914333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:44.929392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.930234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.931370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:44.932341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:44.933003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:44.933676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:45.147174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.157257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.159048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:45.160591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d8bf6a8a-638c-4892-a35b-9bdecbc983d8 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.258435 Oct 04 18:42:45.172659 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3311/6647] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:44 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:46.196610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:46.197914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:46.205754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.206531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.207182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.208766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:46.209413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:46.210198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:46.402125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.412319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.413898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:46.415547 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d77e82b9-d05e-4456-b606-c081081f138b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.226659 Oct 04 18:42:46.423417 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3337/6648] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:46 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:47.443671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:47.444353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:47.451115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.451636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.452075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.452762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:47.453256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:47.453685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:47.613984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.627434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.629447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:47.630675 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-721af863-d7ec-480d-8614-4f4ceee04d8d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.190944 Oct 04 18:42:47.631251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3312/6649] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:47 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:48.657264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:48.658516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:48.669467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.670210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.670826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:48.671856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:48.676054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:48.676054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:49.095409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.106531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.108128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:49.109356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2bcd146a-afb9-4ab9-849e-c8fbf0e4bda1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.456616 Oct 04 18:42:49.112321 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3338/6650] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:48 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:50.135038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:50.135709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:50.144081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.144811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.145481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.146375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:50.148130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:50.149437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:50.515648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.528357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.537241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:50.545115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-728f2464-9272-4a1b-b0f7-7f52633eb881 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.407775 Oct 04 18:42:50.547450 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3313/6651] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:50 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:51.578600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:51.579229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:51.586819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.587209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.587702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.588525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:51.595008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:51.595008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:51.816482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.827049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.829435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:51.830751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6ee9251-170e-4af0-82d6-ddd9d295a938 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.261421 Oct 04 18:42:51.831336 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3339/6652] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:51 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:52.857225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:52.859058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:52.867765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.868808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.869228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:52.871596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:52.872095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:52.873001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:53.045348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.054100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.055573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:53.056804 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b522b867-1dde-4544-878e-a78add6d228e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.203994 Oct 04 18:42:53.057373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3314/6653] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:52 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:42:54.085325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:54.085974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:54.093205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.094199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.094645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.095339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:54.095873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:54.096307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:54.262423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.272130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.273607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:54.274801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1e058c3-01d6-44a3-a860-d33bd4e54efb tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.193583 Oct 04 18:42:54.275372 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3340/6654] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:54 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:55.303400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:55.304525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:55.315216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.315767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.316206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.316907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:55.317728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:55.318189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:55.460212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.468717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.470169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:55.471602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f780687f-e05d-422d-b208-b61515551671 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.174133 Oct 04 18:42:55.472477 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3315/6655] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:55 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:56.501364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:56.502274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:56.508971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.509454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.509891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.510589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:56.511042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:56.511515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:56.676748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.685632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.687983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:56.689509 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5fc6ab7-5a3d-4adb-a76d-cdd0a54494c9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.193660 Oct 04 18:42:56.690172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3341/6656] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:56 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:57.716178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:57.716909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:57.724687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.725252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.725883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.727197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:57.727862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:57.728553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:57.897925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.908087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.909864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:57.911098 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a02f50ed-1150-424a-8eaa-8aa04e2f38c2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.198948 Oct 04 18:42:57.912084 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3316/6657] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:57 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:42:58.945267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:58.945887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:58.958937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.175118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.184207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.185997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:42:59.188150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c90a9bac-d0d2-4a9f-9731-c2214c0d205b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.246206 Oct 04 18:42:59.194693 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3342/6658] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:42:58 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:00.219399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.220136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.227115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.227725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.228238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.229014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.229541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.230039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.421591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.432686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.434351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.435793 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ca3430d-28c8-4e47-8e90-38ee5f585ff6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.220814 Oct 04 18:43:00.448203 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3317/6659] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:00 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:01.470361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.471934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.494461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.495247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.511775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.520306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.523688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.525382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.737400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.749827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.751401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.753452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17ef21fe-4e96-4285-aba9-71604fa9ceb1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1743 microversion: 2.20 time: 0.290652 Oct 04 18:43:01.754138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3343/6660] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1743 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:02.782314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.784982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.792294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.793095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.794255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.795188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.796072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.797318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.017229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.043992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.046034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:03.048077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-19cc9c47-d691-462f-a2f7-c639bfc2259b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1743 microversion: 2.20 time: 0.271369 Oct 04 18:43:03.049752 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3318/6661] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:04.081138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.081740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "name": "network-vif-plugged", "status": "completed", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:04.082878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.090065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.090709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.091232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.091773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.092115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.092259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.092693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.092803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.093423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.104550 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] Creating event network-vif-plugged:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h2-833090-21 Oct 04 18:43:04.110734 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5d3ac61b-c5b1-45be-90d5-28872469f395 req-4940fef2-4b5e-4347-8ac2-d6af0dd11ffe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Oct 04 18:43:04.111366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3319/6662] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:04.267442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:04.293755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:04.295227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:04.298934 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78df21a0-589b-4b28-87d1-ec9b97226c57 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1743 microversion: 2.20 time: 0.221910 Oct 04 18:43:04.321262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3344/6663] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1743 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:05.331366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:05.332370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:05.338827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.339431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.340004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.340840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:05.341395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:05.342147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:05.534687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.548441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.550534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:05.551983 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0896f642-1ba3-4b27-bc23-fbfd3b942533 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1743 microversion: 2.20 time: 0.226589 Oct 04 18:43:05.553202 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3320/6664] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:05 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:06.577983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:06.578600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:06.594267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.594492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.597947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.597947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:06.597947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:06.597947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:06.802159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.813827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.816327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:06.818515 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c10ccc6a-7079-48b6-8df9-120e2922b001 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.244616 Oct 04 18:43:06.819790 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3345/6665] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:06 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:07.853161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:07.856325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:07.881021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.881990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.883819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:07.884793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:07.886383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:07.889422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:08.322240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.331867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.340022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:08.342537 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f5e5a7e-f2e7-459f-9f41-c4668d456be6 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.498783 Oct 04 18:43:08.344572 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3321/6666] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:07 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:09.369946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:09.371222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:09.379589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.380103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.380528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.381465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:09.382079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:09.382515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:09.694939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.708858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.711362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:09.712891 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-514f5f34-d6d2-40da-ac96-d0d02d823250 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.347521 Oct 04 18:43:09.724397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3346/6667] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:09 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:10.743099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:10.743723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:10.760249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.760756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.763006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.766224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:10.766854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:10.768191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:10.953583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.955612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=71 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:10.969822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.971621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:10.973066 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17cb33c4-3880-4931-8742-02d080f4d90b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.233984 Oct 04 18:43:10.973840 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3322/6668] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:10 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:12.008816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:12.009450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:12.019683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.020193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.020650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.023754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:12.024326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:12.024787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:12.189398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.198516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.200012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:12.201161 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-465763e7-ab9f-4ee3-a74c-7827b8d2683c tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.197355 Oct 04 18:43:12.201957 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3347/6669] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:12 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:13.228602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:13.229297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:13.237029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=27 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:13.238643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.239360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.240205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.241147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:13.242029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:13.242699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:13.906677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.917434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.919269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:13.920713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-430b1307-ee53-42b6-8fdc-61954ff8ad4e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.696263 Oct 04 18:43:13.921504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3323/6670] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:13 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:14.954057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:14.955306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:14.971921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=25 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:14.981902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.984628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.984628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.984628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:14.984628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:14.985197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:14.989727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:15.206244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.228191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.245165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:15.247864 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e85a016b-823c-4f1f-b07d-d4e398a2f243 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.299011 Oct 04 18:43:15.249571 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3348/6671] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:14 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:16.279391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:16.280148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:16.290212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.294019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.299391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.300357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:16.301232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:16.301868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:16.647160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.659981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.661750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:16.664772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00645bb0-e2c6-496c-a710-ef2c7a822832 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.388724 Oct 04 18:43:16.684177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3324/6672] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:16 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:17.698783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:17.700064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:17.719177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.721386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.722250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:17.723742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:17.727045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:17.727683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:18.008924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.017881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.020103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:18.021853 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e62ad26-602e-4d29-bfc8-0797df6e3be3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.330169 Oct 04 18:43:18.051319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3349/6673] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:17 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:19.065779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:19.065779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:19.075953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.092279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.094589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.094589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:19.094589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:19.095195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:19.433978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.451198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.451198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:19.451198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0072ca1-a775-4922-b625-1cf298273464 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.395486 Oct 04 18:43:19.466114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3325/6674] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:19 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:20.475130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:20.475918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:20.487438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.487967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.488408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.489117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:20.499171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:20.499932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:20.764094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.773700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.775850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:20.776440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0e96c84-0bd2-4bf5-a97f-7ec4f9c3e5b4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.306735 Oct 04 18:43:20.784934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3350/6675] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:20 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:21.804051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:21.806332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:21.812812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.813859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.814507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:21.815410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:21.816107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:21.816735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:22.102268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.112274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.114576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:22.116358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2be8040-4bc1-473d-92cc-08941a8a3d31 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.316872 Oct 04 18:43:22.117826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3326/6676] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:21 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:23.154034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:23.154659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:23.172416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.173116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.173710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.174590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:23.175212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:23.175830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:23.373178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.381931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.384447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:23.386816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-873e2b4f-79f7-4a57-b943-1eabd9ccc8ea tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1738 microversion: 2.20 time: 0.236548 Oct 04 18:43:23.387508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3351/6677] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:23 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:24.414608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:24.416018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:24.424017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.424701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.425327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.426314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:24.426923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:24.427609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:24.737021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.746510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.748247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:24.750123 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61e76861-ac24-4365-ac31-2861a7a45c59 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1720 microversion: 2.20 time: 0.340167 Oct 04 18:43:24.751193 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3327/6678] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:24 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1720 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:25.777117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:25.778448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:25.787324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.788085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.788738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.789795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:25.790480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:25.791107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:25.956699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.965043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.966658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:25.967886 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bddbda1-291d-4dc5-a737-a5ee37301637 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1720 microversion: 2.20 time: 0.195247 Oct 04 18:43:25.968453 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3352/6679] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:25 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:26.995502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:26.996161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.003675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.004690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.005296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.006692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.007315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.007928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.215542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.223070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.226514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:27.228217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-648bc1ca-13b4-4ff9-a33f-1210b5a081b1 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1723 microversion: 2.20 time: 0.236989 Oct 04 18:43:27.229077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3328/6680] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:26 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:27.253651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6bb0dd-ef29-4922-a4e3-642da1fc43ab"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:27.259869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:27.273462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.273956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.274395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:27.275149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:27.275676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:27.277567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.323157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "name": "network-vif-unplugged", "status": "completed", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:28.333684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.334411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.334841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.353387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_external_events [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] Unable to find a host for instance a82404fd-a622-4ca4-9c67-36d44bf076fe. Dropping event network-vif-unplugged {{(pid=123886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:43:28.354277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bd1f7057-01dd-4ddf-863a-61696fb92e2a req-864059d3-e975-4212-b23c-805dae1e6c2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035052 Oct 04 18:43:28.354829 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3329/6681] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:43:28.778013 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-46022232-df3d-4206-a45a-3010855204ca tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.528311 Oct 04 18:43:28.778645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3353/6682] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 4 18:43:27 2022] POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments => generated 188 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:43:28.938986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:28.939502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:28.945885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.946596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.947048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:28.947858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:28.948323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:28.948761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.702018 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b43c1284-43c3-4624-8375-fe5b27d50d79 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments/6c6bb0dd-ef29-4922-a4e3-642da1fc43ab" status: 202 len: 0 microversion: 2.20 time: 0.767211 Oct 04 18:43:29.703151 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3330/6683] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 4 18:43:28 2022] DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments/6c6bb0dd-ef29-4922-a4e3-642da1fc43ab => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:29.778652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:29.778652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:29.780445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.781026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.781564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.782408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:29.782959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:29.783499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:29.974214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123887) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:43:30.373046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c06d1598-15df-433b-a01f-f14289caeb3e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/action" status: 202 len: 0 microversion: 2.20 time: 0.604874 Oct 04 18:43:30.373687 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3354/6684] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 4 18:43:29 2022] POST /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:43:30.382033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:30.382663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:30.390689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.391177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.391652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.392352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:30.392811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:30.393245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:30.522176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.533058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.534544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:30.535776 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67a811c8-f38d-42cf-b27b-9f4d2c3669d3 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1671 microversion: 2.20 time: 0.157789 Oct 04 18:43:30.551199 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3331/6685] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:30 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:31.565079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:31.566910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:31.577374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.578037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.578665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.579963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:31.584697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:31.584697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:31.739753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.753269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.757483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:31.758792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8e6573cc-b428-4fa6-a52a-7acb859b83f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1671 microversion: 2.20 time: 0.200061 Oct 04 18:43:31.759363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3355/6686] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:31 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:32.786085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:32.787147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:32.796562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.797056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.797549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.798301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:32.798764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:32.799195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:32.963448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.973110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.974801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:32.976034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f12cb34f-7a2f-428c-be49-462594a5049d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.195189 Oct 04 18:43:32.976925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3332/6687] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:32 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:34.003333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:34.003981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:34.010670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.011327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.011796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.012801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.013428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.013863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.101603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:34.113641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:34.114361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:34.115638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:34.128085 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] Creating event network-changed:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h1-833090-21 Oct 04 18:43:34.133593 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e333ca1d-758e-4ab8-a228-4d0f2c6102a4 req-813634f9-3691-4868-8f7f-037eb53c6d18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Oct 04 18:43:34.134194 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3333/6688] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:43:34.292603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.305804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.307549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:34.309006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74a7f552-14da-4c24-9d81-0163b443c848 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.310755 Oct 04 18:43:34.309795 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3356/6689] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:33 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:35.337684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:35.341547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:35.345086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.345609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.346058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.346756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:35.347222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:35.347734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:35.576576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.586513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.596843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:35.598132 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43b56b53-be02-4ecd-a7b9-a1c15c9db5fe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.265833 Oct 04 18:43:35.598733 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3334/6690] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:35 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:36.628934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:36.629674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:36.640436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.640436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.640436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.646910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:36.648724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:36.649752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:36.963125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.972729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.974208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:36.975517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-936eddbe-41de-4755-a945-fd9a45b03419 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.351152 Oct 04 18:43:36.976136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3357/6691] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:36 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:38.003945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:38.005226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:38.012783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.013651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.014252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.015324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:38.016058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:38.016647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:38.258001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.270612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.272558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:38.274241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16767390-c8a5-417f-8db7-d037c1a1d2f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.275866 Oct 04 18:43:38.275519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3335/6692] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:37 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:39.305285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:39.305970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:39.313549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.314044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.314484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.315183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:39.315669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:39.316101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:39.508905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.533922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.536067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:39.537600 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b61c098c-8d2a-4196-8c7d-77be94f7cb52 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.236178 Oct 04 18:43:39.539898 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3358/6693] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:39 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:40.567499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:40.568207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:40.587792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.591976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.591976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.591976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:40.591976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:40.591976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:40.907143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.917193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.924132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:40.924542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bae41b6-f85a-482b-91c5-a66495a4ea28 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.361556 Oct 04 18:43:40.940114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3336/6694] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:40 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:41.952401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:41.962806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:42.123452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.134261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.135876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:42.137498 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c807f0ac-2697-4025-b8e0-83b5a1674c65 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.189482 Oct 04 18:43:42.139433 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3359/6695] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:41 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:43.165142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:43.170246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:43.185301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.190573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.191299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.192300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:43.193006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:43.197222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:43.404312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.424042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:43.424042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.424042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:43.424042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a16b454-7283-4b04-8345-bddca3cc8eaa tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.257962 Oct 04 18:43:43.424042 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3337/6696] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:43 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:44.446743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:44.447622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:44.460895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.461354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.461796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.462518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:44.462975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:44.463411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:44.725416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.742445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.745159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:44.747495 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c7de868-68ca-463a-b9b4-71a6d58683b7 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.304076 Oct 04 18:43:44.751621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3360/6697] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:44 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:43:45.784738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:45.785359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:45.788215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=30 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:45.797336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.802778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.802778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.802778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:45.802778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:45.802778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:45.964842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.974167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.980857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:45.980857 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61e90022-05fb-4084-b787-121f63a50a77 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.198469 Oct 04 18:43:45.980857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3338/6698] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:45 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:47.004191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:47.005938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:47.010600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:47.016321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.017099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.018006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.019279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:47.020078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:47.020756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:47.023963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:47.212050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.223223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.224789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:47.226501 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dade6f17-dd8c-41e0-95fc-c82b1191a503 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.227449 Oct 04 18:43:47.227965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3361/6699] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:46 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:48.255404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:48.255982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:48.264853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.265357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.265802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.266521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:48.266985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:48.267545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:48.406356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.414833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.416371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:48.417543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa4e79dd-332d-423a-8cae-b4b93b251fb9 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.168677 Oct 04 18:43:48.418113 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3339/6700] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:48 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:49.444473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:49.445231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:49.461329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.461825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.462267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.462979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:49.463437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:49.463943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:49.640729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.649505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.651043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:49.652609 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1af9c58-ee9c-4e6b-8e3e-4fa1527edb2f tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.212571 Oct 04 18:43:49.653555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3362/6701] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:49 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:50.681156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:50.681156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:50.696019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.696019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.696274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.702741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:50.702741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:50.702741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:50.855078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.864159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.865639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:50.866938 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b769a3d-4ed7-43dc-b512-fbbbe55a01f2 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.192207 Oct 04 18:43:50.867948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3340/6702] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:50 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:51.818847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "name": "network-vif-plugged", "status": "completed", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:51.829362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.829843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.830266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.841799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] Creating event network-vif-plugged:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h1-833090-21 Oct 04 18:43:51.847833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6cf58c65-496c-44ef-9ddf-c0ee955f5789 req-4449d977-bd74-4fa3-a40d-da2d40eb9a6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035352 Oct 04 18:43:51.848430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3363/6703] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:51.898383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:51.899080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:51.909546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.910054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.910586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:51.911318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:51.911822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:51.912259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:52.100660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.109423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.110889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:52.112456 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0abae82-de14-4214-9968-41d9acd40af4 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.218345 Oct 04 18:43:52.113027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3341/6704] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:51 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:53.139679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:53.140391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:53.147913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.148404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.151947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.151947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:53.151947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:53.151947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:53.304949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.325618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.327766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:53.329239 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f051be25-648a-4d53-9a96-32e692e10288 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.194989 Oct 04 18:43:53.345093 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3364/6705] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:53 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:54.358405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:54.359020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:54.366070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.371620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.371620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.371620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:54.371620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:54.371620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:54.550321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.559612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.561347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:54.562798 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0162e5e4-b6fa-40bb-97bd-6509b744c236 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1729 microversion: 2.20 time: 0.208405 Oct 04 18:43:54.581453 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3342/6706] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:54 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:43:55.588588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:55.589199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:55.596539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.597021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.597483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.598168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:55.605710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:55.605710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:55.740118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.744069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.745630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:55.746913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5abc47f1-308f-4631-b88a-f4a47c54d6ec tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1716 microversion: 2.20 time: 0.162337 Oct 04 18:43:55.747965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3365/6707] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:43:55 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:11.676264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:11.677049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=31 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:11.814562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-270722120", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "c8b33563-c68c-4f6e-8775-0518461fc25f"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:11.872233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] validate_networks() for [('c8b33563-c68c-4f6e-8775-0518461fc25f', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:12.360064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:12.360498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:12.360979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:12.361430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:12.361881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:12.371095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.371616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.372058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.372912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:12.373423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:12.373803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:12.399989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Getting quotas for project 8c0ad3c4095244c280d4ff73e725a41e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:12.405834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Getting quotas for user 174b5456d2354180844af0be6b27ce41 and project 8c0ad3c4095244c280d4ff73e725a41e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:12.418743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:12.421176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:12.539543 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:44:13.550273 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 58538. Oct 04 18:44:13.555263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74a9cb78-3ddf-4fde-a7d8-8ed93a659b0b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884906 Oct 04 18:44:13.556134 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3343/6708] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:13.568657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb19fccc-71cc-4a14-b3a0-61cc5277aa60 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:13.569883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cb19fccc-71cc-4a14-b3a0-61cc5277aa60 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:13.576448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=9 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:13.577907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=25 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:13.634784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cb19fccc-71cc-4a14-b3a0-61cc5277aa60 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:13.643325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb19fccc-71cc-4a14-b3a0-61cc5277aa60 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1213 microversion: 2.1 time: 0.078444 Oct 04 18:44:13.656147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3366/6709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:13 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:14.666514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-056bdf77-c49e-44f7-ae71-2e87fb46e90b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:14.667230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-056bdf77-c49e-44f7-ae71-2e87fb46e90b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:14.848574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-056bdf77-c49e-44f7-ae71-2e87fb46e90b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:14.859575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-056bdf77-c49e-44f7-ae71-2e87fb46e90b tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1213 microversion: 2.1 time: 0.193839 Oct 04 18:44:14.859575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3344/6710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:14 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:15.880189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:15.880840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:15.889477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.889962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.890594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.891288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:15.891766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:15.892192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:15.959036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:15.969243 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d47d717-596a-4298-ace8-eaa87a735979 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1265 microversion: 2.1 time: 0.093296 Oct 04 18:44:15.969953 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3367/6711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:15 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:16.993071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:16.994298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:17.005826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.006744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.007200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.007938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:17.008520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:17.018604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:17.093666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:17.102765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-abe81e21-9418-45e5-b5c1-fb0d6f64684e tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1271 microversion: 2.1 time: 0.113781 Oct 04 18:44:17.105718 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3345/6712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:16 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:18.131098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:18.131809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:18.139111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.140385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.140829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.141540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.141998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.142429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.254754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7953e92-8ab3-4c68-92d1-18d9385cac3f", "tag": "7c9fa0c3-e230-43f8-bd76-d5a318a263a9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:18.266019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:18.266771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:18.268181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:18.279732 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] Creating event network-changed:7c9fa0c3-e230-43f8-bd76-d5a318a263a9 for instance f7953e92-8ab3-4c68-92d1-18d9385cac3f on n-h1-833090-21 Oct 04 18:44:18.287163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-34e2ce67-e976-4de0-9041-3f74361ca8a8 req-c3d6c3fe-a197-4d8c-bc9b-0c7610295672 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035958 Oct 04 18:44:18.289029 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3346/6713] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:18.398503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:18.409367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7e300f2-ce16-42f7-be8d-3944b5fae44d tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.280417 Oct 04 18:44:18.409367 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3368/6714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:18 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:19.433289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:19.433914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:19.440805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.441290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.441727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.442421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:19.442876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:19.443613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:19.587697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:19.596037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4cee4140-db88-465f-9f81-e773ab55b8c0 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.167880 Oct 04 18:44:19.596620 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3347/6715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:19 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:20.618995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:20.619683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:20.628007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.628409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.628793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.629484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:20.629994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:20.630602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:20.804214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:20.814369 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a68d70b-2861-4887-8cd5-9bfcbe8cf268 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.198718 Oct 04 18:44:20.818057 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3369/6716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:20 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:21.841639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:21.842891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:21.850403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.850910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.851360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:21.852124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:21.852657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:21.853096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:22.071029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:22.086101 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b25bbdb-4d3b-40d5-84b4-39428f6752ff tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.248985 Oct 04 18:44:22.099753 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3348/6717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:21 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:23.117568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:23.119134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:23.127514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.128383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.128967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.130164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:23.130799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:23.131237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:23.565644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:23.573742 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d585e9f-743e-4e2c-a3db-2ac99c3eb571 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.461035 Oct 04 18:44:23.574324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3370/6718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:23 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:24.002903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7953e92-8ab3-4c68-92d1-18d9385cac3f", "name": "network-vif-plugged", "status": "completed", "tag": "7c9fa0c3-e230-43f8-bd76-d5a318a263a9"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:24.012743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:24.019987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.028281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.028971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.043276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] Creating event network-vif-plugged:7c9fa0c3-e230-43f8-bd76-d5a318a263a9 for instance f7953e92-8ab3-4c68-92d1-18d9385cac3f on n-h1-833090-21 Oct 04 18:44:24.049423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-37d4bfdf-a922-4e43-8954-06f20180a36d req-dfe92b6c-b4fc-47d6-95cb-d108f5f9d561 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051495 Oct 04 18:44:24.050153 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3349/6719] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:24.597704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:24.598676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:24.600781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:24.602658 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:44:24.602808 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:44:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f (ip 10.222.0.40) !!! Oct 04 18:44:24.620319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.620818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.621377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.622088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:24.622541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:24.622967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:24.776434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:24.792311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae43148a-7bb8-4c0d-9a77-f5dfbf12b8ec tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1313 microversion: 2.1 time: 0.191141 Oct 04 18:44:24.792311 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3371/6720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:24 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:25.805879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:25.806905 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:44:25.807054 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 18:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f (ip 10.222.0.40) !!! Oct 04 18:44:25.813330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:25.814037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:25.823642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.824131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.824569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.825262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:25.825717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:25.826144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:25.974810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:25.982982 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dd46f87-7cea-4dd0-a72a-dc02e1a0d3d6 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1496 microversion: 2.1 time: 0.178233 Oct 04 18:44:25.983585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3350/6721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:25 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1496 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:28.434705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.438021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.456617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.481373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff0817e8-c5fe-4535-a1cb-cef3104c7f4b tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051152 Oct 04 18:44:28.481944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3372/6722] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:28.554446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.554446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.564237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.565464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.566095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.566821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.567294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.567782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.599969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:28.932606 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-60fb22d0-db9f-43dd-85d2-ed16c718145d tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 204 len: 0 microversion: 2.20 time: 0.385405 Oct 04 18:44:28.933834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3351/6723] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:44:28 2022] DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:44:28.943855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:28.944898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:28.961931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.964450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.964450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:28.964450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:28.964450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:28.964911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:29.116560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:29.127034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:29.128860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:29.130143 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e84101d-6e39-4219-ba89-51760a602f0e tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.190920 Oct 04 18:44:29.130678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3373/6724] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:28 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:30.158508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:30.160425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:30.167798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.168377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.168923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.170381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:30.170911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:30.171416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:30.337358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.347360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.348944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:30.350163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c9a5244-8016-4be3-9276-35ef48a4b115 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1722 microversion: 2.20 time: 0.197280 Oct 04 18:44:30.350767 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3352/6725] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:30 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:31.074531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.075747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.081954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.082441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.082877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.083598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.084056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.084482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.111712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:31.375927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.377309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.393124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.393867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.394776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.395737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.396389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.397030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.481008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.507513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.521286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.521286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94be784f-fe56-4c1f-b022-9fce9eb80160 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1655 microversion: 2.20 time: 0.142629 Oct 04 18:44:31.521286 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3353/6726] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:31.571918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e430754c-f277-4e87-a1bf-e7c092a0ec96 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 204 len: 0 microversion: 2.1 time: 0.500935 Oct 04 18:44:31.576023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3374/6727] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:31 2022] DELETE /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:31.581080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:31.581712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:31.592711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.593472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.593986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.596559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.597147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.597895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.773339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82404fd-a622-4ca4-9c67-36d44bf076fe", "name": "network-vif-deleted", "tag": "53511986-920a-4cac-9b3f-b0922ef6a8b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:31.797484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:31.798292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:31.798924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:31.812600 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] Creating event network-vif-deleted:53511986-920a-4cac-9b3f-b0922ef6a8b9 for instance a82404fd-a622-4ca4-9c67-36d44bf076fe on n-h1-833090-21 Oct 04 18:44:31.819164 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a1a91704-4130-4d79-94e5-4d135afc1995 req-7f60d0e2-2d3a-42f7-9899-6012ec4e58c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050166 Oct 04 18:44:31.819541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:31.820254 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3375/6728] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:44:31.828957 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3979f8c0-8a68-41cc-845d-197adb8f58e1 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1502 microversion: 2.1 time: 0.251850 Oct 04 18:44:31.829549 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3354/6729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:31 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:32.547359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:32.548782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:32.557539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.558667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.559314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.560513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.561897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.562802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.639821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.648601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.650320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94e0ec1aeb9d46f48802ddcd78a9e1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fca84063bd74931ac5b7d6473c38255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:32.651596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80347490-4186-42cf-bbcd-5ebdf0aad603 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 200 len: 1655 microversion: 2.20 time: 0.111053 Oct 04 18:44:32.652112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3376/6730] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:32 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 1655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:44:32.853742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:32.856137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:32.863506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.864637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.865277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:32.866234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:32.869743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:32.870422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.073575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:33.089223 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-caf9d782-edc2-4058-aadc-57db02a9cd73 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1502 microversion: 2.1 time: 0.234834 Oct 04 18:44:33.096985 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3355/6731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:32 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:33.677576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.678193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:33.693041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.694168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.694614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.695337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.695849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.696278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.713056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe HTTP/1.1 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a82404fd-a622-4ca4-9c67-36d44bf076fe'} Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:33.714839 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:33.719318 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:33.721255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:33.722110 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bec4c97b-a504-4328-bb0a-d35e31e39db5 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 404 len: 111 microversion: 2.20 time: 0.048527 Oct 04 18:44:33.722956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3377/6732] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:33 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:33.731439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e08ae0e9-bb41-4017-bded-d0234881149a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '.version_select at 0x7f90082244c0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:33.840090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7953e92-8ab3-4c68-92d1-18d9385cac3f", "name": "network-vif-deleted", "tag": "7c9fa0c3-e230-43f8-bd76-d5a318a263a9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:33.847740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e08ae0e9-bb41-4017-bded-d0234881149a tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-555830397" status: 204 len: 0 microversion: 2.20 time: 0.120114 Oct 04 18:44:33.852956 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3356/6733] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 4 18:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-555830397 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:44:33.859501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:33.860054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:33.861327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:33.876328 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] Creating event network-vif-deleted:7c9fa0c3-e230-43f8-bd76-d5a318a263a9 for instance f7953e92-8ab3-4c68-92d1-18d9385cac3f on n-h1-833090-21 Oct 04 18:44:33.883178 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2b903437-b01b-434b-9776-cf2c1aca4e5e req-382455c6-7f72-4481-8551-81cebb78c587 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047758 Oct 04 18:44:33.885698 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3378/6734] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:34.120108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:34.120967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:34.135063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.135063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.135063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.135063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.135353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.135942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.210811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:34.210811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:34.210811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:34.210811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lazy-loading 'fault' on Instance uuid f7953e92-8ab3-4c68-92d1-18d9385cac3f {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:34.309945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b5456d2354180844af0be6b27ce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0ad3c4095244c280d4ff73e725a41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:34.323813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3b1d031-9281-407a-8bc7-f83f34b89099 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 200 len: 1303 microversion: 2.1 time: 0.209017 Oct 04 18:44:34.333023 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3357/6735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:34 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:34.693662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1987479577", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "e08d0e66-2870-4dfe-b142-d8322ec06a9e"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:34.754458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] validate_networks() for [('e08d0e66-2870-4dfe-b142-d8322ec06a9e', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:35.171593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:35.171593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:35.171593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:35.171593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:35.171593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:35.176480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.177231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.177826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.178783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.179248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.179721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.199459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Getting quotas for project fddee54aa6af46cbac5f568848dad1e8. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:35.205396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Getting quotas for user 2f51d7b27e414609a06384d9dad5dcd7 and project fddee54aa6af46cbac5f568848dad1e8. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:35.217964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:35.232137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:35.350629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.351552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] [instance: f7953e92-8ab3-4c68-92d1-18d9385cac3f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.357738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.358227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.358696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.359403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:35.359887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:35.360373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:35.375581 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] HTTP exception thrown: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Request method failure captured: Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f HTTP/1.1 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH75t1vzxTfhWWjXLza4MHboueiqENXI1Q1si8HHh8fTVV6tFN296jYu4VQgXAgWTgvIOcPSD5ORyYCpKEos0jj6aMmirIS0IXXS1eTtm7EXr6G_GM7u9O2x-CC4VQI_WhPPdSmGKYB2ZZ9kmzWoXGjCEoh3OTaMratV2XEw0tUYkD4 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 8c0ad3c4095244c280d4ff73e725a41e Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesActionsTest-863182064 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c0ad3c4095244c280d4ff73e725a41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c0ad3c4095244c280d4ff73e725a41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c0ad3c4095244c280d4ff73e725a41e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c0ad3c4095244c280d4ff73e725a41e"}]}] Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesActionsTest-863182064 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 8c0ad3c4095244c280d4ff73e725a41e Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesActionsTest-863182064 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesActionsTest-863182064-project Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 174b5456d2354180844af0be6b27ce41 Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesActionsTest-863182064-project Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'f7953e92-8ab3-4c68-92d1-18d9385cac3f'} Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:35.376709 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] Returning 404 to user: Instance f7953e92-8ab3-4c68-92d1-18d9385cac3f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4303b91b-82d5-4952-b693-4f44e5aaef24 tempest-VolumesActionsTest-863182064 tempest-VolumesActionsTest-863182064-project] 10.222.0.40 "GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f" status: 404 len: 111 microversion: 2.1 time: 0.033494 Oct 04 18:44:35.381892 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3358/6736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/f7953e92-8ab3-4c68-92d1-18d9385cac3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:44:35.403785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7caf426-aa9c-469c-821c-cfdc526c2e2c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714829 Oct 04 18:44:35.404846 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3379/6737] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:44:35.416115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15ad32b9-8b3a-4c6c-a494-c949b8208c92 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:35.416115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15ad32b9-8b3a-4c6c-a494-c949b8208c92 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:35.490430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15ad32b9-8b3a-4c6c-a494-c949b8208c92 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:35.500648 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15ad32b9-8b3a-4c6c-a494-c949b8208c92 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1214 microversion: 2.1 time: 0.088438 Oct 04 18:44:35.502560 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3359/6738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:35 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:36.525966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a407a6e8-5f31-457e-bc40-408964ae1944 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:36.526593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a407a6e8-5f31-457e-bc40-408964ae1944 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:36.584955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a407a6e8-5f31-457e-bc40-408964ae1944 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:36.596962 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a407a6e8-5f31-457e-bc40-408964ae1944 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1214 microversion: 2.1 time: 0.076383 Oct 04 18:44:36.611647 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3380/6739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:36 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:37.620579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:37.621206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:37.630097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.630591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.631036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.631767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:37.632235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:37.632670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:37.697921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:37.706465 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb920b2c-0b5e-42d0-89e1-107891e91d89 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1266 microversion: 2.1 time: 0.089897 Oct 04 18:44:37.707031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3360/6740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:37 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:38.354982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.355528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.362805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.363428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.363900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.364593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.365168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.365600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.380356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe HTTP/1.1 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a82404fd-a622-4ca4-9c67-36d44bf076fe'} Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:38.382015 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f11d494-408d-44a3-a559-0fdf0c727c68 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 404 len: 111 microversion: 2.20 time: 0.032534 Oct 04 18:44:38.386668 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3381/6741] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:44:38 2022] DELETE /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:38.392856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.393522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: a82404fd-a622-4ca4-9c67-36d44bf076fe] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.399668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.400150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.400586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.401555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.402019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.402449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.417905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe HTTP/1.1 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a82404fd-a622-4ca4-9c67-36d44bf076fe'} Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.420215 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. Oct 04 18:44:38.424707 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:38.425809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance a82404fd-a622-4ca4-9c67-36d44bf076fe could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:38.426697 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5456f01-df6a-4361-88f3-20a804485282 tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe" status: 404 len: 111 microversion: 2.20 time: 0.038351 Oct 04 18:44:38.449770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3361/6742] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/a82404fd-a622-4ca4-9c67-36d44bf076fe => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:38.729707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:38.730319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:38.743504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.744011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.744457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.745178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:38.745634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:38.746073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:38.914545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:38.926671 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d90dedc3-a0f3-4087-9a1b-686417d464df tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1284 microversion: 2.1 time: 0.200580 Oct 04 18:44:38.933956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3382/6743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:38 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:39.949827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:39.951264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:39.963133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.963611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.964060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:39.964775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:39.965241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:39.965678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.140046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:40.149170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29a535b1-bd86-461b-a358-5806438ee7ee tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.203390 Oct 04 18:44:40.150663 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3362/6744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:39 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:40.399155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131a3fbd-26f4-4828-9452-874efb0dac6d", "tag": "81d1f9b2-68f4-42d1-93dd-cc430c1af326"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:40.416160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:40.418712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:40.419338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:40.438647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] Creating event network-changed:81d1f9b2-68f4-42d1-93dd-cc430c1af326 for instance 131a3fbd-26f4-4828-9452-874efb0dac6d on n-h1-833090-21 Oct 04 18:44:40.449974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9b27de11-958a-404d-85d8-d5d015498c93 req-91b2f1aa-f8ed-4930-86c9-eee693c81f07 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062231 Oct 04 18:44:40.450713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3383/6745] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:41.173217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:41.173895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:41.181533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.182036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.182553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.183187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:41.183871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:41.184309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:41.340477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:41.344754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:41.350480 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-50a2dc1f-3803-4d76-8e9c-37a32483cb90 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.181278 Oct 04 18:44:41.351179 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3363/6746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:41 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:42.375205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:42.376539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:42.383629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.384347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.384966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.385850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:42.386477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:42.386915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:42.583607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:42.602535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7cef14c-024c-4707-ac4f-984ab8fccd52 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.232493 Oct 04 18:44:42.614706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3384/6747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:42 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:43.628747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:43.630235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:43.638256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:43.640779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.641595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.642222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.643125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:43.643812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:43.645307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:43.805599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:43.820595 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de261745-157d-4396-9357-665843af5965 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.197756 Oct 04 18:44:43.823836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3364/6748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:43 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:44.847878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:44.849228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:44.856795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.858537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.859335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:44.860303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:44.860968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:44.861633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.014964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:45.024042 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aae69830-9fb7-4adc-bfd4-782151479b88 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.180943 Oct 04 18:44:45.029829 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3385/6749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:44 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:45.140674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.142958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.148421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.149105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.149555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.150279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.150712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.151141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.168008 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 HTTP/1.1 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2001502a-a48c-438b-82dc-6e7f2749e8e1'} Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:45.169595 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:45.174085 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8577a27d-e7a8-4cef-a9c9-f3b7b4a232ff tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 404 len: 111 microversion: 2.20 time: 0.037981 Oct 04 18:44:45.175141 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3365/6750] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 4 18:44:45 2022] DELETE /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:45.180245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:45.180856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] [instance: 2001502a-a48c-438b-82dc-6e7f2749e8e1] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:45.187731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:45.189678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.190166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.190602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.191295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:45.191780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:45.192207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:45.208921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] HTTP exception thrown: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Request method failure captured: Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 HTTP/1.1 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH1h_r0bY5UAjnE07mgHGWP3AzHfOqnMv95sbDPC1ry3EMYQfNKvRLtGlIOwPxi4fMW0GBJ2Brj8rmghTW-9JOJtUzIeIKSKX8MaMV_QnuIlu21LgpSe3Y_EzQeXDb0rzEvzEYVLqAYlFPEt_ra0McWhLn83dtEPWNmTA0s1pSDmwJM Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7fca84063bd74931ac5b7d6473c38255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7fca84063bd74931ac5b7d6473c38255"}]}] Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 7fca84063bd74931ac5b7d6473c38255 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2023515675 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 94e0ec1aeb9d46f48802ddcd78a9e1d5 Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2023515675-project Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2001502a-a48c-438b-82dc-6e7f2749e8e1'} Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.212081 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] Returning 404 to user: Instance 2001502a-a48c-438b-82dc-6e7f2749e8e1 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f93e246-6015-49a3-8d27-fb136d7abbfe tempest-AttachVolumeShelveTestJSON-2023515675 tempest-AttachVolumeShelveTestJSON-2023515675-project] 10.222.0.40 "GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1" status: 404 len: 111 microversion: 2.20 time: 0.035777 Oct 04 18:44:45.216276 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3386/6751] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 4 18:44:45 2022] GET /compute/v2.1/servers/2001502a-a48c-438b-82dc-6e7f2749e8e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:44:46.048459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:46.049494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:46.055325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:46.057435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.058112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.058721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.059785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.060443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.061114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.338632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131a3fbd-26f4-4828-9452-874efb0dac6d", "name": "network-vif-plugged", "status": "completed", "tag": "81d1f9b2-68f4-42d1-93dd-cc430c1af326"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:46.350292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:46.361982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:46.363097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:46.364813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:46.370153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:46.382140 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] Creating event network-vif-plugged:81d1f9b2-68f4-42d1-93dd-cc430c1af326 for instance 131a3fbd-26f4-4828-9452-874efb0dac6d on n-h1-833090-21 Oct 04 18:44:46.389813 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bf001d1f-0ced-4383-9206-6fcc385e188d req-532dd80c-a657-4a42-a6a8-2fd5000ca193 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058045 Oct 04 18:44:46.394213 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3387/6752] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:46.440580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:46.453847 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7bfcc1d8-2d26-483f-abc4-8de576ddad96 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.409425 Oct 04 18:44:46.462252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3366/6753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:46 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:47.484708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:47.493771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:47.494434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:47.503617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.508932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.508932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.508932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:47.508932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:47.508932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:47.678290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:47.686702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f25b1923-dbcd-4f47-b2f4-55fdb31e4149 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1314 microversion: 2.1 time: 0.202914 Oct 04 18:44:47.688851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3388/6754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:47 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:48.712252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:48.712922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:48.722317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.722837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.723271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.724069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:48.724589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:48.724980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:48.935150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:48.944241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-852bc18a-e5aa-4233-b6a5-a1e83a660fa1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1498 microversion: 2.1 time: 0.235930 Oct 04 18:44:48.944842 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3367/6755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:48 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.139217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.139773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.147231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.147737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.148173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.148859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.149304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.149741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.178275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:44:50.592221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0d2b05e-59f9-4085-a5fc-f96a6c6b6232 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 204 len: 0 microversion: 2.1 time: 0.449752 Oct 04 18:44:50.592221 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3389/6756] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:44:50 2022] DELETE /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:44:50.594132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.594851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.601762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.602257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.602698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.603407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.603898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.604329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.797237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.809619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e9249b4e-2f3a-4482-b303-668fc95b0f8c tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1504 microversion: 2.1 time: 0.219441 Oct 04 18:44:50.810391 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3368/6757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.834076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.834781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.841524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.842014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.842452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.843148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.843668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.844096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.007363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:52.036426 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-acd83cf4-b330-4569-acf7-9d8b4c5a4bc1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1504 microversion: 2.1 time: 0.206710 Oct 04 18:44:52.037028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3390/6758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:52.573709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131a3fbd-26f4-4828-9452-874efb0dac6d", "name": "network-vif-deleted", "tag": "81d1f9b2-68f4-42d1-93dd-cc430c1af326"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:52.587828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.588493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.589049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.602317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] Creating event network-vif-deleted:81d1f9b2-68f4-42d1-93dd-cc430c1af326 for instance 131a3fbd-26f4-4828-9452-874efb0dac6d on n-h1-833090-21 Oct 04 18:44:52.608460 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0132ee77-e711-47f4-a4c7-bcf89b3c4be0 req-c7d8930e-9b11-46d0-84cf-ebea6aa7641b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039665 Oct 04 18:44:52.609576 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3369/6759] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:53.064900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:53.065632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:53.073201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.074010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.074456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.075161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.075655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.076884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.111806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:53.112498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:53.113135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.113735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lazy-loading 'fault' on Instance uuid 131a3fbd-26f4-4828-9452-874efb0dac6d {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:44:53.176135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.184304 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c2efc60-1bd2-4500-852b-773465795bfa tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 200 len: 1304 microversion: 2.1 time: 0.123970 Oct 04 18:44:53.184879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3391/6760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:53 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:54.229120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.230682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: 131a3fbd-26f4-4828-9452-874efb0dac6d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.238869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.239371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.239839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.240656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.241118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.241728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.257010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] HTTP exception thrown: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Request method failure captured: Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d HTTP/1.1 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH8PLp-XJM9zYaCUZun8-_q_GF7ZITR3Gcx8ynH54pCIUzmU0AX6_E3vPUvJjXarRE2FO5dqy5quceW6KxS0y3H3I4gyP7rx4ystafQIraJ9Szc1U9FfrgnXYBbxLnkg9dTnp9-w9N0HfteH5fb8aTHI4PSU5nBUamVFgvrvZEwCrEU Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fddee54aa6af46cbac5f568848dad1e8 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesActionsTest-509374502 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fddee54aa6af46cbac5f568848dad1e8"}]}] Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesActionsTest-509374502 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fddee54aa6af46cbac5f568848dad1e8 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesActionsTest-509374502 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesActionsTest-509374502-project Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2f51d7b27e414609a06384d9dad5dcd7 Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesActionsTest-509374502-project Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '131a3fbd-26f4-4828-9452-874efb0dac6d'} Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:54.258832 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. Oct 04 18:44:54.262597 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:44:54.264535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Returning 404 to user: Instance 131a3fbd-26f4-4828-9452-874efb0dac6d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:54.265457 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bfa4bf32-ea6b-426d-ab4f-1d9382d2c6a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d" status: 404 len: 111 microversion: 2.1 time: 0.059126 Oct 04 18:44:54.276043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3370/6761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/131a3fbd-26f4-4828-9452-874efb0dac6d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:54.371647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-107447640", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "e08d0e66-2870-4dfe-b142-d8322ec06a9e"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:54.429159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] validate_networks() for [('e08d0e66-2870-4dfe-b142-d8322ec06a9e', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:54.815039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:54.815699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:54.816452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:54.817047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:54.817692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:54.834550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.835232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.835788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.836879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.837992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.838835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.861613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Getting quotas for project fddee54aa6af46cbac5f568848dad1e8. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:54.866851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Getting quotas for user 2f51d7b27e414609a06384d9dad5dcd7 and project fddee54aa6af46cbac5f568848dad1e8. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:54.879778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:54.882098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:55.058976 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7c06cd0-d448-48de-aa0e-bd2895e37827 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691392 Oct 04 18:44:55.061127 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3392/6762] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:55.072037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c86fb6b2-06cd-42a7-b56a-4ca6dff8f8d1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.072655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c86fb6b2-06cd-42a7-b56a-4ca6dff8f8d1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.128000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c86fb6b2-06cd-42a7-b56a-4ca6dff8f8d1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.135506 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c86fb6b2-06cd-42a7-b56a-4ca6dff8f8d1 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1213 microversion: 2.1 time: 0.067545 Oct 04 18:44:55.138741 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3371/6763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:56.158109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.158741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.166221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.166713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.167155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.167883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.168344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.168775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.245298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.268456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8777a1c-2033-4cec-98ea-13bd162f5dad tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1217 microversion: 2.1 time: 0.105944 Oct 04 18:44:56.269606 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3393/6764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:57.291746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.292370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.301145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.303302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.303302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.303302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.303691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.304159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.369916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.381257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc9c88bd-b966-4e52-a9e2-a78515c707d3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1265 microversion: 2.1 time: 0.093197 Oct 04 18:44:57.382109 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3372/6765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:58.404488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:58.405100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:58.412085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.414723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.415111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.415857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:58.416320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:58.416748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:58.520484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:58.530994 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e4f827f4-f4c9-4aca-81c3-2f73ef4625d0 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1271 microversion: 2.1 time: 0.129930 Oct 04 18:44:58.546603 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3394/6766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:58 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.554634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.556176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.564072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.564757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.565471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.566471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.567091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.567727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.769299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.778381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d1f7307-81b4-4b43-9074-822057d5b8fc tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.227694 Oct 04 18:44:59.780226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3373/6767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.839586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc437960-e9fb-4aa1-a92b-a744727a0842", "tag": "92876ad4-8370-465c-af80-3d59a05009bf"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.860389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.861905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.862375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.886130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] Creating event network-changed:92876ad4-8370-465c-af80-3d59a05009bf for instance bc437960-e9fb-4aa1-a92b-a744727a0842 on n-h1-833090-21 Oct 04 18:44:59.898585 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-de790679-764b-432c-a8a7-789961a74b2f req-782e2f99-cc3a-4e4e-9e15-6cf129d89faf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064187 Oct 04 18:44:59.900659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3395/6768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:00.802884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.803618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.815373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.816736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.819139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.821660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.822383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.828182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.003311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.014021 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c3936c4-edb4-4bc0-96dc-671058003ba3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.214878 Oct 04 18:45:01.015692 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3374/6769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:02.040925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.041724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.051108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.051794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.052342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.053152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.053936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.054638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.236110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.245431 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2293eed6-0beb-4017-ae58-8dc37ebe1d5a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.209566 Oct 04 18:45:02.248474 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3396/6770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.273319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.273872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.281913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.282430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.283156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.283956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.285118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.285559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.437070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:03.445416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59c59359-ff92-4041-9967-2bae61cecb8a tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.176668 Oct 04 18:45:03.446002 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3375/6771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:04.478396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:04.479005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:04.487384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.492056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.492706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.493455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:04.494249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:04.494705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:04.707999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:04.717563 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3d64fe1b-af97-438e-8de5-53d0672ba925 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.243319 Oct 04 18:45:04.718539 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3397/6772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:04 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:05.742746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:05.743558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:05.748594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:05.753001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.753771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.754313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.755106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:05.755680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:05.756376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:05.913707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:05.922520 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-adb0df00-5e60-4e11-8f1a-3e7101a63c9b tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.184013 Oct 04 18:45:05.923107 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3376/6773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:05 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:06.449764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc437960-e9fb-4aa1-a92b-a744727a0842", "name": "network-vif-plugged", "status": "completed", "tag": "92876ad4-8370-465c-af80-3d59a05009bf"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:06.461906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:06.461906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:06.464844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.465529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.465974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.479125 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] Creating event network-vif-plugged:92876ad4-8370-465c-af80-3d59a05009bf for instance bc437960-e9fb-4aa1-a92b-a744727a0842 on n-h1-833090-21 Oct 04 18:45:06.485327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4c985670-5799-4eca-9c80-cdd3c35c74ab req-33abc36a-6ab4-428e-bdd0-567be7224590 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Oct 04 18:45:06.490944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3398/6774] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:06.948144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:06.948769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:06.957671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.958385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.958990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:06.959881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:06.960582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:06.961179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:07.120498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:07.129379 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-736aba0b-8d15-4d95-a701-4bbbc286f1a3 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1313 microversion: 2.1 time: 0.185503 Oct 04 18:45:07.130077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3377/6775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:06 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:08.155859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:08.156557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:08.164080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.164545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.165594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.166318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:08.166773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:08.167202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:08.358389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:08.368466 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db90f0bf-45c9-4217-9367-57570bea5c39 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1498 microversion: 2.1 time: 0.217898 Oct 04 18:45:08.369172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3399/6776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:08 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:09.364091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.364592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.371759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.372576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.373534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.374275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.374888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.375538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.404216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:09.767647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcb09d2a-7571-490d-93be-49ce75ce9245 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 204 len: 0 microversion: 2.1 time: 0.407245 Oct 04 18:45:09.769091 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3378/6777] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:09 2022] DELETE /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:09.779923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:09.782060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:09.791267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.791810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.792255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.793118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:09.793588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:09.794013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:09.975994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:09.985388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6ea0c09-7fad-4cbf-9afe-bd652b10af59 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1504 microversion: 2.1 time: 0.211700 Oct 04 18:45:09.986268 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3400/6778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:09 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.031271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.032525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.042279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.042708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.043180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.043918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.044682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.045279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.241216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.259772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c7d2af0-71ab-49f3-b9a3-305586d14f4e tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1504 microversion: 2.1 time: 0.250721 Oct 04 18:45:11.260461 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3379/6779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:11.769591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc437960-e9fb-4aa1-a92b-a744727a0842", "name": "network-vif-deleted", "tag": "92876ad4-8370-465c-af80-3d59a05009bf"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:11.781886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.785519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.788358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.808221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] Creating event network-vif-deleted:92876ad4-8370-465c-af80-3d59a05009bf for instance bc437960-e9fb-4aa1-a92b-a744727a0842 on n-h1-833090-21 Oct 04 18:45:11.814896 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2adf6d2e-75f0-4546-82b2-10ef45c7d2ea req-3c8efa8e-54de-495a-9b9e-e1a942d174a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052610 Oct 04 18:45:11.815611 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3401/6780] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:12.284934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.285567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.293510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.293997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.294478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.295281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.295929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.296503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.333735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.334227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.334666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.335113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lazy-loading 'fault' on Instance uuid bc437960-e9fb-4aa1-a92b-a744727a0842 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:12.380465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51d7b27e414609a06384d9dad5dcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fddee54aa6af46cbac5f568848dad1e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.389070 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bdc23cd4-c12c-4eb1-a9f0-9a7c0436d6e5 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 200 len: 1303 microversion: 2.1 time: 0.108832 Oct 04 18:45:12.389645 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3380/6781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.421863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.422695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] [instance: bc437960-e9fb-4aa1-a92b-a744727a0842] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.442931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.443881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.444550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.445473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.446208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.446844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.483154 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] HTTP exception thrown: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Request method failure captured: Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 HTTP/1.1 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH8PLp-XJM9zYaCUZun8-_q_GF7ZITR3Gcx8ynH54pCIUzmU0AX6_E3vPUvJjXarRE2FO5dqy5quceW6KxS0y3H3I4gyP7rx4ystafQIraJ9Szc1U9FfrgnXYBbxLnkg9dTnp9-w9N0HfteH5fb8aTHI4PSU5nBUamVFgvrvZEwCrEU Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fddee54aa6af46cbac5f568848dad1e8 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-VolumesActionsTest-509374502 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fddee54aa6af46cbac5f568848dad1e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fddee54aa6af46cbac5f568848dad1e8"}]}] Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-VolumesActionsTest-509374502 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fddee54aa6af46cbac5f568848dad1e8 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-VolumesActionsTest-509374502 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-VolumesActionsTest-509374502-project Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2f51d7b27e414609a06384d9dad5dcd7 Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-VolumesActionsTest-509374502-project Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'bc437960-e9fb-4aa1-a92b-a744727a0842'} Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:13.490430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] Returning 404 to user: Instance bc437960-e9fb-4aa1-a92b-a744727a0842 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88a3880a-adb1-4e08-851f-1078eab01c61 tempest-VolumesActionsTest-509374502 tempest-VolumesActionsTest-509374502-project] 10.222.0.40 "GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842" status: 404 len: 111 microversion: 2.1 time: 0.072262 Oct 04 18:45:13.495131 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3402/6782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/bc437960-e9fb-4aa1-a92b-a744727a0842 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:56.817958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:56.817958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:57.006261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-711e5204-0bb2-48d0-bdcd-1ca28f1d77a6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: .version_select at 0x7f90082523a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-988949968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+hd2WWrjRCfjXg96yeOd0Gok6DzXg4KbX9p+EjX3SQbDtq1yLHNBEs3jBfVdMZMt8T6FgickUo9ebl+XHrb52U64sX+Lo8YPuW9lKRgcQUXaUDMqM/E/WfQBQSXBj8eQ=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:57.029346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-711e5204-0bb2-48d0-bdcd-1ca28f1d77a6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:57.038784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-711e5204-0bb2-48d0-bdcd-1ca28f1d77a6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:57.153218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-711e5204-0bb2-48d0-bdcd-1ca28f1d77a6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.345447 Oct 04 18:45:57.153829 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3381/6783] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:45:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:06.345370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:06.350470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:06.566968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Calling method '.version_select at 0x7f90082b10d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:06.568967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.569639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.570244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.585821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.586530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.587684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.599043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:06.599951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:06.600244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:06.606493 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-505f035a-b911-4bec-bd6e-f00477a709f6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1040694325-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.280808 Oct 04 18:46:06.607295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3403/6784] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 18:46:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:10.906629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2104397322", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "19debd3d-3cb5-4366-8059-d4cfd6749ed6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-988949968", "security_groups": [{"name": "tempest-secgroup-smoke-1798949063"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:10.958588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:11.151781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] validate_networks() for [('19debd3d-3cb5-4366-8059-d4cfd6749ed6', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:12.081998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:12.082665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:12.082900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:12.083567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:12.084302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:12.100253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.100803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.101489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.102551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.103200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.103868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.142698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:12.147019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:12.175614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:12.176758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:12.356243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a87e1e5a-3917-48c1-887d-c52b54769f17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.457704 Oct 04 18:46:12.357552 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3382/6785] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:12.377355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e48de35-4f9c-4504-941e-db0af9829b41 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.377984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e48de35-4f9c-4504-941e-db0af9829b41 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.489338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e48de35-4f9c-4504-941e-db0af9829b41 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.499318 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e48de35-4f9c-4504-941e-db0af9829b41 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1266 microversion: 2.1 time: 0.134136 Oct 04 18:46:12.500424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3404/6786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:13.529094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5dc2b08c-9e38-455c-9c21-962d7113b988 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:13.529094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5dc2b08c-9e38-455c-9c21-962d7113b988 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:13.586064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5dc2b08c-9e38-455c-9c21-962d7113b988 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:13.596026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5dc2b08c-9e38-455c-9c21-962d7113b988 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1266 microversion: 2.1 time: 0.072781 Oct 04 18:46:13.596645 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3383/6787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:13 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:14.624041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:14.625403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.633897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.634366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.634814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.636313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.636958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.637411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.706513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:14.714724 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc68e62f-76df-43d1-b292-29cb643ca205 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1270 microversion: 2.1 time: 0.096227 Oct 04 18:46:14.715634 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3405/6788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:14 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:15.740567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:15.741859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:15.750193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.750764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.751210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.751948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:15.752490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:15.752929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.821385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.831217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b49805c-27b6-414e-86d2-7c8b054ca2bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1318 microversion: 2.1 time: 0.094657 Oct 04 18:46:15.831835 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3384/6789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:15 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.854656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:16.860093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.873844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.874659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.875102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.876826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.877302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.877788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.981467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.992024 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2474aa85-c98d-4984-ab3a-4d1869c4bc21 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1324 microversion: 2.1 time: 0.141343 Oct 04 18:46:16.993125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3406/6790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:16 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1324 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.016908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.017561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.024962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.025723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.026390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.028165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.028830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.029263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.240512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.240512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2bfb2a44-bfe6-4d68-becf-9187d56d6fa8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.223098 Oct 04 18:46:18.240512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3385/6791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.629128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:18.640374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.643633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.643633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.657148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] Creating event network-changed:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h1-833090-21 Oct 04 18:46:18.667300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5cfe02f4-1348-4262-a647-fa52b76d6515 req-527a7d8a-0992-451c-b5c2-1147a760a2f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207216 Oct 04 18:46:18.667982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3407/6792] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:19.259265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.259940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.267539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.268081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.268536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.269271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.269816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.270298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.441156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.446138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a0850e1c-f8a3-432d-99dd-3e874cb7bb10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.190780 Oct 04 18:46:19.447179 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3386/6793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:20.471290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.472365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.488352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.490388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.491974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.492720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.493169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.495372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.736893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.763690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b752b8e5-99ff-43ad-a038-278be636aa1c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.296598 Oct 04 18:46:20.771409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3408/6794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.794994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.795659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.802599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.810179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.810179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.810179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.810179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.810179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.990778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.001958 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1dfcdceb-e923-4170-8989-6361188f9d10 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.211509 Oct 04 18:46:22.002716 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3387/6795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:22.715989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:22.920855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "name": "network-vif-plugged", "status": "completed", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:22.942636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:22.942636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:22.943297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.982860 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] Creating event network-vif-plugged:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h1-833090-21 Oct 04 18:46:22.988607 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-76a5a35f-cd22-4adc-b49c-7055a2b5c45e req-7a7c969c-3ef8-44f9-b0e5-59dbdb7a90d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282552 Oct 04 18:46:22.990384 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3409/6796] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:23.026381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.026998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.029627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.043886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.245518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.254336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-de3e1043-f79d-44c2-8bc7-ba79de716524 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.231792 Oct 04 18:46:23.255051 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3388/6797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.279887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.281735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.303783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.304454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.305132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.306011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.306593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.307123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.669191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.701224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35b15929-10fc-4eed-bfc8-56a5a69289e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1392 microversion: 2.1 time: 0.426787 Oct 04 18:46:24.702450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3410/6798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.726313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.731898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.731898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:25.740514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.741022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.741477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.742186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.742828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.743271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.891288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.900625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1bd9d7c7-07c1-42cd-9365-fb00c472860a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1565 microversion: 2.1 time: 0.178120 Oct 04 18:46:25.916186 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3389/6799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1565 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.928824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.929992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.945348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.946160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.947236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.948432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.949869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.950593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.114136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.122590 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e2df6994-5f44-436b-9045-f66ea881801f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1565 microversion: 2.1 time: 0.202114 Oct 04 18:46:26.123312 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3411/6800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1565 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:28.929789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:28.933778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:28.934934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:28.948396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.949591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.950481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.951772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.953032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.953637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.957651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:28.961791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:28.962784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:28.977731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] Creating event network-changed:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h1-833090-21 Oct 04 18:46:28.983922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5edf8bc9-6bca-4ce9-a956-bd721a223b03 req-1b4a61f6-7ed6-4a22-a1f4-000f33aac737 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061189 Oct 04 18:46:28.984877 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3390/6801] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:29.326688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.346039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d84fc45-0647-4875-91c2-521340c7120e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1565 microversion: 2.1 time: 0.418833 Oct 04 18:46:29.348293 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3412/6802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:28 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1565 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:50.660412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.662469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=40 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:50.669144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:50.672898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.698235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.701946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.702455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.703216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.711656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.712707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.799238 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09a4a221-c9de-41fc-bfba-078d2bd3f6c2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action" status: 200 len: 24571 microversion: 2.1 time: 0.140939 Oct 04 18:46:50.799972 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3391/6803] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:50 2022] POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action => generated 24571 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:47:01.815783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.818868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.826099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=24 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.827153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=46 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:01.828994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.829502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.829960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.830686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.831149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.831645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.195219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27699bf0-f53e-495c-95b7-c1ba99a5f67a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1837 microversion: 2.1 time: 0.383051 Oct 04 18:47:02.210003 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3413/6804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1837 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.220878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:02.222912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.231822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.234755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.234755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.234755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.234755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.234755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.439406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:02.458650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad7a3e8a-8c9e-4475-8242-a722c309a457 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1684 microversion: 2.1 time: 0.225036 Oct 04 18:47:02.458650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3392/6805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.630722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:02.636988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.658804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.658804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.658804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.662570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.662570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.662570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.743948 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6b7fe59-fa30-4c74-9dc0-06168f101f18 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action" status: 200 len: 32642 microversion: 2.1 time: 0.117766 Oct 04 18:47:02.744690 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3414/6806] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:02 2022] POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action => generated 32642 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:47:02.972952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:02.973552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:02.983991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.988331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.988953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.989869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.990501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.991173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.232060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6bf4293f3bd7494bac07132dd56a476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b9237c1884e308528099c67f1700f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.236432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] flavor_id is None. Assuming migration. {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:47:03.236432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:47:03.965306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41976ac3-f256-43f1-b85b-06ed30cb8519 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action" status: 202 len: 0 microversion: 2.1 time: 1.000153 Oct 04 18:47:03.970633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3393/6807] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:02 2022] POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:03.980223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.981688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.996730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.998392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.999047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.000008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.000663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.001318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.267043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.278469 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-724f131c-7093-4fa9-8d66-b28f6e6ada2e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1693 microversion: 2.1 time: 0.303207 Oct 04 18:47:04.279075 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3415/6808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:03 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1693 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:05.309360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.311455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.320947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.325472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.325472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.325472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.325472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.325472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.686318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.695404 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-536df55e-e7ff-4dfa-9e76-5a540f02dc86 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1693 microversion: 2.1 time: 0.392704 Oct 04 18:47:05.696027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3394/6809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1693 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.720829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.720829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.728250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.728745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.729231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.738854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.738854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.738854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.073097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.081799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf64f639-b222-4623-9aa2-8c3e8f928ae4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1693 microversion: 2.1 time: 0.365911 Oct 04 18:47:07.082761 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3416/6810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1693 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:08.119296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.120712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:08.133847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.146407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.146407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.147279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.154639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.155116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.409491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:08.419381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14fc07af-d7ad-4110-b094-ffcedc6294e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1693 microversion: 2.1 time: 0.304771 Oct 04 18:47:08.420075 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3395/6811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1693 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:09.448175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:09.448175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.457039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.457713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.458318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.459835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.461354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.462369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.685543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.694372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f2ca8a31-6abb-4066-9aee-6825471db6f6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.253588 Oct 04 18:47:09.709411 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3417/6812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:09 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.723905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.724484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.735204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.737877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.738523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.739885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.740739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.741458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.967022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.971931 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3647d78b-68b3-4350-b417-b9ff284ba6c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.255106 Oct 04 18:47:10.973259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3396/6813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:11.996669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.997336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:12.004535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.005325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.005955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.006706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:12.007162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:12.007952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.239237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.248484 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-202c66b1-473b-40eb-9970-0f4e6405d1bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.255732 Oct 04 18:47:12.263609 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3418/6814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:13.274405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.275031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.288568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.289378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.290002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.290915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.291397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.292372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.585701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.597822 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c874197-130b-40d8-98e1-26abcdd929cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.324365 Oct 04 18:47:13.597822 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3397/6815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.619441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.620147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.630012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.630509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.630945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.631682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.632136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.632556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.817895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.827598 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fa5779c-728d-4d35-a83e-b228f30788b0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.212044 Oct 04 18:47:14.830536 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3419/6816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.855737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.856345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.879389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.880166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.880984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.882092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.882760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.883645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.227130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.240754 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ada9c4b-b187-4842-8daf-5ac61755220a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.389261 Oct 04 18:47:16.242027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3398/6817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:17.267595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.268102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.274892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.275865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.276522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.277331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.277870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.278387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.470931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:17.486591 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b042aa8-0c46-4ca2-ae92-d926b8e81977 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.222853 Oct 04 18:47:17.504493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3420/6818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:18.511534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:18.512438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:18.519631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.520254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.520822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.521708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:18.522400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:18.522948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:18.691071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.701742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9e547fd3-38c3-43f7-808b-c3c2470efefd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.195438 Oct 04 18:47:18.702914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3399/6819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:18 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:19.728559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.734341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.746862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.748267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.749485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.750521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.751230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.751912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.999163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.008058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a122d711-9e45-4f23-9207-09d5a3b04fdf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.283580 Oct 04 18:47:20.008982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3421/6820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:21.034115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.034746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.041793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.042836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.043532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.044248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.044810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.045146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.271529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.282241 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c0355a72-3566-4933-9b99-66a1f542437c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.251800 Oct 04 18:47:21.292924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3400/6821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.308288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.309480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.328885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.329733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.329855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.333614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.336060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.338517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.548845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.567338 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86b14c58-dae4-4ab7-a6fb-a6977682d04b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.263358 Oct 04 18:47:22.586685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3422/6822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.608641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.609287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.635187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.635780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.636393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.637842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.638576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.639240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.888691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.897806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d818210a-650c-441a-907f-04f902d2debc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.308572 Oct 04 18:47:23.901222 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3401/6823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:24.928614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.929807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.939428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.943753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.943753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.943753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.943753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.943753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.177563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.187460 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d73f49e4-f178-4387-8b06-2fa488849aff tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.262522 Oct 04 18:47:25.188772 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3423/6824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.212123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.212747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.239677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.250988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.251480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.252269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.252741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.253173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.419341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.443979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57cc5419-1421-47af-9372-bcaab7dcd69a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1698 microversion: 2.1 time: 0.235629 Oct 04 18:47:26.452470 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3402/6825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1698 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:27.358572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "name": "network-vif-unplugged", "status": "completed", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:27.378226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.378917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.380309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.473372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:27.477976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:27.501807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.502926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.506525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.512053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.515368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.516611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.846839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Creating event network-vif-unplugged:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h2-833090-21 Oct 04 18:47:27.859145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:27.874489 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7897233e-bcde-4958-8041-fe2373c6942c req-3c6bc854-4ab3-46d1-a6c3-96f6b5fad537 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.519754 Oct 04 18:47:27.877296 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3424/6826] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:28.095452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.104178 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dcbc9a3e-cbe7-4901-b667-bcc56043ff22 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1697 microversion: 2.1 time: 0.639009 Oct 04 18:47:28.105274 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3403/6827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:27 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1697 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.131488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.134859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.144330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.145414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.147790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.148788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.149499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.150487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.346285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:29.355507 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ac06db4-b413-4a6c-aab3-111019f3537d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1695 microversion: 2.1 time: 0.229332 Oct 04 18:47:29.356192 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3425/6828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.917943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:29.929439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.930345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.930852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.944828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Creating event network-changed:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h2-833090-21 Oct 04 18:47:29.951572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:29.963252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-62e9a5a6-cf5e-43d8-9205-f6eff9cd0bc7 req-2edbb6a5-c710-4218-891c-e93e8c58d33d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049199 Oct 04 18:47:29.964555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3404/6829] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:30.382829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:30.384203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:30.400179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.403493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.406393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.407367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:30.408945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:30.410105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.671833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.680264 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-475d59ca-726c-40d1-8906-9ae5c3daf8ee tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1695 microversion: 2.1 time: 0.303388 Oct 04 18:47:30.684769 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3426/6830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:30 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1695 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.710546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.711857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.718566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.719261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.719867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.720568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.721373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.722032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.952752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.961022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-46011238-df2f-46ed-a7f5-723e64afee69 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1695 microversion: 2.1 time: 0.255710 Oct 04 18:47:31.961565 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3405/6831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:32.985317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.985951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.997050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=29 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:32.998532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.999277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.999992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.000936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.001643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.002162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.037823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=81 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:33.252134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.260175 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ca28b2e-f520-4a22-9314-05b989f55d0c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1692 microversion: 2.1 time: 0.278670 Oct 04 18:47:33.263748 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3427/6832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.291894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:33.293084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.296224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=33 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:33.304848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.316174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:33.829718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffb68643-7e41-4386-adb9-20c7c907fd93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action" status: 204 len: 0 microversion: 2.1 time: 0.541671 Oct 04 18:47:33.830886 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3406/6833] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:33 2022] POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:33.851038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.852259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.860800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.861301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.861745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.862460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.862921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.863382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.028612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.028612 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af6c10db-622c-4103-8de6-31534310366d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1692 microversion: 2.1 time: 0.192033 Oct 04 18:47:34.033207 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3428/6834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1692 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:35.058901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.059907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.081507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.083074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.083441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.086694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.087159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.087631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.267027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:35.277666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-776d4fab-72ff-4515-9f6f-31c0d3b32a9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1692 microversion: 2.1 time: 0.223449 Oct 04 18:47:35.295750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3407/6835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1692 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:35.833272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "name": "network-vif-plugged", "status": "completed", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:35.847374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.848138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.848751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.863046 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Creating event network-vif-plugged:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h2-833090-21 Oct 04 18:47:35.879346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:35.893577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0dbe4ab1-4c39-415d-81cd-448edc56df2b req-7dd2df08-58ea-4bc2-8924-2392cd81b1e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064585 Oct 04 18:47:35.898287 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3429/6836] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:36.302298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:36.303629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:36.312523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.313417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.314175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.314760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:36.315372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:36.315994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.478288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.491215 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-001d1555-9808-4989-9253-417430979be8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1692 microversion: 2.1 time: 0.192780 Oct 04 18:47:36.517733 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3408/6837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:36 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1692 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.520833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.523146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.534525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.535382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.536296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.537342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.538385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.539359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.798958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:37.807946 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aab4c7d7-d197-4826-89df-08bef2a748e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1684 microversion: 2.1 time: 0.292742 Oct 04 18:47:37.808537 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3430/6838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1684 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:06.053758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:06.061612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:06.065382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=5 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:06.066317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:06.068949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.069915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.070612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.083438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:06.084207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:06.084890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:06.164510 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d966eb50-f56f-41e2-a9f7-80f8a2e599e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action" status: 200 len: 24578 microversion: 2.1 time: 0.114959 Oct 04 18:48:06.165301 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3409/6839] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:06 2022] POST /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480/action => generated 24578 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:48:28.900942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:28.902966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:28.919188 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:48:28.919416 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:48:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 (ip 10.222.0.40) !!! Oct 04 18:48:28.921908 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:48:28.922031 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:48:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 (ip 10.222.0.40) !!! Oct 04 18:48:28.923028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=7 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:28.924036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=21 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:28.927813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.929965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.929965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:28.929965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:28.930946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:28.931597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:29.139690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e4620ba-08c9-45d4-a58d-365f87506df2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1837 microversion: 2.1 time: 0.245713 Oct 04 18:48:29.156287 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3431/6840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:28 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1837 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:30.702362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:30.703521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:30.704154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:30.706937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:30.735508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.735508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.735941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.743902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.744552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.744990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.745746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:30.746208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:30.746631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:30.763833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] Creating event network-changed:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h2-833090-21 Oct 04 18:48:30.770011 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-aaa45244-93ac-4e5a-a4eb-86abaa43c514 req-215e05d2-23a3-48e6-a137-c03450fbb7fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072113 Oct 04 18:48:30.772313 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3432/6841] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:30.810232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:48:31.252295 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e116744-30cf-444b-9e34-85f1bb1ffd90 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 204 len: 0 microversion: 2.1 time: 0.563642 Oct 04 18:48:31.253577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3410/6842] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:48:30 2022] DELETE /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:48:31.263326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:31.264123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:31.279349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.279883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.280324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.281038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:31.281491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:31.281917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:31.532976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:31.552747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-67889669-5824-4820-bcd3-17f3caebf879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1690 microversion: 2.1 time: 0.294631 Oct 04 18:48:31.556045 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3433/6843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:31 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:32.584517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:32.585228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:32.593572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:32.617947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:32.617947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.617947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:32.617947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:32.617947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:32.832586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:32.842486 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95bc8b6b-0ebb-4e44-8e4f-d43cbb7328f0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1690 microversion: 2.1 time: 0.262169 Oct 04 18:48:32.843243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3411/6844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:32 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:33.410409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb0e100-cea6-4520-aa6a-15c4a53c1480", "name": "network-vif-deleted", "tag": "f788efed-553a-4c07-ac73-4f287bb1ddba"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:33.429656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.429656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.429656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.442061 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] Creating event network-vif-deleted:f788efed-553a-4c07-ac73-4f287bb1ddba for instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 on n-h2-833090-21 Oct 04 18:48:33.449306 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cfcce6b7-9db5-45be-9a44-1000a0fa929d req-5820ab31-3f3d-4521-8c40-f40646032df2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042711 Oct 04 18:48:33.451255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3434/6845] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:33.870588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:33.871481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:33.893972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.900747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.901662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.902905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.906396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.907256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.980213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:33.981343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:33.981957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:33.983426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lazy-loading 'fault' on Instance uuid 4fb0e100-cea6-4520-aa6a-15c4a53c1480 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:48:34.041518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:34.051277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-00e458bf-fa87-4af6-afc2-9acb8cc48dd6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 200 len: 1356 microversion: 2.1 time: 0.186490 Oct 04 18:48:34.069465 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3412/6846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:33 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:35.077810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:35.078526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 4fb0e100-cea6-4520-aa6a-15c4a53c1480] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:35.091842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.092536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.093246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.094864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:35.095519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:35.096165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:35.114399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] HTTP exception thrown: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Request method failure captured: Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 HTTP/1.1 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH9jCNCqAuU3u6zvxDcgL_Tkr1DnoYs17IEbv55f48Ko9n5jwzBglzSORaCXIwx1F-ukJ2TlVev1Vyd1EmkrP-45RZSwazdV4YUOvbGUSynq7r_od1nSMeIXlAFabWZzgh1RmDVbI4IC3qAaWGPiwq9TexiIJXL2oU0nuWJo4ULHMmw Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3639f5cb83f14b369390f5f295dffc1e"}]}] Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6b6a59bfa4bd4ec5b33f8cc9c7864b00 Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4fb0e100-cea6-4520-aa6a-15c4a53c1480'} Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:48:35.116641 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. Oct 04 18:48:35.123049 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:48:35.124860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Returning 404 to user: Instance 4fb0e100-cea6-4520-aa6a-15c4a53c1480 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:48:35.126002 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70458864-651a-4620-8d18-4596ac8cfaeb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480" status: 404 len: 111 microversion: 2.1 time: 0.053500 Oct 04 18:48:35.127093 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3435/6847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:35 2022] GET /compute/v2.1/servers/4fb0e100-cea6-4520-aa6a-15c4a53c1480 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:48:40.975832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9715afeb-4d2a-47d4-8609-6340905cba6f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '.version_select at 0x7f90080edca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:41.058903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9715afeb-4d2a-47d4-8609-6340905cba6f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-988949968" status: 202 len: 0 microversion: 2.1 time: 0.093831 Oct 04 18:48:41.059525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3413/6848] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 18:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-988949968 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:41.090129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79e846b5-fa0c-4728-99c6-8ebeb9c5cc4a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: .version_select at 0x7f90082089d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-829738307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ffTN4fl0pVOxIaisGsGhS7/T2ZfGapsYyX7V1a9AQPYbwDFPS9QZRNKOiaiabx/5e7917iey7O6WKtBv8mmcEy5RvOfWX1OEIUH72yqmVc5ZFMiMrGf0nRTNyweWELw=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:41.108022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-79e846b5-fa0c-4728-99c6-8ebeb9c5cc4a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:41.113443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-79e846b5-fa0c-4728-99c6-8ebeb9c5cc4a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:41.190585 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79e846b5-fa0c-4728-99c6-8ebeb9c5cc4a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.105224 Oct 04 18:48:41.191379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3436/6849] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:48:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:51.200529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:51.202577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:51.206873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-432437509", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "53358d9b-46bf-4236-956f-50d5abef034b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-829738307", "security_groups": [{"name": "tempest-secgroup-smoke-2134414723"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:51.421561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] validate_networks() for [('53358d9b-46bf-4236-956f-50d5abef034b', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:48:52.081978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:52.082405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:52.083094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:52.083536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:52.084045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:52.095365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.096137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.096756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.097759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.098399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.099000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.123727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:48:52.132116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:48:52.166025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:52.169242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:52.328874 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b7453ae-3b29-47f1-a7dd-cbf892794119 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133551 Oct 04 18:48:52.334776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3414/6850] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:48:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:52.352022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:52.353641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:52.354946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:52.364008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-edbfeb90-45ed-4b80-b1e1-60c00e9e7d13 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.365585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-edbfeb90-45ed-4b80-b1e1-60c00e9e7d13 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.532027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-edbfeb90-45ed-4b80-b1e1-60c00e9e7d13 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.547221 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-edbfeb90-45ed-4b80-b1e1-60c00e9e7d13 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1265 microversion: 2.1 time: 0.193024 Oct 04 18:48:52.548862 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3437/6851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.580351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c39de2c8-f221-4bae-a66f-c849b530b8ec tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.582505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c39de2c8-f221-4bae-a66f-c849b530b8ec tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.668421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c39de2c8-f221-4bae-a66f-c849b530b8ec tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.676369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c39de2c8-f221-4bae-a66f-c849b530b8ec tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1265 microversion: 2.1 time: 0.103339 Oct 04 18:48:53.677159 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3415/6852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:54.700966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.701727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.710974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.711495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.712543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.717915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.717915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.717915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.778521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.786496 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8140551e-f0f3-46e7-8c22-383ccf6fdb8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1269 microversion: 2.1 time: 0.089293 Oct 04 18:48:54.787007 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3438/6853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:55.810218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.810837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.818977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.819454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.819937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.820650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.821187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.821629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.891948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:55.901094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9f89bb73-f0ee-4183-af54-d069e2ded5a8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1261 microversion: 2.1 time: 0.095060 Oct 04 18:48:55.903744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3416/6854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:56.925993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:56.927216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:56.936509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.937008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.937637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.939070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:56.939748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:56.940340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.021244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.031016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28301d03-dfdb-4030-aac5-35d64d08a146 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1335 microversion: 2.1 time: 0.109698 Oct 04 18:48:57.033868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3439/6855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:56 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:58.056806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.057430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.064703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.065196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.065644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.066404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.066862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.067289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.281314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.293365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18bf024f-e0e2-43cc-bd08-7aaa8e9ffba3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.240317 Oct 04 18:48:58.294660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3417/6856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:58.626677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:58.638521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.639003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.639457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.650379 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] Creating event network-changed:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:48:58.655985 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-d98a3e18-ee99-4907-9bbe-06ed8625edcd req-bd80cd0c-d027-4447-80bc-79edea7d776a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Oct 04 18:48:58.656588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3440/6857] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:59.322062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.324356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.332167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.332753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.333277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.334128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.334888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.336863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.499325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.507828 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f48b830-758d-4f82-b680-57be7bbc6911 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.190350 Oct 04 18:48:59.509231 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3418/6858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.534939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.535721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.543128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.543660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.544095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.544812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.545267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.545693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.704835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.714222 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-511be9c2-6d4c-47e4-af42-3673b7e67329 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.184163 Oct 04 18:49:00.714834 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3441/6859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.739048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.741344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.757739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.758831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.759478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.760401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.761204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.761822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:02.048990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.057516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7968065c-8786-4d3c-8814-fe854dd70ef7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.323197 Oct 04 18:49:02.075896 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3419/6860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.085991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:03.093586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.096658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.106576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.107398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.108363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.109273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.109898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.110644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.382789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.392875 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b468400f-1871-4af4-8d61-c1623fe24154 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.312134 Oct 04 18:49:03.402047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3442/6861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:04.414658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:04.417959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:04.423872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.425854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.433038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.433872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.434870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.435755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.436293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.436964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.581873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:04.590297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4d79197-c414-4851-87a2-1416f402308d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.176458 Oct 04 18:49:04.594263 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3420/6862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.447709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-plugged", "status": "completed", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:05.459921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.460860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.461454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.474321 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] Creating event network-vif-plugged:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:49:05.480936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e4bac5ea-cf45-4c19-9215-0388bd38241b req-390b29ab-c5d9-4bdc-b77c-69f88fc384e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 Oct 04 18:49:05.481799 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3443/6863] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:05.614339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.614947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.622195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.622683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.623126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.623870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.624328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.624756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.758273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.766223 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1a1b801-5749-498e-9f6e-9244dc493397 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.155831 Oct 04 18:49:05.766804 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3421/6864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.790844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.792172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.802463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.803307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.803948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.804839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.805458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.806077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.034320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.043372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34f067cf-ebb9-4e52-a05a-4770ac6269e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1391 microversion: 2.1 time: 0.257624 Oct 04 18:49:07.059460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3444/6865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.066655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.067272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.074772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.075262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.075850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.076555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.077011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.077437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.224612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:08.232841 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3bc2ad0a-882c-4189-a003-59ccc8bce52a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1563 microversion: 2.1 time: 0.170093 Oct 04 18:49:08.233429 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3422/6866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.255207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.255988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.263874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.264381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.264830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.265545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.266008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.266445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.473430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:08.483317 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-91337696-b2d0-4209-a226-6b84ef1cb6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1563 microversion: 2.1 time: 0.231968 Oct 04 18:49:08.484025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3445/6867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.140748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.141291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.160237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.326912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.340302 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b92c429-a1dc-4087-aa06-3e00f1d9ad07 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1563 microversion: 2.1 time: 0.204125 Oct 04 18:49:11.341126 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3423/6868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.365401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:11.376168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.376718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.377163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.391174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] Creating event network-changed:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:49:11.398093 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0f6e5100-c44f-46db-ad9f-c8da52fdf711 req-22f46ea6-c8e0-44da-a68e-605a258cd5b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259786 Oct 04 18:49:11.399021 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3446/6869] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:35.701756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:35.704255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:35.707011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:35.707708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=50 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:35.718382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:35.779638 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac2da563-8b74-427b-b38d-99b6cbe9ca82 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action" status: 200 len: 24561 microversion: 2.1 time: 0.082372 Oct 04 18:49:35.783514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3424/6870] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:35 2022] POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action => generated 24561 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:49:46.871184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:46.871831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:46.874349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=22 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:46.875019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=42 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:46.880324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.880811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.885705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:46.885705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:46.885705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:46.885705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.196508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05b72192-a074-43f0-be4d-1e621c7644b4 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1835 microversion: 2.1 time: 0.329510 Oct 04 18:49:47.197172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3447/6871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:46 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1835 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:47.221614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:47.222344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:47.225057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:47.231504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.232015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.232680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.233415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.233877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.234488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.433936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:47.441974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d789c82b-400a-46d5-a9ee-9fd6d92e08d7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1682 microversion: 2.1 time: 0.225316 Oct 04 18:49:47.442541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3425/6872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:47 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:47.549628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:47.552040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:47.558921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.559411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.559884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.560591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.561070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.561499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.626803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b284b212-a9ee-49af-aff3-d172bb0d4d7a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action" status: 200 len: 32636 microversion: 2.1 time: 0.081052 Oct 04 18:49:47.627863 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3448/6873] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:47 2022] POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action => generated 32636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:49:47.793894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:47.794478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:47.801040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.801537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.801981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.802682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:47.803144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:47.803634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:47.835421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6bf4293f3bd7494bac07132dd56a476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241b9237c1884e308528099c67f1700f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:47.836029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] flavor_id is None. Assuming migration. {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:49:47.836473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:49:48.072358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0bf381bf-6d5c-4f2d-9a92-8c9db841aa0e tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action" status: 202 len: 0 microversion: 2.1 time: 0.282951 Oct 04 18:49:48.073305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3426/6874] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:47 2022] POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:49:48.081743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:48.085238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:48.090640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.091204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.091782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.092550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:48.093007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:48.093431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:48.231821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:48.239652 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06834183-4a7e-4973-ad97-388a3edf9c9d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1691 microversion: 2.1 time: 0.162101 Oct 04 18:49:48.240226 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3449/6875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:48 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:49.265469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:49.266098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:49.273386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.273886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.274330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.275037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:49.275515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:49.275954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:49.423515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:49.438167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-011c192f-c711-4f48-bda9-7a57f8b20595 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1691 microversion: 2.1 time: 0.178380 Oct 04 18:49:49.438932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3427/6876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:49 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:50.465986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:50.466932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:50.474205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.474695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.475137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.475877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:50.476369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:50.476941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:50.611646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:50.619725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f07dbdcc-91eb-429a-85e9-33c55569ab01 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1691 microversion: 2.1 time: 0.158190 Oct 04 18:49:50.620408 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3450/6877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:50 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:51.644437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:51.645992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:51.652511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.653467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.654092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.655000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:51.655667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:51.656256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:51.809456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:51.817656 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8ccc304-0e4d-414d-9881-a0a021024dd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1691 microversion: 2.1 time: 0.177318 Oct 04 18:49:51.818242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3428/6878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:51 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:52.841315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:52.842066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:52.848916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.849483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.849929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.850630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:52.851095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:52.851562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:52.987987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:53.001087 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e963fcf9-0e90-4fa7-9e10-8707dcfb0038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.163720 Oct 04 18:49:53.001665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3451/6879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:52 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:54.027202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:54.029467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:54.036893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.037386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.037832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.038540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:54.039014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:54.039449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:54.170170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:54.178473 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-786cc1c1-c151-425f-8a96-b00a74dea6b6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.155210 Oct 04 18:49:54.179059 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3429/6880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:54 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:55.203514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:55.204137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:55.211347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.211870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.212306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.213009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:55.213448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:55.213874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:55.349478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:55.358109 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec94491e-9ed4-455a-909c-67da226577f5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.158597 Oct 04 18:49:55.358701 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3452/6881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:55 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:56.382270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:56.383074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:56.391155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.391694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.392147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.392861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:56.393326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:56.393770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:56.523722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:56.531777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b04d17b-349f-4efa-9393-11d4caf48b08 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.153401 Oct 04 18:49:56.532294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3430/6882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:56 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:57.554598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:57.555217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:57.562592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.563079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.563545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.564252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:57.564714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:57.565145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:57.704306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:57.717540 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-529e2a5e-4a87-4fa7-8b17-42e97eba36ca tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.166824 Oct 04 18:49:57.718163 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3453/6883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:57 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:58.740900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:58.741510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:58.748582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.749063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.749506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.750193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:58.750646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:58.751076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:58.894545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:58.902620 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0248e96e-580a-4e69-b1aa-f307dd7c8c50 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.165618 Oct 04 18:49:58.903780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3431/6884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:58 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:59.927235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:59.928405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:59.936343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.936835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.937284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:59.937989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:59.938447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:59.938910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:00.076597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:00.084527 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0f6c6ad9-d076-4937-82fb-e6334c5aa038 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.161199 Oct 04 18:50:00.085106 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3454/6885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:59 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:01.108719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:01.109345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:01.117324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.117817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.118265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.118968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:01.119432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:01.119974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:01.261446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:01.269969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64ec309b-d4ae-4e8b-ad7a-9723ba2f3d83 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.165166 Oct 04 18:50:01.270555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3432/6886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:01 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:02.294851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:02.296383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:02.303223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.304239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.305085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.306043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:02.306506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:02.306944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:02.450089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:02.461061 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-32ae5f17-fa1f-49e4-ae9a-51f5acc4542d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.171645 Oct 04 18:50:02.461652 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3455/6887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:02 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:03.484181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:03.484834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:03.491817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.492308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.492752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.493454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:03.493918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:03.494353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:03.629236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:03.637348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4cf8897-e271-4004-8079-9dcde3b282a0 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.157038 Oct 04 18:50:03.637961 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3433/6888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:03 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:04.661866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:04.662479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:04.669363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.669865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.670300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.670995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:04.672096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:04.673728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:04.811374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:04.819256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4448310f-b449-422a-89b3-873b9aef8b4b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.161315 Oct 04 18:50:04.819857 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3456/6889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:04 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:05.842553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.843759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.850404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.850896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.851343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.852080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.852575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.853009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.985718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.993645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b23d72c-b332-44a9-b2d0-547dd4395446 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.155353 Oct 04 18:50:05.994232 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3434/6890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:07.016927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:07.017545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:07.024792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.025291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.025751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.026528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:07.026997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:07.027429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.172366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.172366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0bb40c12-f7a8-4db8-b869-00b7d2f62bd2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.156715 Oct 04 18:50:07.172366 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3457/6891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:07 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:08.193520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.194140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.201281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.201772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.202247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.203449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.203989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.204427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.341861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.349723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffbed939-85f5-407c-a480-82bd731a81cf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.160240 Oct 04 18:50:08.350300 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3435/6892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.372947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.377142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.381506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.381933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.382376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.383072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.383559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.383989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.525912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.536364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be076029-d09f-4ea2-9483-8b52c0f5cb6d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1696 microversion: 2.1 time: 0.167090 Oct 04 18:50:09.537053 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3458/6893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:10.056574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-unplugged", "status": "completed", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:10.068762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.069473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.069974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.082451 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Creating event network-vif-unplugged:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h2-833090-21 Oct 04 18:50:10.087819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:10.098777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4ac8cc30-07db-4505-b538-4b9697d931b5 req-ed5422bd-a005-4b28-bfa2-8411e89e9807 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046424 Oct 04 18:50:10.099529 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3436/6894] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:10.561999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.564003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.573480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.573986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.574437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.575155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.575656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.576094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.792611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:10.803661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42e518fc-88ca-4c6a-9e5e-4dad97e77bc1 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1695 microversion: 2.1 time: 0.247047 Oct 04 18:50:10.804576 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3459/6895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:11.829776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:11.830487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:11.837038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:11.837535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:11.838317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.838659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:11.839121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:11.839575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.977927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.986010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7cb8071b-d699-4caf-810c-fdf925236936 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1693 microversion: 2.1 time: 0.162089 Oct 04 18:50:11.986634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3437/6896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:11 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.113480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:12.123699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.124172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.124605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.139354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Creating event network-changed:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h2-833090-21 Oct 04 18:50:12.145328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:12.156093 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ee102a61-a103-4d5c-9c9e-4ce04c609c01 req-841f0bfa-4bf3-4aa1-9e6e-fb1596ac7d00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046293 Oct 04 18:50:12.156689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3460/6897] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:13.015299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:13.015299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:13.022368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.022872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.023509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.024102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:13.024513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:13.024942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.163716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.172457 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca4eaf43-a0af-491e-9653-e36b912f225e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1693 microversion: 2.1 time: 0.161854 Oct 04 18:50:13.173062 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3438/6898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:13 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.219802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.221415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.730221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.738713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fbab75cc-34a7-46e5-981e-f65e049c3005 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1693 microversion: 2.1 time: 0.546333 Oct 04 18:50:14.739289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3461/6899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1693 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.762185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.762807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.769786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.770332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.770779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.771485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.771981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.772413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.920392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.933018 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7455b7f7-74d7-40c4-b9ba-f2712121ba51 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1690 microversion: 2.1 time: 0.174793 Oct 04 18:50:15.933589 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3439/6900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.955318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:15.955944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.962815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.965321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.965321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.965321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.965321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.965708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.135237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:16.324688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d6b6625-98c7-4039-81d6-329f935ddda2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action" status: 202 len: 0 microversion: 2.1 time: 0.373125 Oct 04 18:50:16.325330 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3462/6901] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:15 2022] POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:16.333563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.334293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.340571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.341065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.345355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.345355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.345355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.345355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.347267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:16.495601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.507001 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c96f287a-3210-4080-90c7-726aa8c92a70 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.177292 Oct 04 18:50:16.507826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3440/6902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.533034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.533747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.536554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:17.541642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.542139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.542582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.543286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.543767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.551031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.680296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.690229 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6882e4d2-8737-4297-bc7e-2d88a41346eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.162021 Oct 04 18:50:17.690981 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3463/6903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.239138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-plugged", "status": "completed", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:18.245189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=37 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:18.251070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.251704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.252143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.263679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Creating event network-vif-plugged:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h2-833090-21 Oct 04 18:50:18.269612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:18.280691 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9b1c0919-cdab-4a2e-ba92-d60b9c7b00d0 req-4b19b56e-88bf-43a9-9ee4-755ed91104de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045374 Oct 04 18:50:18.281530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3441/6904] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:18.714673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.717085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.727977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.732665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.732665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.732665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.732665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.732665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.876223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:18.884255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-984cec16-d3cb-4579-85f6-a6cb6d0570ce tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.173940 Oct 04 18:50:18.884927 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3464/6905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:19.909402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:19.910288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:19.918354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.918850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.919297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.920051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:19.920510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:19.920943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.065850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.073919 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a2a12bd-0720-4fa9-adcb-ac10d34036e4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.169617 Oct 04 18:50:20.074519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3442/6906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:19 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.437810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-unplugged", "status": "completed", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:20.449119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.449589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.450060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.462134 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Creating event network-vif-unplugged:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:50:20.469208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:20.479191 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8131193c-a872-4943-8ccc-de08d9d8481f req-7afb7697-045a-403c-9f42-2dbdf5f7f8c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045289 Oct 04 18:50:20.479950 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3465/6907] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:21.097444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.100856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.105017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.105523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.106047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.106795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.107263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.107722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.251393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.262237 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-408a5852-9bb4-419d-acef-0779b470cfcf tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.168952 Oct 04 18:50:21.262925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3443/6908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.288653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.289274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.296621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.297105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.297552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.298250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.298709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.299139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.444278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:22.453398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9fbac29-8b91-4157-b33f-e55907b1e582 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.169688 Oct 04 18:50:22.453977 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3466/6909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.494146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:22.506796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.507417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.507893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.521832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Creating event network-changed:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:50:22.528117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:22.541147 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-39e44f66-0cfd-416d-be7e-83bdfaf56d03 req-ea54740a-d048-4c83-97e9-19cc3b61b2d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050673 Oct 04 18:50:22.542284 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3444/6910] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:23.478405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:23.479256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:23.496050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.496679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.497131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.498169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:23.498632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:23.499073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.714222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.722738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39026159-8993-4eb1-88d4-080fecc45fae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1689 microversion: 2.1 time: 0.248346 Oct 04 18:50:23.723434 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3467/6911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:23 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:24.746887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.747551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.755299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.755820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.756260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.756945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.757399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.757823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.891218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.899172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-648856df-2e8f-411a-8e11-b8bbd39fc352 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1682 microversion: 2.1 time: 0.156746 Oct 04 18:50:24.899978 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3445/6912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.940769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-plugged", "status": "completed", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:27.951278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.951803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.952241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.963258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] Creating event network-vif-plugged:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:50:27.968786 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bceef72d-5481-434c-a8c2-51d369dddeb2 req-3ae2c33f-db91-47a7-853d-b56e0822c3e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031229 Oct 04 18:50:27.973211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3468/6913] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:51.111686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:51.113976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:51.116467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=9 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:51.117125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=30 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:51.122000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.122492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.122928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.123663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:51.124123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:51.124771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:51.186257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bbb22f32-55d4-487e-95c4-2f5f52103326 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action" status: 200 len: 63167 microversion: 2.1 time: 0.078982 Oct 04 18:50:51.186937 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3446/6914] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:51 2022] POST /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85/action => generated 63167 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:50:57.637370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:57.638764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:57.642742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:57.643451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:57.649583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.650188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.650551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.651255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:57.651745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:57.657183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:57.793709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cda333c-1ec2-4cd6-8c05-ecbb7897ca27 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1835 microversion: 2.1 time: 0.158638 Oct 04 18:50:57.794324 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3469/6915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:57 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1835 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:58.834061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:58.834574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:58.845444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:58.849944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.850462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.850913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.851660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.852127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.852564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.860700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:58.861273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:58.861912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:58.892035 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] Creating event network-changed:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:50:58.898223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7cf90df7-bdad-49d6-be22-ba410ca4104c req-3337614d-7a04-445d-bb29-213d78a91e0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058565 Oct 04 18:50:58.902808 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3470/6916] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:58.915081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:59.357034 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd867c76-d869-4a48-9150-4251aa51c53e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 204 len: 0 microversion: 2.1 time: 0.527536 Oct 04 18:50:59.357944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3447/6917] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:58 2022] DELETE /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:59.372058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:59.375989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:59.381028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.381993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.382734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.383721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:59.385274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:59.386003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:59.559323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:59.568828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd204418-0085-4e60-bed8-a07ecc3c1e8e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1688 microversion: 2.1 time: 0.205743 Oct 04 18:50:59.569915 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3471/6918] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:59 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:00.595131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:00.595947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:00.603431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.603938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.604376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.605067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:00.605521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:00.605949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:00.744006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:00.752667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-52feb80b-9d63-4c06-8184-d2803fb2ec64 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1688 microversion: 2.1 time: 0.162460 Oct 04 18:51:00.753260 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3448/6919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:00 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:01.776320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96fccf3-7496-47cc-9764-e8ac668f5b85", "name": "network-vif-deleted", "tag": "61ecd949-be89-4f91-a10b-6843a1cf7dd3"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:01.777817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:01.778676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:01.786381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.825532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.826122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.826234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.826338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.826437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.826437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:01.826437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:01.826437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:01.826833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] Creating event network-vif-deleted:61ecd949-be89-4f91-a10b-6843a1cf7dd3 for instance b96fccf3-7496-47cc-9764-e8ac668f5b85 on n-h1-833090-21 Oct 04 18:51:01.826833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b7bcd284-c8aa-4ee9-af00-fa298bcebd4f req-d1f9e4c3-1f47-42b2-898a-c25565762d0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032263 Oct 04 18:51:01.826833 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3472/6920] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:01.860744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:01.866634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd79c1b3-eed5-4d72-9ed6-d7cc99b3deb4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1501 microversion: 2.1 time: 0.093356 Oct 04 18:51:01.867699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3449/6921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:01 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1501 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:02.892076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:02.892798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:02.899249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.899714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.900161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.900897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.901364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.901801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.935915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:02.936405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:02.936848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:02.937299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lazy-loading 'fault' on Instance uuid b96fccf3-7496-47cc-9764-e8ac668f5b85 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:51:02.990186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:02.997539 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b4120db-1bb3-4c89-8481-c575fd36e98d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 200 len: 1355 microversion: 2.1 time: 0.110997 Oct 04 18:51:02.998121 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3473/6922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:02 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:04.022288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:04.023043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: b96fccf3-7496-47cc-9764-e8ac668f5b85] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:04.030417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.030914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.031364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.032103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:04.032669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:04.033107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:04.046888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] HTTP exception thrown: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Request method failure captured: Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 HTTP/1.1 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH9jCNCqAuU3u6zvxDcgL_Tkr1DnoYs17IEbv55f48Ko9n5jwzBglzSORaCXIwx1F-ukJ2TlVev1Vyd1EmkrP-45RZSwazdV4YUOvbGUSynq7r_od1nSMeIXlAFabWZzgh1RmDVbI4IC3qAaWGPiwq9TexiIJXL2oU0nuWJo4ULHMmw Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3639f5cb83f14b369390f5f295dffc1e"}]}] Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6b6a59bfa4bd4ec5b33f8cc9c7864b00 Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'b96fccf3-7496-47cc-9764-e8ac668f5b85'} Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.048608 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Returning 404 to user: Instance b96fccf3-7496-47cc-9764-e8ac668f5b85 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:04.053763 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-75833cc0-f56c-47e1-b9fa-378ad8c9b0c9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85" status: 404 len: 111 microversion: 2.1 time: 0.031800 Oct 04 18:51:04.057526 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3450/6923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:04 2022] GET /compute/v2.1/servers/b96fccf3-7496-47cc-9764-e8ac668f5b85 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:07.744223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7deda9a7-7a5c-452a-b2af-819c2772a48f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '.version_select at 0x7f90081651f0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:07.854295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7deda9a7-7a5c-452a-b2af-819c2772a48f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-829738307" status: 202 len: 0 microversion: 2.1 time: 0.114070 Oct 04 18:51:07.854827 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3474/6924] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 18:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-829738307 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:07.897579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-64f3d9a5-9a42-48ac-a00d-1222a31e0d84 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: .version_select at 0x7f9009bc8820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1319663486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBasHM5phdFWTXg86T5ihCMAep9hbcJL8ZuEuuE4ClodG2vKvv9VHXJcoEss5edjScrBmrtgOuKy2Oo+19pnvcxiPbh5h5pnA89c2mphRn0l/TBr0YpzhDQT0dsJz60j/A=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:07.911950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-64f3d9a5-9a42-48ac-a00d-1222a31e0d84 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:07.917456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-64f3d9a5-9a42-48ac-a00d-1222a31e0d84 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:08.018979 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-64f3d9a5-9a42-48ac-a00d-1222a31e0d84 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.129898 Oct 04 18:51:08.019611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3451/6925] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:51:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:17.600185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=24 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:17.604706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-773860458", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "0d73ece1-fe6e-4653-a582-4feed504435a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1319663486", "security_groups": [{"name": "tempest-secgroup-smoke-1567817284"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:17.742619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] validate_networks() for [('0d73ece1-fe6e-4653-a582-4feed504435a', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:18.338147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:18.338848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:18.339395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:18.339845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:18.340273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:18.351672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.352164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.352604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.353335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:18.353793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:18.354224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:18.376009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:18.382766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:18.396797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:18.399132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:18.524976 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77454b41-9ada-4c01-9abf-42300e81e4da tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.926576 Oct 04 18:51:18.526535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3475/6926] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:18.539352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:18.540819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:18.541857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:18.546038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5ea1a47-80f6-4d09-ad82-9a6e28a79f7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:18.554547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5ea1a47-80f6-4d09-ad82-9a6e28a79f7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:18.680215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e5ea1a47-80f6-4d09-ad82-9a6e28a79f7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:18.680215 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5ea1a47-80f6-4d09-ad82-9a6e28a79f7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1266 microversion: 2.1 time: 0.115720 Oct 04 18:51:18.680215 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3452/6927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:18 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:19.683315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1bdd318-4dad-4551-8fc0-b10d9bf03f3e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:19.684014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1bdd318-4dad-4551-8fc0-b10d9bf03f3e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:19.772121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c1bdd318-4dad-4551-8fc0-b10d9bf03f3e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:19.780985 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1bdd318-4dad-4551-8fc0-b10d9bf03f3e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1266 microversion: 2.1 time: 0.106402 Oct 04 18:51:19.782403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3476/6928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:19 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:20.804653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a22593c-eff2-4a1f-bddb-d43336ff4109 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:20.805308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a22593c-eff2-4a1f-bddb-d43336ff4109 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:20.869067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a22593c-eff2-4a1f-bddb-d43336ff4109 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:20.876896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a22593c-eff2-4a1f-bddb-d43336ff4109 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1266 microversion: 2.1 time: 0.076219 Oct 04 18:51:20.877489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3453/6929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:20 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:21.903238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:21.903885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:21.911721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.912476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.913015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.913928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:21.914378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:21.915012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:21.986278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.004744 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-98f34728-5571-424a-85fd-77c929855648 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1262 microversion: 2.1 time: 0.103034 Oct 04 18:51:22.005481 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3477/6930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:21 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:23.033034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.038085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.050207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.052477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.052477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.052477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.052477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.052953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.135865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.145324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cdbcf22-2fbf-4194-8ba0-040642ae62d9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1336 microversion: 2.1 time: 0.116683 Oct 04 18:51:23.146723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3454/6931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.173621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.174859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.182236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.185116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.185116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.185116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.185116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.185116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.404737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.413212 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-227d1175-e8f9-453f-91f4-03d424e8fd60 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.243544 Oct 04 18:51:24.414037 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3478/6932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.757011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:24.766625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.767103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.767569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.778349 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] Creating event network-changed:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h2-833090-21 Oct 04 18:51:24.783890 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-38fc7c97-93c5-4891-89b0-1fe71b0acd23 req-298472eb-af3c-46c5-9889-c39dabe9b782 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119028 Oct 04 18:51:24.784489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3455/6933] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:25.438980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.439627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.446824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.447326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.449392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.450117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.450789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.451443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.623032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.631998 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15d92130-53b0-403d-9fb5-d883217d2eb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.197548 Oct 04 18:51:25.632657 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3479/6934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:26.656739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:26.657469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:26.663771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.664268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.664714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.665411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:26.665878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:26.666313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:26.799013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:26.807206 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f733bcbb-7898-4c7b-aee5-6b45be51d311 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.155674 Oct 04 18:51:26.807811 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3456/6935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:27.829930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:27.830549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:27.833384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:27.838206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.839177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.839386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.839919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.840381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.840876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.979324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.988347 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1c7c615-e867-45a8-aeca-ec8862728c19 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.162409 Oct 04 18:51:27.988931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3480/6936] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:27 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.011566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.012118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.019596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.020085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.020525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.021644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.022112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.022539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.165663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.174360 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c10eafd-f181-447d-abb6-773e6e92df54 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.166868 Oct 04 18:51:29.174948 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3457/6937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.198409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.199255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:30.201247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:30.202773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:30.208355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.209021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.209845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.210203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.210719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.211121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.362108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.370310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a4c4f269-9cbf-414c-ac8e-918129ab8e36 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.175889 Oct 04 18:51:30.370919 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3481/6938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:30 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:31.394510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.395134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.397948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:31.402926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.403417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.403891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.404588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.405228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.405659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.538674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.546333 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09af0650-6a28-482d-8c3b-2cf61cb99a1b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.155986 Oct 04 18:51:31.546912 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3458/6939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:32.539780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "name": "network-vif-plugged", "status": "completed", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:32.549445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.549928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.550412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.564252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] Creating event network-vif-plugged:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h2-833090-21 Oct 04 18:51:32.569747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-53d51aab-9904-43e1-8c16-808609120ffb req-2e957199-1f85-4562-8d5a-af7ffa76f3be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103868 Oct 04 18:51:32.576722 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3482/6940] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:32.576850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.576850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.578314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.579396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.579872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.580585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.581106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.581542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.722989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:32.745511 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b7a714d7-1a4c-4225-ba69-ddb5139e0602 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.167658 Oct 04 18:51:32.745511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3459/6941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:33.758406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:33.759153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:33.767151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.767684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.768137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.768837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:33.769291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:33.769758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.914088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.921918 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3aec064c-d285-42b4-b784-bb25fd2c326c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1392 microversion: 2.1 time: 0.167848 Oct 04 18:51:33.922504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3483/6942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:33 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.945101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.945731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.952662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.953166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.954093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.954800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.955264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.955800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.099204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:35.107234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-894f518e-4247-4406-9f86-2f5fe782c4ae tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1564 microversion: 2.1 time: 0.166199 Oct 04 18:51:35.107866 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3460/6943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:35.131441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.137415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.139167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.139711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.140155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.140856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.141414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.141965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.272995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:35.281219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9381ec3-471d-4efa-a59d-af4382111ac4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1564 microversion: 2.1 time: 0.153789 Oct 04 18:51:35.282335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3484/6944] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.620860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.621610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.626521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:37.634343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.635020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.635506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.636217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.638765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.639253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.671087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.671631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.672103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.691150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] Creating event network-changed:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h2-833090-21 Oct 04 18:51:37.697142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-62925faf-a288-4e20-adac-324c641db5c6 req-d9832f50-4ecc-4f94-9f8b-422e4320223c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074778 Oct 04 18:51:37.698332 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3485/6945] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:37.799339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:37.808644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc8a92e9-cf2f-41f1-a46c-e94ae7736c9e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1564 microversion: 2.1 time: 0.192209 Oct 04 18:51:37.823366 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3461/6946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:09.107978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:09.108663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=48 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:09.113446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:09.115884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:09.123359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.123878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.124326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.125061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.125525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.126501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.206339 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cbf0666-4743-41fe-b037-949499c21d9c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action" status: 200 len: 24576 microversion: 2.1 time: 0.100483 Oct 04 18:52:09.207007 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3486/6947] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:09 2022] POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action => generated 24576 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:52:39.687395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:39.688198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:39.690819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:39.691497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=44 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:39.697099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.697602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.698108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.698825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.699282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.699759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.840505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:39.848278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c164a9dd-3bfb-4204-b3f5-1cb02c377e66 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1683 microversion: 2.1 time: 0.166088 Oct 04 18:52:39.849351 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3462/6948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:39 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:39.949191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:39.951487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:39.953988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:39.959965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.960447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.960916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:39.961604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:39.962052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:39.962474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.034264 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba445758-2fc1-488e-8054-d1476d2e86a4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action" status: 200 len: 32643 microversion: 2.1 time: 0.089786 Oct 04 18:52:40.035183 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3487/6949] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:39 2022] POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action => generated 32643 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:52:40.251131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:40.251830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:40.258590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.259083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.259600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.260282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.260745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.261451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.393622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aace554a-959d-4a98-b190-41affb9cc81a tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1836 microversion: 2.1 time: 0.146519 Oct 04 18:52:40.394213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3463/6950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:40 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1836 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:40.424170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:40.426727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:40.434743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.435233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.435717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.436415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:40.436873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:40.437303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:40.476819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lazy-loading 'flavor' on Instance uuid 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:52:40.489129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Going to try to live migrate instance to another host {{(pid=123887) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:52:43.585437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-99868312-8673-4fd8-a0e1-37453b5706fe tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action" status: 202 len: 0 microversion: 2.1 time: 3.165516 Oct 04 18:52:43.586105 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3488/6951] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:40 2022] POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action => generated 0 bytes in 3167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:43.595062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:43.596613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:43.603079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.603612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.604120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.604844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:43.605286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:43.605716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:43.741166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:43.749043 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bcca7983-42c4-4b1b-b3e8-3ba525df552a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.157998 Oct 04 18:52:43.749631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3464/6952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:43 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:44.777186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:44.779729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:44.790433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.791242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.791984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.793008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:44.793625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:44.794456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:44.961828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:44.965680 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8da0674-6118-4ef0-ace8-5772918aac8d tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.194235 Oct 04 18:52:44.966421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3489/6953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:44 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:45.512021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:45.522365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:45.522846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:45.523275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:45.534439 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] Creating event network-vif-unplugged:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h2-833090-21 Oct 04 18:52:45.540152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2de1adfb-71f9-464e-98e9-ed83fa854329 req-5548be94-860c-4a25-82cf-8cf0506f49fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031810 Oct 04 18:52:45.540791 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3465/6954] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:45.990108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:45.990855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:45.999360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.000004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.000715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.001601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.002093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.002483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.171391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:46.179427 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7a440cc-e178-4aa1-95bc-3a45e020764b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.193330 Oct 04 18:52:46.180274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3490/6955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:45 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:47.208624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:47.209322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:47.215538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.216053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.216491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.217179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.217631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.218054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.350150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:47.358096 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c03e3b87-ced1-495f-bd46-cf33ecf1d59b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.154512 Oct 04 18:52:47.358678 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3466/6956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:47 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:47.563842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:47.574102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:47.574577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:47.575009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:47.587150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] Creating event network-changed:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h2-833090-21 Oct 04 18:52:47.592450 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b3929b80-10a6-40f3-a4d7-afa13b0bbb03 req-afe8f236-dc03-4540-b7d2-b9d73fa664f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032365 Oct 04 18:52:47.593030 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3491/6957] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:48.383250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:48.383896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:48.391818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.392532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.393720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.394181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:48.394803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:48.395409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:48.534920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:48.542949 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6b5a4f7-f739-4d23-8ea7-21cb77d677e6 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.164708 Oct 04 18:52:48.546834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3467/6958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:48 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:49.578409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:49.579116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:49.586233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.586728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.587173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.587908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:49.588373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:49.588806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:49.728938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:49.736885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1bb39f9-b2f2-4194-97b3-237e5ce1ee15 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.163789 Oct 04 18:52:49.741653 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3492/6959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:49 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:50.760889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:50.761439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:50.768225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.768709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.769144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.769831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:50.770285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:50.770713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:50.901512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:50.909325 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a0f3937-ab05-4131-82e3-84507426ec99 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.152427 Oct 04 18:52:50.909902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3468/6960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:50 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:51.934582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:51.934582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:51.941371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.941998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.942306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:51.943034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:51.943503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:51.943931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:52.132164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:52.140237 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-20615854-38df-4369-98db-352d84d082cc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.210936 Oct 04 18:52:52.140825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3493/6961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:51 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:53.166964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:53.168194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:53.175499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.176519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.177100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.178537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:53.179074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:53.179658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:53.326087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:53.335330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-85936a69-280b-4b55-8dcc-275b79927cc3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1693 microversion: 2.1 time: 0.175312 Oct 04 18:52:53.336180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3469/6962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:53 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.359050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.359846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.367352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.367952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.368484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.369182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.369826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.370257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.509250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:54.517517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8821c82-5bd4-4e5c-a30f-febde3ffd4bd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1683 microversion: 2.1 time: 0.162347 Oct 04 18:52:54.518142 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3494/6963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.540312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.541166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.548121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.548609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.549044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.549749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.550206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.550629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.700299 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4908b3b8-fa70-41ac-9aa8-fdc465bec7e2 tempest-TestNetworkAdvancedServerOps-285866212 tempest-TestNetworkAdvancedServerOps-285866212-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1836 microversion: 2.1 time: 0.163781 Oct 04 18:52:54.701499 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3470/6964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1836 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:54.767173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:54.888390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:54.893902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0433fcde-0bd3-4df3-88bd-e00a7a8c28fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1683 microversion: 2.1 time: 0.173429 Oct 04 18:52:54.894623 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3495/6965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:54 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:54.998459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:55.000805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:55.007516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.008051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.008500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.009206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:55.009673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:55.010110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:55.077887 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce0f0518-45c8-4e4f-89ba-d0c654d9942c tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action" status: 200 len: 38684 microversion: 2.1 time: 0.083168 Oct 04 18:52:55.085303 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3471/6966] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:54 2022] POST /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5/action => generated 38684 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:52:56.191224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.192323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.194804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:56.200778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.201585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.202215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.203308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.207662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.208162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.209202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.214857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.215669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.225547 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] Creating event network-changed:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h1-833090-21 Oct 04 18:52:56.236827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5d81c74d-e36b-40b4-a24d-9cb8c3fb6c50 req-b7c75bd3-5db3-4cf9-a9f7-0b5b94f50eb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045459 Oct 04 18:52:56.242778 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3472/6967] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:52:56.256807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:52:56.629351 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d593d99d-7986-4277-9630-91caec4fc218 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 204 len: 0 microversion: 2.1 time: 0.441772 Oct 04 18:52:56.631427 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3496/6968] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:52:56 2022] DELETE /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:52:56.642024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:56.643206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:56.653071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.654022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.654661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.656111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:56.656747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:56.657571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:56.823165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:56.835512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09323a15-c35b-4721-8db1-c0271d1fd628 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1689 microversion: 2.1 time: 0.198745 Oct 04 18:52:56.848869 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3473/6969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:56 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:57.657393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921c0647-5d1c-4f7f-996c-6fb08f66e1b5", "name": "network-vif-deleted", "tag": "a29b735e-7344-4386-bcd1-c615d9c9287a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:57.668582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.669389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.669558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.680287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] Creating event network-vif-deleted:a29b735e-7344-4386-bcd1-c615d9c9287a for instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 on n-h1-833090-21 Oct 04 18:52:57.685160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a9112aa5-c461-4ea6-9954-a472cd6dadb1 req-f6564d77-b102-4b8e-bb1e-4133988f4b32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Oct 04 18:52:57.685750 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3497/6970] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:57.861536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:57.862157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:57.869044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.869540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.869991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.870694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:57.871162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:57.871680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:57.943964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:57.950473 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b44038b3-9b1f-4aaa-b299-7ea5b34f9a2a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 200 len: 1351 microversion: 2.1 time: 0.092914 Oct 04 18:52:57.951270 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3474/6971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:57 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:58.975726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.976433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 921c0647-5d1c-4f7f-996c-6fb08f66e1b5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.982945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.983444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.983919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.984620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.985083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.985515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.999322 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] HTTP exception thrown: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Request method failure captured: Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 HTTP/1.1 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPH9jCNCqAuU3u6zvxDcgL_Tkr1DnoYs17IEbv55f48Ko9n5jwzBglzSORaCXIwx1F-ukJ2TlVev1Vyd1EmkrP-45RZSwazdV4YUOvbGUSynq7r_od1nSMeIXlAFabWZzgh1RmDVbI4IC3qAaWGPiwq9TexiIJXL2oU0nuWJo4ULHMmw Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3639f5cb83f14b369390f5f295dffc1e"}]}] Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6b6a59bfa4bd4ec5b33f8cc9c7864b00 Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '921c0647-5d1c-4f7f-996c-6fb08f66e1b5'} Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:52:59.000981 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Returning 404 to user: Instance 921c0647-5d1c-4f7f-996c-6fb08f66e1b5 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd376c65-dc91-4ab2-819d-928b26902180 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5" status: 404 len: 111 microversion: 2.1 time: 0.032647 Oct 04 18:52:59.005889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3498/6972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/921c0647-5d1c-4f7f-996c-6fb08f66e1b5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:53:02.902669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-874dbe3e-1fd1-492a-9f66-c4a0002cd879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '.version_select at 0x7f9009900d30>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.000567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-874dbe3e-1fd1-492a-9f66-c4a0002cd879 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1319663486" status: 202 len: 0 microversion: 2.1 time: 0.101883 Oct 04 18:53:03.001379 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3475/6973] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 4 18:53:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1319663486 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:53:03.043767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d30335c-d0e7-4c12-8ef0-4365044350a3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: .version_select at 0x7f900833d8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-952586738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu0fGmvM4SuheYRz7+YPIQ9eOB8diS6aDbUdjk2RDBuMyAxAJ7nszmzDkCva2kpa6z25FEXQS8L+GjI4/rsDuaCZzI+s8bQ2/XtvbFn8bk/sbos7Q2rR48LuPRs7ZdwRA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:03.061056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0d30335c-d0e7-4c12-8ef0-4365044350a3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:03.067239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0d30335c-d0e7-4c12-8ef0-4365044350a3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:03.213254 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d30335c-d0e7-4c12-8ef0-4365044350a3 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.180441 Oct 04 18:53:03.214350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3499/6974] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:53:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:11.706536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-699137384", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "e803751f-1f2e-4e10-9179-7b9fac494844"}], "key_name": "tempest-TestNetworkAdvancedServerOps-952586738", "security_groups": [{"name": "tempest-secgroup-smoke-625454194"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:11.757152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=68 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:11.758349 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:53:11.758673 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 18:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 18:53:11.760172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:11.894707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] validate_networks() for [('e803751f-1f2e-4e10-9179-7b9fac494844', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:12.632711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:12.637364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:12.637364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:12.637364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:12.637364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:12.645363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.646275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.647766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.648939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:12.649709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:12.650425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.673900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:12.681193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Getting quotas for user 6b6a59bfa4bd4ec5b33f8cc9c7864b00 and project 3639f5cb83f14b369390f5f295dffc1e. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:12.695812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:12.698466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:12.869183 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e857a6f-d906-4674-b878-97ff895548bc tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.167904 Oct 04 18:53:12.869843 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3476/6975] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:53:12.879386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:12.885907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fc4cb92b-0716-49ae-9e59-ed4568b60278 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:12.886901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fc4cb92b-0716-49ae-9e59-ed4568b60278 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:12.889277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:12.959452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fc4cb92b-0716-49ae-9e59-ed4568b60278 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.960090 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fc4cb92b-0716-49ae-9e59-ed4568b60278 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1265 microversion: 2.1 time: 0.081995 Oct 04 18:53:12.960188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3500/6976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:12 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:13.992384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:13.994747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:14.015175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.016011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.016641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.017362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.017871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.018904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.101052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.110006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04124915-e31f-49ef-9590-26d6aa6b06d8 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1269 microversion: 2.1 time: 0.131621 Oct 04 18:53:14.111212 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3477/6977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:13 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.138711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.139782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.149127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.149630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.150077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.150791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.156163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.162339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.241759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.249987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-409817fe-1200-4fab-a691-48bd0703dcb2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1317 microversion: 2.1 time: 0.115643 Oct 04 18:53:15.250585 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3501/6978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1317 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:16.273630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.274344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.281862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.282487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.283189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.284123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.289508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.289508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.445102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.460095 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9bf1714c-0ee2-4287-9d58-ea5daa52f1eb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.190387 Oct 04 18:53:16.460694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3478/6979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.447101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:17.458627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.459865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.460430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.472365 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] Creating event network-changed:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:53:17.478223 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a8892916-53de-4121-8844-b76d7843204c req-5a66ecbe-970c-4def-8416-89ad6b3664ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 Oct 04 18:53:17.478843 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3502/6980] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:17.485932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.487191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.501596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.502111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.502620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.503279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.503780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.504222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.654499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.663928 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5d3d65af-84b3-4438-8e9c-10709afc6bfb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.183280 Oct 04 18:53:17.664665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3479/6981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:18.688053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:18.688789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:18.695361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.695876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.696323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.697077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:18.697539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:18.698195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:18.832712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:18.840866 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f71af82c-bf2a-45c7-ab8b-79e83dc6946b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.158024 Oct 04 18:53:18.841506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3503/6982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:18 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:19.864317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.864901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.872443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.872934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.873381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.874075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.874535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.874966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.022810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.031452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8fd40910-68b6-42a0-afc3-a3d30341d249 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.171030 Oct 04 18:53:20.032396 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3480/6983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.054274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.055154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.062331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.062824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.063275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.064010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.064478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.064910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.204981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.213037 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b927057-3515-41a9-8655-69e77af50ace tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.162757 Oct 04 18:53:21.213628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3504/6984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:22.235957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.237170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.244626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.245282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.245817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.246658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.247222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.247782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.384595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.392720 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33c0050c-5fc5-49bd-9b46-c9b10fd114ab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.160592 Oct 04 18:53:22.400556 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3481/6985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:23.417178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.417814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.420540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:23.425532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.426038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.426458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.427148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.428248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.428680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.569383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:23.577466 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4aa91780-0ac3-45b0-8196-d0e789acf7b5 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.164790 Oct 04 18:53:23.578156 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3505/6986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:24.608150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:24.608150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:24.608150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:24.608150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:24.609881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.610366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.610811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.611538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.612004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.612438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.753136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:24.761515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3588f77-3bdc-41f5-8399-c364f8b37a93 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.164456 Oct 04 18:53:24.762114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3482/6987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:24 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:25.039048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "name": "network-vif-plugged", "status": "completed", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:25.048596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.049084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.049522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.061301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] Creating event network-vif-plugged:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:53:25.066256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-06bb9abb-931f-4690-8d61-3f340d2d9481 req-1a87848a-68ee-4160-9532-4efe50a5448c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Oct 04 18:53:25.066861 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3506/6988] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:25.785649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:25.786348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:25.794013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.794505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.794947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.795687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.796146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.796582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.930981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.938766 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91f9b7f1-466c-44e4-9536-4d748f89ecd7 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1390 microversion: 2.1 time: 0.157394 Oct 04 18:53:25.939337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3483/6989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:25 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:26.964828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.965643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.972057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.972547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.973076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.973780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.974239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.974669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.110320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.118796 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-97e470d9-6d78-4342-9a19-61a5bad19b8b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1562 microversion: 2.1 time: 0.160071 Oct 04 18:53:27.119380 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3507/6990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.141475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.142087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.149077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.149564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.150012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.150715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.151143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.151628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.297147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.308487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01451fc9-4ed8-4c49-8c20-65a22d0d3686 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1562 microversion: 2.1 time: 0.170872 Oct 04 18:53:27.308995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3484/6991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:29.317762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.319228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.319821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:29.327657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.328334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.328927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.329707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.330225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.330353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.330670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.330800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.331240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.342797 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] Creating event network-changed:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:53:29.348036 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bfb7d29b-5455-46ea-b07d-34842f49c15a req-b6a0dfa6-dd7b-4149-bee0-07287436d8c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031814 Oct 04 18:53:29.348615 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3485/6992] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:29.567631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:29.579012 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50ba64f9-5b15-4d99-9cc4-aa7bd023db1e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1562 microversion: 2.1 time: 0.265467 Oct 04 18:53:29.580250 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3508/6993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1562 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:00.884231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:00.885121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=52 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:00.889401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:00.892715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:00.897989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.898529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.898972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.900229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.900698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.901136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.971801 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3f213a9-10c3-4933-813f-870a99fff47f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action" status: 200 len: 24568 microversion: 2.1 time: 0.089360 Oct 04 18:54:00.972509 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3486/6994] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:00 2022] POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:54:02.749917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-663434581", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:02.757501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=19 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:02.758170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=40 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:02.805532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] validate_networks() for None {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:03.079905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:03.080337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:03.080815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:03.081228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:03.081644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:03.093676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.094162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.094602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.095331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.095812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.096359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.114532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Getting quotas for project b09674a31318478eb63a589212dcd7ab. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:03.120321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Getting quotas for user 997cc5a87d3341449d4aaf005a97cd37 and project b09674a31318478eb63a589212dcd7ab. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:03.132555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:03.135578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:03.263868 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81694fd6-8b24-467b-8997-5fce138aba68 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517990 Oct 04 18:54:03.264535 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3509/6995] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:03.280989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c572f71e-3c34-4dfa-b005-79b447cbf726 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:03.280989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c572f71e-3c34-4dfa-b005-79b447cbf726 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:03.352990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c572f71e-3c34-4dfa-b005-79b447cbf726 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:03.363876 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c572f71e-3c34-4dfa-b005-79b447cbf726 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1214 microversion: 2.1 time: 0.091179 Oct 04 18:54:03.367130 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3487/6996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:03 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:04.389133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:04.389709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:04.400773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.403032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.403032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.403032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.403032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.403555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.468397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:04.476138 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-467e0850-eb05-4672-9e72-7eff60389b90 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1218 microversion: 2.1 time: 0.092663 Oct 04 18:54:04.477865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3510/6997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:04 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:05.499194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:05.499836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:05.506850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:05.507332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:05.507797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.508482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:05.508964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:05.509393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.578721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:05.586528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c1bc128d-1d9e-4dbf-9238-06c950ebd818 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1284 microversion: 2.1 time: 0.091420 Oct 04 18:54:05.587928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3488/6998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:05 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:06.610378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:06.611724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:06.619606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.620106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.620546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.621285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.621742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.622169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.815084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:06.823414 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e153f4ad-a7c5-481c-a21f-28948e694da1 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.217083 Oct 04 18:54:06.824043 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3511/6999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:06 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:07.563738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711b7d06-f85e-4ad0-b94d-4f93d9cce5ee", "tag": "09b4dc00-6db1-4ad8-871a-1ce7f6470eb2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:07.575537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.576060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.576501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:07.592217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] Creating event network-changed:09b4dc00-6db1-4ad8-871a-1ce7f6470eb2 for instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee on n-h1-833090-21 Oct 04 18:54:07.597452 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-612b71e0-051e-4e18-902a-bd8c6a1004e6 req-bc068254-ed97-4b9b-a4bc-32ceb05507cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037610 Oct 04 18:54:07.598079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3489/7000] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:07.846248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.846862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:07.854356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.854840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.855274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:07.855993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:07.856446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:07.856870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:08.148718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:08.157374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b960fc04-3e1b-44a9-8b2c-ded3abe57c12 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.315046 Oct 04 18:54:08.157965 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3512/7001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:07 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:09.182847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:09.183496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:09.189733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.190216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.190652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.191339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.191813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.192238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.325836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:09.333715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89f5019f-2e58-4ddf-a3f6-a7396fc8fdc8 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.156762 Oct 04 18:54:09.334284 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3490/7002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:09 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:10.356491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.357108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.364022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.364508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.364952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.365644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.366102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.366534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.495136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.502796 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9f17abec-557f-44f6-babd-01dd21785999 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.150275 Oct 04 18:54:10.503379 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3513/7003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:11.526219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.527351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.534151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.534641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.535087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.535823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.536292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.536729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.669411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:11.677320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1607b58e-d6fd-44df-877e-01f36d35ffe3 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.155053 Oct 04 18:54:11.678787 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3491/7004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:12.700317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:12.700938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:12.707949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.708437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.708878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.709580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.710042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.710473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.848403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:12.857041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c07201de-7c43-4928-a8da-e4639691ae8c tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.160707 Oct 04 18:54:12.857637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3514/7005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:12 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:12.877520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711b7d06-f85e-4ad0-b94d-4f93d9cce5ee", "name": "network-vif-plugged", "status": "completed", "tag": "09b4dc00-6db1-4ad8-871a-1ce7f6470eb2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:12.888134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.888563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.889003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.900185 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] Creating event network-vif-plugged:09b4dc00-6db1-4ad8-871a-1ce7f6470eb2 for instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee on n-h1-833090-21 Oct 04 18:54:12.905902 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2c76aab6-d5aa-45a5-bd56-3e8ee447d5e4 req-a84b76ba-a834-42df-a9f9-a194ffe755ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Oct 04 18:54:12.906500 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3492/7006] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:13.879892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.880512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.882558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:13.883234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:13.889066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.889551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.889992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.890686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.891145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.891600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.021511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:14.030176 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5e41878-6937-4952-b244-dfb13dbe8102 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1314 microversion: 2.1 time: 0.154226 Oct 04 18:54:14.030765 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3515/7007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:13 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.049071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:15.054429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.055297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.061526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.062015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.062461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.063156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.063652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.064092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.197587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:15.205590 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-270bfe9c-e7a1-4376-bcf1-870bcf63ace9 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1464 microversion: 2.1 time: 0.157424 Oct 04 18:54:15.207181 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3493/7008] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.258234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.258741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.265633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.266122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.266566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.267256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.267742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.268172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.297673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:15.559575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcfdb03a-0184-4bcf-a0d8-6920443b7608 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "DELETE /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 204 len: 0 microversion: 2.1 time: 0.304894 Oct 04 18:54:15.560168 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3516/7009] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:15 2022] DELETE /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:15.568399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:15.569019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:15.575487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.575989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.576436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.577156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.577618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.578047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.707769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:15.716257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe04ca4e-ee89-483e-905c-b833180da355 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1470 microversion: 2.1 time: 0.151848 Oct 04 18:54:15.716866 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3494/7010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:15 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:16.739829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:16.740528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:16.747896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.748375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.748806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.749484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.749933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.750347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.888004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:16.895782 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f820a40-8555-4915-9d98-a346677bc02b tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1470 microversion: 2.1 time: 0.160229 Oct 04 18:54:16.896355 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3517/7011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:16 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.494236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711b7d06-f85e-4ad0-b94d-4f93d9cce5ee", "name": "network-vif-deleted", "tag": "09b4dc00-6db1-4ad8-871a-1ce7f6470eb2"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:17.505775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.511913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.511913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.518902 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] Creating event network-vif-deleted:09b4dc00-6db1-4ad8-871a-1ce7f6470eb2 for instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee on n-h1-833090-21 Oct 04 18:54:17.524043 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1a320fa0-04a6-4063-bb42-7aa9343468b0 req-84c2cd9d-658f-44e2-b404-c241303f88b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033526 Oct 04 18:54:17.524955 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3495/7012] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:17.918962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.919634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.926880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.930269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.930269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.930269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.930269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.930269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.962683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.963415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.964649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.964987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lazy-loading 'fault' on Instance uuid 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:18.009823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '997cc5a87d3341449d4aaf005a97cd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09674a31318478eb63a589212dcd7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:18.018213 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b58085a8-43b2-4d53-9a7f-dd4ef335c61e tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 200 len: 1304 microversion: 2.1 time: 0.103344 Oct 04 18:54:18.018790 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3518/7013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:19.045642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:19.046360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] [instance: 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:19.052828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.053311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.053749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.054698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.055150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.055612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.068777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] HTTP exception thrown: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Request method failure captured: Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee HTTP/1.1 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIFHo4PlQSLMK4Gnfj8QI0Xr-fvt16Z76bs-4BxcUviq7-STTB9MHd4du2mszGVYIM8HJ00BjKCs1i6b0yXBABFHn7mg2NueiHjzZH2DJnHGt_Cxv-jvvALgtXNl2XyA_GY2OjxzTXDwTT9VuId4dw9M6K60TW_NpFXVhokCpQRDtyE Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: b09674a31318478eb63a589212dcd7ab Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-VolumesNegativeTest-620659508 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b09674a31318478eb63a589212dcd7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b09674a31318478eb63a589212dcd7ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b09674a31318478eb63a589212dcd7ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b09674a31318478eb63a589212dcd7ab"}]}] Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-VolumesNegativeTest-620659508 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: b09674a31318478eb63a589212dcd7ab Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-VolumesNegativeTest-620659508 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-VolumesNegativeTest-620659508-project Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 997cc5a87d3341449d4aaf005a97cd37 Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-VolumesNegativeTest-620659508-project Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '711b7d06-f85e-4ad0-b94d-4f93d9cce5ee'} Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:19.070404 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] Returning 404 to user: Instance 711b7d06-f85e-4ad0-b94d-4f93d9cce5ee could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f99f90b-e5ae-4fa1-a344-d2dcb1617a86 tempest-VolumesNegativeTest-620659508 tempest-VolumesNegativeTest-620659508-project] 10.222.0.40 "GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee" status: 404 len: 111 microversion: 2.1 time: 0.031962 Oct 04 18:54:19.076051 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3496/7014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:19 2022] GET /compute/v2.1/servers/711b7d06-f85e-4ad0-b94d-4f93d9cce5ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:54:31.438385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:31.441241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:31.443904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:31.444569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:31.449831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.450436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.450788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.451505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.451966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.457624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.535082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:31.535534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:31.536022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:31.536444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:31.536863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:31.790511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:31.797052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.797547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.797980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.798684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.799144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.799605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.825712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d42eecbf-5519-4659-a8b5-c03ce9178d7b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action" status: 202 len: 1137 microversion: 2.1 time: 0.391593 Oct 04 18:54:31.830266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3519/7015] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:31 2022] POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action => generated 1137 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:54:31.846337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:31.846970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:31.850292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:31.850959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=42 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:31.857386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.858969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.858969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:31.858969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:31.859447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:31.859912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:32.018777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:32.027649 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5329762e-93f0-4e3d-92b9-dbd8dace55f4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.184402 Oct 04 18:54:32.028239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3497/7016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:31 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:33.051322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:33.051973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:33.059224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.059761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.060210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.060914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:33.061377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:33.061812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:33.204820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:33.213108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3f42d4ce-acd1-4ae0-8995-c134f7fabb9a tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.165875 Oct 04 18:54:33.213752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3520/7017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:33 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:34.236470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:34.237095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:34.244202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:34.244695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:34.245139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:34.245905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:34.246383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:34.246872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:34.376695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:34.384615 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53402bc1-795a-4130-90ef-7d4253367706 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.152239 Oct 04 18:54:34.385227 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3498/7018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:34 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:35.408985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:35.409597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:35.416601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.417093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.417531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:35.418224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:35.418685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:35.419115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:35.552883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:35.561057 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-721a67b0-3265-4559-a3fa-8af35bf301ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.156043 Oct 04 18:54:35.561642 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3521/7019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:35 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:36.585488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:36.586043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:36.592948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:36.593440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:36.593890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.594589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:36.595053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:36.595502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:36.726660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:36.735073 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8336b10-b353-49e5-b33d-7b1c018bf5b9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.153597 Oct 04 18:54:36.735687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3499/7020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:36 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:37.758247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:37.758949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:37.766346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.768621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.768621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.768621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:37.768971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:37.769142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:37.901429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:37.909554 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af3fe42f-2c8a-467e-8968-3f3ff07a76c4 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.155296 Oct 04 18:54:37.910147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3522/7021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:37 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:38.933816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:38.935032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:38.942163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.942661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.943107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:38.943838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:38.944330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:38.944781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:39.088676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:39.096613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6771ab43-c4ba-4d10-818b-09ee7a3ef1fd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.166836 Oct 04 18:54:39.097122 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3500/7022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:38 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:40.120643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:40.122160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:40.138291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:40.270571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:40.279121 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d381cf98-a838-49ea-94f1-eee90c2de0be tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.162519 Oct 04 18:54:40.280188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3523/7023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:40 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:41.306475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:41.307231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:41.314196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.314763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.315282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.316109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:41.316657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:41.317241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:41.462911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:41.471618 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2d81b8b-d15a-4918-be07-db1cfb1c853f tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.169462 Oct 04 18:54:41.472272 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3501/7024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:41 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:42.494279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:42.494959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:42.502592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.503086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.503559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.504259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:42.504711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:42.505141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:42.642672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:42.650760 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-85226437-9745-4a9c-ab6d-d67dd6a4f078 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.160363 Oct 04 18:54:42.651385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3524/7025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:42 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:43.529111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a74caab-4d87-444f-b29b-fba458294a09 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Action: 'create', calling method: .version_select at 0x7f9009786550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1968904427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYWbzscVMNNr5plIhK6CyGk/Xuz+8pP4ygi40vCQocMdrvLwnDVsOj8v51dysap8TzJhODYVcupD7gPv4CFnnXGoktU6j2E+NRQf3w+sTPjCpDgVYjH/pR4mpFJvYu/sg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:43.544066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9a74caab-4d87-444f-b29b-fba458294a09 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:43.549873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9a74caab-4d87-444f-b29b-fba458294a09 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for user f0a6a7e3d1704d70b3ff961e2b2bd864 and project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:43.663637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a74caab-4d87-444f-b29b-fba458294a09 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.308020 Oct 04 18:54:43.664290 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3502/7026] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:54:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:43.678121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:43.678121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:43.682158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.682655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.683111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.683845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:43.684308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:43.684737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:43.817071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:43.825130 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bb47d742-982c-49a8-938b-db7e29750e40 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1690 microversion: 2.1 time: 0.154970 Oct 04 18:54:43.826348 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3525/7027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:43 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:44.851127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:44.851686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:44.858142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.858640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.859087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:44.859862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:44.860402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:44.860916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:45.126269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:45.134078 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-37af6367-3fe3-4384-b4eb-0e2a908c00dd tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1696 microversion: 2.1 time: 0.288047 Oct 04 18:54:45.134660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3503/7028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:44 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:46.159217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:46.159862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:46.166700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.167200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.167678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.168373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:46.168833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:46.169262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:46.427219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:46.435915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-594bb605-0520-4180-83ae-ff3ef21db502 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1696 microversion: 2.1 time: 0.280046 Oct 04 18:54:46.436494 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3526/7029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:46 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1696 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:47.439531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "name": "network-vif-unplugged", "status": "completed", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:47.451745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.453072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.458694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:47.459318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:47.465955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.466499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.466946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.468092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.472406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:47.473086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:47.473535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:47.483448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] Creating event network-vif-unplugged:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:54:47.488706 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-35d6c86b-9c4d-4562-ad91-2fd154384caf req-5e2992a0-417a-4b53-b5a0-4a96a37d3494 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056837 Oct 04 18:54:47.489430 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3504/7030] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:47.617558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:47.626298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-60dca0c7-9c90-4dcf-827f-d31e16d338fb tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1696 microversion: 2.1 time: 0.171536 Oct 04 18:54:47.627141 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3527/7031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:47 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:48.651303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:48.652091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:48.659110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.659633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.660709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.660854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:48.661274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:48.661731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:48.961028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:48.976020 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67ecb697-9044-43e3-8472-42f470e2d68e tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1681 microversion: 2.1 time: 0.329864 Oct 04 18:54:48.976621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3505/7032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:48 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:51.407357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "name": "network-vif-plugged", "status": "completed", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:51.418945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:51.419945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:51.420560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:51.435984 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] Creating event network-vif-plugged:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:54:51.442706 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-289a0287-d97f-4d2e-9d9e-b6736ddce081 req-8f464fbf-f0f1-4c3b-934d-ce0cb72c0ed0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039186 Oct 04 18:54:51.444165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3528/7033] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:51.605079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-400420065-access_point-1434720747", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "737d0a1b-2d22-406e-a7ac-c5d6c58dc9c1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1968904427", "security_groups": [{"name": "tempest-secgroup_access--28760828"}, {"name": "tempest-secgroup_general--803050961"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:51.772248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] validate_networks() for [('737d0a1b-2d22-406e-a7ac-c5d6c58dc9c1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:52.176251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:52.176957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:52.177559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:52.178081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:52.178868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:52.193888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.193888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.193888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.193888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:52.194328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:52.194439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:52.212983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:52.218601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for user f0a6a7e3d1704d70b3ff961e2b2bd864 and project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:52.232250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:52.234260 n-d-833090-21 devstack@n-api.service[123886]: WARNING nova.utils [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-400420065-access_point-1434720747 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-400420065-acc Oct 04 18:54:52.235006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:52.365917 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fe2f178-6875-4075-95a4-45a9f039235b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 0.764979 Oct 04 18:54:52.366583 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3506/7034] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:51 2022] POST /compute/v2.1/servers => generated 455 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:52.378994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c30f83f4-4e48-4c7a-b4b5-db42d2e9bc41 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:52.380139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c30f83f4-4e48-4c7a-b4b5-db42d2e9bc41 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:52.458370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c30f83f4-4e48-4c7a-b4b5-db42d2e9bc41 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:52.466720 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c30f83f4-4e48-4c7a-b4b5-db42d2e9bc41 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1294 microversion: 2.1 time: 0.091033 Oct 04 18:54:52.468520 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3529/7035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:52 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:53.491191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:53.491844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:53.499113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.499655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.500134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.500950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:53.501425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:53.501862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:53.563746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:53.571399 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7a3854f-6a6f-478c-a9b9-a43b7001b6ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1298 microversion: 2.1 time: 0.085132 Oct 04 18:54:53.571998 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3507/7036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:53 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:54.595966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:54.596594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:54.605858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.606341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.606897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.607959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:54.608450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:54.608875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:54.695879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:54.706634 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4682762d-9cb9-49d3-a435-b612d2e1a888 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1354 microversion: 2.1 time: 0.115417 Oct 04 18:54:54.707493 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3530/7037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:54 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:55.729727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:55.731078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:55.738544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.739109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.739696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.740468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:55.740999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:55.741494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:55.891332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:55.899385 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b526ee15-ff4a-4e05-bbd9-9ef4512a3eda tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.173724 Oct 04 18:54:55.900100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3508/7038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:55 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:56.406807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a984dcee-416d-40ab-aa36-94592a431783", "tag": "0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:56.417597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.418066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.418500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.430251 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] Creating event network-changed:0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e for instance a984dcee-416d-40ab-aa36-94592a431783 on n-h1-833090-21 Oct 04 18:54:56.436124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-72038ac8-20f5-42c7-808a-6bc8080c8249 req-02b0947e-738a-44dd-a5a2-26ed326dcfdd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Oct 04 18:54:56.436730 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3531/7039] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:56.929766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:56.930388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:56.939052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.939571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.940014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:56.940712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:56.941167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:56.941593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:57.099965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:57.108614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d57e5452-d273-4b8c-b874-adbe81494c67 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.183286 Oct 04 18:54:57.109228 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3509/7040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:56 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:58.132417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:58.133073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:58.140300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.140771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.141203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.141878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:58.142326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:58.142745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:58.280034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:58.287987 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef17a4fe-d9e8-4a85-b86e-29155e9df479 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.159951 Oct 04 18:54:58.288684 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3532/7041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:58 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:59.312111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:59.312712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:59.319638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.320131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.320577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.321306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:59.321772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:59.322212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:59.463694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:59.471719 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3d9240f-59c7-41ce-a6de-afc71d7da3f4 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.164099 Oct 04 18:54:59.472304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3510/7042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:59 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:00.494993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:00.495582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:00.502469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.502948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.503390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.504133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:00.504582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:00.505004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:00.644627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:00.652368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57549b65-1e66-4f7c-a06c-c7f912153aee tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.161487 Oct 04 18:55:00.652941 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3533/7043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:00 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:01.056582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a984dcee-416d-40ab-aa36-94592a431783", "name": "network-vif-plugged", "status": "completed", "tag": "0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:01.067750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.068604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.068792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.082227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] Creating event network-vif-plugged:0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e for instance a984dcee-416d-40ab-aa36-94592a431783 on n-h1-833090-21 Oct 04 18:55:01.087203 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-39140cb6-0718-4265-bd14-6389bf19e743 req-b038f0d1-a149-4375-a231-a070004df00e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034641 Oct 04 18:55:01.087837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3511/7044] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:01.676842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.679379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.680658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:01.685470 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.686008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.686452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.687152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.687642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.688078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.702968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:01.831501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.838983 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df100419-59fc-4618-8b5b-7bc5de3a39eb tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1469 microversion: 2.1 time: 0.166131 Oct 04 18:55:01.839612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3534/7045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.860750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:02.861559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:02.865623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.866320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.868160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:02.873766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.880293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=73 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:03.019433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.027957 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c79d1d45-b400-46de-8362-ac2773c75223 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1642 microversion: 2.1 time: 0.168850 Oct 04 18:55:03.028451 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3512/7046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1642 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:03.051682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.052296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.054360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:03.060163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.060647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.061086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.061993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.062675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.063192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.205205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.212996 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-120218cd-b2fe-47e6-9f2e-de2c559ebf65 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1642 microversion: 2.1 time: 0.165926 Oct 04 18:55:03.213662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3535/7047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1642 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:03.235601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.236274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.243200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.247738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.247738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.247738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.247738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.247738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.544778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1640632f-0e35-42eb-a775-e8bff1ed7e2c tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1795 microversion: 2.1 time: 0.312940 Oct 04 18:55:03.545401 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3513/7048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1795 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:05.836233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a984dcee-416d-40ab-aa36-94592a431783", "tag": "0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:05.847020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.847712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.848159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.861510 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] Creating event network-changed:0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e for instance a984dcee-416d-40ab-aa36-94592a431783 on n-h1-833090-21 Oct 04 18:55:05.866910 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-748add90-8af2-44b5-bea6-0c899a239318 req-b367e415-eba0-472b-b3a5-7db0e33d8543 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108521 Oct 04 18:55:05.867715 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3536/7049] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:23.282371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:23.284560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:23.286848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:23.287606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=11 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:23.292373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.292868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.293341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.294063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:23.294531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:23.294972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:23.362167 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d54db82c-ce6a-496b-9cf7-5f6654f6e34b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action" status: 200 len: 24571 microversion: 2.1 time: 0.083905 Oct 04 18:55:23.363063 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3514/7050] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 18:55:23 2022] POST /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:55:48.608159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1462251672", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "2790c836-1a80-4491-9158-a58ed5edddcc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1968904427", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a984dcee-416d-40ab-aa36-94592a431783"]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:48.639965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=5 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:48.641046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:48.642372 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:55:48.642699 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 18:55:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 18:55:48.704813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] validate_networks() for [('2790c836-1a80-4491-9158-a58ed5edddcc', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:49.152008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:49.153106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:49.153777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:49.154387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:49.154988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:49.167526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.170754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.170754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.170754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.170754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.170754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.192409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:49.204493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Getting quotas for user f0a6a7e3d1704d70b3ff961e2b2bd864 and project 25bb4abc635a44ed9c41fa054b61448a. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:49.219799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:49.222431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:49.325067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d967952-f310-4645-8cf5-2cfe5ae37024 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.721514 Oct 04 18:55:49.325067 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3537/7051] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:48 2022] POST /compute/v2.1/servers => generated 361 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:49.337230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1adc7f18-efd5-4415-bf42-74cb264eba64 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.337938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1adc7f18-efd5-4415-bf42-74cb264eba64 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.397464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1adc7f18-efd5-4415-bf42-74cb264eba64 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.405933 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1adc7f18-efd5-4415-bf42-74cb264eba64 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1242 microversion: 2.1 time: 0.073688 Oct 04 18:55:49.406542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3515/7052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:49 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:50.439276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:50.440124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:50.451647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.452472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.453228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.454431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:50.455275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:50.455971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.533760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.542458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7838b7a6-cbc1-4e46-b3f5-e7cbb6d87728 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1246 microversion: 2.1 time: 0.110273 Oct 04 18:55:50.543118 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3538/7053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:50 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:51.566610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:51.567179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.574584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.575073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.575543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.576245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.576704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.577165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.650052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:51.658220 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72b32da0-89ef-4382-be78-50007b2e2784 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1302 microversion: 2.1 time: 0.095656 Oct 04 18:55:51.658803 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3516/7054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:51 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:52.682388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:52.683001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:52.690006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.690578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.691092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.691895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:52.692429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:52.693377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:52.798622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:52.808703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69f7d0b1-87af-4ef3-ae8f-927b4a9f4232 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.130210 Oct 04 18:55:52.809303 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3539/7055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:52 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:53.501729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8a4bfc-b446-4345-8de0-7001b18d0a59", "tag": "b40d1d04-f20b-4023-a9a4-e88e8ec3b777"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:53.512743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.513234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.513680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.524981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] Creating event network-changed:b40d1d04-f20b-4023-a9a4-e88e8ec3b777 for instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 on n-h2-833090-21 Oct 04 18:55:53.530091 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d78a0c55-2134-4530-9e1b-44944c9aac4e req-e1e482ee-f189-488b-b471-cf041771a07d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032088 Oct 04 18:55:53.530694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3517/7056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:53.832749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:53.833884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:53.840951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.841434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.841868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.842560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:53.843007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:53.843430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:53.957553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:53.979533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2c3b405b-62ff-42e4-a48a-c69192433f7b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.150608 Oct 04 18:55:53.980138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3540/7057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:53 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:54.766896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:54.772504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:54.775161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:54.787612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.788108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.788719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.789464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.789918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.790504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.794242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:54.794891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:54.795328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:54.807712 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] Creating event network-changed:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:55:54.813124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-dc8f5dec-cae1-4735-ae85-eb8744017ec9 req-282db8d3-9d1b-4aae-9989-1244299f0391 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044317 Oct 04 18:55:54.813731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3541/7058] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:54.819430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:55.003956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.004689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.011001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.011515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.012111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.012827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.013311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.013728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.085733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d692313c-faa0-4cc9-97e4-550650f708e9 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 204 len: 0 microversion: 2.1 time: 0.322902 Oct 04 18:55:55.086338 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3518/7059] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:54 2022] DELETE /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:55.097365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:55.098356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:55.105173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.105600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.106048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.106760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:55.107230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:55.107730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:55.111142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:55.120253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-30f404f6-d7bb-4e6e-8414-73e78853f675 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.121663 Oct 04 18:55:55.128071 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3542/7060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:54 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:55.250769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:55.259272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-591c93ac-b390-488e-8c2f-1e257b4d94ac tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1687 microversion: 2.1 time: 0.168241 Oct 04 18:55:55.259898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3519/7061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:55 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:56.142988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:56.143643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:56.151145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.151796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.152247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.152942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.153402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.153831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.234020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:56.241794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-41d4f01e-8d9b-4c49-82a4-1732821d582f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.102780 Oct 04 18:55:56.242372 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3543/7062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:56 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:56.281960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:56.282578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:56.290220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.290706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.291150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.291872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:56.292328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:56.292758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:56.429629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:56.437401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea2d018d-0dff-4148-a193-2b4f928d3dc2 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1687 microversion: 2.1 time: 0.159431 Oct 04 18:55:56.437984 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3520/7063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:56 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:57.264715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.265335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.272319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.272806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.273247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.273950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.274408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.274842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.357019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.365576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58758176-4718-4189-9fc8-c16fb7b5c1f6 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.104782 Oct 04 18:55:57.366146 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3544/7064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:57.597868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:57.598831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:57.605471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.605903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.606349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.607049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:57.607532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:57.607969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:57.741119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:57.749604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0adb8181-ebef-47d1-9917-8ea8b949e9ef tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1687 microversion: 2.1 time: 0.292545 Oct 04 18:55:57.750478 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3521/7065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:57 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1687 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:58.388399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:58.389014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:58.396459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.396945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.397374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.398074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.398526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.399000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.502697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.510259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a71899c-467e-4dcd-a42a-594c50c29e97 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.125732 Oct 04 18:55:58.510845 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3545/7066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:58 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:58.769990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f833c8b-b32e-4cbf-8ec1-3f2825f395bb", "name": "network-vif-deleted", "tag": "370ab19c-f882-4894-840d-b6f04d9f159e"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:58.778510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:58.779148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:58.781642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.782133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.782571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.787324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.787930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.789043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.789138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:58.789545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:58.789983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:58.794887 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] Creating event network-vif-deleted:370ab19c-f882-4894-840d-b6f04d9f159e for instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb on n-h2-833090-21 Oct 04 18:55:58.800204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-02d7a5e9-5ec8-4280-bf8b-1a46fbc4c18a req-a080ce96-e038-49a3-bcde-88d87bcf0099 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034159 Oct 04 18:55:58.801239 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3522/7067] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:58.859150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:58.867675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3b85a370-597f-441a-9c5d-9ac67dbb4cab tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1501 microversion: 2.1 time: 0.099378 Oct 04 18:55:58.868490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3546/7068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:58 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1501 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:59.531640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:59.535975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.537251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.543217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.543731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.544165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.544846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.545296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.545719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.629048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.637175 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8b34f25-ae06-4c8f-8a9c-486e40ef1e33 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.106670 Oct 04 18:55:59.637744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3523/7069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:59.728823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8a4bfc-b446-4345-8de0-7001b18d0a59", "name": "network-vif-plugged", "status": "completed", "tag": "b40d1d04-f20b-4023-a9a4-e88e8ec3b777"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:59.734492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:59.740417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:59.742137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.742620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.743045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.754342 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] Creating event network-vif-plugged:b40d1d04-f20b-4023-a9a4-e88e8ec3b777 for instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 on n-h2-833090-21 Oct 04 18:55:59.759768 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-18631f4a-7484-4577-a450-309822595848 req-d3c21efe-ad3f-4e8c-88a7-a7cb1649f923 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Oct 04 18:55:59.760372 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3547/7070] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:59.891421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:59.892071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:59.900231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.900729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.901176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.901904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.902374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.902811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.934619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:59.935103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:59.935572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:59.936028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lazy-loading 'fault' on Instance uuid 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:59.980520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b6a59bfa4bd4ec5b33f8cc9c7864b00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3639f5cb83f14b369390f5f295dffc1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:59.988342 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8c23f15-34b0-4c0f-bea5-1c452fce0083 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 200 len: 1355 microversion: 2.1 time: 0.100985 Oct 04 18:55:59.990216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3524/7071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:59 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:00.660187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:00.660925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:00.668963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.669448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.669887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.670636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:00.671093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:00.671547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:00.758895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:00.768107 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad47e5bb-4559-41d2-8714-b22a93bddfd1 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1300 microversion: 2.1 time: 0.112230 Oct 04 18:56:00.768692 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3548/7072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:00 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:01.012138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.012774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] [instance: 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.019662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.020161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.021153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.021888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.022351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.022790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.037243 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] HTTP exception thrown: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Request method failure captured: Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb HTTP/1.1 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPH9jCNCqAuU3u6zvxDcgL_Tkr1DnoYs17IEbv55f48Ko9n5jwzBglzSORaCXIwx1F-ukJ2TlVev1Vyd1EmkrP-45RZSwazdV4YUOvbGUSynq7r_od1nSMeIXlAFabWZzgh1RmDVbI4IC3qAaWGPiwq9TexiIJXL2oU0nuWJo4ULHMmw Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3639f5cb83f14b369390f5f295dffc1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3639f5cb83f14b369390f5f295dffc1e"}]}] Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 3639f5cb83f14b369390f5f295dffc1e Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1321431240 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6b6a59bfa4bd4ec5b33f8cc9c7864b00 Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1321431240-project Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '6f833c8b-b32e-4cbf-8ec1-3f2825f395bb'} Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:56:01.038912 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Returning 404 to user: Instance 6f833c8b-b32e-4cbf-8ec1-3f2825f395bb could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab80374a-3470-4949-a61d-b67510f8bf17 tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb" status: 404 len: 111 microversion: 2.1 time: 0.032372 Oct 04 18:56:01.044049 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3525/7073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/6f833c8b-b32e-4cbf-8ec1-3f2825f395bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:01.792500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.793068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.800222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.801156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.801604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.802948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.803445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.803916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.885121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:01.893258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed40a480-8440-460e-97c5-70c75a7a47a3 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1473 microversion: 2.1 time: 0.104833 Oct 04 18:56:01.893868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3549/7074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1473 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:01.916325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:01.916981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:01.923027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.923538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.923979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:01.924910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:01.925626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:01.926054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.385420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:02.392584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9010b646-3eed-4e42-86f7-46cc1b0e97d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1473 microversion: 2.1 time: 0.480150 Oct 04 18:56:02.393236 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3526/7075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:01 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1473 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:02.415225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.415974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.422169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.422658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.423101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.423822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.424280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.424712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.506197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-486cfb4b-5a08-4286-b77c-4d8730aff286 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1626 microversion: 2.1 time: 0.094733 Oct 04 18:56:02.507143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3550/7076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1626 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:02.528707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.529317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.535252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.535771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.536247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.536934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.537390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.537818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.777636 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-179e049c-2503-4370-a6e9-7e0f44e2e278 tempest-TestSecurityGroupsBasicOps-45774744 tempest-TestSecurityGroupsBasicOps-45774744-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1912 microversion: 2.1 time: 0.252338 Oct 04 18:56:02.778230 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3527/7077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1912 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:02.883898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.884553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.891454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.892042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.892490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.893189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.894338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.894338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.920651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:03.193310 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e7abd39a-a606-4189-af28-c2894c496c4f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 204 len: 0 microversion: 2.1 time: 0.313857 Oct 04 18:56:03.193925 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3551/7078] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:02 2022] DELETE /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:03.202258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.202886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.210580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.211073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.211546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.212252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.212714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.213148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.303046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:03.312258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-70f2740f-d502-48fe-8e5d-7eba8ec5c3d7 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1479 microversion: 2.1 time: 0.113863 Oct 04 18:56:03.313016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3528/7079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1479 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:04.336239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:04.337101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:04.344150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.344643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.345091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.345787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:04.346252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:04.346679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:04.432871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:04.441085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2585971d-971f-43e5-bfb9-0d259ef81b6b tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1479 microversion: 2.1 time: 0.109147 Oct 04 18:56:04.441688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3552/7080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:04 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1479 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:05.084337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ef3d074-0e98-4721-a90a-4e80a4a43d3b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] Calling method '.version_select at 0x7f90080dcc10>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.165833 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ef3d074-0e98-4721-a90a-4e80a4a43d3b tempest-TestNetworkAdvancedServerOps-1321431240 tempest-TestNetworkAdvancedServerOps-1321431240-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-952586738" status: 202 len: 0 microversion: 2.1 time: 0.085754 Oct 04 18:56:05.166474 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3529/7081] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 18:56:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-952586738 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:05.361448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8a4bfc-b446-4345-8de0-7001b18d0a59", "name": "network-vif-deleted", "tag": "b40d1d04-f20b-4023-a9a4-e88e8ec3b777"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:05.372065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.372579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.373018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.385592 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] Creating event network-vif-deleted:b40d1d04-f20b-4023-a9a4-e88e8ec3b777 for instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 on n-h2-833090-21 Oct 04 18:56:05.390736 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-513dcaa9-b1d0-4cc1-8b62-8c4cf5da32e1 req-13542e17-cfec-4820-9a63-59c8cb670848 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033045 Oct 04 18:56:05.391289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3553/7082] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:05.468274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.469157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.482502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.483010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.483459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.484269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.484917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.485356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.549915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:05.558025 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2871e56-c172-4983-8a44-11fb261b71d2 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 200 len: 1327 microversion: 2.1 time: 0.093945 Oct 04 18:56:05.558601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3530/7083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:05 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:06.583769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:06.584466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: 6b8a4bfc-b446-4345-8de0-7001b18d0a59] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:06.590693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.591176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.591656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.592354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.592814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.593237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.607152 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] HTTP exception thrown: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Request method failure captured: Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 HTTP/1.1 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIFxLtp1ni06XBxlbAhRqWBdxRQMeMVnEwbxo5AkiYBRfQwBH3soAPY_FKUHuR6NI_WYeWO4bEL1FDh8bBe7bWe29hPoc9Y2Hbafj91FhuYWaV7Pr528VLiUr8EMNYXmzZ-nFGPlsw_QNXjcdQ4aHNpqYLRyOxFaUZ_kS6eJRqtWw2g Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 25bb4abc635a44ed9c41fa054b61448a Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25bb4abc635a44ed9c41fa054b61448a"}]}] Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 25bb4abc635a44ed9c41fa054b61448a Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestSecurityGroupsBasicOps-400420065-project Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f0a6a7e3d1704d70b3ff961e2b2bd864 Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestSecurityGroupsBasicOps-400420065-project Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '6b8a4bfc-b446-4345-8de0-7001b18d0a59'} Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:06.608857 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Returning 404 to user: Instance 6b8a4bfc-b446-4345-8de0-7001b18d0a59 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3516fa2-07f1-4e9b-92bd-6abda7d4b714 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59" status: 404 len: 111 microversion: 2.1 time: 0.032179 Oct 04 18:56:06.612402 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3554/7084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:06 2022] GET /compute/v2.1/servers/6b8a4bfc-b446-4345-8de0-7001b18d0a59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:12.240305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.241622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a984dcee-416d-40ab-aa36-94592a431783", "tag": "0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:12.242005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.252932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.254456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.255310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.256035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.256781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.257258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.261353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.261867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.262319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.269014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:12.277159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] Creating event network-changed:0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e for instance a984dcee-416d-40ab-aa36-94592a431783 on n-h1-833090-21 Oct 04 18:56:12.282296 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-10fc1e5c-cc78-4efe-bcc4-fa022fd09548 req-fbf3e58f-18b9-4d94-837d-d307da16d97b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044494 Oct 04 18:56:12.283102 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3555/7085] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:12.285731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:12.323964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:12.535611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ff8f0b9-442e-4571-bdda-53e7d01741ed tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 204 len: 0 microversion: 2.1 time: 0.301549 Oct 04 18:56:12.536266 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3531/7086] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:12 2022] DELETE /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:12.548133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:12.548857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:12.559599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.560203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.560811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.561608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:12.562217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:12.562940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:12.918135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.935458 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69781e5a-d8ac-483a-a1b5-2d6c8b1c9603 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1765 microversion: 2.1 time: 0.394463 Oct 04 18:56:12.943123 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3556/7087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:12 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1765 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:13.971905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.973179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:13.981070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.983937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.983937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.983937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.983937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.984648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.321375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.329512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3f329b66-3cf4-498a-a2a8-8a1abbcf4305 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1765 microversion: 2.1 time: 0.362130 Oct 04 18:56:14.330188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3532/7088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1765 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:15.035733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a984dcee-416d-40ab-aa36-94592a431783", "name": "network-vif-deleted", "tag": "0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:15.054100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.054851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.055286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.073039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] Creating event network-vif-deleted:0e7dbcd3-5273-4fb2-8ec5-ebdcac70347e for instance a984dcee-416d-40ab-aa36-94592a431783 on n-h1-833090-21 Oct 04 18:56:15.079544 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1656c1f9-af35-4e6f-b20e-4b9fa406378a req-9b7b0d57-1593-469b-ab49-616be69f1334 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048143 Oct 04 18:56:15.080184 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3557/7089] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:15.354793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.355413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.364112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.364609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.365215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.366227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.366861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.367438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.408792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.409222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.409662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.410663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lazy-loading 'fault' on Instance uuid a984dcee-416d-40ab-aa36-94592a431783 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:15.476482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a6a7e3d1704d70b3ff961e2b2bd864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bb4abc635a44ed9c41fa054b61448a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:15.485316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1f6e965-c6c1-4686-955b-aa49ceefdf79 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 200 len: 1384 microversion: 2.1 time: 0.134539 Oct 04 18:56:15.486096 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3533/7090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 1384 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:16.512341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.513244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] [instance: a984dcee-416d-40ab-aa36-94592a431783] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.519820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.520409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.521168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.522142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.524106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.524106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.538877 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] HTTP exception thrown: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Request method failure captured: Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 HTTP/1.1 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIFxLtp1ni06XBxlbAhRqWBdxRQMeMVnEwbxo5AkiYBRfQwBH3soAPY_FKUHuR6NI_WYeWO4bEL1FDh8bBe7bWe29hPoc9Y2Hbafj91FhuYWaV7Pr528VLiUr8EMNYXmzZ-nFGPlsw_QNXjcdQ4aHNpqYLRyOxFaUZ_kS6eJRqtWw2g Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 25bb4abc635a44ed9c41fa054b61448a Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25bb4abc635a44ed9c41fa054b61448a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25bb4abc635a44ed9c41fa054b61448a"}]}] Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 25bb4abc635a44ed9c41fa054b61448a Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-400420065 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestSecurityGroupsBasicOps-400420065-project Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f0a6a7e3d1704d70b3ff961e2b2bd864 Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestSecurityGroupsBasicOps-400420065-project Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'a984dcee-416d-40ab-aa36-94592a431783'} Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:16.540859 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. Oct 04 18:56:16.544072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:16.545108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Returning 404 to user: Instance a984dcee-416d-40ab-aa36-94592a431783 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:16.546123 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04a5091a-3798-4476-a344-32b9fba53480 tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783" status: 404 len: 111 microversion: 2.1 time: 0.039047 Oct 04 18:56:16.550978 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3558/7091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/a984dcee-416d-40ab-aa36-94592a431783 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:21.955080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-87edfa41-d986-4318-808a-6d0fb3d9345f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] Calling method '.version_select at 0x7f9008ee1670>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.000623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:22.125161 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-87edfa41-d986-4318-808a-6d0fb3d9345f tempest-TestSecurityGroupsBasicOps-400420065 tempest-TestSecurityGroupsBasicOps-400420065-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1968904427" status: 202 len: 0 microversion: 2.1 time: 0.176982 Oct 04 18:56:22.125787 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3534/7092] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 4 18:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1968904427 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:23.511127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.512884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.513365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.513826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.514603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.515062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.515501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.527580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:23.540650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8bbc2eb-9243-4d12-a42f-12cf428d7120 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.171225 Oct 04 18:56:23.541232 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3559/7093] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:23.655689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1523684983", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "availability_zone": "nova:n-h1-833090-21", "networks": [{"uuid": "840f2bc1-35cd-4964-8ede-92be0738c4e1"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:23.720506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] validate_networks() for [('840f2bc1-35cd-4964-8ede-92be0738c4e1', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:24.134859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:24.139874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:24.139874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:24.139874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:24.139874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:24.148838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.149351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.149798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.150690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.151230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.151707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.170865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Getting quotas for project 2cd82ec67f6f4d1a879ceacea3a1f077. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:24.177110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Getting quotas for user 9dba4270f04746ddb690059e5d10b653 and project 2cd82ec67f6f4d1a879ceacea3a1f077. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:24.189490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:24.191908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:24.322109 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d10441b5-fdb4-4814-abe2-3f786b2ee03e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671733 Oct 04 18:56:24.323103 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3535/7094] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:24.335341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05ed1c3f-f8e8-4af8-8072-d0551707c36d tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.336024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05ed1c3f-f8e8-4af8-8072-d0551707c36d tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.403577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05ed1c3f-f8e8-4af8-8072-d0551707c36d tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1329 microversion: 2.1 time: 0.072052 Oct 04 18:56:24.404286 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3560/7095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1329 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:25.428419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ce1b953-fa6a-4939-9726-224e0589ef4e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:25.429708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ce1b953-fa6a-4939-9726-224e0589ef4e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:25.501338 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ce1b953-fa6a-4939-9726-224e0589ef4e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1329 microversion: 2.1 time: 0.078772 Oct 04 18:56:25.501924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3536/7096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:25 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1329 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.526667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:26.527298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.537539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.538632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.539653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.541078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.541701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.542289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.622356 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2dded788-7577-4a28-a72d-ddcb0dc65aa6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1418 microversion: 2.1 time: 0.100271 Oct 04 18:56:26.623137 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3561/7097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:26 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1418 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:27.646209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:27.646852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:27.654661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.655243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.655736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.656475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:27.656939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:27.657377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:27.736727 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d7e12d9c-977a-4f16-aba1-7ff582792c85 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1424 microversion: 2.1 time: 0.094805 Oct 04 18:56:27.751420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3537/7098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:27 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:28.760758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:28.761374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:28.769438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.770197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.770628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.771500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.772112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.772556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.912195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a326b6ae-7643-4130-9141-8e5a7996d002", "tag": "cabf4260-0f0a-4b93-9ee6-7488f39dd6c0"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:28.934739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:28.935655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:28.936330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:28.958463 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] Creating event network-changed:cabf4260-0f0a-4b93-9ee6-7488f39dd6c0 for instance a326b6ae-7643-4130-9141-8e5a7996d002 on n-h1-833090-21 Oct 04 18:56:28.969390 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5d706620-0ea7-4fd1-9db4-0baee9fec772 req-95fef6be-bb66-409e-b38a-649306299ac4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061048 Oct 04 18:56:28.970742 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3538/7099] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:29.004111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6cc82ba-8ba4-4695-bfde-4bfed209cc6e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.247004 Oct 04 18:56:29.019018 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3562/7100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:28 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:30.031658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:30.032816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:30.044091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.044720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.045277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.046115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:30.047431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:30.049937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:30.231113 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a34e3c34-4361-4b0c-a759-4ffe73968cd2 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.204681 Oct 04 18:56:30.232171 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3539/7101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:30 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:31.255772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:31.256620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:31.263608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.264216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.265133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.266002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:31.266561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:31.267245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:31.421462 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aaa92118-fad2-4c70-bbf5-7d0c52977ac8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.170751 Oct 04 18:56:31.422054 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3563/7102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:31 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:32.445475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:32.446094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:32.453558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.454056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.454497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.455966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:32.456430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:32.457021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:32.686554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9885ce3-d30f-40b1-9d62-c6882e54e90e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.244578 Oct 04 18:56:32.687575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3540/7103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:32 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:33.549067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:33.711310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:33.712513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:33.719919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.720434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.721589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.722629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.723093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.723546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.737100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a326b6ae-7643-4130-9141-8e5a7996d002", "name": "network-vif-plugged", "status": "completed", "tag": "cabf4260-0f0a-4b93-9ee6-7488f39dd6c0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:33.749197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:33.750155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:33.750757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:33.765384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] Creating event network-vif-plugged:cabf4260-0f0a-4b93-9ee6-7488f39dd6c0 for instance a326b6ae-7643-4130-9141-8e5a7996d002 on n-h1-833090-21 Oct 04 18:56:33.771408 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1a22248d-0c43-465d-8bb8-e8f55f9435b0 req-e6aaaf69-378e-4c85-abcc-fd3ab74a2e0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238394 Oct 04 18:56:33.772238 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3564/7104] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:33.988558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2eca328d-c4e2-40ba-82be-5855e978da9a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.281118 Oct 04 18:56:33.994723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3541/7105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:33 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:35.012048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:35.022751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:35.022751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:35.028618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.029126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.029570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.030432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:35.030901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:35.031347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:35.184273 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a081e262-682f-4746-89a7-87ce2ca52c16 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1466 microversion: 2.1 time: 0.173390 Oct 04 18:56:35.185020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3565/7106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:35 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1466 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:36.207199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.207839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.210026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:36.211759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:36.216662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.217152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.217592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.218294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.218746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.219171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.432244 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2885eccd-c268-4dc7-ab60-2c815aefbddb tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1650 microversion: 2.1 time: 0.229300 Oct 04 18:56:36.432960 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3542/7107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1650 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:36.466512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.467941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.481800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.489409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.489409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.489811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.490425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.490939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.676388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ff1f166-9933-4f04-bcab-144b005a911a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1650 microversion: 2.1 time: 0.216050 Oct 04 18:56:36.677014 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3566/7108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1650 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:36.698893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:36.699454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:36.717229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:37.196875 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0626357c-415e-4ea2-bccb-ea850964a3a8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1650 microversion: 2.1 time: 0.501663 Oct 04 18:56:37.197474 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3543/7109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:36 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1650 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:37.318728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-292787919", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "availability_zone": "nova:n-h2-833090-21", "networks": [{"uuid": "840f2bc1-35cd-4964-8ede-92be0738c4e1"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:37.397127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] validate_networks() for [('840f2bc1-35cd-4964-8ede-92be0738c4e1', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:38.164967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:38.178211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:38.178211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:38.178211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:38.178211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:38.178211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.179213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.179829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.180727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.184806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.185482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.220878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Getting quotas for project 2cd82ec67f6f4d1a879ceacea3a1f077. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:38.234182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Getting quotas for user 9dba4270f04746ddb690059e5d10b653 and project 2cd82ec67f6f4d1a879ceacea3a1f077. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:38.255757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:38.259289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:38.377665 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95e7868c-ca6d-4838-b31f-0be2d8b0aa33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062499 Oct 04 18:56:38.379732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3567/7110] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:38.395201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5b00d85-4ba5-4536-abfd-8b2f9c8929d8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.397506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5b00d85-4ba5-4536-abfd-8b2f9c8929d8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.466418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5b00d85-4ba5-4536-abfd-8b2f9c8929d8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1328 microversion: 2.1 time: 0.078510 Oct 04 18:56:38.468658 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3544/7111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:38 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1328 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:39.492164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.492803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.504731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.505319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.505836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.506674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.507137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.507591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.588766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e06c43e-9892-4c3d-b170-fe595d637cdc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1345 microversion: 2.1 time: 0.101483 Oct 04 18:56:39.595971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3568/7112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:40.147707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5aac5d68-7180-4b88-932a-dc53403d5cb8 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Action: 'create', calling method: .version_select at 0x7f9008ee19d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1125670674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcafel4D1JkISHktyghD3rQSw6BjDFeceJogRCxxWS2Um/X9nNwirDz2wHRWjTgB8mkcSmjmiHseXG5d5kkVgZDtISz5Z4PIM5V/KditKpSbTzYrZ+UzZiS6ClWIZLA0g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:40.168475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5aac5d68-7180-4b88-932a-dc53403d5cb8 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for project 305926e02a464ec3bc757a9c5be51984. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:40.177209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5aac5d68-7180-4b88-932a-dc53403d5cb8 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for user e53b2df556f24f6693d30d85cf3eaa43 and project 305926e02a464ec3bc757a9c5be51984. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:40.306014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5aac5d68-7180-4b88-932a-dc53403d5cb8 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.313499 Oct 04 18:56:40.306711 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3545/7113] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 18:56:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:40.612727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.613342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.620689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.621281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.621723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.622423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.622880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.623309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.709695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-989336d4-8d31-4fc2-977f-ec513ec7fff8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1417 microversion: 2.1 time: 0.101170 Oct 04 18:56:40.710284 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3569/7114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1417 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:41.735052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:41.736789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:41.746531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.747297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.747932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.748816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.749471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.750044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.910051 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9f87d9e-ce0b-4b62-b3f6-ade86e653cfa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.180471 Oct 04 18:56:41.923490 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3546/7115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:41 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:42.934293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.934927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.942579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.946618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.946618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.946618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.946618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.946618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.131945 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80eb0abe-367f-4a1c-8b41-b96aa6b01f30 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.201507 Oct 04 18:56:43.147607 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3570/7116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:43.190772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abfed83-040a-4867-8124-b073130fec63", "tag": "c5bf3015-270d-4a59-b196-8020b0b79e55"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:43.201869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:43.202444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:43.203908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:43.221704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] Creating event network-changed:c5bf3015-270d-4a59-b196-8020b0b79e55 for instance 4abfed83-040a-4867-8124-b073130fec63 on n-h2-833090-21 Oct 04 18:56:43.227306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9a156dcb-ed41-4387-91aa-7f062ba785e0 req-938b1eef-fa70-4040-b42c-b18728b14246 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122029 Oct 04 18:56:43.228264 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3547/7117] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:43.482277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1636465175", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1125670674", "security_groups": [{"name": "tempest-secgroup-smoke-604291348"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d2c0bbe6-dcf2-464e-9c26-cdc2be70fa58"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:43.659224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] validate_networks() for [('d2c0bbe6-dcf2-464e-9c26-cdc2be70fa58', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:44.054362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for project 305926e02a464ec3bc757a9c5be51984. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:44.059666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for user e53b2df556f24f6693d30d85cf3eaa43 and project 305926e02a464ec3bc757a9c5be51984. Resources: dict_keys(['metadata_items']) {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:44.075753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:44.079393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:44.079393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:44.079393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:44.079393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:44.086945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.087425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.087892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.088606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.089057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.089485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.109343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for project 305926e02a464ec3bc757a9c5be51984. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:44.115204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Getting quotas for user e53b2df556f24f6693d30d85cf3eaa43 and project 305926e02a464ec3bc757a9c5be51984. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:44.128112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:44.130307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:44.154631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.155364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.163253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.163768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.165259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.165259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.165425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.165836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.169900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:44.295602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a96d65d-e01e-4ef6-8a60-f3c1c45132ee tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.144897 Oct 04 18:56:44.296185 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3548/7118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:44 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:44.308748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b47c5f66-70d8-41d0-af18-a0ed2ca772fd tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.833280 Oct 04 18:56:44.309508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3571/7119] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:44.327833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6f1fbdb-8f48-4bc2-8b38-b25cd160b6cb tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.327833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6f1fbdb-8f48-4bc2-8b38-b25cd160b6cb tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.382551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6f1fbdb-8f48-4bc2-8b38-b25cd160b6cb tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:44.389600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6f1fbdb-8f48-4bc2-8b38-b25cd160b6cb tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1303 microversion: 2.1 time: 0.068762 Oct 04 18:56:44.390250 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3549/7120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:44 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1303 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:45.319050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.319708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.329330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.329817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.330268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.330957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.331411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.331869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.335670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=67 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:45.413919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:45.414597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:45.423320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.423879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.424324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.425113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:45.425741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:45.426172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:45.467313 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-546c1e96-c3b5-4057-9c06-e6c2a0b3ea55 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.152929 Oct 04 18:56:45.467934 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3572/7121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:45.492440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:45.500082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc86e114-a12c-4b49-9027-6d953bb15e90 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1307 microversion: 2.1 time: 0.090367 Oct 04 18:56:45.500656 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3550/7122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:45 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:46.490616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:46.491235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:46.498401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.498890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.499337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.500107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.500575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.501569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.522167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:46.522785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:46.529583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.530072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.530506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.531192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:46.531685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:46.532113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:46.596145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:46.604011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f15844b5-22e3-46f2-8eea-17a791b58278 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1355 microversion: 2.1 time: 0.085687 Oct 04 18:56:46.604596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3551/7123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:46 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1355 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:46.628807 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0bcae1a-dfc6-467f-94ae-3e153393dae0 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.142069 Oct 04 18:56:46.629534 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3573/7124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:46 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:47.628464 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.629096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.637535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.640039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.640039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.640039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.640499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.640940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.650782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.652108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.670385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.670889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.671954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.673187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.673546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.673976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.844411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:47.856115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02662e80-1a92-44d8-8776-6ef8897aabd3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.232006 Oct 04 18:56:47.857123 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3552/7125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:47 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:47.885627 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d49a146e-e339-49d1-a029-f33a0f36ae2e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.238557 Oct 04 18:56:47.900905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3574/7126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:47 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:48.658295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c210c1-40bc-4d88-b7c0-24dfda09a1bf", "tag": "4ef7001d-519a-4b92-bd33-fca24b4146b5"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:48.684075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.684956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.685628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.700332 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] Creating event network-changed:4ef7001d-519a-4b92-bd33-fca24b4146b5 for instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf on n-h2-833090-21 Oct 04 18:56:48.707780 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0a794ec5-c571-4421-8610-9d5d4a563ca3 req-56df9fc6-f0d3-44f9-88ae-344cee60f4cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053345 Oct 04 18:56:48.709647 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3553/7127] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:48.885155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.885771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.893278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.893766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.894208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.894916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.895371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.895829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.910722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.911435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.918104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.918599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.919042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.919766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.920230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.920660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.056373 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2eeb7f2a-6d91-45f8-b4d0-fbea5718fb7f tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.145047 Oct 04 18:56:49.056373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3554/7128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:49.097359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:49.105288 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b63298f6-1313-4dd6-a1cf-60539711db5a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.224100 Oct 04 18:56:49.105871 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3575/7129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:49.941469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abfed83-040a-4867-8124-b073130fec63", "name": "network-vif-plugged", "status": "completed", "tag": "c5bf3015-270d-4a59-b196-8020b0b79e55"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:49.951774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.952281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.952711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.963358 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] Creating event network-vif-plugged:c5bf3015-270d-4a59-b196-8020b0b79e55 for instance 4abfed83-040a-4867-8124-b073130fec63 on n-h2-833090-21 Oct 04 18:56:49.968170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-343999db-5214-4d7a-b289-de83f32eb2f0 req-0e25cb02-5aba-4ab7-9a28-21e017ea7574 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Oct 04 18:56:49.968746 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3555/7130] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:50.078078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:50.078700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:50.086019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.086524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.086969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.087687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.088150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.088581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.128968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:50.129818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:50.142770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.143258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.143725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.144420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.144875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.145300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.215834 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-86c0badf-98e0-49d0-8dbf-56ea74324efa tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.141408 Oct 04 18:56:50.216363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3576/7131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:50 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:50.281415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:50.289748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c7ad787-34dc-4f34-81ca-f2d4642bb717 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.165691 Oct 04 18:56:50.290321 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3556/7132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:50 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:51.238750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.239369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:51.246594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.247076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.247555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.248253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.248715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.249148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.313948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.314587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:51.321646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.322222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.322669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.323362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.323843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.324267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.377717 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed36d7f3-c04f-4aa3-8414-c9bd1296a826 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.143321 Oct 04 18:56:51.378350 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3577/7133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:51 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:51.460706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:51.468800 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14eb537e-4c75-4862-9ee1-e2a9d9887f94 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.159037 Oct 04 18:56:51.469955 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3557/7134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:51 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:52.401200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:52.401825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:52.409296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.409784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.410224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.410928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.411393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.411847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.491134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:52.492407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:52.500247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.500989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.501736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.502517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:52.503084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:52.503615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:52.570306 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f2574d8-dcec-47b8-8c53-1ae7583f9947 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1465 microversion: 2.1 time: 0.172959 Oct 04 18:56:52.570933 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3578/7135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:52 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:52.648001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:52.655603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-382e625b-4cdb-41f5-bd31-a8e02abcf2c2 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.168396 Oct 04 18:56:52.656177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3558/7136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:52 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:53.593226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.593872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.601464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.601952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.602395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.603091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.603583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.604012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.678245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.678867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.685958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.686457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.686899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.687652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.688146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.688585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.728783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e0fd963-b334-4fa2-ab95-7f82ed3ad502 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1650 microversion: 2.1 time: 0.139314 Oct 04 18:56:53.729500 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3579/7137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:53 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1650 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:53.751603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.752219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.759379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.760008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.760464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.761167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.761804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.762235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.829688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:53.842563 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13933da9-b7f7-43f4-ab2e-addc9f399b29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.164066 Oct 04 18:56:53.842563 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3559/7138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:53 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:53.892429 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-106236da-3d33-409a-b2af-69c3613ca7b6 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1650 microversion: 2.1 time: 0.144532 Oct 04 18:56:53.893022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3580/7139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:53 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1650 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:53.915012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:53.915885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:53.917840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:53.923234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.923770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.924247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.924989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.925626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.926142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.973817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c210c1-40bc-4d88-b7c0-24dfda09a1bf", "name": "network-vif-plugged", "status": "completed", "tag": "4ef7001d-519a-4b92-bd33-fca24b4146b5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:53.983363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:53.983906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:53.984343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:53.996242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] Creating event network-vif-plugged:4ef7001d-519a-4b92-bd33-fca24b4146b5 for instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf on n-h2-833090-21 Oct 04 18:56:54.001435 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-48abea7c-73f1-4fa9-b556-2d549f0be172 req-b774ae88-ff09-4c2c-9d93-cdb5e1d23b7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 Oct 04 18:56:54.002072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3581/7140] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:54.058077 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b37f931-e98a-4f5b-aafc-eccf27ec1ee1 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1650 microversion: 2.1 time: 0.146682 Oct 04 18:56:54.058655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3560/7141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:53 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:54.082915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:54.083635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:54.089952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.090446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.090894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.091641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.092122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.092560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.108444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:54.119819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:54.122838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:54.377158 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-47419551-4962-4980-8b88-3c1629d9fa97 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 204 len: 0 microversion: 2.1 time: 0.299037 Oct 04 18:56:54.378286 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3582/7142] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:54 2022] DELETE /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:54.386660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:54.387537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:54.389172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:54.396437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.397018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.397535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.398244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.398710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.399211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.527518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ce92e09-21cd-4e07-9e66-773bc9fc95fc tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1656 microversion: 2.1 time: 0.144923 Oct 04 18:56:54.528125 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3561/7143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:54 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1656 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:54.863413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:54.864215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:54.871173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.871699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.872135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:54.872821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:54.873273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:54.873696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.002288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:55.010133 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3bc48d46-38d2-4462-b424-b7541478dbb7 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.151646 Oct 04 18:56:55.010717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3583/7144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:54 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:55.551526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:55.552145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:55.558923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:55.559410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:55.559878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.560556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:55.561010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:55.561434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:55.682895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a62641c-b6a5-4dc0-8f76-75f52e267bc9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1656 microversion: 2.1 time: 0.135622 Oct 04 18:56:55.683485 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3562/7145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:55 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1656 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:56.032769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:56.033381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:56.036933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:56.041853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.046897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.046897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.046897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.046897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.046897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.177124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:56.184929 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1031348f-60ba-4bf2-9416-9b0f241aac05 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1428 microversion: 2.1 time: 0.156137 Oct 04 18:56:56.185452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3584/7146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:56 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:56.705264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:56.705855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:56.712919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.713434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.713851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.714548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:56.715013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:56.715449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:56.851432 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a57768cd-0fe2-4c06-af5b-2c42b3dbbf9e tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1656 microversion: 2.1 time: 0.150053 Oct 04 18:56:56.852048 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3563/7147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:56 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:57.209496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:57.210560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:57.218214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.218868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.219298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.220247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.220899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.221367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.618831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abfed83-040a-4867-8124-b073130fec63", "name": "network-vif-deleted", "tag": "c5bf3015-270d-4a59-b196-8020b0b79e55"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:57.629213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.629732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.630134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.641261 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] Creating event network-vif-deleted:c5bf3015-270d-4a59-b196-8020b0b79e55 for instance 4abfed83-040a-4867-8124-b073130fec63 on n-h2-833090-21 Oct 04 18:56:57.646810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-488f07ab-9fc3-4a2f-8aad-9936eb687d8e req-58e6402c-fa6f-431a-a157-b0a78b6f2ac9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Oct 04 18:56:57.647801 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3564/7148] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:57.686523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:57.695015 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fce1cd87-44d8-4eae-8d07-f45e599d194b tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1608 microversion: 2.1 time: 0.490309 Oct 04 18:56:57.695629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3585/7149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:57 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1608 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:57.717830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:57.718544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:57.725670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.726213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.733393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.733393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.733393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.733393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.864000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:57.875168 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f936c7bf-8906-44a7-9bb5-d3d9b55dee04 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1608 microversion: 2.1 time: 0.161937 Oct 04 18:56:57.875788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:57.876030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3565/7150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:57 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1608 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:57.876410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:57.882608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.887563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.887563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.887563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.887563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.887563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.897218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:57.897831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:57.903889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.904376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.904819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.905605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:57.906076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:57.906508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:57.964645 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b4707e2-50e4-41ff-b56a-60e14b741c0b tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 200 len: 1450 microversion: 2.1 time: 0.092338 Oct 04 18:56:57.965314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3586/7151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:57 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 1450 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:58.048462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:58.057172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a94bc7a-d9ea-4c7a-bdec-304130f5a291 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1608 microversion: 2.1 time: 0.163798 Oct 04 18:56:58.057938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3566/7152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:57 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1608 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:58.989194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:58.993774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: 4abfed83-040a-4867-8124-b073130fec63] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:58.996950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:58.997444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:58.997885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:58.998589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:58.999117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:58.999595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.013287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] HTTP exception thrown: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Request method failure captured: Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 HTTP/1.1 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIHXPThrjC4gB0QFifyL2mzBVT-fWDu12-YXhr22MWZbi9rJxnP7jhbDpdTyGSTzLiFr2xxxorzNgu8hkymSvFM3exfcVRqTob0uOOqEd-tByiMWnycfYKFZ-HWRaaz7XV-jixcVhLClOkfoa9csPcQ-VCwmuqT36I8IIcEWi8p_eq4 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 2cd82ec67f6f4d1a879ceacea3a1f077 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestServerMultinode-751856129 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2cd82ec67f6f4d1a879ceacea3a1f077"}]}] Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestServerMultinode-751856129 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 2cd82ec67f6f4d1a879ceacea3a1f077 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestServerMultinode-751856129 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestServerMultinode-751856129-project-admin Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 9dba4270f04746ddb690059e5d10b653 Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestServerMultinode-751856129-project-admin Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4abfed83-040a-4867-8124-b073130fec63'} Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:59.015003 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Returning 404 to user: Instance 4abfed83-040a-4867-8124-b073130fec63 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ca9cb7c4-6d08-422f-8917-4d225e7d17b8 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63" status: 404 len: 111 microversion: 2.1 time: 0.031263 Oct 04 18:56:59.019930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3587/7153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:58 2022] GET /compute/v2.1/servers/4abfed83-040a-4867-8124-b073130fec63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:59.025846 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:59.026362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:59.034602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.038172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.038172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.038172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.038172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.038172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.062865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:59.065637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:59.411048 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03ae93da-4c40-4642-83e8-7a283c662c66 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 204 len: 0 microversion: 2.1 time: 0.388671 Oct 04 18:56:59.411592 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3567/7154] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:59 2022] DELETE /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:59.419962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:59.421191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:59.427561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.428057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.428499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.429365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:59.429832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:59.430269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:59.446555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:59.560698 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-154a5aa5-9477-4ea0-abbb-19bb1890de33 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1656 microversion: 2.1 time: 0.144475 Oct 04 18:56:59.561279 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3588/7155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:59 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1656 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:00.499798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c210c1-40bc-4d88-b7c0-24dfda09a1bf", "tag": "4ef7001d-519a-4b92-bd33-fca24b4146b5"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:00.510755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.511241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.511705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.522573 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] Creating event network-changed:4ef7001d-519a-4b92-bd33-fca24b4146b5 for instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf on n-h2-833090-21 Oct 04 18:57:00.527515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1f10fbc5-94ad-40a4-8380-55ea1fa0079b req-6a76c801-97c2-4945-b3c3-7fae30b4392e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031849 Oct 04 18:57:00.528117 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3568/7156] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:00.584658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:00.585278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:00.592407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.592897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.593335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.594032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:00.594485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:00.594912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:00.836868 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3d9b087-1b9c-4e83-b52c-118e25b3bf48 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1656 microversion: 2.1 time: 0.256438 Oct 04 18:57:00.837448 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3589/7157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:00 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1656 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:01.862096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:01.862808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:01.869622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:01.870144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:01.870593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.871335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:01.871814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:01.872243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.903837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:01.904326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:01.904774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:01.905218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lazy-loading 'fault' on Instance uuid a326b6ae-7643-4130-9141-8e5a7996d002 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:57:01.954103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a295f72b-a2cb-4a4f-95cb-313a1a67ace9 tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 200 len: 1456 microversion: 2.1 time: 0.097185 Oct 04 18:57:01.954732 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3569/7158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:01 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 1456 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:02.541776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a326b6ae-7643-4130-9141-8e5a7996d002", "name": "network-vif-deleted", "tag": "cabf4260-0f0a-4b93-9ee6-7488f39dd6c0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:02.552732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:02.553212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:02.553651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:02.564713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] Creating event network-vif-deleted:cabf4260-0f0a-4b93-9ee6-7488f39dd6c0 for instance a326b6ae-7643-4130-9141-8e5a7996d002 on n-h1-833090-21 Oct 04 18:57:02.570970 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2a0e0e73-c4f7-42f5-bc1d-27878a530886 req-8c111594-93eb-4f20-b0ab-da16e34abe96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Oct 04 18:57:02.571661 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3590/7159] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:02.978165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:02.978884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] [instance: a326b6ae-7643-4130-9141-8e5a7996d002] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:02.985972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:02.986462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:02.987821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:02.988526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:02.989019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:02.989452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:03.005669 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] HTTP exception thrown: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Request method failure captured: Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 HTTP/1.1 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIHXPThrjC4gB0QFifyL2mzBVT-fWDu12-YXhr22MWZbi9rJxnP7jhbDpdTyGSTzLiFr2xxxorzNgu8hkymSvFM3exfcVRqTob0uOOqEd-tByiMWnycfYKFZ-HWRaaz7XV-jixcVhLClOkfoa9csPcQ-VCwmuqT36I8IIcEWi8p_eq4 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 2cd82ec67f6f4d1a879ceacea3a1f077 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestServerMultinode-751856129 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2cd82ec67f6f4d1a879ceacea3a1f077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2cd82ec67f6f4d1a879ceacea3a1f077"}]}] Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestServerMultinode-751856129 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 2cd82ec67f6f4d1a879ceacea3a1f077 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestServerMultinode-751856129 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestServerMultinode-751856129-project-admin Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 9dba4270f04746ddb690059e5d10b653 Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestServerMultinode-751856129-project-admin Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'a326b6ae-7643-4130-9141-8e5a7996d002'} Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:57:03.007325 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] Returning 404 to user: Instance a326b6ae-7643-4130-9141-8e5a7996d002 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0e94855-fb16-42ad-9fa1-7f1d46b19d3a tempest-TestServerMultinode-751856129 tempest-TestServerMultinode-751856129-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002" status: 404 len: 111 microversion: 2.1 time: 0.034400 Oct 04 18:57:03.011092 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3570/7160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:02 2022] GET /compute/v2.1/servers/a326b6ae-7643-4130-9141-8e5a7996d002 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:58:04.990941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=13 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:04.993536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:58:04.997582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:58:04.998170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:58:05.004604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:05.005097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:05.005544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:05.006274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:05.006739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:05.007170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:05.033250 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-15782dfd-eeb3-4e19-b246-1298eb007e29 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044528 Oct 04 18:58:05.033857 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3591/7161] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 4 18:58:04 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:08.557279 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:02:08.558246 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:02:08.559199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:08.559980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:08.561254 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:02:08.561421 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:08.562818 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:02:08.562964 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:08.564300 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:02:08.564413 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:08.791692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:08.792205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:08.798188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:08.798680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:08.799124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.799856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:08.800324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:08.800760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:08.827924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:02:09.142956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d74a706b-a443-4d90-8402-c97d1ba111df tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 204 len: 0 microversion: 2.1 time: 0.587833 Oct 04 19:02:09.143492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3571/7162] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:08 2022] DELETE /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:02:09.151249 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:02:09.152195 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:02:09.152831 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:02:09.152957 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:09.153925 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:02:09.154023 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:09.155168 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:02:09.155168 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:02:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf (ip 10.222.0.40) !!! Oct 04 19:02:09.160515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:09.161184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:09.170903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.171390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.171858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.172550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:09.173091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:09.173426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:09.412707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:09.421265 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5a99c77-1fc0-447a-ad71-18997da3b677 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1732 microversion: 2.1 time: 0.273468 Oct 04 19:02:09.421837 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3592/7163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:09 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1732 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:10.444078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:10.444787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:10.456055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.456551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.457018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.457775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.458215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.458650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.463919 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 41366. Oct 04 19:02:10.467376 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 41364. Oct 04 19:02:10.588513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:10.596423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd16a71c-9e1b-4fd3-863e-5035c471b1d0 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1665 microversion: 2.1 time: 0.156797 Oct 04 19:02:10.597003 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3572/7164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:10 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:10.792344 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 41378. Oct 04 19:02:10.792344 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 41376. Oct 04 19:02:10.850083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c210c1-40bc-4d88-b7c0-24dfda09a1bf", "name": "network-vif-deleted", "tag": "4ef7001d-519a-4b92-bd33-fca24b4146b5"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:10.867181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:10.867714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:10.868158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:10.882187 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] Creating event network-vif-deleted:4ef7001d-519a-4b92-bd33-fca24b4146b5 for instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf on n-h2-833090-21 Oct 04 19:02:10.891879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f2a2fe8e-b944-4f11-b478-5bf4b2a241b9 req-cf505c81-99af-4173-ad30-4e3ff324e6b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118334 Oct 04 19:02:10.892508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3593/7165] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:11.621108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:11.622517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:11.630296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.630791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.631230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.632012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.632472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.632901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.675440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:11.676215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:11.676656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:11.677112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lazy-loading 'fault' on Instance uuid d1c210c1-40bc-4d88-b7c0-24dfda09a1bf {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:02:11.721300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53b2df556f24f6693d30d85cf3eaa43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305926e02a464ec3bc757a9c5be51984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:11.729751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e5444e4f-9dd7-4cfc-9717-f0faec3538ec tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 200 len: 1389 microversion: 2.1 time: 0.113132 Oct 04 19:02:11.730881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3573/7166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:11 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 1389 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:12.754182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:12.754896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:12.762540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.763032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.763496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.764194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:12.764657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:12.765090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:12.779387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] HTTP exception thrown: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Request method failure captured: Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf HTTP/1.1 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIHgVnLA8Wsdo6dc_KblS92wmr91Ci0mnJqACjJn-pkDhEVOAZ-utlsRQpm66_oHTd8QtSYXmSZZEeEggbYOgXn5WLnKiFJ_Uzj41dMYtLVw_m6JFShJSANUksJAlME5B4JCMclPm3nZ77mSrbc7oiEmiRqfenj4S25v12Fz8NKlySw Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_305926e02a464ec3bc757a9c5be51984"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/305926e02a464ec3bc757a9c5be51984"}]}] Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e53b2df556f24f6693d30d85cf3eaa43 Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1c210c1-40bc-4d88-b7c0-24dfda09a1bf'} Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:12.781037 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Returning 404 to user: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfa81e62-b036-4c9a-87a0-2cb741375461 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 404 len: 111 microversion: 2.1 time: 0.032663 Oct 04 19:02:12.785364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3594/7167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:12 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:13.273730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:13.274361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:13.281572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.281997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.282440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.283134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.283619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.284049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.297922 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] HTTP exception thrown: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Request method failure captured: Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf HTTP/1.1 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIHgVnLA8Wsdo6dc_KblS92wmr91Ci0mnJqACjJn-pkDhEVOAZ-utlsRQpm66_oHTd8QtSYXmSZZEeEggbYOgXn5WLnKiFJ_Uzj41dMYtLVw_m6JFShJSANUksJAlME5B4JCMclPm3nZ77mSrbc7oiEmiRqfenj4S25v12Fz8NKlySw Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_305926e02a464ec3bc757a9c5be51984"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/305926e02a464ec3bc757a9c5be51984"}]}] Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e53b2df556f24f6693d30d85cf3eaa43 Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'd1c210c1-40bc-4d88-b7c0-24dfda09a1bf'} Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:13.301933 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Returning 404 to user: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53153dbf-4e1f-4207-b74f-49256b2d8aa3 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 404 len: 111 microversion: 2.1 time: 0.031331 Oct 04 19:02:13.306538 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3574/7168] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:02:13 2022] DELETE /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:13.310284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:13.310928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] [instance: d1c210c1-40bc-4d88-b7c0-24dfda09a1bf] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:13.316907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.317417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.317851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.318531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:13.318982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:13.319403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:13.332916 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] HTTP exception thrown: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Request method failure captured: Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf HTTP/1.1 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIHgVnLA8Wsdo6dc_KblS92wmr91Ci0mnJqACjJn-pkDhEVOAZ-utlsRQpm66_oHTd8QtSYXmSZZEeEggbYOgXn5WLnKiFJ_Uzj41dMYtLVw_m6JFShJSANUksJAlME5B4JCMclPm3nZ77mSrbc7oiEmiRqfenj4S25v12Fz8NKlySw Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_305926e02a464ec3bc757a9c5be51984"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/305926e02a464ec3bc757a9c5be51984"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/305926e02a464ec3bc757a9c5be51984"}]}] Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 305926e02a464ec3bc757a9c5be51984 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestServerBasicOps-1527995546 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e53b2df556f24f6693d30d85cf3eaa43 Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestServerBasicOps-1527995546-project Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'd1c210c1-40bc-4d88-b7c0-24dfda09a1bf'} Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:02:13.334436 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Returning 404 to user: Instance d1c210c1-40bc-4d88-b7c0-24dfda09a1bf could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e397e0c5-2151-42d7-9fe7-250458e7c05a tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf" status: 404 len: 111 microversion: 2.1 time: 0.029984 Oct 04 19:02:13.338615 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3595/7169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:13 2022] GET /compute/v2.1/servers/d1c210c1-40bc-4d88-b7c0-24dfda09a1bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:02:13.890479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4af17cd-2755-4ab9-a074-1a75af574d61 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] Calling method '.version_select at 0x7f9008d925e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:14.046806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4af17cd-2755-4ab9-a074-1a75af574d61 tempest-TestServerBasicOps-1527995546 tempest-TestServerBasicOps-1527995546-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1125670674" status: 202 len: 0 microversion: 2.1 time: 0.160217 Oct 04 19:02:14.047406 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3575/7170] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 19:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1125670674 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:38.498934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2103827148", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "42eb64e8-5687-4068-8c9f-21e607b46b50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:38.509945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:38.510757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:38.712124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:02:39.508094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:02:39.508638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:02:39.508993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:02:39.509394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:02:39.509861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:02:39.519606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.520095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.520537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.521303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.521766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.522198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.539893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:02:39.545193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:02:39.600815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:02:39.603371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42eb64e8-5687-4068-8c9f-21e607b46b50',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:02:39.943361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be6ed651-cb29-4742-be98-87e0f4a7b571 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448543 Oct 04 19:02:39.944052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3596/7171] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:02:39.955163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9bba56f2-5dae-41f8-a7a2-d52f7cc16634 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:39.955806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9bba56f2-5dae-41f8-a7a2-d52f7cc16634 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:39.958743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:39.959797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:40.101286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9bba56f2-5dae-41f8-a7a2-d52f7cc16634 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:40.109040 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9bba56f2-5dae-41f8-a7a2-d52f7cc16634 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1057 microversion: 2.1 time: 0.157736 Oct 04 19:02:40.123840 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3576/7172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:39 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1057 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:41.133661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-958d8c5f-1cf7-462c-948a-be689f1bc96a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:41.134319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-958d8c5f-1cf7-462c-948a-be689f1bc96a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:41.187444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-958d8c5f-1cf7-462c-948a-be689f1bc96a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:41.194542 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-958d8c5f-1cf7-462c-948a-be689f1bc96a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1057 microversion: 2.1 time: 0.065876 Oct 04 19:02:41.195124 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3597/7173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:41 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1057 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:42.217239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:42.217860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:42.225139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.225626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.226067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.226765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:42.227359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:42.227701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:42.291149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:42.298875 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7f1a2fe-ee63-4771-9576-02a5da1ae99b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1155 microversion: 2.1 time: 0.085558 Oct 04 19:02:42.299457 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3577/7174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:42 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:43.329552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:43.339849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:43.339849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.339849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.339849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.340481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:43.341133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:43.341571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:43.505238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:43.514550 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2824302b-6dfd-4b31-a570-6ed053318d73 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1215 microversion: 2.1 time: 0.188891 Oct 04 19:02:43.515485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3598/7175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:43 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:44.326682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25fa0b0-8807-48d1-996c-6824606e9a97", "tag": "cf8d46ee-dfd2-4e52-b418-3e5c9955093b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:44.338422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.338974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.342522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.352025 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] Creating event network-changed:cf8d46ee-dfd2-4e52-b418-3e5c9955093b for instance c25fa0b0-8807-48d1-996c-6824606e9a97 on n-h1-833090-21 Oct 04 19:02:44.358950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6e9597b8-4c53-482b-ab62-a1a65ac507f4 req-9749ada6-d63c-4927-8530-805c1059089a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105757 Oct 04 19:02:44.359680 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3578/7176] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:44.538330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:44.540433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:44.548973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.549728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.550221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.550912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:44.551365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:44.551819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:44.689532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:44.697817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d3c23da-4a82-423e-a1a5-1547368c9058 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1215 microversion: 2.1 time: 0.163373 Oct 04 19:02:44.698401 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3599/7177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:44 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:45.721512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:45.722231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:45.729648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.730149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.730596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.731317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:45.731814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:45.732252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:45.865112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:45.873623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc0fd72f-42ee-4695-837d-f5873a5ecd4c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1215 microversion: 2.1 time: 0.156397 Oct 04 19:02:45.874234 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3579/7178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:45 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:46.896229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:46.896752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:46.904617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.905076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.907626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:46.907626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:46.907626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:46.907626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:47.038354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:47.046371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-477d5929-be0f-45d7-8224-b848cabe95e7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1215 microversion: 2.1 time: 0.154333 Oct 04 19:02:47.046963 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3600/7179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:46 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:48.070220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:48.070883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:48.079303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.079859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.080326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.081036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:48.081503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:48.081936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:48.215239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:48.223515 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0bd1c46-ee00-4168-8e38-9524b4eedb20 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1215 microversion: 2.1 time: 0.158221 Oct 04 19:02:48.224097 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3580/7180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:48 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:49.246459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:49.247077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:49.254002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.254490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.254930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.255653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:49.256111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:49.256540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:49.390213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:49.397955 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adbeb0d1-2a86-4294-8f25-58bdb52eb887 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.155428 Oct 04 19:02:49.399410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3601/7181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:49 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:50.422454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:50.422999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:50.425868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:50.430698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.431713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.432159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.432856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:50.433323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:50.433759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:50.561826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:50.569625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3607511-8852-4249-a77d-02599ef07a10 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.151383 Oct 04 19:02:50.570213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3581/7182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:50 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:51.595152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:51.596168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:51.598095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:51.599680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:51.604504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.604990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.605430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.606123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:51.606581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:51.607075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:51.733837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:51.741625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-294320d7-4f5a-4384-be65-2453f918128e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.151562 Oct 04 19:02:51.742206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3602/7183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:51 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:52.765031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:52.765648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:52.772539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.773027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.773715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.774410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:52.774856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:52.775283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:52.903936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:52.911718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e800b559-da93-4579-9366-d14b8a5f47f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.150584 Oct 04 19:02:52.912298 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3582/7184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:52 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:53.934413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:53.934936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:53.941816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.942293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.942726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:53.943405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:53.943886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:53.944301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:54.077587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:54.085319 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0ebcf39f-8dd6-47a1-9b65-375660170e85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.154951 Oct 04 19:02:54.085895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3603/7185] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:53 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:55.108092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:55.108704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:55.115570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.116056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.116491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.117203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:55.117657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:55.118082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:55.252675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:55.260909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4d307350-9e65-4415-b223-b4ef020980ca tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.156788 Oct 04 19:02:55.261494 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3583/7186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:55 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:56.284670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:56.285222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:56.292796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.293287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.293733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.294432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:56.294897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:56.295334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:56.423137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:56.431159 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb3a4314-60ad-41a2-a9dd-79e66123558c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.150509 Oct 04 19:02:56.431815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3604/7187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:56 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:57.454548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:57.455171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:57.462342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.462837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.463981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.464687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:57.465149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:57.465612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:57.594241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:57.602138 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-be8659f1-b70e-4573-b1e9-f486527004df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.151544 Oct 04 19:02:57.602968 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3584/7188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:57 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:58.625555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:58.626202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:58.633187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.633677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.634118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.634816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:58.635873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:58.636307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:58.762153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:58.769936 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d6b1ead-1360-4ddd-939e-16cbb14be6d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.148402 Oct 04 19:02:58.770524 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3605/7189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:58 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:59.367505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25fa0b0-8807-48d1-996c-6824606e9a97", "name": "network-vif-plugged", "status": "completed", "tag": "cf8d46ee-dfd2-4e52-b418-3e5c9955093b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:59.377199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.378337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.378797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.392850 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] Creating event network-vif-plugged:cf8d46ee-dfd2-4e52-b418-3e5c9955093b for instance c25fa0b0-8807-48d1-996c-6824606e9a97 on n-h1-833090-21 Oct 04 19:02:59.398711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-96f366e9-858e-4d0b-8792-700450a8d08c req-d05b4e9c-0dfc-4b40-8b7d-558d19ab33d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083296 Oct 04 19:02:59.399731 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3585/7190] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:02:59.793525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:59.794171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:59.801102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.801593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.802037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.802735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:59.803196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:59.803670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:59.937203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:59.944913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e401955-0b98-4814-9a5b-2365021b459a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1203 microversion: 2.1 time: 0.155859 Oct 04 19:02:59.945488 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3606/7191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:59 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:00.969190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:00.969905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:00.978442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.983293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.983293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:00.983293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:00.983293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:00.983293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.114321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.122222 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67846a6d-fd79-4e52-8072-ebc2bc318020 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1389 microversion: 2.1 time: 0.157406 Oct 04 19:03:01.122806 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3586/7192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:00 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:01.145174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.145795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.153562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.154051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.154497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.155192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.155692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.156127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.284871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.292755 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c46a0186-959c-47eb-b9f0-1b6b394d302f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1389 microversion: 2.1 time: 0.151464 Oct 04 19:03:01.293347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3607/7193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:01.318085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.318826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.325466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.325954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.326409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.327141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.328690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.329138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.456094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.464604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0c1bb8e-3511-4e31-b2da-1e5436bd088c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1389 microversion: 2.1 time: 0.150416 Oct 04 19:03:01.465187 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3587/7194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:01.486385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.486825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.492867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.493356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.493810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.495005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.495477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.495921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.520528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:01.820601 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb053880-11c7-4b8c-b1a1-bbc9d538d136 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 204 len: 0 microversion: 2.1 time: 0.337802 Oct 04 19:03:01.821137 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3608/7195] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:01 2022] DELETE /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:01.830070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:01.830690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:01.836726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.843025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.843025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.843025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:01.843025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:01.843025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:01.969404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:01.977818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5a868986-46cb-4655-a6e5-f6c5eb676a11 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1395 microversion: 2.1 time: 0.151699 Oct 04 19:03:01.978888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3588/7196] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:01 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:03.001377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:03.002091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:03.008962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.009453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.010487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.011190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.011687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.012120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.145604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:03.153732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-07f9e4d1-87ca-4979-9c19-2e475f8f780d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1395 microversion: 2.1 time: 0.156710 Oct 04 19:03:03.154311 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3609/7197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:02 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:03.932677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25fa0b0-8807-48d1-996c-6824606e9a97", "name": "network-vif-deleted", "tag": "cf8d46ee-dfd2-4e52-b418-3e5c9955093b"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:03.946498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:03.946498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:03.946498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:03.957467 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] Creating event network-vif-deleted:cf8d46ee-dfd2-4e52-b418-3e5c9955093b for instance c25fa0b0-8807-48d1-996c-6824606e9a97 on n-h1-833090-21 Oct 04 19:03:03.962884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-067a443a-1d29-4e81-b5ed-8031749f96dd req-0e7f8b5b-ed3c-4960-987a-e9fb0af591c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Oct 04 19:03:03.963550 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3589/7198] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:04.176754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:04.177374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:04.184948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.185440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.185880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.186583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:04.187043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:04.187497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:04.249067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:04.257096 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-464aba1f-e0ae-416e-b1ba-949198906995 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1188 microversion: 2.1 time: 0.084260 Oct 04 19:03:04.257621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3610/7199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:04 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:05.281273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:05.281978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:05.288281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:05.288766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:05.289204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:05.289891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:05.290342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:05.291380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:05.357175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:05.365154 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-18fb88c0-c7dc-4412-9733-9a53a94cd785 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1188 microversion: 2.1 time: 0.089097 Oct 04 19:03:05.365761 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3590/7200] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:05 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:06.396654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:06.397229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:06.405198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.405693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.406142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.406851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:06.407315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:06.407773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:06.471441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:06.479739 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-57632e58-0ec1-453b-904c-0425039bc720 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1188 microversion: 2.1 time: 0.087007 Oct 04 19:03:06.480349 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3611/7201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:06 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:07.502492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:07.503219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:07.510435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.510964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.511415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.512162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:07.512629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:07.513090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:07.576188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:07.584271 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-87eff9cf-d73d-4c6d-b3c5-d4b05c5222b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1188 microversion: 2.1 time: 0.085683 Oct 04 19:03:07.584776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3591/7202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:07 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:08.608173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:08.608792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:08.611633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:08.616413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.616901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.617345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.618044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.618506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.619636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.623700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:08.649884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:08.650329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:08.650772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:08.651222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lazy-loading 'fault' on Instance uuid c25fa0b0-8807-48d1-996c-6824606e9a97 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:08.692737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:08.701361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70646a68-4196-4fc2-8fd0-f01cbcd4054b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 200 len: 1193 microversion: 2.1 time: 0.097121 Oct 04 19:03:08.701939 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3612/7203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:08 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:09.725233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:09.725859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c25fa0b0-8807-48d1-996c-6824606e9a97] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:09.733372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:09.733865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:09.734319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:09.735018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:09.735496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:09.735938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:09.749737 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 HTTP/1.1 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c25fa0b0-8807-48d1-996c-6824606e9a97'} Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:09.751368 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c25fa0b0-8807-48d1-996c-6824606e9a97 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8a68100-a458-4a3e-81ad-9f0dc71bb94f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97" status: 404 len: 111 microversion: 2.1 time: 0.031962 Oct 04 19:03:09.755982 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3592/7204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:09 2022] GET /compute/v2.1/servers/c25fa0b0-8807-48d1-996c-6824606e9a97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:16.365113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-710911415", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "51a47f6e-183a-4776-8fb3-bd4c491a8826", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:16.425701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:16.863449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:16.863941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:16.864416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:16.864823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:16.865265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:16.875058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.875573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.876013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.876729 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.877179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.877603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.897407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:16.902637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:16.960148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:16.962129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51a47f6e-183a-4776-8fb3-bd4c491a8826',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:17.271654 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d155e1d5-a661-4b54-bdda-abd67e015309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910716 Oct 04 19:03:17.272731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3613/7205] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:17.286428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ebb6902b-f226-4a60-8b2a-bc90656e9481 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:17.287050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ebb6902b-f226-4a60-8b2a-bc90656e9481 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:17.289238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=37 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:17.343184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ebb6902b-f226-4a60-8b2a-bc90656e9481 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:17.350270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ebb6902b-f226-4a60-8b2a-bc90656e9481 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1056 microversion: 2.1 time: 0.067970 Oct 04 19:03:17.350848 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3593/7206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:17 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:18.374623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:18.375154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:18.384836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.385352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.385794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.386492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.386950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.387904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.452566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:18.460767 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d00d3d8-ca86-41f0-b429-d4b186587dc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1106 microversion: 2.1 time: 0.091210 Oct 04 19:03:18.461507 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3614/7207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:19.485347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.486017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.495097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.495628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.496069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.496892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.497360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.497794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.502241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=81 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:19.594001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:19.601219 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fff4bf00-a0e5-46dc-b171-d96bf8949ebe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1172 microversion: 2.1 time: 0.120778 Oct 04 19:03:19.601834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3594/7208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:19 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1172 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:20.625695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:20.626317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.633021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.633512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.634025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.634654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.635113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.635566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.769036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:20.777430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a96ee71c-d6f5-485b-833d-f4d2f0137150 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1214 microversion: 2.1 time: 0.156090 Oct 04 19:03:20.778187 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3615/7209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:20 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:20.867830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c831f8d5-47a5-4a45-bd7a-5819c8c592f7", "tag": "ff9b4ae4-9f3c-41ae-9555-5aeacca437f1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:20.881359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.882194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.882811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.896057 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] Creating event network-changed:ff9b4ae4-9f3c-41ae-9555-5aeacca437f1 for instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 on n-h1-833090-21 Oct 04 19:03:20.902300 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6800407b-d0e3-424b-8a8d-cdc0fb59e5be req-df04edd1-12f1-409b-92e7-42d018482e9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038747 Oct 04 19:03:20.904144 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3595/7210] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:21.800372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:21.800991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:21.810708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.811213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.811692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.812400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:21.812866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:21.813293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:21.948322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:21.957456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69be27a4-dac5-4bdd-94ee-c5f6bcba0085 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1214 microversion: 2.1 time: 0.161010 Oct 04 19:03:21.958051 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3616/7211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:21 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:22.981239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:22.982947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:22.990177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.990671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.991121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:22.991848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:22.992311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:22.992742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.140434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:23.148810 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12bcb201-46de-44bf-bb99-9cc64e517bae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1214 microversion: 2.1 time: 0.172409 Oct 04 19:03:23.152173 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3596/7212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:22 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:24.173037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:24.173667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:24.180880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.181378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.181823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.182538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:24.183002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:24.183435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.320726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.329237 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6b306c0c-99ec-441f-b1ed-73e3b82952f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1214 microversion: 2.1 time: 0.160785 Oct 04 19:03:24.334139 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3617/7213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:24 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:25.353270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.353867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.361394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.361892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.362341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.363040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.363529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.363966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.492392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.500155 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b543b13-747a-46d6-943a-d4a7d1e78ad6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.151021 Oct 04 19:03:25.500737 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3597/7214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:26.522555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:26.523766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:26.530700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.531191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.531670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.532370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.532838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.533268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.667636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.675944 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-893e69bf-9055-4856-bb42-26a0da00d0d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.157704 Oct 04 19:03:26.676525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3618/7215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:26 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:27.700245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.700862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.703691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:27.708893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.713311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.713311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.713311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.713311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.713311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.840862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:27.848572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a84aaadd-c15a-4679-8e46-9e56b656f6a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.152917 Oct 04 19:03:27.849153 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3598/7216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:28.871242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:28.871886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:28.873862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:28.874530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:28.880267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.883422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.883422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:28.883422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:28.883422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:28.883422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:29.013669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:29.021751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b81de865-221a-4b6d-a8f5-8037eeee691e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.154256 Oct 04 19:03:29.022347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3619/7217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:28 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:30.044618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:30.045232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:30.052094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.052577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.053012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.053695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:30.054148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:30.054595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:30.181411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:30.189764 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e8e55213-9779-4ee1-9f85-4f682307e5e8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.149693 Oct 04 19:03:30.190337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3599/7218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:30 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:31.213268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:31.213920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:31.221762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.223224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.223224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.223418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:31.223923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:31.224338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:31.360992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:31.371566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-449779a5-7536-4af4-b311-ee24d2f494f2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.162285 Oct 04 19:03:31.372328 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3620/7219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:31 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:32.397383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:32.397912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:32.405065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.405553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.405991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.406676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:32.407131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:32.407591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:32.534927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:32.542962 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3fb44eef-7250-40a3-89f4-7e60e45d0b4a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.149931 Oct 04 19:03:32.544099 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3600/7220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:32 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:33.566188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:33.566704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:33.573766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.574257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.575197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.575926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:33.576390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:33.576822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:33.711191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:33.718975 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90bd565f-ee9b-4201-9daa-0059089ed3db tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.156784 Oct 04 19:03:33.719599 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3621/7221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:33 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:34.741467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:34.742086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:34.749107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.749594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.750034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.750727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:34.751184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:34.751644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:34.885315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:34.893584 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d2ab21cd-326b-4c69-ba2f-21b2e10cf471 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.156002 Oct 04 19:03:34.894189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3601/7222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:34 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:35.386022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c831f8d5-47a5-4a45-bd7a-5819c8c592f7", "name": "network-vif-plugged", "status": "completed", "tag": "ff9b4ae4-9f3c-41ae-9555-5aeacca437f1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:35.397163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.397639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.398071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.408977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] Creating event network-vif-plugged:ff9b4ae4-9f3c-41ae-9555-5aeacca437f1 for instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 on n-h1-833090-21 Oct 04 19:03:35.414014 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-77e0119c-c9f9-4c7a-9cac-709a107ec489 req-75bda737-7e7d-4241-ae2f-1403af07e148 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 Oct 04 19:03:35.414599 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3622/7223] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:35.917573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:35.918142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:35.925752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.926245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.926689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:35.927385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:35.927874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:35.928309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:36.060119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:36.067743 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d87f9b2f-9857-4d08-a225-2faf7c0b23cc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1202 microversion: 2.1 time: 0.154276 Oct 04 19:03:36.068319 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3602/7224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:35 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.091673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.092382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.098625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.099113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.099581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.100280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.100737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.101168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.226797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.235157 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f41b99e-4d40-4484-bf17-901cbc4d3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1389 microversion: 2.1 time: 0.148687 Oct 04 19:03:37.235769 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3623/7225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.257514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.258129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.264872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.265354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.265791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.266477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.266934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.267362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.393342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.401637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff01daf9-c8de-4375-943f-ff461250b071 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1389 microversion: 2.1 time: 0.147905 Oct 04 19:03:37.402223 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3603/7226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.425046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.425669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.431855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.432347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.432789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.433487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.434028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.434451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.563292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:37.571412 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae020774-8280-491c-a2f1-746ddaa93575 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1389 microversion: 2.1 time: 0.150325 Oct 04 19:03:37.572023 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3624/7227] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:37.593832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.594340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.600409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.600838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.601281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.601989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.602452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.602888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.627437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:37.898883 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4e620fb2-8b51-462d-9ea9-0e9c2ccc61c2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 204 len: 0 microversion: 2.1 time: 0.309262 Oct 04 19:03:37.899540 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3604/7228] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:37 2022] DELETE /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:37.908376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:37.908998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:37.914962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.915433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.915948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:37.916634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:37.917092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:37.917538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:38.049880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:38.057840 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08a3fba0-3820-422a-880a-0b95984eac6f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1395 microversion: 2.1 time: 0.153420 Oct 04 19:03:38.058425 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3625/7229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:37 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:39.083145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:39.083886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:39.091346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.091900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.092394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.093095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:39.093564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:39.094000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:39.225505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:39.233834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ab8ed09-eb8b-4497-9397-25c694588c0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1395 microversion: 2.1 time: 0.155842 Oct 04 19:03:39.234414 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3605/7230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:39 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:40.059578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c831f8d5-47a5-4a45-bd7a-5819c8c592f7", "name": "network-vif-deleted", "tag": "ff9b4ae4-9f3c-41ae-9555-5aeacca437f1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:40.070850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.071340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.071809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.084461 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] Creating event network-vif-deleted:ff9b4ae4-9f3c-41ae-9555-5aeacca437f1 for instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 on n-h1-833090-21 Oct 04 19:03:40.089617 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-082b523f-a442-45ed-8d1b-e116f6a346d1 req-49302ee4-5a84-4f2a-857f-04c486381a05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Oct 04 19:03:40.090602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3626/7231] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:40.257171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:40.257726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:40.265232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.265669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.266104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.266789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:40.267243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:40.267730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:40.333752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:40.338331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-532de18a-1190-4a7a-ab17-d2f9ba127be1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1187 microversion: 2.1 time: 0.085080 Oct 04 19:03:40.338929 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3606/7232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:40 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:41.363988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:41.364584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:41.371023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.371529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.373757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.373757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:41.373757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:41.373757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:41.436782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:41.444684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f7a515d-5f2f-4c1d-ae88-596acd638d47 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1187 microversion: 2.1 time: 0.086130 Oct 04 19:03:41.445263 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3627/7233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:41 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:42.468116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:42.468735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:42.475014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.475533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.475977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.476685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:42.477144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:42.477571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:42.541813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:42.550242 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5f2db0bf-196d-4704-8d69-6cf4da4bb318 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1187 microversion: 2.1 time: 0.086173 Oct 04 19:03:42.550832 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3607/7234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:42 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:43.573661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:43.574312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:43.581709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.582191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.582622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.583306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.583787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.584210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.652744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:43.661009 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a71d06e-74c1-4aec-972f-836be1d0ac44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1187 microversion: 2.1 time: 0.091177 Oct 04 19:03:43.661707 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3628/7235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:43 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:44.684382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:44.685028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:44.691816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.692302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.692744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.693433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.693892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.694324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.725585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:44.726069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:44.726509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:44.726958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lazy-loading 'fault' on Instance uuid c831f8d5-47a5-4a45-bd7a-5819c8c592f7 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:44.769080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.776986 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6188209b-900a-4a79-9307-791ad476d15a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 200 len: 1192 microversion: 2.1 time: 0.096480 Oct 04 19:03:44.777583 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3608/7236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:44 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:45.800767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:45.801432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c831f8d5-47a5-4a45-bd7a-5819c8c592f7] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:45.808350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.808831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.809266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.809948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.810404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.810824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.824024 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 HTTP/1.1 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c831f8d5-47a5-4a45-bd7a-5819c8c592f7'} Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:45.825642 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c831f8d5-47a5-4a45-bd7a-5819c8c592f7 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdd77713-07ec-4aeb-ac36-80e3f67123ed tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7" status: 404 len: 111 microversion: 2.1 time: 0.030167 Oct 04 19:03:45.830011 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3629/7237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:45 2022] GET /compute/v2.1/servers/c831f8d5-47a5-4a45-bd7a-5819c8c592f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:18.109733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-176839078", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2b809c49-43d2-4d82-bf20-c74133f0ef3c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:18.121466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:18.122268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:18.205505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:18.707019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:18.707447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:18.707950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:18.708358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:18.708768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:18.721856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.722347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.722785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.723567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:18.724054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:18.724484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:18.745431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:18.753360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:18.768829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:18.771141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2b809c49-43d2-4d82-bf20-c74133f0ef3c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:18.928042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af86f8ff-5bad-4025-a257-12d6ec3f71cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822319 Oct 04 19:04:18.928651 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3609/7238] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:18.940423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-655abb7b-56a0-443f-8ff2-691eda835f56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:18.941169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-655abb7b-56a0-443f-8ff2-691eda835f56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:18.944157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:18.946017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=93 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:19.004733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-655abb7b-56a0-443f-8ff2-691eda835f56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:19.014473 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-655abb7b-56a0-443f-8ff2-691eda835f56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1056 microversion: 2.1 time: 0.078254 Oct 04 19:04:19.015104 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3630/7239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:18 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1056 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:20.039755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:20.040967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:20.048418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.048919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.049371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.050063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.050532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.050965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.112181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:20.120013 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5653aa04-a5a4-4315-a311-a60c39ba18e5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1052 microversion: 2.1 time: 0.085129 Oct 04 19:04:20.120595 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3610/7240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:20 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1052 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:21.146745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:21.148071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:21.159752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:21.160375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:21.160764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.161784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:21.162250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:21.162693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:21.241721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:21.249560 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-98111ec8-5d11-4b5a-8694-0a0518fb6309 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1126 microversion: 2.1 time: 0.107306 Oct 04 19:04:21.250145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3631/7241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:21 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1126 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:22.274004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:22.275351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:22.286275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.287097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.287971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.289111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:22.289912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:22.290581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:22.803229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:22.815738 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-96ac942e-0169-4f86-b03b-41c16faaf0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.545586 Oct 04 19:04:22.816665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3611/7242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:22 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:23.054171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca98299-b180-4e19-9c3b-3b69942c1ec0", "tag": "676af0fa-48e2-4f7d-955d-6cc78d646861"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:23.068472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.070028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.070647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.090394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] Creating event network-changed:676af0fa-48e2-4f7d-955d-6cc78d646861 for instance aca98299-b180-4e19-9c3b-3b69942c1ec0 on n-h1-833090-21 Oct 04 19:04:23.100331 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-77a89e13-e5e2-4446-8d95-58136feee11c req-636ca610-1c08-47a4-9147-94c857d001e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049181 Oct 04 19:04:23.101517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3632/7243] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:23.838405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:23.839083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:23.845835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.846323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.846767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.847474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:23.847949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:23.848380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:23.983164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:23.991906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89b991a1-cfc0-4748-8318-285e4a593b93 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.157484 Oct 04 19:04:23.992525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3612/7244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:23 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:25.016237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:25.016939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:25.024902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.025199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.025643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:25.026351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:25.026804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:25.027228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:25.164815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:25.174355 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1d591c6-d1af-4bb9-9263-70748983b81c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.162549 Oct 04 19:04:25.174944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3633/7245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:25 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:26.198412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:26.199004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:26.206712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.207201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.207672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.208370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.208827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.209256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.347960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:26.355836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-224238a5-36db-44b2-8c7b-55c6d018e5f3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.161471 Oct 04 19:04:26.356617 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3613/7246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:26 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:27.379998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:27.380607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:27.388972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.389498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.389941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.390641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.391163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.391631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.530385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:27.539094 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7925dadb-1dc6-419c-8fe6-3b48d2b6f67c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.163937 Oct 04 19:04:27.539721 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3634/7247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:27 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:28.562171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:28.562874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:28.570171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.570650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.571138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.571853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:28.572309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:28.572732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.713822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:28.722348 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c6ca5b56-3e0f-4825-8df1-6d09db31dddd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.164058 Oct 04 19:04:28.723307 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3614/7248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:28 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:29.745376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:29.746042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.748909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:29.753748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.754250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.754688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.755371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.755845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.761092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.894790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:29.902977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-710ce8f7-86e3-462b-aa23-04df18fb969f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.161599 Oct 04 19:04:29.903589 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3635/7249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:29 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.930352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.931000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.933034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:30.933766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:30.939446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.942472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.942472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.942472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.942472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.942472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.081005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:31.088799 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a8e4497c-0e86-46d9-9a06-8f520fbeeb37 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.162632 Oct 04 19:04:31.089364 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3615/7250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:32.115753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.116370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.123553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.124046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.124494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.125246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.125709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.126756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.263192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.271808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ed7f5c5-0883-4956-9ee6-5475acae6b50 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.160029 Oct 04 19:04:32.272390 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3636/7251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:33.306284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.306284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.306284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.306284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.306284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.307178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.307745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.308367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.452686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.461566 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-359cdcd2-3525-446f-bd15-9650a051cc8b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.170877 Oct 04 19:04:33.462189 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3616/7252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.487302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.487965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.495563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.496045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.496478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.497160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.497680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.498105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.649032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.657096 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-efc97e36-90be-4a10-a909-6f7888947616 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.174015 Oct 04 19:04:34.657682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3637/7253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.682353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.682972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.689909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.690401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.690883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.691608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.692076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.692513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.830472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:35.838749 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f81d768-b0c4-45b4-b0aa-7dc3d0ca1e45 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.160338 Oct 04 19:04:35.839348 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3617/7254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:36.862110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:36.862725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:36.870588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.871077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.871546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:36.872246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:36.872794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:36.873258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:37.013207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:37.016878 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06a51e82-7581-4631-ab6e-75abb3377f0e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.158718 Oct 04 19:04:37.017449 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3638/7255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:36 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:38.042956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:38.043595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:38.051347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.051857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.052294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.052988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:38.053444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:38.053873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:38.194907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:38.203252 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ff1c33e-1dae-49e7-a56c-6e95618a5512 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.164098 Oct 04 19:04:38.203875 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3618/7256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:38 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:39.228277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:39.228803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:39.235734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.236217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.236652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.237335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:39.237786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:39.238854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:39.382269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:39.389959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59edd49b-2456-4045-b930-3ac9bb02a679 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.166168 Oct 04 19:04:39.390537 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3639/7257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:39 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:40.413673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:40.414290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:40.422391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.422882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.423380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.424062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:40.424537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:40.424969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:40.569171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:40.577144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9b8232f-e786-4e5e-906e-e474d6df10af tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.167475 Oct 04 19:04:40.577728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3619/7258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:40 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:41.602192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:41.602922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:41.609970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.610439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.610888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.611609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:41.612068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:41.612495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:41.745913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:41.755262 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7dd45167-6380-403e-861a-a04f325f9813 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.156671 Oct 04 19:04:41.755926 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3640/7259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:41 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:42.779334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:42.780617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:42.786776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.787261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.787735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.788417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:42.797352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:42.797352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:42.934756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:42.943534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f27db735-c5f3-4209-a388-02fa67d27643 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.169153 Oct 04 19:04:42.944163 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3620/7260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:42 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:43.966535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:43.967073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:43.974038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.974537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.974981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:43.975717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:43.976183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:43.976619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:44.115063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:44.123066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8961448-9871-4090-9d14-cc4b18299913 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.160553 Oct 04 19:04:44.123681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3641/7261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:43 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:45.147344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:45.147997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:45.154827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.155313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.155792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.156488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.156949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.157378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.289064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.296778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a033265c-e6df-4ac1-91a2-bdb36f3d490b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.154157 Oct 04 19:04:45.297354 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3621/7262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:45 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:46.319255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:46.319916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:46.326855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.327346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.327818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.328521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:46.328980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:46.329409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:46.459932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:46.467749 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa956806-b850-4c33-8df2-db6b793e948e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.152302 Oct 04 19:04:46.468333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3642/7263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:47.490261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.490884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.497878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.498375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.498819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.499665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.500133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.500567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.635361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.643937 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-79d82d38-59f2-453c-b73e-a22ab089d650 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.157499 Oct 04 19:04:47.644523 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3622/7264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:47 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:48.666960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:48.667605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:48.674571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.675063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.675527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.676240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.676704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.677137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.814209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.822976 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04db5ea4-6c45-412b-979a-2eed4eef0da5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.159886 Oct 04 19:04:48.823602 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3643/7265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:48 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:49.846221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.846840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.850064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:49.854800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.855298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.855777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.856486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.857001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.875493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.875493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=81 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:49.989403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.997248 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e6df2bd3-19e4-4013-bb2c-73e06602a126 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.154988 Oct 04 19:04:49.997823 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3623/7266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:51.021257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:51.022235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.029543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.030146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.030660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.031442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.032442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.032788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.172088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.174327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=79 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:51.182204 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4f1ec89e-ba6e-4a3d-aaa8-31469db18b68 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1168 microversion: 2.1 time: 0.165272 Oct 04 19:04:51.182892 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3644/7267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:51 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:52.205009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.205627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.212730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.213155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.213598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.214325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.214785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.215213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.344572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:52.352524 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad625f4e-692a-432f-b101-887b77763e29 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.151481 Oct 04 19:04:52.353095 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3624/7268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:53.378016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:53.378558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:53.381859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=33 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:53.386790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.387278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.387820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.388509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:53.388971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:53.389398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.516465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:53.525047 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-026f9043-88d0-475f-995f-072536f5de85 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.151533 Oct 04 19:04:53.525628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3645/7269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:53 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:54.547343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:54.548035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:54.554954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.555435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.561146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.561146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.561146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.561146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.691936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.700337 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f10d385-e029-42d9-b4bc-36eba34bbc01 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.156955 Oct 04 19:04:54.700932 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3625/7270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:54 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:55.722251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:55.722871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.729843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.730325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.730775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.731492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.731949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.732380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.862214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.870551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbac3be8-6c65-449e-9c73-87c21ed3307a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.152223 Oct 04 19:04:55.871132 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3646/7271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:55 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:56.894159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:56.894781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:56.902145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.902632 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.903072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.903787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.904246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.904685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.036634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.044667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-229be849-e38f-4e2a-90e3-ae4d4f67b0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.154703 Oct 04 19:04:57.045251 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3626/7272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:56 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:58.067700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:58.068321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:58.075184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.075724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.076174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.076873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:58.077337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:58.077772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.203090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.211453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d5e82f3-6290-4b8e-a059-4b197d16125a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.147723 Oct 04 19:04:58.212063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3647/7273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:58 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:59.234275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:59.234925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:59.242488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.242975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.243419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.244142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.244611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.245043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:59.375493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:59.383207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6923249e-0529-4bee-b5de-28a4fa497957 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.152964 Oct 04 19:04:59.383827 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3627/7274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:59 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:00.406244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:00.406794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:00.414064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.414545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.414982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.415712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.416171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.416602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.543645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.551375 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9f89cd4c-a325-462b-981b-62feac9ccdbe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.149308 Oct 04 19:05:00.551984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3648/7275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:00 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:01.574969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:01.575623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:01.582546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.583025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.583460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.584163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.584617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.585694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.713778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:01.721648 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-291cf5ee-3952-4748-bf7d-175ea8d708e0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.150578 Oct 04 19:05:01.722246 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3628/7276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:01 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:01.932666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca98299-b180-4e19-9c3b-3b69942c1ec0", "name": "network-vif-plugged", "status": "completed", "tag": "676af0fa-48e2-4f7d-955d-6cc78d646861"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:01.943059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:01.943604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:01.944039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:01.958575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] Creating event network-vif-plugged:676af0fa-48e2-4f7d-955d-6cc78d646861 for instance aca98299-b180-4e19-9c3b-3b69942c1ec0 on n-h1-833090-21 Oct 04 19:05:01.964354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7f8349b6-796b-40cc-9bf3-0c0170f9f046 req-b97c6567-3f52-4507-b3ba-54a34325ffcf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036033 Oct 04 19:05:01.965022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3649/7277] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:05:02.745193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:02.745806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:02.752725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.753216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.753659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.754346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:02.754810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:02.755240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:02.884594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:02.892564 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c99de0fb-f079-423b-8cba-8f8cee51465f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1202 microversion: 2.1 time: 0.151600 Oct 04 19:05:02.893135 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3629/7278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:02 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:03.916968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:03.917674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:03.923963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.924446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.924886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:03.925603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:03.926066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:03.926494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.064787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.073569 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f0d536d3-4ca3-428c-a8e5-5bc3d1ae2822 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1388 microversion: 2.1 time: 0.162074 Oct 04 19:05:04.074143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3650/7279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:03 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.095824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.096435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.103250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.103786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.104234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.104936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.105402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.105835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.232472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.240184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2866649c-526c-4ecc-a6b3-51de829878dd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1388 microversion: 2.1 time: 0.148294 Oct 04 19:05:04.240768 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3630/7280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:04 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.263124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.263781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.270088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.270577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.271022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.271746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.272212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.272645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.405861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.414295 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be4cfe7a-5be2-4a6f-afaf-4ea73516c2ba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1388 microversion: 2.1 time: 0.154999 Oct 04 19:05:04.414878 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3651/7281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:04 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:04.494452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.494951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.500936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.501424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.501866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.502567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.503028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.503458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.527969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:05:04.775532 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-81c26604-7ecb-44f8-abb1-4422d390c744 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 204 len: 0 microversion: 2.1 time: 0.285212 Oct 04 19:05:04.776140 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3631/7282] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:04 2022] DELETE /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:05:04.784263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:04.788480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:04.791733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.792251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.792687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.793375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:04.793829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:04.794365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:04.926762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:04.934731 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e63b87f-6de8-424a-a46e-f64b67fea9dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1394 microversion: 2.1 time: 0.154426 Oct 04 19:05:04.935309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3652/7283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:04 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:05.958131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:05.958835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:05.965728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.966218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.966657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:05.967351 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:05.967839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:05.968266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.111396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:06.120701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b437275-1831-4e71-8fe0-d41a16b6aeb7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1394 microversion: 2.1 time: 0.166893 Oct 04 19:05:06.121738 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3632/7284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:05 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1394 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:06.917080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca98299-b180-4e19-9c3b-3b69942c1ec0", "name": "network-vif-deleted", "tag": "676af0fa-48e2-4f7d-955d-6cc78d646861"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:06.927958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:06.928446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:06.928893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:06.941548 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] Creating event network-vif-deleted:676af0fa-48e2-4f7d-955d-6cc78d646861 for instance aca98299-b180-4e19-9c3b-3b69942c1ec0 on n-h1-833090-21 Oct 04 19:05:06.947242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e8776759-13f6-42b5-8ba0-d811d60fd69d req-4c65f51e-6f44-4366-8e05-447eacf51ed9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Oct 04 19:05:06.947903 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3653/7285] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:07.142896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:07.143538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:07.150395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.150886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.151352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.152038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:07.152516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:07.152928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:07.220877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:07.229274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-96183edc-f885-4262-aff8-7e41d6aee8a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1187 microversion: 2.1 time: 0.090332 Oct 04 19:05:07.229881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3633/7286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:07 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:08.253766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:08.254598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:08.261445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:08.261931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:08.262366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.263053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:08.263538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:08.263968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:08.326674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:08.335287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87dae0f5-a4c8-4d2e-a7a7-1d2ae0b57ddb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1187 microversion: 2.1 time: 0.086019 Oct 04 19:05:08.335894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3654/7287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:08 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:09.358299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:09.358843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:09.365997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.366522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.366977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.367775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:09.368248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:09.368679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:09.432602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:09.441163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-586234af-93ae-4fef-bc74-b103777b4a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1187 microversion: 2.1 time: 0.087011 Oct 04 19:05:09.441770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3634/7288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:09 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:10.465273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:10.465881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:10.472800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.475791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.475791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.475791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:10.475791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:10.476114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:10.542749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:10.550737 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e064b781-31eb-4ea1-8679-b85a83d86815 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1187 microversion: 2.1 time: 0.089473 Oct 04 19:05:10.551309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3655/7289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:10 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:11.578447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:11.579056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:11.585193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.585679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.586117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.586813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:11.587268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:11.587722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:11.659147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:11.667666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5912833-e5dd-4e00-acc8-8ea2de8ee09d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 200 len: 1187 microversion: 2.1 time: 0.093203 Oct 04 19:05:11.668355 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3635/7290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:11 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:12.690479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:12.691138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:12.698188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.698790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.699239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.699974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:12.700463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:12.700895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:12.715301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 HTTP/1.1 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'aca98299-b180-4e19-9c3b-3b69942c1ec0'} Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:12.717109 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28de3fc7-d277-4c4a-8562-e453f7d72d74 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 404 len: 111 microversion: 2.1 time: 0.032234 Oct 04 19:05:12.724249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3656/7291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:12 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:14.858521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.859010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.866565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.867046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.867507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.868201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.868651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.869085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.883301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 HTTP/1.1 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'aca98299-b180-4e19-9c3b-3b69942c1ec0'} Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:14.884979 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fd4ec2c-ac46-4ec9-af6b-0ce93cf82e49 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 404 len: 111 microversion: 2.1 time: 0.031708 Oct 04 19:05:14.888631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3636/7292] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:05:14 2022] DELETE /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:14.895180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:14.895820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: aca98299-b180-4e19-9c3b-3b69942c1ec0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:14.902783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.903264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.903738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.904473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:14.904875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:14.905300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:14.919263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 HTTP/1.1 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'aca98299-b180-4e19-9c3b-3b69942c1ec0'} Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:05:14.920821 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance aca98299-b180-4e19-9c3b-3b69942c1ec0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d53b946-e231-4476-88a4-ce342eccff28 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0" status: 404 len: 111 microversion: 2.1 time: 0.031122 Oct 04 19:05:14.924630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3657/7293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:14 2022] GET /compute/v2.1/servers/aca98299-b180-4e19-9c3b-3b69942c1ec0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:05:46.590518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1086336718", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8d5c11d8-26db-4ecc-b9ba-28bdc0dccdb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:46.601440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:46.602110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:46.658748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:05:47.017127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:05:47.017588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:05:47.018100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:05:47.018519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:05:47.018941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:05:47.028146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.028643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.029092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.029831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:47.030856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:47.031302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.048156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:05:47.053400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:05:47.113006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:05:47.115169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d5c11d8-26db-4ecc-b9ba-28bdc0dccdb4',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:05:47.520120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ae4c697-1e94-4838-a294-ab0b25319a59 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933590 Oct 04 19:05:47.520847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3637/7294] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:05:47.532150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c118344-6cb6-4994-8d20-4856f90bbf70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:47.532771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c118344-6cb6-4994-8d20-4856f90bbf70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:47.535230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=25 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:47.536026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=63 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:47.589348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c118344-6cb6-4994-8d20-4856f90bbf70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.596522 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c118344-6cb6-4994-8d20-4856f90bbf70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1071 microversion: 2.1 time: 0.068399 Oct 04 19:05:47.597108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3658/7295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:47 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1071 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:48.619888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.620507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.627929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.628622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.629271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.630146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.630631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.631057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.696854 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:48.705089 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66f62b4b-b72b-4c28-9ade-b003cdf8861d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1121 microversion: 2.1 time: 0.090284 Oct 04 19:05:48.705697 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3638/7296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:48 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1121 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:49.728830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:49.729673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:49.741503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.742007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.742445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.743331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.743821 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.744257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.810623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.818517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c15f892-1a36-428a-bba6-96f433bb1354 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1177 microversion: 2.1 time: 0.094183 Oct 04 19:05:49.819108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3659/7297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:49 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1177 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:50.842910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:50.843478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:50.850605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:50.851093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:50.851566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:50.852308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:50.852733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:50.853169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.094990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:51.105253 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a090600-a62a-458b-a7d6-e31b68419712 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1229 microversion: 2.1 time: 0.266255 Oct 04 19:05:51.106062 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3639/7298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:50 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1229 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:51.359718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f6ac75-7136-496f-9415-91fe43ee663a", "tag": "009007c0-4610-4413-8491-52a5253725f0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:51.371387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:51.372060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:51.372597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:51.387120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] Creating event network-changed:009007c0-4610-4413-8491-52a5253725f0 for instance 09f6ac75-7136-496f-9415-91fe43ee663a on n-h1-833090-21 Oct 04 19:05:51.393573 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-397593f5-8373-4285-8ab6-bb9e1c326bd8 req-fd403427-e789-4492-98aa-7c5d815acdb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037801 Oct 04 19:05:51.394302 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3660/7299] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:52.128943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:52.129576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:52.137051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:52.145457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:52.145457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:52.145457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:52.145457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:52.145457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:52.288933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:52.296855 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2b864dc9-5276-4639-b311-3dadb943b367 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1229 microversion: 2.1 time: 0.172276 Oct 04 19:05:52.297438 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3640/7300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:52 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:53.320806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:53.321437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:53.328638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:53.329126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:53.329564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:53.330256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:53.330709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:53.331131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:53.465490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:53.473976 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d6a1a94-76a4-46ec-bac9-00daef0e7801 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1229 microversion: 2.1 time: 0.158158 Oct 04 19:05:53.474564 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3661/7301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:53 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:54.497105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:54.497727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:54.505117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.505606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.506039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.506721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:54.507174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:54.507627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:54.652297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:54.658566 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63e5887b-42dc-41bb-9a8d-25bb5c821473 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1229 microversion: 2.1 time: 0.165228 Oct 04 19:05:54.658963 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3641/7302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:54 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:55.681634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:55.682179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:55.689663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.690145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.690730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.691494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:55.692014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:55.692444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:55.825710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:55.833881 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-992c2873-dbd4-4f38-999c-bef5bda18b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.156225 Oct 04 19:05:55.834471 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3662/7303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:55 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:56.856716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:56.857373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:56.864649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:56.865131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:56.865567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:56.866249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:56.866705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:56.867132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:56.993257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:57.001577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8121b929-ba52-4d4a-b97d-2772087307e4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.148802 Oct 04 19:05:57.002154 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3642/7304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:56 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:58.024519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:58.025269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:58.028356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:58.033370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.033862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.034305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.035009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:58.035560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:58.035996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:58.164130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:58.172566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50e2f6cf-0aa9-4c44-996b-74db15ed7ff1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.151994 Oct 04 19:05:58.173143 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3663/7305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:58 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:59.195553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:59.196163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:59.198044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:59.198864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:59.200313 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:05:59.200454 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a (ip 10.222.0.40) !!! Oct 04 19:05:59.207251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:59.215571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:59.215571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:59.215571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:59.215571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:59.215571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:59.341753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:59.350832 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32fc6fda-e5f9-4ffd-814c-3761c9707791 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.159130 Oct 04 19:05:59.351580 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3643/7306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:59 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:00.381527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:00.382141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:00.384872 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:06:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a (ip 10.222.0.40) !!! Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:00.400467 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:00.523785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:00.532263 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6662b29f-b036-4329-96bb-21494cdf89cf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.154657 Oct 04 19:06:00.532847 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3664/7307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:00 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:01.554213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:01.554834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:01.561801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.562317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.562787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.563491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:01.563960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:01.564392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:01.701041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:01.708723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6c5d21b-c65e-44e3-8704-c7490fe5e48d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.158382 Oct 04 19:06:01.709303 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3644/7308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:01 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:02.732029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:02.732668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:02.740068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.740553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.740990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.741673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:02.742126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:02.742548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:02.890019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:02.890019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10d9782c-605f-40eb-8641-f48099eb88c6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.158126 Oct 04 19:06:02.890019 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3665/7309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:02 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:03.909613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:03.910232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:03.917117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:03.917604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:03.918045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:03.918744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:03.919202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:03.919656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:04.052738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:04.060535 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c734acb-b705-4917-a2f9-7b42b327eb9b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.155424 Oct 04 19:06:04.061124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3645/7310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:03 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:05.082224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:05.082787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:05.089687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.090178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.090622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.091318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:05.091966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:05.092408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:05.222283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:05.230114 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73cfb388-353a-4888-a24a-83de312e1690 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.151870 Oct 04 19:06:05.230698 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3666/7311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:05 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:06.254167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:06.254877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:06.261593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6ac75-7136-496f-9415-91fe43ee663a", "name": "network-vif-plugged", "status": "completed", "tag": "009007c0-4610-4413-8491-52a5253725f0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:06.262454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.263015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.263515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.264241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.264989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.265963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.274226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:06.274670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:06.275103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:06.288397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] Creating event network-vif-plugged:009007c0-4610-4413-8491-52a5253725f0 for instance 09f6ac75-7136-496f-9415-91fe43ee663a on n-h1-833090-21 Oct 04 19:06:06.293860 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b5c4e25a-c202-4025-9868-02cf62ecde7f req-4d20ae98-9643-4ba1-add4-65265597abde service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035951 Oct 04 19:06:06.294772 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3667/7312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:06.730610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:06.738631 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fbe7122-803c-426e-838d-9d7c435c59d8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.489100 Oct 04 19:06:06.739226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3646/7313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:06 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:07.762330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:07.763034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:07.769609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.770088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.770531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.771220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:07.771716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:07.772142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:07.908476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:07.916725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0887858f-741c-4b6b-aea3-6b7fb0fcdbfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1217 microversion: 2.1 time: 0.159547 Oct 04 19:06:07.917313 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3668/7314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:07 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:08.939860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:08.940592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:08.947439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.947960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.948398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:08.949088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:08.949546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:08.949976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.079165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.086993 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bff39646-664b-41d6-9018-e140d12b87df tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1404 microversion: 2.1 time: 0.151680 Oct 04 19:06:09.087598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3647/7315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:08 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:09.110635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:09.111247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:09.119748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.120234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.120675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.121364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.121819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.122245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.248299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:09.256115 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61c925c5-64d7-4493-9d01-ca23cd1c3e6a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1404 microversion: 2.1 time: 0.150070 Oct 04 19:06:09.256725 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3669/7316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:09 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:09.278258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-373675940"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:09.281225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:09.287217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.287732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.288169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.288851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:09.289299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:09.289720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:09.379767 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Attempting to quiesce instance before volume snapshot. Oct 04 19:06:09.451045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 19:06:09.669627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Creating snapshot from volume 8d5c11d8-26db-4ecc-b9ba-28bdc0dccdb4. {{(pid=123886) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 19:06:11.184885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7205f377-905f-4d51-b2c5-2266bcbaed31 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a/action" status: 202 len: 0 microversion: 2.1 time: 1.910370 Oct 04 19:06:11.185612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3648/7317] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:09 2022] POST /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a/action => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:06:12.340604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-197084079", "imageRef": "5e99d422-5f5b-4fa3-98ac-00b1b5f8b480", "flavorRef": "452", "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:12.402987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:12.777743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:12.778175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:12.778658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:12.779101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:12.779578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:12.789306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:12.789734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:12.790177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.790957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:12.791419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:12.791873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:12.812392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:12.818283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:12.830547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:12.833180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b52b5717-1ce3-4e2b-b5f6-3c9b53eabf34',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:12.967434 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-44177505-5135-4de3-86b6-7652f33e1b3a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630852 Oct 04 19:06:12.968271 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3670/7318] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:06:12.981468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddf0bafd-9e1a-43b2-bc40-3d022ae2ef1f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:12.982188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddf0bafd-9e1a-43b2-bc40-3d022ae2ef1f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.036285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddf0bafd-9e1a-43b2-bc40-3d022ae2ef1f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:13.043872 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddf0bafd-9e1a-43b2-bc40-3d022ae2ef1f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1229 microversion: 2.1 time: 0.067395 Oct 04 19:06:13.044453 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3649/7319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:12 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1229 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:14.067181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:14.067832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:14.074053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.074544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.082016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.082016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:14.082016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:14.082016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:14.138363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:14.147040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2eaa49cd-9e91-444b-920e-152832a4fa7a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1233 microversion: 2.1 time: 0.084652 Oct 04 19:06:14.150780 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3671/7320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:14 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:15.171511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:15.172142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:15.180077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.180582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.181250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.181974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:15.182444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:15.183097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:15.249513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:15.258827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0070fd8-ed14-4669-bccb-a681d6704d82 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1289 microversion: 2.1 time: 0.091183 Oct 04 19:06:15.259419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3650/7321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:15 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:16.282909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:16.284404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:16.292123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.292865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.293777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.294697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:16.295348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:16.295990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:16.517396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:16.526373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2838b912-77c3-4f22-8388-2bb781846de2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.248125 Oct 04 19:06:16.527208 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3672/7322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:16 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:17.208499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8863f38-30da-40b2-91e8-1c93fec0b582", "tag": "046aba39-084f-4511-89a3-cdccc4ca46c6"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:17.213779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:17.219809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.220309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.220756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.225141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:17.233489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] Creating event network-changed:046aba39-084f-4511-89a3-cdccc4ca46c6 for instance c8863f38-30da-40b2-91e8-1c93fec0b582 on n-h2-833090-21 Oct 04 19:06:17.239021 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-1068b829-ce1c-415c-b80a-c10fc749c79a req-c38553d5-dc99-42e0-b9c3-075ce01b82c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087543 Oct 04 19:06:17.239952 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3651/7323] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:17.550736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:17.551973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:17.559225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.559945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.560564 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.561426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:17.562046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:17.562472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:17.703833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:17.711965 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e9156815-aa6e-46fc-8f6e-314db367396f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.165487 Oct 04 19:06:17.712579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3673/7324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:17 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:18.736481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:18.737274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:18.748472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.748983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.749440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.750172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:18.750646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:18.751091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:18.901298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:18.909277 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ab2457bd-44af-4d03-ba29-77b118cd53ef tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.178722 Oct 04 19:06:18.909871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3652/7325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:18 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:19.932003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:19.932616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:19.935432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:19.940385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.940879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.941333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.942032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:19.942623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:19.942926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:19.946936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=79 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:20.077875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:20.086156 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c410893c-795a-489d-b598-03b2f3ee431a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.158089 Oct 04 19:06:20.086779 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3674/7326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:19 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:21.109696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.110328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.117926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.118427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.118884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.119614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.120094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.120552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.261376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:21.269552 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-899d5be7-c694-4b55-8b22-6f3cb71327ee tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.163715 Oct 04 19:06:21.270133 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3653/7327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:22.292599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.293271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.302009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.302812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.303610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.304763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.305317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.305753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.447348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.455552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e91eac54-c181-4abf-8159-8c8f74205b32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.167050 Oct 04 19:06:22.456133 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3675/7328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:22 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:23.479976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.480607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.483486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:23.488561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.489061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.489515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.490219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.490688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.491127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.628944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.636611 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1aa21172-71cb-4c5d-8960-cb561e888453 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.161051 Oct 04 19:06:23.637183 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3654/7329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:24.657075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:24.657864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:24.663196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.663960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.670065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.670546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.670985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.671705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.672160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.672587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.809844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:24.818969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dce5387d-9b13-435b-ac32-f42724e0614f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.162487 Oct 04 19:06:24.819580 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3676/7330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:25.842167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:25.842799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:25.849866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.850366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.850824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:25.851579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:25.852058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:25.852506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:26.000700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:26.010067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-523f90ac-ed28-4d9d-b565-4ac43445ab0a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.171781 Oct 04 19:06:26.013370 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3655/7331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:25 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:27.034800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:27.035422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:27.042497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.042984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.043519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.044278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:27.044764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:27.045227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:27.190970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:27.200565 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b54c039-0b72-4603-830c-f9d456d8b304 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.169785 Oct 04 19:06:27.201217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3677/7332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:27 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:28.223238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:28.223905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:28.231051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.231602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.232365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.233087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:28.233562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:28.234013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:28.377930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:28.386534 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86451cb1-f886-48e7-b357-5cdd2169fb1a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.167097 Oct 04 19:06:28.387154 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3656/7333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:28 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:29.412884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:29.413484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:29.421068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.421560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.422002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.422746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:29.423205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:29.423694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:29.571571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:29.579266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5266c0a0-2a36-4004-9c85-252caec9fbe2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.171212 Oct 04 19:06:29.579872 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3678/7334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:29 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:30.605450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:30.606382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:30.618042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.619506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.619506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.619787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:30.620430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:30.620892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:30.759004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:30.767952 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67d57434-61c5-49af-a44e-35d97009ad41 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.166705 Oct 04 19:06:30.768539 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3657/7335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:30 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:31.792273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:31.792887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:31.800048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.802829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.802829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.802829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:31.802829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:31.802829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:31.933200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:31.941413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-533050c7-598f-4e18-a300-37ff682e3f7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.154355 Oct 04 19:06:31.942038 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3679/7336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:31 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:32.965465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:32.966268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:32.973991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.974629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.975491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:32.976331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:32.977355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:32.977821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:33.121527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:33.129848 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb9e8169-a09b-4fb4-a4d8-e44d25e7ceb0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.169180 Oct 04 19:06:33.130800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3658/7337] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:32 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:34.155968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:34.156637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:34.163512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.163993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.165090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.165770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.166225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.166772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.306199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:34.314655 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-24a82542-16ea-4e18-8da1-0e733eefb6f4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.162680 Oct 04 19:06:34.315247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3680/7338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:34 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:35.338296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:35.338921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:35.346338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.346834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.347288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.348045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:35.348513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:35.348954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:35.493115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.501039 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8141ff3d-972e-4e1d-aaec-125ae396a015 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.166769 Oct 04 19:06:35.501660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3659/7339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:35 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:36.524942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:36.526054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:36.533354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.533843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.534288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.534985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.535439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.535893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.666797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.675044 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9361c620-2bcc-4e44-ae5a-d8ed6f1ef622 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.154330 Oct 04 19:06:36.675676 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3681/7340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:36 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:37.697224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.697850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:37.704774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.705272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.705719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.706415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.706921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.707363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.841292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:37.849428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f70dd0e-7dbb-4fec-82b6-63576d378384 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.156178 Oct 04 19:06:37.850012 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3660/7341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:38.873551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:38.874090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:38.881296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.881790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.882230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.882950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.883394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.884025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.021050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.029239 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a4ab129-a3c9-4442-bb34-7545095bfca6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.160375 Oct 04 19:06:39.030176 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3682/7342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:38 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:40.052657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:40.053283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:40.060918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.061406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.061849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.062562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.063019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.063484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.193918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:40.203190 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-205f754e-0e0b-4a3d-a9f8-aec0ede50dcd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.154392 Oct 04 19:06:40.203792 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3661/7343] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:40 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:41.232875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:41.233481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:41.239521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.240137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.240515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.241196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:41.241645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:41.242066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.377396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.385948 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-feb3778e-b3fb-4025-81bb-1a1d3e7ab854 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.157268 Oct 04 19:06:41.386525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3683/7344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:41 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:42.410011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:42.410552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:42.417207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.420868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.420868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.420868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.420868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.420868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.559185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.566907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-21794849-c9fb-4192-b1d0-5eebf754bda2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.161466 Oct 04 19:06:42.567590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3662/7345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:42 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:43.590948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.591692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.598628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.599164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.599751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.600513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.600977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.601413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.736279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:43.744396 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fccb301-20fb-41d9-b54c-28a5ebe6e7de tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.158087 Oct 04 19:06:43.745100 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3684/7346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:44.768289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:44.768940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:44.776122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.776620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.777071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.777769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.778244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.778682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.908939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.917257 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6f07fd4-2d34-4c51-b68f-56b92bbd7e3c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.152899 Oct 04 19:06:44.917838 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3663/7347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:44 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.940545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.941164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.948131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.948621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.949072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.949813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.950279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.950712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.084517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.092784 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c2f4bc6-1cce-4da3-9dfa-1cb89e757772 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.156199 Oct 04 19:06:46.093365 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3685/7348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:47.116710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:47.117282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:47.125051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.125705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.126030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.126759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.127234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.127707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.264938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:47.274179 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f678e45e-8eef-434f-8717-fa271be6937f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.161400 Oct 04 19:06:47.274941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3664/7349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:47 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:48.298790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:48.299436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:48.307045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.314247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.314247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.314247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:48.314247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:48.314247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:48.445974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:48.454591 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2200575e-aed3-4d5a-b078-cbe9fb4d15e6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.160102 Oct 04 19:06:48.455497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3686/7350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:48 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:49.476511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:49.477200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:49.479918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=28 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:49.484697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.485202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.485656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.486368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:49.486836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:49.487283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:49.489912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=80 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:49.618919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:49.627271 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69467769-48df-4879-a8ea-6fbaca108424 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.154710 Oct 04 19:06:49.627877 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3665/7351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:49 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:50.650319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:50.650837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:50.654112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=26 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:50.659105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.659621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.660075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.660764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:50.661224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:50.661654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:50.665762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=78 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:50.803490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:50.812371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8dad6d6-aad3-41b1-8289-3b0b0880cfa1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.165936 Oct 04 19:06:50.813314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3687/7352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:50 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:51.836357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:51.836996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:51.844396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.847260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.847260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.847260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:51.847260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:51.847260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:51.986543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:51.994614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3808fed6-8e89-492a-9e68-43c1f97d1cd1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1341 microversion: 2.1 time: 0.162035 Oct 04 19:06:51.995253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3666/7353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:51 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:53.017419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:53.018027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:53.025975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.026481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.027437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.027675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:53.028167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:53.028624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:53.159978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:53.167801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10dfe23d-f3fb-4d9c-b53f-15549212acb3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.154275 Oct 04 19:06:53.168394 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3688/7354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:53 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:54.190768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:54.191387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:54.198190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.198678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.199122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.199843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:54.200310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:54.200742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:54.333301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:54.341523 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-37595090-1db3-43fe-bfc4-d3ac4e4bf652 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.154616 Oct 04 19:06:54.342096 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3667/7355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:54 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:55.363937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:55.364478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:55.372315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.372799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.373235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.373957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:55.374418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:55.374853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:55.507367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:55.515796 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dc2615f8-ecd4-44b0-9447-d786e3e5f4dc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.155813 Oct 04 19:06:55.516390 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3689/7356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:55 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:56.539035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:56.539673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:56.546718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.549411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.549411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.549411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:56.549411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:56.549411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:56.683228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:56.691694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c90c07d-d6bc-420c-812a-d63f9fbf5b52 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.156542 Oct 04 19:06:56.692292 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3668/7357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:56 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:57.714593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:57.715235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:57.722168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.725873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.725873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.725873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:57.725873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:57.725873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:57.862812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:57.871028 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6100c4f6-2374-411c-9103-3cc855d4b5d3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.160603 Oct 04 19:06:57.871663 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3690/7358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:57 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:58.895644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:58.896277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:58.904168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.904722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.905173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:58.905880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:58.906355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:58.906799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:59.037244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:59.045144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5eb21df-dbba-47e8-937f-91ce109c109e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.153490 Oct 04 19:06:59.045728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3669/7359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:58 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:00.068365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:00.069003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:00.076023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.076504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.076939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.077622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:00.078074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:00.078535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:00.208149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:00.216525 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b49c6794-6a78-49d7-9488-ec7e573aee06 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.152162 Oct 04 19:07:00.217131 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3691/7360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:00 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:01.239673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:01.240307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:01.247815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.248319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.248775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.249508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:01.249970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:01.250409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:01.380876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:01.388984 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78e1079e-2d90-4a2e-96d9-e61fe6d3f76b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.153281 Oct 04 19:07:01.389572 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3670/7361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:01 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:02.411903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:02.412527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:02.422283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:02.557102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:02.565335 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6255cb96-8b60-4c04-b3a1-9edbb8124e69 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.157655 Oct 04 19:07:02.565912 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3692/7362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:02 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:03.588791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:03.589422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:03.596938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.599621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.599621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.599621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:03.599621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:03.599621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:03.733570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:03.741644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3bcff2ed-c88e-45fe-b269-90058945438b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.156905 Oct 04 19:07:03.742227 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3671/7363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:03 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:04.496051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8863f38-30da-40b2-91e8-1c93fec0b582", "name": "network-vif-plugged", "status": "completed", "tag": "046aba39-084f-4511-89a3-cdccc4ca46c6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:04.506537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.507018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.507451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.518703 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] Creating event network-vif-plugged:046aba39-084f-4511-89a3-cdccc4ca46c6 for instance c8863f38-30da-40b2-91e8-1c93fec0b582 on n-h2-833090-21 Oct 04 19:07:04.523855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ff5133a5-2e55-411a-90f6-b34a5898416e req-d24e315a-a889-463d-b518-b727a4c18945 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Oct 04 19:07:04.524443 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3693/7364] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:07:04.766610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:04.767621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:04.775032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.777675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.777675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.777675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:04.777675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:04.778028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:04.913286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:04.921309 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e2b9682-5448-4bce-9758-1d33391179ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.159754 Oct 04 19:07:04.921877 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3672/7365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:04 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:05.945525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:05.946256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:05.952541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.953031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.954018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:05.954721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:05.955219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:05.955682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:06.091444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:06.100538 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a06efa2f-9ad0-4ac4-8ba4-28d239127b40 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1375 microversion: 2.1 time: 0.160064 Oct 04 19:07:06.101120 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3694/7366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:05 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:07.124498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.125131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.132127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.132623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.133072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.133769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.134236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.134678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.269535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.277403 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-93ccc132-6f8f-476c-9a5f-f96b61b2f052 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1561 microversion: 2.1 time: 0.157392 Oct 04 19:07:07.277924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3673/7367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:07.309965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.310584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.317627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.318122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.318572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.319270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.319887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.320283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.454300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:07.462250 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c0d6a24-02e4-42d6-8c20-309a5286f244 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1561 microversion: 2.1 time: 0.156360 Oct 04 19:07:07.462903 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3695/7368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:07.544026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.544480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.550539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.558910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.558910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.558910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.558910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.558910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.582418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:07.950908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-261d6d77-8272-4880-90d6-01c642cb4fd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 204 len: 0 microversion: 2.1 time: 0.410532 Oct 04 19:07:07.952080 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3674/7369] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:07 2022] DELETE /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:07.960013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:07.960630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:07.966871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.968073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.968535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:07.969227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:07.969711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:07.970134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:08.107800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:08.115723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9edfcb57-af0f-4ce9-a040-cafc0d444efb tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1567 microversion: 2.1 time: 0.159525 Oct 04 19:07:08.116311 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3696/7370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:07 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:09.140489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:09.141204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:09.148248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.148755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.149210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.149946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:09.150421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:09.150864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:09.285367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:09.293315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd5694b7-7e39-41e9-a9c9-d239518517d6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1567 microversion: 2.1 time: 0.157945 Oct 04 19:07:09.293900 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3675/7371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:09 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:10.235949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8863f38-30da-40b2-91e8-1c93fec0b582", "name": "network-vif-deleted", "tag": "046aba39-084f-4511-89a3-cdccc4ca46c6"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:10.260104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.261263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.261702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.276817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] Creating event network-vif-deleted:046aba39-084f-4511-89a3-cdccc4ca46c6 for instance c8863f38-30da-40b2-91e8-1c93fec0b582 on n-h2-833090-21 Oct 04 19:07:10.283264 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-08a98846-a503-4883-8481-0d3866a22b7d req-3a1aa79e-5c3d-401b-9655-0e698026d9f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050116 Oct 04 19:07:10.283876 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3697/7372] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:10.317561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:10.318566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:10.330900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.331416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.331924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.332735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:10.333207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:10.333911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:10.405764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:10.414695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f3841a91-c21d-4848-bcd4-07a89667d3d1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1525 microversion: 2.1 time: 0.101786 Oct 04 19:07:10.415278 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3676/7373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:10 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1525 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:11.443265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:11.444182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:11.451038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.451545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.452081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.452778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.453228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.453647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.519758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:11.527989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8deb8118-83de-4650-9822-2c3c3c293d04 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1360 microversion: 2.1 time: 0.089550 Oct 04 19:07:11.528680 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3698/7374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:11 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:12.552980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:12.553606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:12.560099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.560603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.561064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.561773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:12.562252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:12.562698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:12.629772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:12.638293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cc3439e-7f88-4f08-984f-28289f238b78 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1360 microversion: 2.1 time: 0.089355 Oct 04 19:07:12.638883 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3677/7375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:12 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:13.661582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:13.662239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:13.669144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.669630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.670073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.670788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:13.671245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:13.671704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:13.739742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:13.748122 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7e11a8fa-a179-4f79-93f7-b708579e9184 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1360 microversion: 2.1 time: 0.090481 Oct 04 19:07:13.753421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3699/7376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:13 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:14.772884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:14.773518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:14.780444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.780953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.781410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.782124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:14.782599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:14.783044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:14.845467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:14.853286 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e03d044-0415-4667-accd-45e4c7f2a7a3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 200 len: 1360 microversion: 2.1 time: 0.084212 Oct 04 19:07:14.853806 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3678/7377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:14 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 1360 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:15.876801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:15.877496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:15.885029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.885529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.885975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.887202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:15.887695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:15.888132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:15.902753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 HTTP/1.1 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c8863f38-30da-40b2-91e8-1c93fec0b582'} Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:15.904466 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9b9fd469-21a4-47e8-8888-6a677cae3878 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 404 len: 111 microversion: 2.1 time: 0.033636 Oct 04 19:07:15.908919 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3700/7378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:15 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:20.259124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:20.259681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:20.264247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:20.267746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.268264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.268745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.269457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.269932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.270374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.273032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:20.296733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:07:20.658813 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c3e5a76d-1e9a-4208-a9ee-ab279a449614 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 204 len: 0 microversion: 2.1 time: 0.403475 Oct 04 19:07:20.659439 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3679/7379] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:20 2022] DELETE /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:20.668217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:20.668837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:20.676174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.676669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.677114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.677813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:20.678272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:20.678706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:20.808832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:20.811129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=76 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:20.817995 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5aa5a421-31d1-441c-8ff3-af0d573bbaae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1410 microversion: 2.1 time: 0.153707 Oct 04 19:07:20.818577 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3701/7380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:20 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:21.842415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:21.843140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:21.851205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.851732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.852179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.852881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:21.853350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:21.853790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:21.987308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:21.995652 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-161dbbed-da46-4f42-b318-20c1c4e695cd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1410 microversion: 2.1 time: 0.157366 Oct 04 19:07:21.996253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3680/7381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:21 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:22.960871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6ac75-7136-496f-9415-91fe43ee663a", "name": "network-vif-deleted", "tag": "009007c0-4610-4413-8491-52a5253725f0"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:22.970495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=30 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:22.976110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.976657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.978029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.988668 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] Creating event network-vif-deleted:009007c0-4610-4413-8491-52a5253725f0 for instance 09f6ac75-7136-496f-9415-91fe43ee663a on n-h1-833090-21 Oct 04 19:07:22.994348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5bf6b9da-a39d-4d67-9a7d-22bca7e64b9e req-f81d34de-fa27-421d-9a9a-51d3880908f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037290 Oct 04 19:07:22.995282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3702/7382] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:23.019357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:23.020314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:23.029848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:23.030726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:23.031430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:23.032247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:23.032944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:23.033451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:23.104728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.112909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-decb4624-9571-437b-a393-1325507d53b9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1368 microversion: 2.1 time: 0.097682 Oct 04 19:07:23.113612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3681/7383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:23 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:24.138816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:24.139539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:24.146405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.146887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.147327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.148063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.148514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.148942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.212975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.222743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0eeafb39-ab62-4d2a-87d4-6918bd038a3b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1202 microversion: 2.1 time: 0.089480 Oct 04 19:07:24.223194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3703/7384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:24 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:25.246653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:25.247317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:25.254896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.255991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.256562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.257160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:25.257638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:25.258084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:25.325700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:25.337790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf5ddd4f-18d6-4232-bf30-f91a69d321b6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1202 microversion: 2.1 time: 0.095091 Oct 04 19:07:25.338375 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3682/7385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:25 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:26.361370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:26.361993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.369251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.369750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.370196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.370937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.371402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.372046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.438173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.447267 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26bc7ffe-de81-4a5a-9b5d-bfd90e5a9942 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1202 microversion: 2.1 time: 0.089905 Oct 04 19:07:26.450054 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3704/7386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:26 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:27.470430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:27.471700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:27.478845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.479358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.479845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.480562 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.481043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.481498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.516419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.516929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.517388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.517856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lazy-loading 'fault' on Instance uuid 09f6ac75-7136-496f-9415-91fe43ee663a {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:07:27.565314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:27.574068 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a72a459d-653f-40f0-8543-d8d51d4887da tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 200 len: 1207 microversion: 2.1 time: 0.107883 Oct 04 19:07:27.588065 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3683/7387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:27 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 1207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:28.597800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:28.598423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:28.605296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.605792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.606210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.606893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.607344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.607795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.621339 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a HTTP/1.1 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '09f6ac75-7136-496f-9415-91fe43ee663a'} Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:28.623066 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-74eaf525-7727-4399-b89a-a6ff65ea7c07 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 404 len: 111 microversion: 2.1 time: 0.030666 Oct 04 19:07:28.626533 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3705/7388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:28 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:30.767224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.767843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.774835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.775338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.775836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.776549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.777028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.777474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.791492 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 HTTP/1.1 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c8863f38-30da-40b2-91e8-1c93fec0b582'} Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:30.793185 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b82b10cb-6eb3-4ced-a54e-720e02ecfd16 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 404 len: 111 microversion: 2.1 time: 0.031276 Oct 04 19:07:30.796809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3684/7389] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:30 2022] DELETE /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:30.804018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.804636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c8863f38-30da-40b2-91e8-1c93fec0b582] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.811624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.812112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.812553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.813241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.813703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.814130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.827661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 HTTP/1.1 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c8863f38-30da-40b2-91e8-1c93fec0b582'} Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:30.829171 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c8863f38-30da-40b2-91e8-1c93fec0b582 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e603b4b5-1d13-4c2d-9911-d742db3891a8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582" status: 404 len: 111 microversion: 2.1 time: 0.031109 Oct 04 19:07:30.833113 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3706/7390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/c8863f38-30da-40b2-91e8-1c93fec0b582 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:31.662622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.663336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.669983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.674490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.674490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.674490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.674490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.674490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.686624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a HTTP/1.1 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '09f6ac75-7136-496f-9415-91fe43ee663a'} Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:31.688227 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc95ef52-6e16-4153-9db4-9749fa5514ea tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 404 len: 111 microversion: 2.1 time: 0.031642 Oct 04 19:07:31.692885 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3685/7391] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:07:31 2022] DELETE /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:31.698896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.703143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 09f6ac75-7136-496f-9415-91fe43ee663a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.705653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.706140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.706583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.707273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.707770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.708702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.722382 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a HTTP/1.1 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '09f6ac75-7136-496f-9415-91fe43ee663a'} Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:07:31.732176 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance 09f6ac75-7136-496f-9415-91fe43ee663a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0ad8363-6b78-4058-991c-795bbad07615 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a" status: 404 len: 111 microversion: 2.1 time: 0.031168 Oct 04 19:07:31.737062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3707/7392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/09f6ac75-7136-496f-9415-91fe43ee663a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:07:31.804839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-938b505b-058b-4156-bd2d-a64289c26753 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: .version_select at 0x7f9008fe48b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1939920368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnHdA5nIDsW95erZyMzLFejuyZvdMlADK5tPbG/2nijppTIQJPMia0D0XrKO16aZ5kTK3OHxFas8/TDzk9+u3ySfiRTZZo2WkBt3fAkVlBx04Yczy1aSECsak96Do8csg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:31.822299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-938b505b-058b-4156-bd2d-a64289c26753 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:31.827422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-938b505b-058b-4156-bd2d-a64289c26753 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:31.905416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-938b505b-058b-4156-bd2d-a64289c26753 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.104405 Oct 04 19:07:31.905919 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3686/7393] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:07:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:58.408009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-393458044", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1939920368", "security_groups": [{"name": "tempest-secgroup-smoke-1716522901"}], "block_device_mapping_v2": [{"uuid": "8a302dc6-9beb-4162-8d5f-65a7f3a376eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:58.419395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=11 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:58.420141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=21 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:58.588390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:07:58.951730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:58.952166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:58.952658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:58.953077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:58.953492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:58.962469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.962957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.963399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.964167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:58.964626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:58.965058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:58.982448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:07:58.988375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:07:59.046840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:07:59.049670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a302dc6-9beb-4162-8d5f-65a7f3a376eb',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:07:59.532688 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3b4aa43-acb8-4c16-b4c0-fa86331d2e7f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.128690 Oct 04 19:07:59.533619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3708/7394] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:07:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:07:59.544819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-506da3a3-ac12-4cf5-9fe2-5998d3d77e60 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:59.545451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-506da3a3-ac12-4cf5-9fe2-5998d3d77e60 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:59.548790 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 19:07:59.549770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:59.550482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:59.551117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:59.668448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-506da3a3-ac12-4cf5-9fe2-5998d3d77e60 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:59.676187 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-506da3a3-ac12-4cf5-9fe2-5998d3d77e60 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1094 microversion: 2.1 time: 0.135426 Oct 04 19:07:59.679584 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3687/7395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:59 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1094 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:00.700460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:00.701113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:00.707450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.707976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.708445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.709116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:00.709571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:00.709992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:00.772364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:00.780473 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-53df1883-972d-4500-8a16-b49cdbe7a731 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1136 microversion: 2.1 time: 0.084910 Oct 04 19:08:00.782335 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3709/7396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:00 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:01.804693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:01.806386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:01.819721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.820245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.820697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.821580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:01.822064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:01.822510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:01.910769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:01.920827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f48cc079-f9ad-401d-a28c-7365a8f0ddf0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1210 microversion: 2.1 time: 0.121178 Oct 04 19:08:01.921775 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3688/7397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:01 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:02.945298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:02.946044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:02.952918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.953531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.954625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:02.955428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:02.956026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:02.956592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.103687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:03.111959 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ed4bec74-c51d-408b-9f9f-8b2ba86a8bc0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1278 microversion: 2.1 time: 0.171074 Oct 04 19:08:03.113072 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3710/7398] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:02 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:03.272095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65a42f4-fad4-45c8-92ae-33a0fc7a808a", "tag": "bfe57022-d3b6-4e68-ba84-2b370cc0b129"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:03.283685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:03.284281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:03.284815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:03.297956 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] Creating event network-changed:bfe57022-d3b6-4e68-ba84-2b370cc0b129 for instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a on n-h1-833090-21 Oct 04 19:08:03.303963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7afbea12-6208-422c-94ea-f78d67ba203e req-69a324c5-b5b8-4c3b-baad-9fefb1509d4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093796 Oct 04 19:08:03.304446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3689/7399] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:04.141740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:04.142359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:04.149422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:04.149917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:04.150365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:04.151062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:04.151544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:04.152144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:04.295668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:04.304567 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6da011c7-1fd9-4557-93f2-5bea59519038 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1278 microversion: 2.1 time: 0.166561 Oct 04 19:08:04.305182 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3711/7400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:04 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:05.327698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:05.328417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:05.335680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.336182 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.336635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.338514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:05.338514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:05.338514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:05.471978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:05.479855 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fa075b6-a73d-4182-8481-1d753c6d5fb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1278 microversion: 2.1 time: 0.156423 Oct 04 19:08:05.480440 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3690/7401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:05 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:06.502977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:06.503643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:06.511069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.511590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.512028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.512733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:06.513190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:06.513618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:06.648848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:06.656577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a913496a-8292-4b15-928b-b4eaddf1585b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1278 microversion: 2.1 time: 0.158191 Oct 04 19:08:06.657162 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3712/7402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:06 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:07.679104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:07.679783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:07.686692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.687203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.687697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.688524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:07.688950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:07.689401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:07.822273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:07.830769 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c04c3563-50fe-491e-801c-b3457adc80b3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.155642 Oct 04 19:08:07.831352 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3691/7403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:07 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:08.854918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:08.855540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:08.863000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.863491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.863922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:08.864599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:08.865048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:08.865469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:08.973397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:08.994886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:09.000321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:09.008767 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2edb478b-0746-4299-a962-1424b5c49f5c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.157692 Oct 04 19:08:09.009353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3713/7404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:08 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:10.032607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:10.033238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:10.036092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.041262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.041767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.042220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.042926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.043713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.043991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.173802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:10.181489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fc6d2f2-9413-417b-8020-69925e917b70 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.152818 Oct 04 19:08:10.182066 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3692/7405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:10 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:08:11.206076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:11.206691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:11.213830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:11.214316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:11.215380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:11.215554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:11.216017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:11.216450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:11.348250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:11.355978 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cf8087c-a917-44fc-a08d-a268c1974bbc tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.154842 Oct 04 19:08:11.356570 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3714/7406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:11 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:12.380185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:12.380809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:12.387144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.387689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.388143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.388839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:12.389306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:12.389746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:12.527765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:12.535731 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a836b04-4527-4656-990a-d3a25322c0ac tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.160226 Oct 04 19:08:12.536237 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3693/7407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:12 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:13.558395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:13.558957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:13.566559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:13.567047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:13.567516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:13.568215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:13.568677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:13.569110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:13.698322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:13.706133 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a8cecea-44b1-4416-8100-4759b4f566b2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.151788 Oct 04 19:08:13.706713 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3715/7408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:13 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:14.729551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:14.730181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:14.737022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:14.737522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:14.737975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:14.738685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:14.739160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:14.739631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:14.871017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:14.879306 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b0d2ee6-4f4a-48f4-899a-19e62237bb5d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.153628 Oct 04 19:08:14.879914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3694/7409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:14 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:15.902553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:15.903174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:15.910792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:15.911282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:15.911752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:15.912449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:15.912912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:15.913346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:16.049299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:16.057107 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92a9682a-bb11-46f5-b5d2-01aedc7a3a83 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.158498 Oct 04 19:08:16.057695 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3716/7410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:15 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:16.979640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65a42f4-fad4-45c8-92ae-33a0fc7a808a", "name": "network-vif-plugged", "status": "completed", "tag": "bfe57022-d3b6-4e68-ba84-2b370cc0b129"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:16.989099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:16.989590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:16.990040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.004375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] Creating event network-vif-plugged:bfe57022-d3b6-4e68-ba84-2b370cc0b129 for instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a on n-h1-833090-21 Oct 04 19:08:17.011489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c37f23ca-e933-4792-941a-8f479e298b06 req-0b0068d0-fbf9-4a9e-9808-6d24a9f7632c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084097 Oct 04 19:08:17.011489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3695/7411] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:17.080813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:17.081425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:17.088457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.088944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.089412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.090144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.090604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.091025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.222007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:17.229729 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-011866e1-ebb4-4e09-bce2-4a258f23546c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.153465 Oct 04 19:08:17.230540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3717/7412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:17 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:18.255612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:18.256333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:18.262784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.263285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.264053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.264990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:18.265469 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:18.265920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.664204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:18.671757 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b2f39a4-1e1b-4144-bbff-04eea983d76c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1266 microversion: 2.1 time: 0.422032 Oct 04 19:08:18.672333 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3696/7413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:18 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:19.693806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:19.694437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:19.701354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.701862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.702302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.702982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.703435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.703888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.839356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:19.847098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-efbabc8d-c991-4a6d-892e-1fbfdfc784b1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1452 microversion: 2.1 time: 0.157240 Oct 04 19:08:19.847705 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3718/7414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:19 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:19.868690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:19.869356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:19.876707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.877209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.877710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.878429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.878905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.879352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.016613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:20.016613 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30e5b426-8e66-4de2-9c04-ad10ad9012f5 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1452 microversion: 2.1 time: 0.150378 Oct 04 19:08:20.016613 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3697/7415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:19 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:21.871124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65a42f4-fad4-45c8-92ae-33a0fc7a808a", "tag": "bfe57022-d3b6-4e68-ba84-2b370cc0b129"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:21.882229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:21.882766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:21.883205 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:21.895315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] Creating event network-changed:bfe57022-d3b6-4e68-ba84-2b370cc0b129 for instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a on n-h1-833090-21 Oct 04 19:08:21.901340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9dd50bb4-3c8d-4bab-b53b-c7399269e2d6 req-64f8fc86-6675-4b04-ab84-23da6401023a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 Oct 04 19:08:21.902158 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3719/7416] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:48.466099 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:10:48.466992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:48.467914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=52 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:48.469025 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:10:48.469234 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a (ip 10.222.0.40) !!! Oct 04 19:10:48.470338 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:10:48.470465 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a (ip 10.222.0.40) !!! Oct 04 19:10:48.474621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:48.475144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:48.483988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.484493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.484957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.485669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.486144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.486590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.514146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:48.789829 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-62e60021-b67c-41fc-965a-44d48f3f6982 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 204 len: 0 microversion: 2.1 time: 0.325974 Oct 04 19:10:48.790437 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3698/7417] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:48 2022] DELETE /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:10:48.796948 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:10:48.798390 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:10:48.798761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:48.799522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=64 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:48.801021 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:10:48.801166 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a (ip 10.222.0.40) !!! Oct 04 19:10:48.802882 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:10:48.803010 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a (ip 10.222.0.40) !!! Oct 04 19:10:48.807218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:48.807963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:48.822185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.822681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.823129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.823865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:48.824338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:48.824843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:48.959623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:48.967417 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1618638a-2616-412d-ad66-e19e8b68d73a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1576 microversion: 2.1 time: 0.172515 Oct 04 19:10:48.970461 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3720/7418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:48 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:49.990645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:49.991363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:50.002883 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43022. Oct 04 19:10:50.005042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.005539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.005987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.006741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:50.007256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:50.007719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:50.138368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:50.146688 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-931afa38-b15b-4317-b002-1554aa597856 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1576 microversion: 2.1 time: 0.160314 Oct 04 19:10:50.147259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3699/7419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:49 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:51.169405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:51.170020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:51.180627 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.181121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.181568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.182265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.182745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.183201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.187071 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43028. Oct 04 19:10:51.191017 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43026. Oct 04 19:10:51.252906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:51.265198 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-af90ee87-f340-405e-8af9-790cd47d1755 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1508 microversion: 2.1 time: 0.099641 Oct 04 19:10:51.265946 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3721/7420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:51 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1508 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:51.535863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65a42f4-fad4-45c8-92ae-33a0fc7a808a", "name": "network-vif-deleted", "tag": "bfe57022-d3b6-4e68-ba84-2b370cc0b129"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:51.546966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:51.547454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:51.547927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:51.559300 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] Creating event network-vif-deleted:bfe57022-d3b6-4e68-ba84-2b370cc0b129 for instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a on n-h1-833090-21 Oct 04 19:10:51.564393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-58b6411a-fa1a-43ec-b214-0ad3a1110241 req-e5c1352e-62e5-46d9-b3cc-862051af9b19 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Oct 04 19:10:51.565504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3700/7421] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:52.288586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:52.289106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:52.296301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.296786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.297220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.297925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:52.298378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:52.298798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:52.366922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:52.374974 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e68c371-72cc-4cdf-a217-ffb2e030acfe tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1225 microversion: 2.1 time: 0.090387 Oct 04 19:10:52.377073 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3722/7422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:52 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:53.399900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:53.400636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:53.407145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.407686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.408145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.408859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:53.409332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:53.409776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:53.479090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:53.487000 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c937acc-afdb-4b9d-ac03-3aa444402719 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1225 microversion: 2.1 time: 0.092475 Oct 04 19:10:53.487612 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3701/7423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:53 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:54.510649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:54.511262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:54.518218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.518708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.519143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.519872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:54.520485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:54.520913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:54.582873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:54.590755 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b60fe634-4758-496d-991f-e556767e6bf3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1225 microversion: 2.1 time: 0.084074 Oct 04 19:10:54.591341 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3723/7424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:54 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:55.614453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:55.615085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:55.622116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.622630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.623090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.623834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:55.624308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:55.624761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:55.687414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:55.696260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67b4ddb7-2d4a-449b-904c-2c51015ccb56 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1225 microversion: 2.1 time: 0.086217 Oct 04 19:10:55.696857 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3702/7425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:55 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.719288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:56.719928 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.727416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.727935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.728372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.729065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.729521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.729948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.769502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.770068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.771283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.771283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lazy-loading 'fault' on Instance uuid c65a42f4-fad4-45c8-92ae-33a0fc7a808a {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:56.824104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:56.832167 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-738a09a1-667f-493f-8ce5-5cae3754f05e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 200 len: 1230 microversion: 2.1 time: 0.116845 Oct 04 19:10:56.832801 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3724/7426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:56 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:57.855250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:57.855906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:57.862743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.863242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.864216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.864923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:57.865394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:57.865838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:57.879227 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a HTTP/1.1 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c65a42f4-fad4-45c8-92ae-33a0fc7a808a'} Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:57.881504 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-74012062-d6f4-4c72-8a14-5e414cf75173 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 404 len: 111 microversion: 2.1 time: 0.031578 Oct 04 19:10:57.886197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3703/7427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:57 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:57.929978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-24059859", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1939920368", "security_groups": [{"name": "tempest-secgroup-smoke-1716522901"}], "block_device_mapping_v2": [{"uuid": "8a302dc6-9beb-4162-8d5f-65a7f3a376eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:58.044759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:58.443871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:58.444296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:58.444775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:58.445214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:58.445626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:58.454460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.454937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.455377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.456128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:58.456583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:58.457025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:58.474212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:58.479458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:58.539014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:58.541214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a302dc6-9beb-4162-8d5f-65a7f3a376eb',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:58.915114 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65e2f019-5045-4856-b31f-87549200a26d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989542 Oct 04 19:10:58.915807 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3725/7428] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:10:58.927051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4f671a4-c69a-4ffb-8116-b5a05b197b75 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:58.927806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4f671a4-c69a-4ffb-8116-b5a05b197b75 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:58.986679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b4f671a4-c69a-4ffb-8116-b5a05b197b75 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:58.994932 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4f671a4-c69a-4ffb-8116-b5a05b197b75 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1093 microversion: 2.1 time: 0.071844 Oct 04 19:10:58.995519 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3704/7429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:58 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:00.018736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:00.019348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:00.026188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.026678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.027637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.027822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:00.028280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:00.028707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:00.094172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:00.102010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a57fc943-4b93-48e1-8384-d0ddb98e62f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1143 microversion: 2.1 time: 0.088044 Oct 04 19:11:00.102590 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3726/7430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:00 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:01.125489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:01.126181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:01.134222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.134738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.135203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.135949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:01.136428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:01.136886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:01.213413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:01.221225 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-088e0ada-6d11-4bda-9397-47512a3ff6f9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1199 microversion: 2.1 time: 0.099673 Oct 04 19:11:01.221784 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3705/7431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:01 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:02.247249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:02.248621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.266967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.268220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.268769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.269767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.271011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.271730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.436680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:02.446841 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d1a2b8a-8823-43fa-9c6d-c36c36bfb828 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1277 microversion: 2.1 time: 0.206673 Oct 04 19:11:02.462819 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3727/7432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:02 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:03.206549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bd1b0f-40dd-45b3-8617-6c37169bbd69", "tag": "d5ad6093-ffcb-432a-bcf9-025bf2bd41ef"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:03.218986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.219816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.220436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.233006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] Creating event network-changed:d5ad6093-ffcb-432a-bcf9-025bf2bd41ef for instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 on n-h1-833090-21 Oct 04 19:11:03.238596 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-7bfd7749-3c75-4a10-81a2-b9c1347099be req-4b48a340-bb42-41bd-a6a4-48dac5ae6608 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035789 Oct 04 19:11:03.239863 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3706/7433] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:03.470175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:03.470975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:03.478256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.478883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.479420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.480235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.480788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.481311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.627632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:03.637242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b1b6a8a-1d38-412b-a723-b9666452acf6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1277 microversion: 2.1 time: 0.170877 Oct 04 19:11:03.637854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3728/7434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:03 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:04.669013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:04.669645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:04.676453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.676948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.677393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.678111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:04.678639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:04.679013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.814052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:04.822406 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db88bb35-4be3-45af-ae8d-217c3bc500f7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1277 microversion: 2.1 time: 0.158625 Oct 04 19:11:04.822977 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3707/7435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:04 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:05.845062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:05.845673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.853140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.853618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.854051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.854736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.855183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.855635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.991126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.998845 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c88acd1-1018-4dbe-be48-fd4d8910be2a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1277 microversion: 2.1 time: 0.157667 Oct 04 19:11:06.007214 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3729/7436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:05 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:07.022696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.023411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.030546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.031046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.031514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.032228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.032697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.033134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.163175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:07.170941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-86fc2e5b-a7c6-4470-806a-af46b3859c7b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.152737 Oct 04 19:11:07.171533 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3708/7437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:08.193942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:08.194548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:08.201420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.201894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.202325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.203006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.203475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.203906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.336709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.344498 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c0209d7b-01a2-4d4c-a634-c4b1829e321d tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.154662 Oct 04 19:11:08.345328 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3730/7438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:08 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:09.369002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.369552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.372424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:09.377264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.377809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.383663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.383663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.383663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.383663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.516471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:09.524834 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e3470447-b360-4a74-b90d-07d467efbef3 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.159795 Oct 04 19:11:09.525424 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3709/7439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:10.547512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.548094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.549945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.551108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:10.556756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.557619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.557712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.558336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.558789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.559227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.694482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.702238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c70f8d4-6c8a-476d-b3a4-2bc02e52f5d0 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.158745 Oct 04 19:11:10.702811 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3731/7440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:10 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:11.724768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:11.725398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:11.731880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.732375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.732827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.733528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.734000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.734439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.863444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:11.871151 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4460645e-8fc4-4f9b-8a7e-1db14d77ad1c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.150480 Oct 04 19:11:11.871744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3710/7441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:11 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:12.894807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:12.895459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:12.902385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.902868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.903303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.904022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.904474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.904898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:13.033807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:13.042197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bba4946-4d2d-40da-9b0a-0616181871c1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.151841 Oct 04 19:11:13.042776 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3732/7442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:12 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:14.064691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:14.065317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:14.072614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.073111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.073554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.074252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:14.074750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:14.075172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:14.205350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:14.213691 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3a7da19d-3f67-48ab-8259-f7a03598ab44 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.152865 Oct 04 19:11:14.214259 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3711/7443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:14 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:15.236126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:15.236743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:15.243739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:15.244230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:15.244673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:15.245364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:15.245819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:15.246246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:15.376956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:15.385364 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfc1fac5-c76a-4c67-b3cd-fae9a2dd94a4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.153128 Oct 04 19:11:15.385951 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3733/7444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:15 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:16.408948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:16.409572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:16.417330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:16.417827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:16.418275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:16.418983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:16.419450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:16.419911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:16.556187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:16.563882 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bad7531a-62bc-4677-b6ef-cf9124e1c9e9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.159084 Oct 04 19:11:16.570061 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3712/7445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:16 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:17.587240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:17.587949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:17.595176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.595697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.596143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.596838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.597372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.597808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.730844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:17.739249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-948ccebc-b537-4c56-899a-443093c10059 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.155981 Oct 04 19:11:17.739931 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3734/7446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:17 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:17.962639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bd1b0f-40dd-45b3-8617-6c37169bbd69", "name": "network-vif-plugged", "status": "completed", "tag": "d5ad6093-ffcb-432a-bcf9-025bf2bd41ef"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:17.973285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:17.973779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:17.974229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:17.985172 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] Creating event network-vif-plugged:d5ad6093-ffcb-432a-bcf9-025bf2bd41ef for instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 on n-h1-833090-21 Oct 04 19:11:17.990777 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4851ba48-0ac7-4b77-adeb-9d8467ee80ed req-2b19c855-f3ca-463f-9163-b2cb5d894d87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 Oct 04 19:11:17.991361 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3713/7447] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:18.762537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:18.806775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:18.902124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:18.904364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=93 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:18.910447 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd0eddc2-c982-4018-9500-fca45ca10dc4 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1265 microversion: 2.1 time: 0.151978 Oct 04 19:11:18.911040 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3735/7448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:18 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:19.935358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:19.936172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:19.938221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:19.943150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:19.943691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:19.944157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:19.944863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:19.945339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:19.945785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:19.949833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:20.080636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:20.088272 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff122e1c-824d-43e3-a213-b84960146190 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1452 microversion: 2.1 time: 0.158209 Oct 04 19:11:20.088845 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3714/7449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:19 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:20.111506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:20.112118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:20.115391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:20.120440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.124905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.124905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.124905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:20.124905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:20.124905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:20.261337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:20.269885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1020f3fb-fb04-44e2-8456-27cf20bdcf4b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1452 microversion: 2.1 time: 0.161865 Oct 04 19:11:20.270483 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3736/7450] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:20 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:22.221049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bd1b0f-40dd-45b3-8617-6c37169bbd69", "tag": "d5ad6093-ffcb-432a-bcf9-025bf2bd41ef"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:22.231352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:22.231879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:22.232321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:22.243748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] Creating event network-changed:d5ad6093-ffcb-432a-bcf9-025bf2bd41ef for instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 on n-h1-833090-21 Oct 04 19:11:22.248845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bc17e780-eede-428c-8ad7-86684ecff89d req-e4946ff6-2dda-4930-9aa0-9d8e363b69e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Oct 04 19:11:22.250001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3715/7451] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:53.661542 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:13:53.662537 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:13:53.663337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:53.664262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=7 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:53.664999 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:13:53.665137 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 19:13:53.667316 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:13:53.667457 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 19:13:53.669174 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:13:53.669281 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 19:13:53.680289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1600064196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1939920368", "security_groups": [{"name": "tempest-secgroup-smoke-1716522901"}], "block_device_mapping_v2": [{"uuid": "20176f90-d911-498f-a244-eaf801c7f560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2eac67e-b2b1-493b-b502-b30242239794"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:53.920144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] validate_networks() for [('c2eac67e-b2b1-493b-b502-b30242239794', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:13:54.296336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:13:54.296792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:13:54.297269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:13:54.297682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:13:54.298134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:13:54.307904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.308383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.308812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:54.309552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.310057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.310513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:54.327003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:13:54.331948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Getting quotas for user 34abb93f585745309968ed0a387e0ba4 and project 352d637ce9a0461697f2d89601c22926. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:13:54.393665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:13:54.395863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20176f90-d911-498f-a244-eaf801c7f560',volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:13:54.672865 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43272. Oct 04 19:13:54.673529 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43274. Oct 04 19:13:54.789867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e824d2c5-21b3-4e8d-8c3d-62814f0b7f5b tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.130097 Oct 04 19:13:54.790575 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3737/7452] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:13:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:13:54.800327 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:13:54.801293 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:13:54.801890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:54.802655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=7 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:54.803988 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:13:54.804135 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 (ip 10.222.0.40) !!! Oct 04 19:13:54.805342 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:13:54.805815 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 (ip 10.222.0.40) !!! Oct 04 19:13:54.813461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b55c23b5-e2ce-4c9b-b87d-90034741054e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:54.814257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b55c23b5-e2ce-4c9b-b87d-90034741054e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:54.927244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b55c23b5-e2ce-4c9b-b87d-90034741054e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:54.934512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b55c23b5-e2ce-4c9b-b87d-90034741054e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1095 microversion: 2.1 time: 0.136149 Oct 04 19:13:54.935118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3716/7453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:54 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:55.959203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:55.959832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:55.965957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:55.966436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:55.966980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:55.967683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:55.968138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:55.968560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:56.029923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:56.037857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-095c884c-e99d-4d69-9a5b-4bd942c48fc8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1145 microversion: 2.1 time: 0.083702 Oct 04 19:13:56.038483 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3738/7454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:55 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:57.061142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:57.061751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:57.072720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:57.073228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:57.073688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:57.074410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:57.074887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:57.075366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:57.079884 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43302. Oct 04 19:13:57.082195 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43304. Oct 04 19:13:57.141025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:57.149067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2fae417-8f26-47ce-aa97-0e12e4883573 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1193 microversion: 2.1 time: 0.091928 Oct 04 19:13:57.149686 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3717/7455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:57 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:58.172641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:58.175819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:58.182303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.182811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.183257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.184300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.184772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.185202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.410563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:58.422551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8cf6f494-f06b-4afa-8411-bb930d887cae tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1279 microversion: 2.1 time: 0.253713 Oct 04 19:13:58.430887 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3739/7456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:58 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:59.448300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:59.450032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:59.466912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.467402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.469131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.469842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.470299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.470724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.483199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566f0a1d-3e3a-4f7e-bb2a-310669747d67", "tag": "0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:59.496602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.499890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.505889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.514704 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] Creating event network-changed:0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38 for instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 on n-h2-833090-21 Oct 04 19:13:59.525316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f0c90eb1-4a9a-4400-ac76-fe05902308f3 req-7365d6d9-3a50-4445-98e5-d9806c3e6405 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115897 Oct 04 19:13:59.526296 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3718/7457] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:59.717228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:59.727031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-203fbb0d-1aa5-478d-a40c-172d7446e871 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1279 microversion: 2.1 time: 0.283783 Oct 04 19:13:59.727916 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3740/7458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:59 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:00.752153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:00.752883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:00.759918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.760424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.760879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:00.761591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.762068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.762515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:00.898751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:00.906745 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a587a0b-dc69-47be-a534-cefac1e25090 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1279 microversion: 2.1 time: 0.160146 Oct 04 19:14:00.907438 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3719/7459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:00 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:01.930320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:01.930859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:01.937920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.938406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.938849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.939586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.940045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.940469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:02.082114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:02.090006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52c5d2e6-c01d-4e0a-8259-9d0942d000d9 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1279 microversion: 2.1 time: 0.163706 Oct 04 19:14:02.090597 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3741/7460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:01 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:03.112585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:03.113217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:03.120357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:03.120866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:03.121470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.122189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:03.122662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:03.123105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.257859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:03.270346 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-da0e697e-e2e0-43da-a563-d3517df35eab tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1279 microversion: 2.1 time: 0.157711 Oct 04 19:14:03.270346 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3720/7461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:03 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:04.290281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:04.290860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:04.298002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.298485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.298935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.299638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.300096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.300588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.321743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:04.338756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:04.443827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:04.451577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d368004-987f-487b-b82f-dc4408516859 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.165313 Oct 04 19:14:04.452198 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3742/7462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:04 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:05.475930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:05.476557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:05.480029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:05.484880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.485383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.485838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.486599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.487069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.487548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.623970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:05.631903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-156f343d-005c-4388-97d8-5bae41e4050c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.159797 Oct 04 19:14:05.637495 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3721/7463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:05 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:06.655341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.655997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.662917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.663425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.663897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.664588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.665043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.665469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.804104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:06.812137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8934403a-f3ec-4b45-860c-7e7a14b74cb1 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.160590 Oct 04 19:14:06.812681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3743/7464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:06 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:07.835733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:07.836366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:07.843374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:07.843907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:07.844363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:07.845071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:07.845543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:07.845985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:07.979458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:07.988444 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b709efe0-5916-4b36-b228-5b51230b6c55 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.156669 Oct 04 19:14:07.989120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3722/7465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:07 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:09.011590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:09.012210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:09.019196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.019718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.020166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.020869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.021326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.021757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.160616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:09.168614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-855eb82e-d4c6-48bb-ba28-fe7b57bbfbd2 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.161186 Oct 04 19:14:09.169194 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3744/7466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:09 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:10.191556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:10.192176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:10.199830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.200336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.200820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.201544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.202020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.202467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.425230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:10.433726 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3bc6df4b-2dbc-464c-888d-ea27136cbc87 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.246209 Oct 04 19:14:10.434621 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3723/7467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:10 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:11.457469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:11.458065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:11.464878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.465352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.465782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.466462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.466911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.467331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.597055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:11.605348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a53c68c4-ae54-4881-8d59-d6990965b230 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.151879 Oct 04 19:14:11.605918 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3745/7468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:11 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:12.628506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:12.629189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:12.636124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.637243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.637704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.638401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.638868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.639301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.774726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:12.782484 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-234daa67-3b9f-4e2a-a64b-26c466235e5f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.157887 Oct 04 19:14:12.783056 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3724/7469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:12 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:13.805900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:13.806529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:13.814140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:13.814617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:13.815048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.815761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:13.816212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:13.816635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.949298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:13.957382 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-18930beb-0772-4dec-8454-62fc30473bd8 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.155176 Oct 04 19:14:13.957969 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3746/7470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:13 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:14.721963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566f0a1d-3e3a-4f7e-bb2a-310669747d67", "name": "network-vif-plugged", "status": "completed", "tag": "0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:14.732717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.734360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.734360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.746336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] Creating event network-vif-plugged:0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38 for instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 on n-h2-833090-21 Oct 04 19:14:14.752218 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-889d7679-7183-4659-aa56-a240d83a7493 req-eaf8a964-eec2-43f6-b5eb-a5dbe4d1bc4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088859 Oct 04 19:14:14.752837 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3725/7471] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:14.982331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:14.982952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:14.989976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.990468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.990912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.991647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.992109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.992542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.127694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:15.135500 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ab023e0-49ad-4018-aa25-bba5a7660bdd tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.157005 Oct 04 19:14:15.136020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3747/7472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:14 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:16.159131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:16.159883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:16.167132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:16.167675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:16.168135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:16.168837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:16.169887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:16.170337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:16.306346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:16.314120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8dd51c4e-5a17-4f68-ad84-1de9cc607f51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1267 microversion: 2.1 time: 0.159348 Oct 04 19:14:16.314700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3726/7473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:16 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:17.337328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:17.337878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:17.345423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.345910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.350334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.350334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.350334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.350334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.486344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:17.495233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5c8f339-5eac-4e96-b9e8-192f42815823 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1453 microversion: 2.1 time: 0.161885 Oct 04 19:14:17.496173 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3748/7474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:17 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:17.521008 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:17.521639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:17.529296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.529804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.530261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.530970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.531446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.531924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.662852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:17.670827 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ea8779a-d389-4967-b2e1-5729030f22b7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1453 microversion: 2.1 time: 0.154042 Oct 04 19:14:17.671442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3727/7475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:17 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:19.939337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566f0a1d-3e3a-4f7e-bb2a-310669747d67", "tag": "0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:19.949181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:19.949780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:19.950223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.961524 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] Creating event network-changed:0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38 for instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 on n-h2-833090-21 Oct 04 19:14:19.968287 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-eae47173-3d7a-4cbe-a856-631097303276 req-d8a5ea82-de79-4f2f-a628-24612118c715 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090288 Oct 04 19:14:19.974555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3749/7476] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:23.869764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=26 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:23.870611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=58 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:23.875271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:23.884380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:23.884530 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:16:23.884530 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:16:23.884530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:23.884530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=70 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:23.885796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:23.886297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:23.886755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566f0a1d-3e3a-4f7e-bb2a-310669747d67", "tag": "0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:23.886930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:23.887903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:23.888536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:23.888982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:23.896828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:23.897307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:23.897739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:23.909808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] Creating event network-changed:0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38 for instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 on n-h2-833090-21 Oct 04 19:16:23.915055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3e21727b-c1f8-4853-aa67-e3f804136555 req-c93aa71c-45d7-411b-afa6-61d70da190ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038157 Oct 04 19:16:23.918700 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3750/7477] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:23.919238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:16:24.230473 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6b07d455-68fa-4cf0-a3d4-c8f3c826e748 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 204 len: 0 microversion: 2.1 time: 0.363184 Oct 04 19:16:24.231075 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3728/7478] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:23 2022] DELETE /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:16:24.239872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:24.240570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:24.248885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:24.249392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:24.249811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:24.250556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:24.251006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:24.251431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:24.386087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:24.394149 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6dee5fc8-7072-4390-91fb-7fa041eeb9d7 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1577 microversion: 2.1 time: 0.158466 Oct 04 19:16:24.394736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3751/7479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:24 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:25.419029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:25.419822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:25.427038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:25.427561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:25.428021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:25.429034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:25.429224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:25.429660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:25.583137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:25.591373 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c922212-3569-450f-b14b-9be6af05a154 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1577 microversion: 2.1 time: 0.176707 Oct 04 19:16:25.591987 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3729/7480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:25 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:26.461506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566f0a1d-3e3a-4f7e-bb2a-310669747d67", "name": "network-vif-deleted", "tag": "0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:26.481298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.481782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.482215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.489192 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43428. Oct 04 19:16:26.495921 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43430. Oct 04 19:16:26.498835 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] Creating event network-vif-deleted:0bc0bc67-79ba-4aa0-b1f3-39014b4b3b38 for instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 on n-h2-833090-21 Oct 04 19:16:26.503843 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5c39523b-11c3-47c0-b822-01fe221c1e32 req-fbe9e8cb-848c-4d87-91aa-8396bf8ecdf5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046059 Oct 04 19:16:26.504437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3752/7481] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:26.615272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:26.615862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:26.623737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.624269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.624774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.625491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:26.625968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:26.626416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:26.690782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:26.698765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed7a8e64-6da9-4120-8459-7f551c73a456 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1226 microversion: 2.1 time: 0.087462 Oct 04 19:16:26.699353 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3730/7482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:26 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:27.722899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:27.723742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:27.731765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:27.736006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:27.736006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:27.736006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:27.736006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:27.736006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:27.810466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:27.818793 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6f6378a-9fea-49f9-914c-6261700a833e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1226 microversion: 2.1 time: 0.100301 Oct 04 19:16:27.819385 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3753/7483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:27 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:28.842544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:28.843180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:28.849383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:28.849892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:28.850355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:28.851067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:28.851575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:28.852026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:28.918144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:28.926066 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3436224-eda9-4552-99e2-c7f31cbdae84 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1226 microversion: 2.1 time: 0.087743 Oct 04 19:16:28.926650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3731/7484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:28 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:29.949658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:29.950268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:29.957158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:29.957639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:29.958078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:29.958764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:29.959223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:29.959677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:30.022535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:30.031222 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9ab0bad3-9b17-4e9c-b1a1-619e28a28747 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1226 microversion: 2.1 time: 0.086076 Oct 04 19:16:30.031854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3754/7485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:29 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:31.054584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:31.055239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:31.062200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:31.062752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:31.063216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:31.064321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:31.064446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:31.064885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:31.098426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:31.098935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:31.099374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:31.099878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lazy-loading 'fault' on Instance uuid 566f0a1d-3e3a-4f7e-bb2a-310669747d67 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:16:31.144349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:31.152803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a80a599-5f05-4761-800d-5ca67b249c32 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 200 len: 1231 microversion: 2.1 time: 0.102206 Oct 04 19:16:31.153386 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3732/7486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:31 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:32.175802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:32.176413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 566f0a1d-3e3a-4f7e-bb2a-310669747d67] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:32.183392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:32.183904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:32.184339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:32.185023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:32.185478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:32.185903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:32.199174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 HTTP/1.1 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '566f0a1d-3e3a-4f7e-bb2a-310669747d67'} Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:32.200827 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance 566f0a1d-3e3a-4f7e-bb2a-310669747d67 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-baeec2e3-66ad-4b7a-92d8-7c86bc5bec9c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67" status: 404 len: 111 microversion: 2.1 time: 0.030401 Oct 04 19:16:32.205238 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3755/7487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:32 2022] GET /compute/v2.1/servers/566f0a1d-3e3a-4f7e-bb2a-310669747d67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:16:38.689841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:38.695171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bd1b0f-40dd-45b3-8617-6c37169bbd69", "tag": "d5ad6093-ffcb-432a-bcf9-025bf2bd41ef"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:38.695705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:38.704439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:38.705054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:38.705588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:38.706392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:38.706943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:38.707173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:38.707558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:38.707832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:38.708341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:38.719728 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] Creating event network-changed:d5ad6093-ffcb-432a-bcf9-025bf2bd41ef for instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 on n-h1-833090-21 Oct 04 19:16:38.725397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-10490967-448b-416a-aad9-5bbcacd02b64 req-c8454751-a8f7-41be-9865-d4d5d0f398d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033771 Oct 04 19:16:38.726183 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3756/7488] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:38.737553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:16:39.069817 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6163427d-271a-4839-8536-f6eba7fd0350 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 204 len: 0 microversion: 2.1 time: 0.383317 Oct 04 19:16:39.070633 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3733/7489] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:38 2022] DELETE /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:16:39.080271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:39.081185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:39.088449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:39.089012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:39.089860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:39.090674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:39.091197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:39.091861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:39.239655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:39.249113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7daecf62-6056-4ee7-819b-5ed109ce1b9f tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1576 microversion: 2.1 time: 0.173404 Oct 04 19:16:39.250002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3757/7490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:39 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:40.274285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:40.274934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:40.282776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.283277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.283750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.284459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.284926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.285429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.354460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:40.362530 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7d57eae-fa95-4527-9275-4ca39eadeaba tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1390 microversion: 2.1 time: 0.092696 Oct 04 19:16:40.363111 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3734/7491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:40 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:40.741356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bd1b0f-40dd-45b3-8617-6c37169bbd69", "name": "network-vif-deleted", "tag": "d5ad6093-ffcb-432a-bcf9-025bf2bd41ef"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:40.752754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:40.753229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:40.753653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:40.765581 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] Creating event network-vif-deleted:d5ad6093-ffcb-432a-bcf9-025bf2bd41ef for instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 on n-h1-833090-21 Oct 04 19:16:40.770394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1d90ffd1-b24f-45ad-baec-12203688b035 req-31d9b839-a449-4283-a405-912af730bb88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033042 Oct 04 19:16:40.770989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3758/7492] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:41.386940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:41.387513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:41.394471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:41.394965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:41.395417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:41.396167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:41.396640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:41.397080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:41.462948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:41.471024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9fa5b2aa-5a6d-4d3c-af67-0eca91d03bcf tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1224 microversion: 2.1 time: 0.088114 Oct 04 19:16:41.471631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3735/7493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:41 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:42.496312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:42.497023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:42.503229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:42.503744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:42.504184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:42.504883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:42.505343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:42.505775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:42.568849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:42.577301 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-368bad29-82d3-4f64-8d83-6da3950bc04e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1224 microversion: 2.1 time: 0.086441 Oct 04 19:16:42.577907 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3759/7494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:42 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:43.600470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:43.600996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:43.608435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:43.608949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:43.609413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:43.610124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:43.610599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:43.611047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:43.679827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:43.684729 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4135f38d-6aed-4529-b335-400d9abbf15c tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1224 microversion: 2.1 time: 0.088181 Oct 04 19:16:43.685342 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3736/7495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:43 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:44.708067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:44.708816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:44.715722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:44.716210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:44.716829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:44.717332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:44.717791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:44.718219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:44.785496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34abb93f585745309968ed0a387e0ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352d637ce9a0461697f2d89601c22926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:44.793650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-685c2345-611e-44bc-9f17-f8d52bc2db08 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 200 len: 1224 microversion: 2.1 time: 0.089767 Oct 04 19:16:44.794240 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3760/7496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:44 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:45.817113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:45.817737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: 47bd1b0f-40dd-45b3-8617-6c37169bbd69] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:45.825171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:45.825667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:45.826117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:45.826813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:45.827307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:45.827772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:45.841353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 HTTP/1.1 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '47bd1b0f-40dd-45b3-8617-6c37169bbd69'} Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:45.843000 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance 47bd1b0f-40dd-45b3-8617-6c37169bbd69 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-964a5fac-aebb-4221-b737-ad08fcc2ce51 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69" status: 404 len: 111 microversion: 2.1 time: 0.031255 Oct 04 19:16:45.847458 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3737/7497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:45 2022] GET /compute/v2.1/servers/47bd1b0f-40dd-45b3-8617-6c37169bbd69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:16:46.377900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:46.378394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:46.385954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.386445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.386896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.387619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.388081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.388513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.401781 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a HTTP/1.1 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'c65a42f4-fad4-45c8-92ae-33a0fc7a808a'} Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:46.403421 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c72bff9-dbe5-4c89-b39a-cd0cc6ceca8a tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 404 len: 111 microversion: 2.1 time: 0.030927 Oct 04 19:16:46.408063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3761/7498] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:16:46 2022] DELETE /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:16:46.413532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:46.414167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] [instance: c65a42f4-fad4-45c8-92ae-33a0fc7a808a] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:46.420194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.420698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.421211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.421895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:46.422373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:46.422831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:46.436554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] HTTP exception thrown: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Request method failure captured: Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a HTTP/1.1 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPINEvu7FK0mYVw9isadHiBzh3VzVVswtOQX9ZR8CcmbMPTi6tkvaOkz4Ia_jdnzKjO99KLrB9uusGBpLSckiM0554P5TjHBn3DEUJlSkBivwDEBjmSVrumjDslGewuOevWZLNoqzrTzo2MgSBVlSIcyTU4M8dWxxmjfjFNAmW0XkzMg Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_352d637ce9a0461697f2d89601c22926"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/352d637ce9a0461697f2d89601c22926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/352d637ce9a0461697f2d89601c22926"}]}] Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 352d637ce9a0461697f2d89601c22926 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestVolumeBootPattern-772681532 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 34abb93f585745309968ed0a387e0ba4 Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestVolumeBootPattern-772681532-project Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'c65a42f4-fad4-45c8-92ae-33a0fc7a808a'} Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:16:46.438105 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Returning 404 to user: Instance c65a42f4-fad4-45c8-92ae-33a0fc7a808a could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cc4f455-be99-48b2-9b73-c11480389c6e tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a" status: 404 len: 111 microversion: 2.1 time: 0.029961 Oct 04 19:16:46.442209 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3738/7499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:46 2022] GET /compute/v2.1/servers/c65a42f4-fad4-45c8-92ae-33a0fc7a808a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:16:50.120355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8154d191-d421-43c1-a3d7-84480a6112f6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] Calling method '.version_select at 0x7f90082c50d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:50.207512 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8154d191-d421-43c1-a3d7-84480a6112f6 tempest-TestVolumeBootPattern-772681532 tempest-TestVolumeBootPattern-772681532-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1939920368" status: 202 len: 0 microversion: 2.1 time: 0.091292 Oct 04 19:16:50.208060 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3762/7500] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 4 19:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1939920368 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:17:11.048721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:11.049503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:11.176751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1313235129", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:11.228624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] validate_networks() for None {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:17:11.502634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:17:11.503068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:17:11.503573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:17:11.503993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:17:11.504414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:17:11.513661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:11.514148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:11.514595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:11.515322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:11.515811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:11.516250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:11.532988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Getting quotas for project 6aab36ba827945b68caa10a855faa586. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:17:11.538158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Getting quotas for user 2150272ab76d4ca89f04107ec846cdd0 and project 6aab36ba827945b68caa10a855faa586. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:17:11.550393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:17:11.556421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:17:11.655615 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:17:12.665182 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43608. Oct 04 19:17:12.670898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-580494ba-e543-49e3-96c1-c9bedc2e0e51 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626946 Oct 04 19:17:12.671577 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3739/7501] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:17:12.682357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=48 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:12.683646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:12.687727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0d4a071d-50a9-4713-b7e6-e11c3a795f44 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:12.691534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0d4a071d-50a9-4713-b7e6-e11c3a795f44 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:12.745551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0d4a071d-50a9-4713-b7e6-e11c3a795f44 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:12.753315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0d4a071d-50a9-4713-b7e6-e11c3a795f44 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1222 microversion: 2.1 time: 0.072815 Oct 04 19:17:12.754149 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3763/7502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:12 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:13.778862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:13.779425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:13.786288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:13.786784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:13.787238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:13.787965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:13.788441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:13.788884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:13.852019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:13.859818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-08697a2f-31b8-4899-bf08-0039597c8b0c tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1226 microversion: 2.1 time: 0.086366 Oct 04 19:17:13.861957 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3740/7503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:13 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:14.884676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:14.885303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:14.893976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:14.894461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:14.894911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:14.895632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:14.896093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:14.896525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:14.960163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:14.968091 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-038fd952-4b9d-4a48-a044-707b5c104b32 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1282 microversion: 2.1 time: 0.087409 Oct 04 19:17:14.968669 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3764/7504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:14 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:15.990958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:15.991618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:15.998765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:15.999271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:15.999758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:16.000470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:16.000947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:16.001397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:16.259179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:16.266858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0de7aee1-7477-492f-893e-0050109991a9 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.279810 Oct 04 19:17:16.267434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3741/7505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:15 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:17.076086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97b0666-dfb1-4cd8-842e-267a8a264632", "tag": "2c235f9b-48f5-4501-83b5-63dd6c320332"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:17.086259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:17.086764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:17.087194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:17.098828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] Creating event network-changed:2c235f9b-48f5-4501-83b5-63dd6c320332 for instance e97b0666-dfb1-4cd8-842e-267a8a264632 on n-h1-833090-21 Oct 04 19:17:17.103851 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c090a47d-8749-4412-ab8f-09ded701f915 req-aad4a0b9-7aa6-46c1-af49-b78e45df4dc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031818 Oct 04 19:17:17.104450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3765/7506] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:17.290444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:17.291019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:17.298328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:17.298836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:17.299296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:17.300039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:17.300521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:17.300965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:17.525942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:17.534395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-31dc7c1b-3ae2-47a8-8253-ab0a771db903 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.248008 Oct 04 19:17:17.534970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3742/7507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:17 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:18.560066 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:18.560773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:18.567188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:18.567713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:18.568161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:18.568854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:18.569318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:18.570073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:18.702590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:18.710405 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c656dfc-3243-4a80-b58e-e4f040688fc2 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.155926 Oct 04 19:17:18.711008 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3766/7508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:18 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:19.733927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:19.734576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:19.741343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:19.741834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:19.742279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:19.744478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:19.744478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:19.744478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:19.878939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:19.886742 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b122836b-865c-4843-816c-b104f19158d8 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.156728 Oct 04 19:17:19.887325 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3743/7509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:19 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:20.910586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:20.911157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:20.918309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:20.918801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:20.919246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:20.919985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:20.920473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:20.920930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:21.051284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:21.059041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-65531331-2e36-48d9-bc80-b33b782430b0 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.152580 Oct 04 19:17:21.059649 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3767/7510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:20 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:21.794441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97b0666-dfb1-4cd8-842e-267a8a264632", "name": "network-vif-plugged", "status": "completed", "tag": "2c235f9b-48f5-4501-83b5-63dd6c320332"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:21.800811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:21.801547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:21.807113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:21.807652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:21.808105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:21.819625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] Creating event network-vif-plugged:2c235f9b-48f5-4501-83b5-63dd6c320332 for instance e97b0666-dfb1-4cd8-842e-267a8a264632 on n-h1-833090-21 Oct 04 19:17:21.824718 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f85ded6c-d2d4-4c41-9b84-7727e69c23e9 req-def9af00-fa42-4429-b584-fb74fab7fd77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Oct 04 19:17:21.825373 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3744/7511] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:22.081927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:22.082569 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:22.089521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:22.090005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:22.090440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:22.091131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:22.092216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:22.092651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:22.222314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:22.230099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7fcbadf8-3542-494d-8f72-744871a08f6d tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.152117 Oct 04 19:17:22.230681 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3768/7512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:22 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:23.256392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:23.257280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:23.265138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:23.265656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:23.266162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:23.266889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:23.267371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:23.267851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:23.405689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:23.415279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0662a9de-1206-4cc0-b9f0-8cd4cc97d0ba tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1322 microversion: 2.1 time: 0.162702 Oct 04 19:17:23.415279 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3745/7513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:23 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:24.437033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:24.442417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:24.442417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:24.445368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:24.445853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:24.446294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:24.446981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:24.447438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:24.447890 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:24.581393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:24.589362 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef9b7e52-cf84-48be-abcb-706a0ee9928f tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1472 microversion: 2.1 time: 0.156646 Oct 04 19:17:24.589946 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3769/7514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:24 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:24.660748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1f1f325d-363a-4510-8db7-4dad32e2ea8f tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '.version_select at 0x7f9008388ca0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:24.729119 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1f1f325d-363a-4510-8db7-4dad32e2ea8f tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fba76d1e356c49459a22ddc333508c4e" status: 200 len: 371 microversion: 2.1 time: 0.118086 Oct 04 19:17:24.729710 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3746/7515] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 19:17:24 2022] GET /compute/v2.1/os-quota-sets/fba76d1e356c49459a22ddc333508c4e => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:24.746339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7faf674-3a86-489e-beec-e66195e882af tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1555497454", "id": 1033488963, "os-flavor-access:is_public": "True"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:24.824895 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7faf674-3a86-489e-beec-e66195e882af tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.082477 Oct 04 19:17:24.825496 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3770/7516] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:17:24 2022] POST /compute/v2.1/flavors => generated 438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:24.837996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1033488963"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:24.840420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:24.846985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:24.847488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:24.847950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:24.848647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:24.849113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:24.849548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.040013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bd384ca7dab245598bb0ff462a38ae05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba76d1e356c49459a22ddc333508c4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:25.046936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1555497454 {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:17:25.053459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.053947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.054390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.055114 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.055601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.056031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.075729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Getting quotas for project 6aab36ba827945b68caa10a855faa586. Resources: {'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:17:25.080649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Getting quotas for user 2150272ab76d4ca89f04107ec846cdd0 and project 6aab36ba827945b68caa10a855faa586. Resources: {'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:17:25.092781 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] ram quota exceeded for fba76d1e356c49459a22ddc333508c4e, tried to resize instance. Oct 04 19:17:25.093320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Request method failure captured: Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action HTTP/1.1 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 39 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIa2Xd3DvRhFyeub3Q9YOMc_40fp7hixYK5AY_kZCYlhBzxir0tFQowu5GgUXoPl-3t7P377UuRNfwE8MHR1OdNrRcF_vTnRc7e05y-dCzMGDrqdYJHiWVfuWV--Cy-7Fcw2HB-qgQz_2lXD9lvIRvsboCC-J0-MxbSZ8oafarYCuQM Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: fba76d1e356c49459a22ddc333508c4e Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,admin,member Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,admin,member Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fba76d1e356c49459a22ddc333508c4e"}]}] Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: fba76d1e356c49459a22ddc333508c4e Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersAdminNegativeTestJSON-523258205-project-admin Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: bd384ca7dab245598bb0ff462a38ae05 Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523258205-project-admin Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: {"resize": {"flavorRef": "1033488963"}} Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'e97b0666-dfb1-4cd8-842e-267a8a264632', 'body': {'resize': {'flavorRef': '1033488963'}}} Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.095333 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f236577b-c7f9-4e2c-a044-3851b432fe24 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action" status: 403 len: 118 microversion: 2.1 time: 0.262717 Oct 04 19:17:25.099721 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3747/7517] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:17:24 2022] POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action => generated 118 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:25.105654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-247fe50d-07c9-4b50-952d-99eb297a13bc tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.167788 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-247fe50d-07c9-4b50-952d-99eb297a13bc tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1033488963" status: 202 len: 0 microversion: 2.1 time: 0.065754 Oct 04 19:17:25.168369 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3771/7518] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 4 19:17:25 2022] DELETE /compute/v2.1/flavors/1033488963 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:17:25.176859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a01f0f2f-e469-4b0e-b286-b6b02547e599 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.197989 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a01f0f2f-e469-4b0e-b286-b6b02547e599 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024723 Oct 04 19:17:25.198567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3748/7519] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 19:17:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:25.219577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0030618c-e45d-4ef8-a2cc-5b88be3e82a0 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '.version_select at 0x7f90082c5670>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.292054 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0030618c-e45d-4ef8-a2cc-5b88be3e82a0 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fba76d1e356c49459a22ddc333508c4e" status: 200 len: 371 microversion: 2.1 time: 0.076709 Oct 04 19:17:25.292637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3772/7520] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 4 19:17:25 2022] GET /compute/v2.1/os-quota-sets/fba76d1e356c49459a22ddc333508c4e => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:25.305009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ad67dd9-dfb4-4743-b82c-e73647114cd9 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1414684966", "id": 85679100, "os-flavor-access:is_public": "True"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:25.371415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ad67dd9-dfb4-4743-b82c-e73647114cd9 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.070066 Oct 04 19:17:25.372017 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3749/7521] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:17:25 2022] POST /compute/v2.1/flavors => generated 431 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:17:25.384387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "85679100"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:25.386795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:25.393494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.393980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.394426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.395119 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.395614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.396048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.531715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bd384ca7dab245598bb0ff462a38ae05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba76d1e356c49459a22ddc333508c4e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:25.537876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1414684966 {{(pid=123887) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:17:25.544433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.544937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.545365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.546076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.546523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.546939 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.567747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Getting quotas for project 6aab36ba827945b68caa10a855faa586. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:17:25.572714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Getting quotas for user 2150272ab76d4ca89f04107ec846cdd0 and project 6aab36ba827945b68caa10a855faa586. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:17:25.585045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.api [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] cores quota exceeded for fba76d1e356c49459a22ddc333508c4e, tried to resize instance. Oct 04 19:17:25.585575 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Request method failure captured: Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action HTTP/1.1 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 37 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIa2Xd3DvRhFyeub3Q9YOMc_40fp7hixYK5AY_kZCYlhBzxir0tFQowu5GgUXoPl-3t7P377UuRNfwE8MHR1OdNrRcF_vTnRc7e05y-dCzMGDrqdYJHiWVfuWV--Cy-7Fcw2HB-qgQz_2lXD9lvIRvsboCC-J0-MxbSZ8oafarYCuQM Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: fba76d1e356c49459a22ddc333508c4e Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,admin,member Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,admin,member Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fba76d1e356c49459a22ddc333508c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fba76d1e356c49459a22ddc333508c4e"}]}] Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: fba76d1e356c49459a22ddc333508c4e Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-523258205 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAdminNegativeTestJSON-523258205-project-admin Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: bd384ca7dab245598bb0ff462a38ae05 Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAdminNegativeTestJSON-523258205-project-admin Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: {"resize": {"flavorRef": "85679100"}} Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e97b0666-dfb1-4cd8-842e-267a8a264632', 'body': {'resize': {'flavorRef': '85679100'}}} Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.587631 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d5db74b-2057-4bba-8a2e-a6f6b814c332 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action" status: 403 len: 113 microversion: 2.1 time: 0.208513 Oct 04 19:17:25.591685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3773/7522] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:17:25 2022] POST /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632/action => generated 113 bytes in 210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:25.598908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f0d6e893-5d9a-442f-9629-cc8410fd869e tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.766308 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f0d6e893-5d9a-442f-9629-cc8410fd869e tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/85679100" status: 202 len: 0 microversion: 2.1 time: 0.171307 Oct 04 19:17:25.766938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3750/7523] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 4 19:17:25 2022] DELETE /compute/v2.1/flavors/85679100 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:17:25.774769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d6053833-9f6c-4094-b6e7-3f7fe25ab7d6 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.794769 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d6053833-9f6c-4094-b6e7-3f7fe25ab7d6 tempest-ServersAdminNegativeTestJSON-523258205 tempest-ServersAdminNegativeTestJSON-523258205-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023635 Oct 04 19:17:25.795338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3774/7524] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 4 19:17:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:25.816989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:25.817510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:25.828155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.828661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.829119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.829829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:25.830308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:25.830755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:25.855302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:17:26.137022 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-12ae87db-928e-4f92-8304-4070e0439069 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 204 len: 0 microversion: 2.1 time: 0.323769 Oct 04 19:17:26.137634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3751/7525] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:17:25 2022] DELETE /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:17:26.145871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:26.146506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:26.152494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:26.152966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:26.153396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:26.154073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:26.154515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:26.154935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:26.282541 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:26.290253 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f8ae146a-d764-40fa-9945-8c2551a0af52 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1478 microversion: 2.1 time: 0.148365 Oct 04 19:17:26.290826 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3775/7526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:26 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1478 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:27.316077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:27.316702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:27.323013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:27.323544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:27.324040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:27.324737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:27.325243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:27.325715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:27.459843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:27.467456 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5c5077e-0657-4eed-8016-68793a622f83 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1478 microversion: 2.1 time: 0.156004 Oct 04 19:17:27.468547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3752/7527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:27 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:28.062653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97b0666-dfb1-4cd8-842e-267a8a264632", "name": "network-vif-deleted", "tag": "2c235f9b-48f5-4501-83b5-63dd6c320332"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:28.072894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:28.073394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:28.073827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:28.086108 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] Creating event network-vif-deleted:2c235f9b-48f5-4501-83b5-63dd6c320332 for instance e97b0666-dfb1-4cd8-842e-267a8a264632 on n-h1-833090-21 Oct 04 19:17:28.091311 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bae84e6a-8bdb-4c8c-a9e3-9f20a981412e req-26c43f21-e539-4b0f-9cae-3bcb8dfb0278 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Oct 04 19:17:28.091962 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3776/7528] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:28.491845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:28.493183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:28.500707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:28.501217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:28.501673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:28.502424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:28.502912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:28.503350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:28.538704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:28.539214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:28.539689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:28.541034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lazy-loading 'fault' on Instance uuid e97b0666-dfb1-4cd8-842e-267a8a264632 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:17:28.580872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150272ab76d4ca89f04107ec846cdd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab36ba827945b68caa10a855faa586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:28.588724 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6488713a-833f-42d3-948c-4a46cc6834b6 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 200 len: 1312 microversion: 2.1 time: 0.101016 Oct 04 19:17:28.589304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3753/7529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:28 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:29.612160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:29.612850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] [instance: e97b0666-dfb1-4cd8-842e-267a8a264632] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:29.620620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:29.621130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:29.621566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:29.622248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:29.622700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:29.623123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:29.636751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] HTTP exception thrown: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Request method failure captured: Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 HTTP/1.1 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIa2cH5B_I2HqXT4YBkCy7ILNF0TjNwsWIkmPWajikgi_E6i3ecZAOI2uww3T651N_IVIccNWJkVJnklOegH_V2hq6tTWwWiprSvwTUUvFX9wlUF80FaB1i6bdyfVYTOZtytPKo_jsV5fxTovG6CDhSM47nLVGyf1-ELG0kGMGNjgSU Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 6aab36ba827945b68caa10a855faa586 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-226380470 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6aab36ba827945b68caa10a855faa586"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6aab36ba827945b68caa10a855faa586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6aab36ba827945b68caa10a855faa586"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6aab36ba827945b68caa10a855faa586"}]}] Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersAdminNegativeTestJSON-226380470 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 6aab36ba827945b68caa10a855faa586 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-226380470 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersAdminNegativeTestJSON-226380470-project Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2150272ab76d4ca89f04107ec846cdd0 Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersAdminNegativeTestJSON-226380470-project Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'e97b0666-dfb1-4cd8-842e-267a8a264632'} Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:29.638334 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] Returning 404 to user: Instance e97b0666-dfb1-4cd8-842e-267a8a264632 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-272e5bbd-6f31-4ca8-8674-0e4379324f37 tempest-ServersAdminNegativeTestJSON-226380470 tempest-ServersAdminNegativeTestJSON-226380470-project] 10.222.0.40 "GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632" status: 404 len: 111 microversion: 2.1 time: 0.031887 Oct 04 19:17:29.643596 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3777/7530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:29 2022] GET /compute/v2.1/servers/e97b0666-dfb1-4cd8-842e-267a8a264632 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:17:38.013262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:38.014070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:38.122986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-618922319", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "8fdfcc64-7c88-492c-aab9-dedcaf744db6"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:38.178025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] validate_networks() for [('8fdfcc64-7c88-492c-aab9-dedcaf744db6', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:17:38.563957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:17:38.564400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:17:38.564895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:17:38.565325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:17:38.565757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:17:38.575124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:38.575669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:38.576128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:38.576879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:38.577350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:38.577791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:38.595193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Getting quotas for project c8262d1463ed404aa8a4b0718389825a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:17:38.600690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Getting quotas for user 6872162016c9470e9babc103693f3889 and project c8262d1463ed404aa8a4b0718389825a. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:17:38.613847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:17:38.616216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:17:38.769415 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ccbd9a8-4abc-4d7a-9783-fdc53907ea7a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762522 Oct 04 19:17:38.770246 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3754/7531] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:17:38.781328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1483e270-3737-41c7-a275-464429c0e197 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:38.782509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1483e270-3737-41c7-a275-464429c0e197 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:38.802294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:38.805228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:38.857366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1483e270-3737-41c7-a275-464429c0e197 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:38.864967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1483e270-3737-41c7-a275-464429c0e197 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1214 microversion: 2.1 time: 0.087472 Oct 04 19:17:38.865837 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3778/7532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:38 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:17:39.889572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:39.890212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:39.897196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:39.897698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:39.898162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:39.898871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:39.899357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:39.899831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:39.962622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:39.971198 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-906ec913-b9be-4d5c-b73c-211813d89638 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1218 microversion: 2.1 time: 0.086573 Oct 04 19:17:39.971816 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3755/7533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:39 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:41.004499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:41.005122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:41.007033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=55 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:41.022613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:41.023691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:41.024207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:41.027136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:41.027878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:41.028497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:41.104629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:41.114300 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03571e23-6139-48e2-8df3-fb33a5be7fc4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1274 microversion: 2.1 time: 0.114655 Oct 04 19:17:41.116069 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3779/7534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:40 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:42.141689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:42.142901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:42.145673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:42.150408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:42.150916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:42.151373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:42.152121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:42.152595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:42.153042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:42.158535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:42.371826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:42.380274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb860051-e3a7-43a0-bcc3-ca8862ccf037 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.243480 Oct 04 19:17:42.380864 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3756/7535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:42 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:42.932875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:42.943674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:42.944155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:42.944584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:42.956150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] Creating event network-changed:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h1-833090-21 Oct 04 19:17:42.961172 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-9b0772da-4322-4379-87cd-c1e31a53ee6a req-f9056cd8-b6d1-4d77-ba9d-1786bfa4fd13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032086 Oct 04 19:17:42.962099 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3780/7536] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:43.413473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:43.414158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:43.421678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:43.422183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:43.422638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:43.423346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:43.423849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:43.424294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:43.640793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:43.648384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e53e22b4-4457-4a12-946f-b6b2391f371c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.239238 Oct 04 19:17:43.648969 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3757/7537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:43 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:17:44.673736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:44.674548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:44.682026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:44.682516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:44.682963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:44.683731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:44.684190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:44.684621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:44.812712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:44.820433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bf0967bf-d87b-4e26-8476-524bb6334264 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.151639 Oct 04 19:17:44.821009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3781/7538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:44 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:45.843099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:45.843783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:45.851418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:45.851986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:45.852442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:45.853161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:45.853638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:45.854086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:45.989964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:45.998043 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c94616d0-8e50-44ed-bd1b-1a882a0fb109 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.158870 Oct 04 19:17:45.998626 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3758/7539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:45 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:17:47.021755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:47.022402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:47.025254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:47.030145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.030634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.031071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.032295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.032752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.033177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.165511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:47.173315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4929189-e323-42d1-92e1-c2554d95ae14 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.155578 Oct 04 19:17:47.173905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3782/7540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:47 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:47.902302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "name": "network-vif-plugged", "status": "completed", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:47.912953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:47.913456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:47.913910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:47.925614 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] Creating event network-vif-plugged:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h1-833090-21 Oct 04 19:17:47.930735 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-133df4ac-617e-4131-bf4e-7ee5ddfbf67c req-c58bcacf-79fd-405b-a2bf-cad822a7ba2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Oct 04 19:17:47.931328 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3759/7541] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:17:48.195952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:48.196563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:48.203363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:48.203878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:48.204314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:48.205000 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:48.205463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:48.205891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:48.338096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:48.346298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4dedad86-869b-4542-a761-ddf9d680ace7 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.154286 Oct 04 19:17:48.346879 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3783/7542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:48 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:49.367375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:49.368144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:49.373095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:49.373821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:49.380477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:49.380973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:49.381426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:49.382133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:49.382600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:49.383040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:49.517436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:49.525203 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-efd0a9c9-01f2-45fc-8368-f83c1b9f3743 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1314 microversion: 2.1 time: 0.159111 Oct 04 19:17:49.525791 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3760/7543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:49 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:50.547938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:50.548538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:50.550376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:17:50.556031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.556510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.556945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.557633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.558088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.558507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.690331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:50.698890 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f574e9c-9043-42ca-babe-6b8b13bc20bd tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1501 microversion: 2.1 time: 0.154856 Oct 04 19:17:50.699486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3784/7544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:50 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:50.721828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:17:50.724183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:50.731111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.731728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.732191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.732899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.733375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.733820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.762262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:50.768255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:17:50.774756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:17:50.775200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:17:50.775721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:17:50.776154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:17:50.776586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:17:50.959275 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-181ecbed-9b6b-4615-b7ac-ea54216831ce tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "POST /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b/action" status: 202 len: 0 microversion: 2.1 time: 0.241266 Oct 04 19:17:50.959921 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3761/7545] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:17:50 2022] POST /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:17:50.968393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:50.969004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:50.975308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.975779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.976209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:50.977113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:50.977366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:50.977789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:51.111893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:51.119992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e79258d-7818-4e60-9ccd-cc13b96205d9 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1510 microversion: 2.1 time: 0.155583 Oct 04 19:17:51.120569 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3785/7546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:50 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:52.145521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:52.146160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:52.152964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:52.156050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:52.156050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:52.156050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:52.156050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:52.156050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:52.286302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:52.295062 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25c272eb-3b41-4a9a-82bc-3f38f2548066 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1510 microversion: 2.1 time: 0.155187 Oct 04 19:17:52.295667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3762/7547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:52 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:53.318977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:53.319571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:53.327198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:53.328047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:53.328526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:53.329219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:53.329674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:53.330824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:53.468335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:53.476235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e64c2b95-4593-42fd-a54d-371407a04eac tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1510 microversion: 2.1 time: 0.161351 Oct 04 19:17:53.476810 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3786/7548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:53 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:54.500255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:54.500924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:54.509051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:54.509555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:54.510012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:54.510737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:54.511211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:54.511727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:54.642251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:54.650689 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-052d30e4-b742-4f5f-906a-5a2759dc102a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1510 microversion: 2.1 time: 0.154430 Oct 04 19:17:54.651305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3763/7549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:54 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:55.674141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:55.674758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:55.681793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:55.682287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:55.682725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:55.683451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:55.683933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:55.684368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:55.811619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:55.820038 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a6e5eba-1c3e-4d03-9baf-b8bdee42d3b5 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.149725 Oct 04 19:17:55.820601 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3787/7550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:55 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:56.843152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:56.843774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:56.851241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:56.851788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:56.852237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:56.852930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:56.853393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:56.853830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:56.985294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:56.993401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cc6a41c4-88c4-4449-b26f-b35f01a29827 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.154177 Oct 04 19:17:56.993974 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3764/7551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:56 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:58.016823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:58.017428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:58.025316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:58.025819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:58.026261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:58.027254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:58.027412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:58.027870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:58.160798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:58.168529 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1da85824-7048-485b-bdb9-aed36bd96382 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.155725 Oct 04 19:17:58.169118 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3788/7552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:58 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:17:59.191828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:17:59.192456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:17:59.198554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:59.199048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:59.199524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:59.200229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:17:59.200701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:17:59.201144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:17:59.329553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:17:59.337799 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3513a454-175e-4bd6-9b81-221a5d2b0234 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.150143 Oct 04 19:17:59.338395 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3765/7553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:17:59 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:00.361617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:00.362181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:00.369170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:00.369652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:00.370085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:00.370818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:00.371208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:00.371655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:00.506069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:00.513901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6db84426-5a4c-438d-8089-7c7e6f2dda8d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.156246 Oct 04 19:18:00.514482 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3789/7554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:00 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:01.537864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:01.538500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:01.545541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:01.546042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:01.546499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:01.547209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:01.547726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:01.548174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:01.678313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:01.686058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80ad7864-e5a6-4180-9d9f-c098a9001dfb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.152655 Oct 04 19:18:01.686649 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3766/7555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:01 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:02.710025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:02.710638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:02.717645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:02.718132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:02.718572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:02.719257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:02.719746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:02.720173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:02.851923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:02.859906 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c8b60c56-1743-4066-a362-4b8fdfe8f034 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.154192 Oct 04 19:18:02.860537 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3790/7556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:02 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:03.884776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:03.885443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:03.888459 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:03.888594 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b (ip 10.222.0.40) !!! Oct 04 19:18:03.895847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:03.896355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:03.896813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:03.897526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:03.898002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:03.898451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:04.027695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:04.035221 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d1600d7e-9427-4baf-8bf6-d621d99cf671 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.154523 Oct 04 19:18:04.035836 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3767/7557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:03 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:05.058273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:05.058889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:05.062261 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:05.062409 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b (ip 10.222.0.40) !!! Oct 04 19:18:05.068415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:05.073131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:05.073131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:05.073131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:05.073131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:05.073131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:05.203908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:05.212405 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-06b34cef-d328-4fdc-ae49-339e3ba4523e tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.158093 Oct 04 19:18:05.212992 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3791/7558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:05 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:06.236342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:06.236974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:06.244832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:06.245331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:06.245790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:06.246489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:06.246959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:06.247400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:06.377303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:06.385006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3896e273-3656-46c5-9379-8a4d5533cab4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.152605 Oct 04 19:18:06.385582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3768/7559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:06 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:07.408323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:07.408846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:07.416014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:07.416499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:07.416937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:07.417620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:07.418074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:07.418498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:07.548547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:07.557036 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45fb6bda-0ac1-48bf-afd5-25e2cbc92f59 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.152697 Oct 04 19:18:07.557613 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3792/7560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:07 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:08.580615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:08.581243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:08.588765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:08.589261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:08.589711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:08.590417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:08.590890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:08.591338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:08.722820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:08.731229 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9033e41-a455-4438-827e-35023e1f8edb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.154535 Oct 04 19:18:08.731831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3769/7561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:08 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:18:09.755314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:09.755959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:09.762786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:09.763265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:09.763739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:09.764424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:09.764880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:09.765307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:09.891343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:09.899171 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8c61581-b547-404c-b65f-da8b5fec4fa3 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.148406 Oct 04 19:18:09.899851 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3793/7562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:09 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:10.923237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:10.923942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:10.931449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:10.931984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:10.932606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:10.933313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:10.933791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:10.934284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:11.063916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:11.072293 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03fa8a4b-ff7f-43ac-a63d-8f7e123d8284 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.153224 Oct 04 19:18:11.073233 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3770/7563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:10 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:12.095535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:12.096152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:12.103112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:12.103640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:12.104085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:12.104775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:12.105231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:12.105656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:12.238602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:12.246622 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8280afe4-9695-4332-9b30-496c11e2f8b4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.155000 Oct 04 19:18:12.247216 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3794/7564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:12 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:13.271113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:13.271773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:13.278875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.279321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.279811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.280513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:13.280988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:13.281435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:13.414746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:13.418988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:13.423770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-063ccd1b-6437-45d7-9a6e-f872465fe67d tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.157124 Oct 04 19:18:13.424353 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3771/7565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:13 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:18:14.448787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:14.449400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:14.456366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:14.456853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:14.457877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:14.458576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:14.459037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:14.459499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:14.463443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=93 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:14.589075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:14.596802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-62bad5a9-923e-43ba-9de3-692ccd0486c4 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.152019 Oct 04 19:18:14.597490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3795/7566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:14 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:18:15.621078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:15.621697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:15.626001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:15.631763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.632277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.632813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.633498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.633968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.634416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.765138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:15.773402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-751667b9-f559-4f3e-b027-daf0c0987738 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.156713 Oct 04 19:18:15.773994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3772/7567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:15 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:16.797284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:16.800141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:16.804889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.805375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.805815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.806503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.806963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.807416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.940107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:16.948513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28abad6a-21b9-4950-a890-d3e0a5efdfeb tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.155234 Oct 04 19:18:16.949089 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3796/7568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:16 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:17.970860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:17.971516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:17.979123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.979669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.980131 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:17.980893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:17.981380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:17.981862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.113575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:18.121594 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-204aafc4-a0b4-48d4-bc2c-3a3003ce336f tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.154701 Oct 04 19:18:18.122180 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3773/7569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:17 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:19.148614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:19.149228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:19.151959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=30 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:19.156809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.157297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.157739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.158504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.158923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.159352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.286800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:19.294533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f9e04ed-5940-4049-acaf-61e240d79185 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.150439 Oct 04 19:18:19.295113 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3797/7570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:19 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:20.318269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:20.318807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:20.325752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.326247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.326710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.327394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.327909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.328349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.459824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:20.467508 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-59f4a0ca-b3b5-452f-b86e-e1e27f22b890 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.153188 Oct 04 19:18:20.469614 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3774/7571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:20 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:21.492422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:21.493032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:21.499874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.500357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.500792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.501475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.501929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.502349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.632614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:21.640456 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adbdb10b-f0cf-479f-b899-235a61a44be8 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1515 microversion: 2.1 time: 0.152738 Oct 04 19:18:21.641037 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3798/7572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:21 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:22.665262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:22.666558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:22.673688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.674197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.674646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.675578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.676050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.676489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.749476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "name": "network-vif-unplugged", "status": "completed", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:22.763078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.763703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.764178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.779883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Creating event network-vif-unplugged:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h2-833090-21 Oct 04 19:18:22.793297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] Instance cd60578c-2a48-4875-9813-8c4fd2dec73b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:18:22.805557 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4f20c0eb-15c3-4ad6-8702-88a2e55d2b38 req-8dd85bd4-acb6-4685-afa9-883c1169afc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061174 Oct 04 19:18:22.806457 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3799/7573] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:22.834724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:22.845599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ebf6435-980f-4a0d-92eb-b0f7cedb0370 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1514 microversion: 2.1 time: 0.183614 Oct 04 19:18:22.846011 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3775/7574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:22 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:23.869945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:23.870567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:23.876816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.877299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.877790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.878480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.879580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.880007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:24.009812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:24.017592 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cef106a6-53a6-4e13-81d4-4c4b08ccdd9a tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1514 microversion: 2.1 time: 0.153075 Oct 04 19:18:24.018180 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3800/7575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:23 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:24.820895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:24.831181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:24.831721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:24.832835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:24.844395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Creating event network-changed:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h2-833090-21 Oct 04 19:18:24.849669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] Instance cd60578c-2a48-4875-9813-8c4fd2dec73b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:18:24.861803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-269ad470-2b66-4470-b43a-ca8e0e909448 req-0ccddadb-1804-4510-a077-460ddffa5de6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045161 Oct 04 19:18:24.862394 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3776/7576] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:25.041274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:25.041897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:25.048913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.049403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.049850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.050551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.051052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.051493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.184279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:25.192707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83096a63-db96-470a-becd-a959ce915404 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1512 microversion: 2.1 time: 0.155338 Oct 04 19:18:25.193300 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3801/7577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:25 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:26.216945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:26.217670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:26.225510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.226015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.226467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.227172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.227677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.228125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.356588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:26.364374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef353b70-9d3c-41f8-a6c9-e6b4a4792864 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1512 microversion: 2.1 time: 0.151767 Oct 04 19:18:26.364952 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3777/7578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:26 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:27.388094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.388751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:27.395277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.396297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.396742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.397453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.397908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.398338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.600786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:27.612042 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6916f4e0-6f73-42d6-97cf-02265d668b07 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1509 microversion: 2.1 time: 0.228154 Oct 04 19:18:27.616782 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3802/7579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:27 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:27.635624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.636151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:27.642759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.643504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.644221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.645177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.646370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.647050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.680567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:18:27.783216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.compute.api [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 19:18:30.069070 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-371fc836-1c58-4776-a949-7dcf72c015ec tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 204 len: 0 microversion: 2.1 time: 2.437107 Oct 04 19:18:30.069926 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3778/7580] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:18:27 2022] DELETE /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 0 bytes in 2439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:18:30.078853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:30.079497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:30.086475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.086988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.087433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.088166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.088677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.089348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.163296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "name": "network-vif-plugged", "status": "completed", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:30.175724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.176441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.177435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.188133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] Creating event network-vif-plugged:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h2-833090-21 Oct 04 19:18:30.193663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2cdffd05-53e3-4740-a8db-660a94134f71 req-309d9493-c077-46cf-a5e6-42ad4d3447cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Oct 04 19:18:30.194266 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3779/7581] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:30.233793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:30.243043 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-418c8314-35e2-4019-b0e0-407ba05963b0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1501 microversion: 2.1 time: 0.168969 Oct 04 19:18:30.245333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3803/7582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:30 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:31.269116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:31.269830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:31.276228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:31.276815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:31.277576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:31.278295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:31.278769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:31.279215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:31.407851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:31.415976 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ad81d21-b315-4b77-878e-20bfc04ec394 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1501 microversion: 2.1 time: 0.151995 Oct 04 19:18:31.416731 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3780/7583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:31 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:32.098215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60578c-2a48-4875-9813-8c4fd2dec73b", "name": "network-vif-deleted", "tag": "01929f62-2c91-4d0d-af78-4b7c7c617e97"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:32.109237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.111288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.111288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.121142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] Creating event network-vif-deleted:01929f62-2c91-4d0d-af78-4b7c7c617e97 for instance cd60578c-2a48-4875-9813-8c4fd2dec73b on n-h2-833090-21 Oct 04 19:18:32.126097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-1dbb919a-76b2-480d-abd2-98c5f7aa2525 req-1d050ab1-b407-4119-ab77-55738f222cd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Oct 04 19:18:32.126679 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3804/7584] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:32.440109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:32.440847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:32.449093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.449608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.450077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.450812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.451655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.452157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.490665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.491430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.492564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.493072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lazy-loading 'fault' on Instance uuid cd60578c-2a48-4875-9813-8c4fd2dec73b {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:18:32.554593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872162016c9470e9babc103693f3889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8262d1463ed404aa8a4b0718389825a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:32.563790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b9a97db8-9cb5-4680-a1a3-2571838c7a7c tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 200 len: 1304 microversion: 2.1 time: 0.127574 Oct 04 19:18:32.564514 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3781/7585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:32 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:33.588994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:33.589695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:33.595932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.596416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.596880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.597560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.598014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.598934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.612052 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] HTTP exception thrown: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Request method failure captured: Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b HTTP/1.1 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIbRyyfBdES34VgeuVwo9mDGxcZTbcQv554sQodzZXzHZgzaZY3j0mnOwybbkwh_Vv349CCWoL3czWqBsH-caXsFTvXB9wpbpFh-nYWKq_PNCxe1olGwtnTBY5ol_B4ZlleCgyXaA9BoFQf6kSy8xiZkV7kbWOdotgDRdDUTbTe6ydY Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8262d1463ed404aa8a4b0718389825a"}]}] Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6872162016c9470e9babc103693f3889 Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'cd60578c-2a48-4875-9813-8c4fd2dec73b'} Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.613682 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Returning 404 to user: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3431c446-216b-49a8-adcc-f7123dc741c0 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 404 len: 111 microversion: 2.1 time: 0.031832 Oct 04 19:18:33.618899 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3805/7586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:33 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:33.632240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:33.632761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:33.639743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.640250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.640709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.641423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.641898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.642348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.655550 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] HTTP exception thrown: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Request method failure captured: Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b HTTP/1.1 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIbRyyfBdES34VgeuVwo9mDGxcZTbcQv554sQodzZXzHZgzaZY3j0mnOwybbkwh_Vv349CCWoL3czWqBsH-caXsFTvXB9wpbpFh-nYWKq_PNCxe1olGwtnTBY5ol_B4ZlleCgyXaA9BoFQf6kSy8xiZkV7kbWOdotgDRdDUTbTe6ydY Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8262d1463ed404aa8a4b0718389825a"}]}] Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 6872162016c9470e9babc103693f3889 Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'cd60578c-2a48-4875-9813-8c4fd2dec73b'} Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:18:33.657250 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Returning 404 to user: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09beab1f-8671-4f39-89bb-410d6470a208 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 404 len: 111 microversion: 2.1 time: 0.030329 Oct 04 19:18:33.662115 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3782/7587] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:18:33 2022] DELETE /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:33.667843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:33.668462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] [instance: cd60578c-2a48-4875-9813-8c4fd2dec73b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:33.674383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.674864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.675301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.676020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.677133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.677562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.690970 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] HTTP exception thrown: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Request method failure captured: Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b HTTP/1.1 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIbRyyfBdES34VgeuVwo9mDGxcZTbcQv554sQodzZXzHZgzaZY3j0mnOwybbkwh_Vv349CCWoL3czWqBsH-caXsFTvXB9wpbpFh-nYWKq_PNCxe1olGwtnTBY5ol_B4ZlleCgyXaA9BoFQf6kSy8xiZkV7kbWOdotgDRdDUTbTe6ydY Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8262d1463ed404aa8a4b0718389825a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8262d1463ed404aa8a4b0718389825a"}]}] Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: c8262d1463ed404aa8a4b0718389825a Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-DeleteServersTestJSON-1018125327 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 6872162016c9470e9babc103693f3889 Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-DeleteServersTestJSON-1018125327-project Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'cd60578c-2a48-4875-9813-8c4fd2dec73b'} Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:18:33.692517 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] Returning 404 to user: Instance cd60578c-2a48-4875-9813-8c4fd2dec73b could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-71e1a72f-15d0-4711-a002-55a03bd12974 tempest-DeleteServersTestJSON-1018125327 tempest-DeleteServersTestJSON-1018125327-project] 10.222.0.40 "GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b" status: 404 len: 111 microversion: 2.1 time: 0.030186 Oct 04 19:18:33.696874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3806/7588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:33 2022] GET /compute/v2.1/servers/cd60578c-2a48-4875-9813-8c4fd2dec73b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:18:43.931392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:43.932415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:44.059720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-472416360", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bc9d9dff-281d-4015-a56c-789a0ecd0f02"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:44.117389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] validate_networks() for [('bc9d9dff-281d-4015-a56c-789a0ecd0f02', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:18:44.515385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:18:44.515931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:18:44.516495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:18:44.516995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:18:44.517552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:18:44.527654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:44.528163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:44.528747 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:44.529503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:44.529979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:44.530425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:44.548547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for project 337f7766a0584a1c99d477257d21a16d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:18:44.554127 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for user e82e9713de8940ef97dca0fc77076b65 and project 337f7766a0584a1c99d477257d21a16d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:18:44.567216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:18:44.569626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:18:44.689089 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ebd2bf1-6647-4c5a-9061-3ada61e8de68 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764086 Oct 04 19:18:44.689853 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3783/7589] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:18:44.701765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5b8d0cd-7449-4384-99e7-e5b25fbc00ca tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:44.702831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5b8d0cd-7449-4384-99e7-e5b25fbc00ca tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:44.710385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=19 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:44.711114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=57 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:44.776931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5b8d0cd-7449-4384-99e7-e5b25fbc00ca tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:44.784549 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5b8d0cd-7449-4384-99e7-e5b25fbc00ca tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1217 microversion: 2.1 time: 0.087067 Oct 04 19:18:44.785369 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3807/7590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:44 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:45.808722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20e8a720-c455-4814-b7a3-8608a45cd90e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:45.809743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20e8a720-c455-4814-b7a3-8608a45cd90e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:45.874665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20e8a720-c455-4814-b7a3-8608a45cd90e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:45.874665 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20e8a720-c455-4814-b7a3-8608a45cd90e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1217 microversion: 2.1 time: 0.069305 Oct 04 19:18:45.874665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3784/7591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:45 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:46.897964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:46.899164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:46.906786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.907632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.908073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.908948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.909552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.910124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.973249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:46.986280 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-78426c9e-1e8d-42ea-8c28-b3b799d1c6d9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1269 microversion: 2.1 time: 0.092607 Oct 04 19:18:46.991600 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3808/7592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:46 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:48.010553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:48.011203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:48.018540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.019051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.019539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.020999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.021491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.021948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.159988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:48.170600 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-683d62e6-e115-4e5a-83ef-089037f05b90 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.164267 Oct 04 19:18:48.171197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3785/7593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:48 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:49.147696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:49.159173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.159799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.160230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.171984 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] Creating event network-changed:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h2-833090-21 Oct 04 19:18:49.177613 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-068bb678-f11b-4f17-bdbd-94dfce6420e1 req-c97bfdb4-ba35-4161-adfd-74bcda0b823d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033755 Oct 04 19:18:49.178229 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3809/7594] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:18:49.192996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:49.193625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:49.200756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.203239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.203239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.203239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.203239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.203239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.333346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:49.341416 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5147c76f-801e-4c5d-ab91-8616e61ba769 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.152457 Oct 04 19:18:49.342013 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3786/7595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:49 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:50.366723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:50.367412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:50.373586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:50.374061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:50.374492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:50.375168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:50.375691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:50.376113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:50.507910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:50.515561 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ef39cb66-2ec2-4aae-adf4-602091774c82 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.154205 Oct 04 19:18:50.516145 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3810/7596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:50 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:51.539300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:51.539960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:51.547091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.547626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.548081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.548783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.549252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.549691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.675815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:51.683959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-417b0dc6-cee7-4275-969b-55dc7d8f11b5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.149042 Oct 04 19:18:51.684537 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3787/7597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:51 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:52.706775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:52.707309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:52.714380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:52.714863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:52.715302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:52.716029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:52.716484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:52.716909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:52.844724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:52.852803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5a249d00-2fa1-4006-8092-87ad397f84ce tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.149986 Oct 04 19:18:52.853398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3811/7598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:52 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:53.876382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:53.877017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:53.884639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:53.885141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:53.885596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:53.886303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:53.886774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:53.887268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.028296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:54.036557 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82a1303d-22b9-45fd-9230-0b8f7ec89a80 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.164196 Oct 04 19:18:54.037149 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3788/7599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:53 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:54.133306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "name": "network-vif-plugged", "status": "completed", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:54.143670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:54.145110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:54.145110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:54.155738 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] Creating event network-vif-plugged:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h2-833090-21 Oct 04 19:18:54.160711 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-bc3b35e2-0398-4eec-84ca-3cf066a0129d req-f96a2267-6640-4396-95c3-f8277d78c690 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031679 Oct 04 19:18:54.161306 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3812/7600] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:55.060227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:55.060857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:55.062790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:55.068432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:55.068928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:55.069383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.070083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:55.070552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:55.070998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:55.248363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:55.256453 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ed0ac276-d875-4c9d-aafc-77184c73219f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1317 microversion: 2.1 time: 0.200150 Oct 04 19:18:55.257026 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3789/7601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:55 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:56.277338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:56.282267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.282975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:56.289921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.290403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.290843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.291561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.292021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.292451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.472854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:56.481284 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12d9f7e0-7b03-4ddd-a370-dc9509f6fafa tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1507 microversion: 2.1 time: 0.205072 Oct 04 19:18:56.481871 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3813/7602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:56.503480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.504149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:56.505997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:56.511725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.513167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.523165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.523165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.523165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.523165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.649077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:56.657043 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-43756007-554d-4563-a9fb-c8ea0486ba4c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1507 microversion: 2.1 time: 0.157396 Oct 04 19:18:56.657635 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3790/7603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:56.680186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:56.682662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:56.688923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.689398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.689837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.690533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.690993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.691424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.814777 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-952e9f12-2e7d-41cc-84b4-b06cc06c2339 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "PUT /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1079 microversion: 2.1 time: 0.138669 Oct 04 19:18:56.815459 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3814/7604] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 4 19:18:56 2022] PUT /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1079 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:56.841454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:56.841454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:56.842344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.842847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.843305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.844039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:56.844512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:56.844961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:56.976347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:56.984302 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b6c866e9-407e-484f-a9b5-a649edaf3717 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1505 microversion: 2.1 time: 0.153621 Oct 04 19:18:56.984909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3791/7605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:56 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:57.007296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:57.007980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:57.014151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.014639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.015089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.015816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.016278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.016706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.148769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:57.156570 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c7d43e7-ab63-420f-9e25-23f3c2938546 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1505 microversion: 2.1 time: 0.153705 Oct 04 19:18:57.157140 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3815/7606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:57 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:57.179524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:57.181906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:57.188213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.188722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.189179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.189919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.190417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.190862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.219432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:57.224903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:18:57.231227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:18:57.231702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:18:57.232194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:18:57.232620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:18:57.233045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:18:57.431755 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5bc154a6-5a94-4cbc-9f86-747c94f80a8c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2/action" status: 202 len: 0 microversion: 2.1 time: 0.256504 Oct 04 19:18:57.432285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3792/7607] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:18:57 2022] POST /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:57.440432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:57.441103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:57.447059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.447585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.448129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.448806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:57.449264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:57.449692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:57.581156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:57.588984 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be0c501d-0a2f-4a47-a461-d58216071254 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1516 microversion: 2.1 time: 0.152459 Oct 04 19:18:57.589565 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3816/7608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:57 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:58.614275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:58.614830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:58.622091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:58.622594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:58.623046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:58.623780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:58.624254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:58.624698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:58.756717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:58.764002 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c68d7b90-d1d1-4f4b-890b-920a1fde0a9e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1516 microversion: 2.1 time: 0.155123 Oct 04 19:18:58.764588 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3793/7609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:58 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:59.787512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:59.788145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:59.795116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:59.795673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:59.796124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:59.796822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:59.797280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:59.797714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:59.934563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:59.943026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f2e0380e-5134-4047-aae8-b7623b80363a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1516 microversion: 2.1 time: 0.159651 Oct 04 19:18:59.943628 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3817/7610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:59 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:00.966332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:00.966924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:00.974533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:00.975026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:00.975462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:00.976185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:00.976959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:00.977681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:01.113995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:01.122011 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-950b0971-6ae3-429b-b9e5-b9b4305bfc04 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.159556 Oct 04 19:19:01.122594 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3794/7611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:00 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:02.147128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:02.147758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:02.154874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:02.155353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:02.155825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:02.156508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:02.156956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:02.157380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:02.286103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:02.293777 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50ba3d6f-7248-4391-8f29-98225707a089 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.150625 Oct 04 19:19:02.294359 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3818/7612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:02 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:03.316399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:03.317609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:03.324856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:03.325356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:03.325824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:03.326538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:03.327012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:03.327455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:03.455273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:03.462923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fafbb4e0-d0e6-4187-b4b4-801ef16c5ef8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.150574 Oct 04 19:19:03.463516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3795/7613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:03 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:04.486814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:04.487434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:04.495275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:04.495799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:04.496241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:04.496932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:04.497390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:04.497820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:04.628181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:04.635938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb7f3b6d-84cf-41ea-ac2d-a660032797e6 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.152979 Oct 04 19:19:04.636517 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3819/7614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:04 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:05.659335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:05.660013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:05.667617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:05.668123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:05.668583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:05.669299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:05.669774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:05.670221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:05.800570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:05.808405 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13c1901a-47c5-41a7-a2e6-1303b5834804 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.153086 Oct 04 19:19:05.808983 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3796/7615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:05 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:06.832643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:06.833251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:06.840555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:06.841069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:06.841540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:06.842239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:06.842701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:06.843128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:06.973675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:06.981395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9fe68b3-324d-4141-a335-689369c4316b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.153161 Oct 04 19:19:06.981982 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3820/7616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:06 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:08.005650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:08.006400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:08.013448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:08.013945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:08.014393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:08.015091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:08.015583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:08.016024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:08.145317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:08.153035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c3bd0c4-1271-4dbd-a721-bf361397aceb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.151447 Oct 04 19:19:08.153602 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3797/7617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:08 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:09.177653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:09.178267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:09.185197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:09.185683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:09.186126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:09.186822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:09.187279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:09.187735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:09.318562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:09.326942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-348b5817-f28f-4d72-9359-1eb307b55acc tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.154038 Oct 04 19:19:09.327540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3821/7618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:09 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:10.367804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:10.368462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:10.375346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:10.375874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:10.376331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:10.377028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:10.377496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:10.377988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:10.511324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:10.521642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b13a53a6-4ad9-443f-9a0d-fdcd3829ea25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.158818 Oct 04 19:19:10.522223 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3798/7619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:10 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:11.549075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:11.549693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:11.557156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.557640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.558086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.558779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:11.559233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:11.559693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:11.688042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:11.695817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-be5c8a9b-3f4f-4be9-b0f5-2bea924ec1b1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.150672 Oct 04 19:19:11.696441 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3822/7620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:11 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:12.719148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:12.719802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:12.727304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:12.727861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:12.728315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:12.729016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:12.729488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:12.729924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:12.860262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:12.863710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:12.868735 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7eed5fe6-4506-4881-bba9-81b7d4ff4c8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.153593 Oct 04 19:19:12.869320 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3799/7621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:12 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:13.892762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:13.893395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:13.900311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:13.900802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:13.901295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:13.901980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:13.902437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:13.902864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:14.034344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:14.042174 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6e231920-8b11-40f5-82d7-6de29a897e73 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.153489 Oct 04 19:19:14.042752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3823/7622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:13 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:15.065571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:15.066194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:15.069899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:15.074874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:15.075371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:15.084084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:15.084084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:15.084084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:15.084084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:15.215451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:15.223684 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99b5e282-eb90-43e7-a330-cf522c080bf3 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.161848 Oct 04 19:19:15.224524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3800/7623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:15 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:16.250906 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:16.251548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:16.254269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:16.259562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:16.260049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:16.260489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.261184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:16.261642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:16.262072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:16.266109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:16.395285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:16.403508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37d1b17f-98c6-43ab-af86-0e5a3913d2c4 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.156512 Oct 04 19:19:16.404086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3824/7624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:16 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:17.426903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:17.427483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:17.435195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:17.435715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:17.436161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:17.436858 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:17.437322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:17.437759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:17.568156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:17.576446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f49008d8-2b25-4c49-b87c-a2214f02ee8e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1521 microversion: 2.1 time: 0.153527 Oct 04 19:19:17.577031 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3801/7625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:17 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:18.513147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "name": "network-vif-unplugged", "status": "completed", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:18.523408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.523919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.524350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.535967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Creating event network-vif-unplugged:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h1-833090-21 Oct 04 19:19:18.541790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:19:18.552488 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-fe6172bf-8ff5-4801-b684-812130b18c0c req-f68080da-8a1c-4b80-9339-3817863174ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043231 Oct 04 19:19:18.553078 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3825/7626] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:18.599683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:18.600439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:18.607930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.608425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.608868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.609569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:18.610034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:18.610506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:18.840120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:18.848076 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b0e0891-abc5-4732-a385-d0f34e84acb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1520 microversion: 2.1 time: 0.252331 Oct 04 19:19:18.854301 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3802/7627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:18 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:19.873295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:19.874019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:19.880520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:19.881004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:19.881451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:19.882150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:19.882602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:19.883032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.019308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:20.028016 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f309ecc7-6b44-4e53-ab99-605a7c37d5ac tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1520 microversion: 2.1 time: 0.159781 Oct 04 19:19:20.028614 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3826/7628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:19 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:20.619820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:20.629087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:20.629578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:20.630019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:20.641330 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Creating event network-changed:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h1-833090-21 Oct 04 19:19:20.646503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:19:20.657014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-493c7c5d-8687-4241-9497-3372e517fb65 req-32b1ee48-fa98-4db9-9115-35c45c14801c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093506 Oct 04 19:19:20.657585 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3803/7629] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:19:21.050642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:21.051259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:21.058161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.058675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.059115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:21.059841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:21.060304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:21.060760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:21.242545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:21.251190 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28ac895b-808b-4afc-958a-4158f54c7956 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1518 microversion: 2.1 time: 0.204367 Oct 04 19:19:21.251803 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3827/7630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:21 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:22.275853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:22.276495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:22.282875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.283378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.283861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.284572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.285051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.285497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.417734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:22.425516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25fa15c8-04d8-4207-b0d7-1f9439acb93d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1515 microversion: 2.1 time: 0.154917 Oct 04 19:19:22.426131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3804/7631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:22 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:22.448421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:22.449117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:22.456059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.456640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.457151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.457911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.458443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.458948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.650378 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e9e5585-9ee3-4355-a89f-cc62563a895c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2/action" status: 204 len: 0 microversion: 2.1 time: 0.205699 Oct 04 19:19:22.650966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3828/7632] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:19:22 2022] POST /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2/action => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:19:22.659229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:22.660162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:22.667354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.667883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.668336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.669054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:22.669628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:22.670072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:22.808034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:22.817751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ff8438b-d13f-4a16-b236-d8e2fac67436 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1515 microversion: 2.1 time: 0.162324 Oct 04 19:19:22.818686 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3805/7633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:22 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:23.842196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:23.842938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:23.849590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:23.852632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:23.852632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:23.852632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:23.852632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:23.853062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:23.992650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:24.000545 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f38612b1-65be-4b18-b00e-24c2068d8d9b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1515 microversion: 2.1 time: 0.163295 Oct 04 19:19:24.001080 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3829/7634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:23 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:25.023957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:25.024727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:25.031717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.032222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.032679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.033388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.033860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.034307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.169949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:25.177774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4edbfb65-859b-4e08-b2c3-38dfc49f22e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1507 microversion: 2.1 time: 0.157751 Oct 04 19:19:25.178351 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3806/7635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:25 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:25.200572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:25.201187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:25.208039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.208524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.208963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.209654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:25.210110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:25.210536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:25.340161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:25.347957 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a19290e-81ec-4297-aab6-1fbdf72cd531 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1507 microversion: 2.1 time: 0.151221 Oct 04 19:19:25.348533 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3830/7636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:25 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:25.374521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5445ac27-c2f1-4829-b441-ca62ccf516bf tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'create', calling method: .version_select at 0x7f9008091a60>, body: {"keypair": {"name": "tempest-keypair-1365582293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr16+xnsNks7mtjERIuhGcEVDGlSjDqOhzbL+kyMrnXX0lDwK/pD4CsOUNwnxS9arqFR2giZqk1YYEfetYF/yQP92KUfJu1TYhC+lhsk2zYtRwfDyGJuKP5d3gn48+WGg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:25.390190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5445ac27-c2f1-4829-b441-ca62ccf516bf tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for project 337f7766a0584a1c99d477257d21a16d. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:25.395341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5445ac27-c2f1-4829-b441-ca62ccf516bf tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for user e82e9713de8940ef97dca0fc77076b65 and project 337f7766a0584a1c99d477257d21a16d. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:25.485543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5445ac27-c2f1-4829-b441-ca62ccf516bf tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114856 Oct 04 19:19:25.486160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3807/7637] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:19:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:19:26.385135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "name": "network-vif-plugged", "status": "completed", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:26.394927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:26.399981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:26.399981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:26.407420 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] Creating event network-vif-plugged:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h1-833090-21 Oct 04 19:19:26.412488 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7674a78a-3871-44a0-8383-16a8009cbc70 req-82808ba9-ee1d-46d5-aa39-b24aa836a306 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094276 Oct 04 19:19:26.413570 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3831/7638] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:27.518871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:27.519515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:27.529552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.530076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.530523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:27.531219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.531713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.532153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:27.932967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:27.941028 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b2055ed-58d0-48f5-8574-79bb2111c10c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 200 len: 1507 microversion: 2.1 time: 0.427221 Oct 04 19:19:27.941596 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3808/7639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:27 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:27.967190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:27.967818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:27.974151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.974634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.975070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:27.975775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:27.976224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:27.976668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:28.044120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:19:28.346785 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5ee30bb3-2028-4bb5-996f-1e9e8a5cdafb tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 204 len: 0 microversion: 2.1 time: 0.384462 Oct 04 19:19:28.347544 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3832/7640] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:19:27 2022] DELETE /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:19:28.406228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1572886442", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "bc9d9dff-281d-4015-a56c-789a0ecd0f02"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:28.458641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] validate_networks() for [('bc9d9dff-281d-4015-a56c-789a0ecd0f02', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:19:28.820150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:19:28.821243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:19:28.821628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:19:28.822061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:19:28.822491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:19:28.831457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:28.831989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:28.832452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:28.833196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:28.833672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:28.834119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:28.851431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for project 337f7766a0584a1c99d477257d21a16d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:19:28.856834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Getting quotas for user e82e9713de8940ef97dca0fc77076b65 and project 337f7766a0584a1c99d477257d21a16d. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:19:28.871887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:19:28.874171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:19:29.017772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7c39ce70-9408-4b93-a3d5-4832b0a5295f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615330 Oct 04 19:19:29.018419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3809/7641] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:19:29.031392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73bee792-6c99-42d8-bb21-c2a17ca5a907 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:29.032216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73bee792-6c99-42d8-bb21-c2a17ca5a907 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:29.087642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73bee792-6c99-42d8-bb21-c2a17ca5a907 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:29.095438 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73bee792-6c99-42d8-bb21-c2a17ca5a907 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1218 microversion: 2.1 time: 0.068684 Oct 04 19:19:29.096033 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3833/7642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:29 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:30.120042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:30.120820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:30.127455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:30.128233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:30.128709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:30.129414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:30.130013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:30.130467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:30.224403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:30.230337 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb635587-bee4-463c-b58f-e4a4460f1047 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1222 microversion: 2.1 time: 0.115833 Oct 04 19:19:30.231100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3810/7643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:30 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:30.416674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf5ef8f-7c46-435d-8d88-16159de8f3d2", "name": "network-vif-deleted", "tag": "3a84920d-1364-4b0b-be3a-345b5e09f819"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:30.429951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:30.430464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:30.430892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:30.443025 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] Creating event network-vif-deleted:3a84920d-1364-4b0b-be3a-345b5e09f819 for instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 on n-h1-833090-21 Oct 04 19:19:30.448746 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4ec9b8ae-8ff6-4c59-bdf7-38ea029e6c62 req-8d383a24-fdd0-44b4-9bb9-5e4ad536daab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035800 Oct 04 19:19:30.449736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3834/7644] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:31.255007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:31.255668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:31.262605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.263109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.263591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.264305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:31.264776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:31.265218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:31.328781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:31.336648 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4286a440-28fb-41ee-b3e3-19cea4b50db7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1270 microversion: 2.1 time: 0.086495 Oct 04 19:19:31.337228 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3811/7645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:31 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:32.362294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:32.362921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:32.369989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:32.370475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:32.370909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:32.371643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:32.372100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:32.372526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:32.568376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:32.576066 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-267f33e5-16d8-486c-8128-870830e1551f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.219139 Oct 04 19:19:32.576688 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3835/7646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:32 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:33.124503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:33.134310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.134898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.135375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.146124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] Creating event network-changed:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h2-833090-21 Oct 04 19:19:33.151428 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9f08808d-7d25-4f93-9b06-86280e67f830 req-7300684b-22cf-4e93-b1d2-92a0f8af856c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089361 Oct 04 19:19:33.152038 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3812/7647] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:19:33.599596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:33.600141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:33.607424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.607943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.608354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.609028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:33.609473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:33.609891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:33.740404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:33.748111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-df242ab7-a0e0-46d1-87dc-dd7e08070795 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.152605 Oct 04 19:19:33.748683 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3836/7648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:33 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:34.771481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:34.772215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:34.778463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.778970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.779436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.780165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:34.780643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:34.781092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:34.908973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:34.917268 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5b9f591-7abc-480a-bda4-7a5248adbf08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.150923 Oct 04 19:19:34.917839 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3813/7649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:34 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:35.945873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:35.945873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:35.949413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:35.949927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:35.950371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:35.951067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:35.951549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:35.951976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:36.463438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:36.471675 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b97a82d6-fba8-420f-be4c-95f3ff19625c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.534375 Oct 04 19:19:36.472271 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3837/7650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:35 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:37.496540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:37.497185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:37.504540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:37.505051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:37.505511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:37.506232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:37.506715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:37.507165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:37.647086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:37.654924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c4eae18-cc9c-4dcf-8ffa-4bc7f973e773 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.162820 Oct 04 19:19:37.655527 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3814/7651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:37 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:38.378017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "name": "network-vif-plugged", "status": "completed", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:38.388382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:38.388854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:38.389278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:38.400623 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] Creating event network-vif-plugged:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h2-833090-21 Oct 04 19:19:38.405513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e65e3e0e-6d1c-42d1-a91e-a9ebf2d3529b req-559447cb-0d6e-4af2-ad49-fd5947de40b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031258 Oct 04 19:19:38.406087 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3838/7652] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:19:38.677849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:38.678487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:38.685466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:38.685967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:38.686422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:38.687126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:38.687629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:38.688085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:38.815133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:38.823239 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-53a2285c-01f9-45dd-8ffd-cbdf11118d42 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.149265 Oct 04 19:19:38.823851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3815/7653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:38 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:39.844188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:39.849224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:39.849991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:39.856103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.856578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.857013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.857687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:39.858136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:39.858574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:39.990852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:40.000026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ad3c3263-7b81-426a-bfac-49a4d071b89a tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1318 microversion: 2.1 time: 0.156765 Oct 04 19:19:40.000619 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3839/7654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:39 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:41.023818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:41.025050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:41.027198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.027930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=10 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.033874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.034381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.034838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.035658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.036136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.036584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.170517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:41.178204 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63acf530-9512-4fc4-9b1f-2bc680473407 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1508 microversion: 2.1 time: 0.158406 Oct 04 19:19:41.178770 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3816/7655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:41 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:41.207392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:41.208036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:41.214825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.215300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.215767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.216449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.216897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.217314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.346772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:41.354537 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83892ee0-4fba-4f24-aa15-5bfd8f874df1 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1508 microversion: 2.1 time: 0.151101 Oct 04 19:19:41.355123 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3840/7656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:41 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:41.378393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:19:41.380805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:41.387596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.388101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.388560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.389269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.389746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.390258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.417834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:41.423264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:19:41.429874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:19:41.430882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:19:41.431377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:19:41.431829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:19:41.432259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:19:41.563663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.678375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff9858ae-0669-44ca-9e47-8d9d89a4c64b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253/action" status: 202 len: 0 microversion: 2.1 time: 0.303982 Oct 04 19:19:41.678993 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3817/7657] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:19:41 2022] POST /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:19:41.688008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:41.688763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:41.694976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.695486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.695990 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.696696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:41.697156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:41.697767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:41.702013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:41.826120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:41.834053 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49539adf-b6b1-4763-b06b-8247487daced tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1515 microversion: 2.1 time: 0.150282 Oct 04 19:19:41.834612 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3841/7658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:41 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:42.858796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:42.859426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:42.866572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.867074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.868056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:42.868772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:42.869307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:42.869695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:43.004224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:43.012290 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2f85f497-77c4-4830-811d-815e8cf52113 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1515 microversion: 2.1 time: 0.159030 Oct 04 19:19:43.012896 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3818/7659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:42 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:44.036345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:44.037273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:44.045662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.046224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.046847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.047595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:44.048054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:44.048489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:44.256669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:44.265101 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73ff21cc-5e07-436e-82d8-6716f1f6dbd7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1515 microversion: 2.1 time: 0.232686 Oct 04 19:19:44.265683 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3842/7660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:44 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:45.288806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:45.289352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:45.292693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:45.297557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.298051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.298576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.299307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:45.299830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:45.300323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:45.434113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:45.441892 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-87d47e8b-25e8-4e3e-b0e0-d00c993cc38e tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.157138 Oct 04 19:19:45.442457 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3819/7661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:45 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:46.466396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:46.467012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:46.469822 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:19:46.469957 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:19:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 (ip 10.222.0.40) !!! Oct 04 19:19:46.471327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:19:46.477280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.477765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.478206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.478897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:46.479938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:46.480370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:46.614054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:46.622057 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ec7823a9-7b12-4b54-bca5-3ec2005dd477 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.160090 Oct 04 19:19:46.622645 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3843/7662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:46 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:47.646974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:47.647642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:47.655423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.655957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.656418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:47.657130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:47.657611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:47.658061 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:47.791443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:47.799228 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4dab4968-cb1d-45fd-a649-9165600e1348 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.156229 Oct 04 19:19:47.799831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3820/7663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:47 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:48.822759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:48.823414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:48.830623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.831108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.831578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.832332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:48.832791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:48.833256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:48.964718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:48.973269 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d531c141-0d14-4935-b61c-c1c7d26e627b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.154611 Oct 04 19:19:48.973935 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3844/7664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:48 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:49.999672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:50.000307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:50.007246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.007776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.008236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.008944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:50.009455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:50.009897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:50.141441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:50.149224 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c67b5989-8f9c-4602-b23e-a805c5c3d1b0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.153568 Oct 04 19:19:50.149805 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3821/7665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:49 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:51.173607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:51.174245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:51.181333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.181818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.182767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.183460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:51.183937 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:51.184400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:51.312235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:51.319980 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c32f765-bc2d-47d6-9660-e74b10bb5872 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.150366 Oct 04 19:19:51.320555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3845/7666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:51 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:52.345216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:52.345768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:52.352797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:52.353301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:52.353754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:52.355146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:52.355649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:52.356099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:52.486504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:52.494514 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8e6e52d0-12dd-4c25-9f9a-35033b65305f tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.153343 Oct 04 19:19:52.495093 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3822/7667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:52 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:53.517673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:53.518288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:53.525151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:53.525633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:53.528068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:53.528068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:53.528068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:53.528377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:53.660753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:53.668893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-08cdc26b-cf90-4aff-a116-0f5ab89d0ca5 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.155089 Oct 04 19:19:53.669483 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3846/7668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:53 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:54.692399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:54.693116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:54.700080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:54.700583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:54.701042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:54.701758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:54.702234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:54.702680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:54.831720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:54.840083 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a9ebcb9-94ed-4c09-b81d-9b158b562f08 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.151680 Oct 04 19:19:54.840665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3823/7669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:54 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:55.863793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:55.864589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:55.872051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.872532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.872963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:55.873649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:55.874101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:55.874519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:56.022511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:56.030726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c13c780a-eaa4-4d56-9733-6ed2be23e6ab tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.170900 Oct 04 19:19:56.031314 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3847/7670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:55 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:19:57.054241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:57.054878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:57.062014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.062522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.062988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.063743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:57.064221 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:57.064671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:57.192515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:57.200752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f8ac2439-ecaf-4f89-bc90-12c93038bd20 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.150462 Oct 04 19:19:57.201323 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3824/7671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:57 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:58.224675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:58.225300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:58.232332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:58.232820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:58.233257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:58.233940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:58.234394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:58.234820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:58.369173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:58.376926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f854a63c-d03c-4f5b-9d0e-a1767c67442d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.156321 Oct 04 19:19:58.377511 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3848/7672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:58 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:19:59.400222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:19:59.400849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:19:59.407750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:59.408241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:59.408696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:59.409396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:19:59.409863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:19:59.410304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:19:59.540159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:19:59.548328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ab57258-226e-4972-9d91-a56ab27bc999 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.151958 Oct 04 19:19:59.548898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3825/7673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:19:59 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:00.573795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:00.574619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:00.584364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:00.584856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:00.585299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:00.586105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:00.586782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:00.587292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:00.716138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:00.723916 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-713575bd-83d9-4a92-98e0-f150b0463b25 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1520 microversion: 2.1 time: 0.156164 Oct 04 19:20:00.724498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3849/7674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:00 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:01.747810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:01.748444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:01.755045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:01.755573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:01.756029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:01.756735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:01.757209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:01.757651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:01.977487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:01.985750 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-40c1a1f6-cea3-47eb-aa14-073128be8cb8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1519 microversion: 2.1 time: 0.241846 Oct 04 19:20:01.986345 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3826/7675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:01 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:02.264117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "name": "network-vif-unplugged", "status": "completed", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:02.274406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:02.274887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:02.275352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:02.286971 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Creating event network-vif-unplugged:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h1-833090-21 Oct 04 19:20:02.298323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] Instance 9dc7761b-0026-4920-a2c6-d01624bca253 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:20:02.303124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0969dfd4-e48c-40d9-a03d-8a39ecd31db8 req-dc956986-77ec-4375-83d8-26f2f2543041 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043449 Oct 04 19:20:02.303788 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3850/7676] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:03.009843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:03.010473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:03.017779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:03.018321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:03.018778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:03.019516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:03.020043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:03.022913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:03.241190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:03.249540 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49ac9a25-0eb2-4a8c-960a-b26373c19e57 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1519 microversion: 2.1 time: 0.243781 Oct 04 19:20:03.250339 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3827/7677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:03 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:04.274095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:04.274837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:04.281674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:04.282098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:04.282535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:04.283221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:04.283702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:04.284127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:04.317914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:04.328962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:04.329468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:04.329925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:04.342147 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Creating event network-changed:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h1-833090-21 Oct 04 19:20:04.347816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] Instance 9dc7761b-0026-4920-a2c6-d01624bca253 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:20:04.358959 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-51d1a3d6-5bc5-497b-9ae9-9da39d379499 req-dc2a0420-69c0-4dba-932a-98b0170a5b74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044716 Oct 04 19:20:04.359605 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3828/7678] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:04.430440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:04.438629 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1c8c24b0-e83f-4fc2-9305-1ceeac1652d0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1517 microversion: 2.1 time: 0.169650 Oct 04 19:20:04.439208 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3851/7679] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:04 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:05.462956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:05.463887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:05.471154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.471708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.472168 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.472888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.473364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.473814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.612511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:05.615048 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d106546a-f1b8-4be4-be08-92000a25aa1b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1514 microversion: 2.1 time: 0.156450 Oct 04 19:20:05.615663 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3829/7680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:05 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:05.638434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:05.638973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:05.645762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.646238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.646669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.647347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.647828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.648247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.802707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbdc6473-870c-433c-af81-03ac78d06695 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "POST /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253/action" status: 204 len: 0 microversion: 2.1 time: 0.167987 Oct 04 19:20:05.803309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3852/7681] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:20:05 2022] POST /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253/action => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:05.812349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:05.813141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:05.819236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.819768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.820226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.820940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:05.821502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:05.821955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:05.952432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:05.960567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35d77a6a-2e8e-46c8-a107-bf7cd5136119 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1514 microversion: 2.1 time: 0.153049 Oct 04 19:20:05.961155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3830/7682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:05 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:06.986483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:06.987160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:06.993632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:06.994140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:06.994574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:06.995303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:06.995787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:06.996216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.130940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:07.138877 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9292fccf-77f9-4576-8732-8006cb740828 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1514 microversion: 2.1 time: 0.158103 Oct 04 19:20:07.139460 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3853/7683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:06 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:08.162261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:08.162890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:08.170439 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.170938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.171695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.172413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.172889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.173333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.305824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:08.314064 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5e8c5406-1b2d-47b9-a6ca-ed3874560b19 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1506 microversion: 2.1 time: 0.155879 Oct 04 19:20:08.314650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3831/7684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:08 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:08.338446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:08.339050 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:08.345957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.346432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.346860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.347558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.348008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.348425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.476273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:08.485296 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9c2c680-d759-48cd-80b9-37f4dc0ee3d7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1506 microversion: 2.1 time: 0.150654 Oct 04 19:20:08.485605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "name": "network-vif-plugged", "status": "completed", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:08.497726 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3854/7685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:08 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:08.498540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.498540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.498540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.508476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:08.509558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] Creating event network-vif-plugged:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h1-833090-21 Oct 04 19:20:08.509686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:08.514285 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-531ae0c1-450d-4086-992c-1da6e3e8bd9d req-9f197a62-fe05-4333-97cf-f11fd9daa9fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Oct 04 19:20:08.514883 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3832/7686] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:08.516598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.517289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.517923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.518718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.519176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.519643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.652936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:08.660663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70f28958-0c9c-45f4-8ec3-b1ca64fd9add tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1506 microversion: 2.1 time: 0.156005 Oct 04 19:20:08.661251 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3855/7687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:08 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:08.683614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:08.684215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:08.690973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.691493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.691954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.692654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:08.693117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:08.693553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.720245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:20:08.866481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:09.044643 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d02a479f-44b3-47e5-981f-534035c8a1b8 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 204 len: 0 microversion: 2.1 time: 0.364762 Oct 04 19:20:09.045803 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3833/7688] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:08 2022] DELETE /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:09.063405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:09.063969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:09.069866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.070342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.070768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.071442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.071912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.072330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.097097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:20:09.111381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:09.141904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.compute.api [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Instance is already in deleting state, ignoring this request Oct 04 19:20:09.142343 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58186406-d12c-4b27-907a-f62d1395b08c tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 204 len: 0 microversion: 2.1 time: 0.082889 Oct 04 19:20:09.142896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3856/7689] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:09 2022] DELETE /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:09.151402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:09.152144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:09.159128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.159653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.160102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.160804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.161335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.161772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.288400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:09.297311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-786f44dc-ed33-4c7b-b704-b2290acf3eb0 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1512 microversion: 2.1 time: 0.149940 Oct 04 19:20:09.297902 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3834/7690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:09 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:10.320825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:10.321442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:10.328912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.329408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.329849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.330552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.331207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.331980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.465334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:10.473834 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7897834e-e522-4675-940b-d901f04635e9 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1512 microversion: 2.1 time: 0.157225 Oct 04 19:20:10.474437 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3857/7691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:10 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:11.303559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc7761b-0026-4920-a2c6-d01624bca253", "name": "network-vif-deleted", "tag": "86e014e2-fa27-4f87-b7f7-4435be599132"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:11.314718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.315339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.320614 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.328591 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] Creating event network-vif-deleted:86e014e2-fa27-4f87-b7f7-4435be599132 for instance 9dc7761b-0026-4920-a2c6-d01624bca253 on n-h1-833090-21 Oct 04 19:20:11.333877 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-73f8dcb8-7cee-472e-934a-cb2cf2572b45 req-eb41bbb4-8e57-445d-985a-9e415b07ac4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038080 Oct 04 19:20:11.334678 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3835/7692] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:11.499091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:11.499679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:11.506646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.507081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.507546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.508244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.508710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.509138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.572803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82e9713de8940ef97dca0fc77076b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f7766a0584a1c99d477257d21a16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:11.580698 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f1d4eda9-3bca-4df7-8a41-824e7afda7fe tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 200 len: 1301 microversion: 2.1 time: 0.086334 Oct 04 19:20:11.581274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3858/7693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:11 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:12.605531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:12.606165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: 9dc7761b-0026-4920-a2c6-d01624bca253] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:12.612421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.619982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.619982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.619982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.619982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.619982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.629335 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] HTTP exception thrown: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Request method failure captured: Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 HTTP/1.1 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIcTyNAYIV0I0oUpwXICnWJkshqd2xzDsnPJwJ83-pLH4hD3CY3teRqjKwKOrIvZAlUAPw7uyzFlXnZe7uGcIZMGR7_G0awuWA-BCMr6JKjZyCyKOQpM3ECpKQd1KETp43XNMZQt5c74JS6qjdaswl1CZD-hrNSUozPLDTS0bfwsbtA Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337f7766a0584a1c99d477257d21a16d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337f7766a0584a1c99d477257d21a16d"}]}] Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e82e9713de8940ef97dca0fc77076b65 Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9dc7761b-0026-4920-a2c6-d01624bca253'} Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:12.631157 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Returning 404 to user: Instance 9dc7761b-0026-4920-a2c6-d01624bca253 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7821e66-c3f6-4386-953e-7f280b173e1d tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253" status: 404 len: 111 microversion: 2.1 time: 0.032344 Oct 04 19:20:12.635752 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3836/7694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:12 2022] GET /compute/v2.1/servers/9dc7761b-0026-4920-a2c6-d01624bca253 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:12.642260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38ef8a0e-c350-4881-8eb4-a1ccccfc9dc7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '.version_select at 0x7f900813f3a0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:12.724933 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38ef8a0e-c350-4881-8eb4-a1ccccfc9dc7 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365582293" status: 202 len: 0 microversion: 2.1 time: 0.087112 Oct 04 19:20:12.725516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3859/7695] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 4 19:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365582293 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:20:13.457070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:13.457581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:13.463734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.464232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.464678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.465372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.465870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.466306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.479836 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] HTTP exception thrown: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Request method failure captured: Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 HTTP/1.1 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIcTyNAYIV0I0oUpwXICnWJkshqd2xzDsnPJwJ83-pLH4hD3CY3teRqjKwKOrIvZAlUAPw7uyzFlXnZe7uGcIZMGR7_G0awuWA-BCMr6JKjZyCyKOQpM3ECpKQd1KETp43XNMZQt5c74JS6qjdaswl1CZD-hrNSUozPLDTS0bfwsbtA Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337f7766a0584a1c99d477257d21a16d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337f7766a0584a1c99d477257d21a16d"}]}] Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: e82e9713de8940ef97dca0fc77076b65 Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'adf5ef8f-7c46-435d-8d88-16159de8f3d2'} Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:13.481399 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Returning 404 to user: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bed3b545-0ae4-4915-85e0-d8680fff626b tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "DELETE /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 404 len: 111 microversion: 2.1 time: 0.030323 Oct 04 19:20:13.486592 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3837/7696] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:13 2022] DELETE /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:13.492287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:13.492905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] [instance: adf5ef8f-7c46-435d-8d88-16159de8f3d2] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:13.499656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.500143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.500588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.501276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.501734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.502163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.515124 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] HTTP exception thrown: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Request method failure captured: Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 HTTP/1.1 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIcTyNAYIV0I0oUpwXICnWJkshqd2xzDsnPJwJ83-pLH4hD3CY3teRqjKwKOrIvZAlUAPw7uyzFlXnZe7uGcIZMGR7_G0awuWA-BCMr6JKjZyCyKOQpM3ECpKQd1KETp43XNMZQt5c74JS6qjdaswl1CZD-hrNSUozPLDTS0bfwsbtA Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337f7766a0584a1c99d477257d21a16d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337f7766a0584a1c99d477257d21a16d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337f7766a0584a1c99d477257d21a16d"}]}] Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 337f7766a0584a1c99d477257d21a16d Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1840106550 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: e82e9713de8940ef97dca0fc77076b65 Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerDiskConfigTestJSON-1840106550-project Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'adf5ef8f-7c46-435d-8d88-16159de8f3d2'} Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:13.516781 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] Returning 404 to user: Instance adf5ef8f-7c46-435d-8d88-16159de8f3d2 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83b49fa3-6d71-4164-9a48-69c5d1311e63 tempest-ServerDiskConfigTestJSON-1840106550 tempest-ServerDiskConfigTestJSON-1840106550-project] 10.222.0.40 "GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2" status: 404 len: 111 microversion: 2.1 time: 0.030057 Oct 04 19:20:13.524849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3860/7697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:13 2022] GET /compute/v2.1/servers/adf5ef8f-7c46-435d-8d88-16159de8f3d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:24.350493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:24.351277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:24.465732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b287110b-0308-4222-b3d9-df19bf5f6d45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: .version_select at 0x7f900807eca0>, body: {"keypair": {"name": "tempest-keypair-488682173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSmeg/qhp9IvNt8OodWjzELaLdTGac6qxG/3/X3mUaFnazszMfvWkjnTImTmtsjar4sFyukjX5neXffcucUP+N75AS5Ex9eIZ/rO9NCxx1DcBPNyiao5XYrFUviJnG36g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:24.482217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b287110b-0308-4222-b3d9-df19bf5f6d45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:24.489018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-b287110b-0308-4222-b3d9-df19bf5f6d45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:24.564788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b287110b-0308-4222-b3d9-df19bf5f6d45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220340 Oct 04 19:20:24.565402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3838/7698] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:20:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:26.787444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1614752931", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d3be960-37b3-4342-aa11-bb9333fbb54d"}], "security_groups": [{"name": "tempest-securitygroup--611608038"}], "key_name": "tempest-keypair-488682173", "user_data": "}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:26.800259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:26.801001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:26.912375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] validate_networks() for [('6d3be960-37b3-4342-aa11-bb9333fbb54d', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:20:27.327230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:20:27.327820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:20:27.328300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:20:27.328772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:20:27.329185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:20:27.338387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:27.338951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:27.340640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:27.341929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:27.342384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:27.342985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:27.363586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:27.369667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:27.383433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:20:27.385885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:20:27.516582 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b5cccf1-a470-4656-ae02-f05db1a1c97a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.737810 Oct 04 19:20:27.517508 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3861/7699] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:20:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:20:27.528934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-db98bb9a-d8a0-4cdb-9bc0-58be8b8b12f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:27.529715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-db98bb9a-d8a0-4cdb-9bc0-58be8b8b12f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:27.589972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-db98bb9a-d8a0-4cdb-9bc0-58be8b8b12f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:27.597720 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-db98bb9a-d8a0-4cdb-9bc0-58be8b8b12f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1238 microversion: 2.1 time: 0.072994 Oct 04 19:20:27.598321 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3839/7700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:27 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:28.621786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cf6d1999-f31c-4caa-aba0-fd547d68145e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:28.622497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cf6d1999-f31c-4caa-aba0-fd547d68145e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:28.676770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cf6d1999-f31c-4caa-aba0-fd547d68145e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:28.683937 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cf6d1999-f31c-4caa-aba0-fd547d68145e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1238 microversion: 2.1 time: 0.066114 Oct 04 19:20:28.684657 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3862/7701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:28 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:29.706447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:29.707077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:29.714838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.715434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.715917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.716716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:29.717289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:29.718277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:29.782921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:29.790762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e0f055e1-9f2e-4155-8e55-896bd2ab8214 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1290 microversion: 2.1 time: 0.088336 Oct 04 19:20:29.791331 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3840/7702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:29 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:30.815058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:30.815606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:30.823046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.823571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.824015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.824750 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:30.825211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:30.825639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:30.965888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:30.973665 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-010f29c4-b56f-44b5-981c-64b8b629f5c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.163224 Oct 04 19:20:30.974239 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3863/7703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:30 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:31.557998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:31.568478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:31.575217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:31.575217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:31.581794 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] Creating event network-changed:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h1-833090-21 Oct 04 19:20:31.587100 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fc6ff06d-f2c0-48e6-9676-c3d95e426420 req-e1cd2dea-1f11-4715-aaec-f8feaaef6c50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033279 Oct 04 19:20:31.587809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3841/7704] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:31.998396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:31.999008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:32.005999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.006486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.006929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:32.007657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:32.008118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:32.008550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:32.146615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:32.154476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84c2c23b-3316-420b-814c-de643500e745 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.160012 Oct 04 19:20:32.155059 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3864/7705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:31 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:33.178725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:33.179454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:33.186595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.187107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.187957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.188671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:33.189150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:33.189604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:33.327150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:33.335744 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3e359078-2b57-4e2d-9ae1-13fe60a176bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.161417 Oct 04 19:20:33.336341 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3842/7706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:33 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:34.359894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:34.360540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:34.367705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.368192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.368629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.369319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:34.369776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:34.370204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:34.501490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:34.509252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1276fdc4-10dd-41b5-8c97-a22c5d527d05 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.153871 Oct 04 19:20:34.509828 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3865/7707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:34 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:35.531604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:35.532240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:35.539159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.539694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.540144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.540839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.541305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.541740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.668775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:35.676878 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae986f4d-1a10-4f30-b217-873cce8ba859 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.149254 Oct 04 19:20:35.677445 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3843/7708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:35 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:36.699598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:36.700235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:36.707666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.715849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.715849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.715849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:36.715849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:36.715849 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:36.841727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:36.849661 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1028012-d2c7-425a-b000-96b0a0ac6f65 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.153998 Oct 04 19:20:36.850241 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3866/7709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:36 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:37.874443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:37.875795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:37.878612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:37.883622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.886900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.886900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:37.886900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:37.886900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:37.886900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:38.012942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:38.020760 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2494b01e-cde8-4cab-a7cf-f09397297bed tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.150374 Oct 04 19:20:38.023524 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3844/7710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:37 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:38.658875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "name": "network-vif-plugged", "status": "completed", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:38.664212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:38.670979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:38.671535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:38.671976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:38.687513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:38.687513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] Creating event network-vif-plugged:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h1-833090-21 Oct 04 19:20:38.689285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6bbb7c91-172c-42f6-a1d5-f1d7821bd64d req-3f446839-5e88-4bd3-82e7-67a6cf977a47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034718 Oct 04 19:20:38.689889 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3867/7711] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:39.044730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:39.045386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:39.052874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:39.053368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:39.053824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:39.054523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:39.054990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:39.055427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:39.183303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:39.191676 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2c620aec-2cc3-4ce3-bbb4-0dea93cd515e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.150887 Oct 04 19:20:39.192243 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3845/7712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:39 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:40.216497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:40.217231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:40.224676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:40.225160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:40.225604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:40.226290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:40.226749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:40.227179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:40.370169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:40.377910 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d611b825-c13b-4510-ba6d-327fe005f24b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1363 microversion: 2.1 time: 0.167062 Oct 04 19:20:40.378480 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3868/7713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:40 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:41.401006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:41.401571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:41.408505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.409010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.409492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.410204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.410679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.411128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.550686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:41.558392 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a44c23ee-90a4-4f7b-9bd8-b0dd107b1ae2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1551 microversion: 2.1 time: 0.161441 Oct 04 19:20:41.558965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3846/7714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:41 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:41.581353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:41.581878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:41.588674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.589152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.589586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.590268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.590720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.591141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.667765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8bb84aa0-8aff-409b-9825-85326030c54d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090190 Oct 04 19:20:41.668368 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3869/7715] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:20:41 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:42.927742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:42.938940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:42.939347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:42.939821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:42.951455 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] Creating event network-changed:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h1-833090-21 Oct 04 19:20:42.956536 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a415b5ce-02af-4989-a2d4-335c55af8076 req-d1deddbd-af3a-45a4-a030-22a074f88031 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032874 Oct 04 19:20:42.957245 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3847/7716] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:21:18.955373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:18.956166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=38 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:18.960724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:18.961393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:18.968157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:18.970719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:18.970719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:18.970719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:18.970719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:18.971082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.360405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:19.369019 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a4f5683-9bf6-4a1e-bc7a-96ba5f0bfae6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.415814 Oct 04 19:21:19.369587 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3870/7717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:18 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:19.390301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:19.391080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=40 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:19.395130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:19.395878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:19.401945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.405786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.405786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.405786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.405786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.405786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.534651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:19.542862 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-30835568-7766-4479-a268-912c971f2866 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.154708 Oct 04 19:21:19.543442 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3848/7718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:19 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:21:19.566165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:19.566704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:19.572735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.573482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.574001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.574692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.575151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.575637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.708738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:19.716550 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1d244654-c2ff-4b93-881e-c1f4fb811c80 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.154546 Oct 04 19:21:19.717116 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3871/7719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:19 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:19.739716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:19.742590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:19.748715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.749214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.749669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.750373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:19.750844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:19.751284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:19.782059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:19.787388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:21:19.794402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:21:19.794839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:21:19.795331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:21:19.795779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:21:19.796206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:21:20.006647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0a03e99-ba3f-4ea7-9eec-e94e57cd39f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/action" status: 202 len: 0 microversion: 2.1 time: 0.270947 Oct 04 19:21:20.007320 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3849/7720] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:21:19 2022] POST /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:21:20.015418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:20.016095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:20.023864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:20.024363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:20.024806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:20.025526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:20.025996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:20.026425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:20.156717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:20.164592 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3252ee63-caad-4a43-b369-8c57d6c73fc3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1679 microversion: 2.1 time: 0.153027 Oct 04 19:21:20.167673 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3872/7721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:20 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:21.188976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:21.189618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:21.197833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:21.198348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:21.198810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:21.199560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:21.200045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:21.200533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:21.329482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:21.337838 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb4e4af9-eb26-47c5-ace9-7e2dd29ec4cb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1679 microversion: 2.1 time: 0.152880 Oct 04 19:21:21.338418 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3850/7722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:21 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:22.362691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:22.363240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:22.370654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:22.371143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:22.371614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:22.372322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:22.372781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:22.373213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:22.508695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:22.517137 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a882b26-3610-45e8-abb5-41c42fef4474 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1679 microversion: 2.1 time: 0.158774 Oct 04 19:21:22.517928 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3873/7723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:22 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:23.542208 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:23.542836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:23.550633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.551132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.551611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.552321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:23.552785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:23.553273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:23.686407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:23.694042 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5bb5c129-ae9f-415c-83ab-9f53ea7e001d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.156434 Oct 04 19:21:23.694640 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3851/7724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:23 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:24.718250 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:24.718868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:24.725861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.726361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.726806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.727530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:24.727992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:24.728423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:24.857209 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:24.865274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27003a46-87b0-45a2-9603-c9d55fc9824c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.151003 Oct 04 19:21:24.865850 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3874/7725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:24 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:25.889498 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:25.890477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:25.897894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.898631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.899082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:25.899873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:25.900341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:25.900785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:26.030687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:26.038541 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c4f1f192-a247-437a-9c8f-9ba758630ae8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.152962 Oct 04 19:21:26.039129 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3852/7726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:25 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:27.062226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:27.062870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:27.070493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.070983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.071421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.072137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:27.072595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:27.073024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:27.214370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:27.214370 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4eda5179-5643-400d-a1cd-d93c2b09cc67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.153969 Oct 04 19:21:27.214370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3875/7727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:27 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:28.236020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:28.236899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:28.243325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.243894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.244360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.245077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:28.245584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:28.246063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:28.386536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:28.394297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a7289456-86c4-4108-a7d1-159a8268a3a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.162406 Oct 04 19:21:28.394884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3853/7728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:28 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:29.418619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:29.419235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:29.426165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:29.426650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:29.427085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:29.427802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:29.428289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:29.429290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:29.556884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:29.564722 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bdb3f1df-3deb-41b4-b1d6-5ac055a7e770 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.149970 Oct 04 19:21:29.565293 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3876/7729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:29 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:30.588285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:30.588957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:30.596011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:30.596507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:30.596958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:30.597682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:30.598150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:30.598589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:30.730379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:30.738336 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e20811d4-82da-4f9f-99f4-1b9a83318005 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.154147 Oct 04 19:21:30.738907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3854/7730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:30 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:31.763550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:31.764176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:31.771036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:31.771556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:31.771999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:31.772695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:31.773154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:31.773584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:31.905113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:31.912968 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc0cf9eb-466d-4d8c-b653-8aee3bfe9046 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.153470 Oct 04 19:21:31.913539 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3877/7731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:31 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:21:32.936882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:32.937521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:32.944833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:32.945333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:32.945787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:32.946491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:32.946964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:32.947410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:33.076256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:33.083961 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36ee18ea-2458-441e-be6b-28eba4c3e42b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.151009 Oct 04 19:21:33.085203 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3855/7732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:32 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:34.108171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:34.108822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:34.116522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:34.117009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:34.117450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:34.118140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:34.118597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:34.119029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:34.245501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:34.253345 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8e5e25b-8fa7-493c-ab5a-f87d4406d8b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.149201 Oct 04 19:21:34.254403 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3878/7733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:34 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:35.277765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:35.278411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:35.285581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.286084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.286546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.287261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:35.288254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:35.288713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:35.423768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:35.432066 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6a3f4659-ffe3-4f62-9d6b-893761cacebf tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.158342 Oct 04 19:21:35.432675 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3856/7734] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:35 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:36.455577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:36.456197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:36.463092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:36.463619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:36.464064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:36.464760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:36.465218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:36.465649 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:36.592931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:36.600756 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e8a0fa7-b16d-47d3-a787-149f5ec33830 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.149178 Oct 04 19:21:36.601337 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3879/7735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:36 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:37.627264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:37.627931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:37.635947 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:37.636454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:37.636985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:37.637696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:37.638165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:37.638606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:37.768822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:37.776710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cd09d36-06f0-43f9-a6c7-49d8c6ebefe9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.153497 Oct 04 19:21:37.777290 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3857/7736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:37 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:38.799761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:38.800382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:38.807281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:38.807787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:38.808234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:38.808923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:38.809378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:38.809804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:38.944199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:38.949227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3905b2e8-afd2-4c08-a1aa-06ed06f2681d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.153520 Oct 04 19:21:38.949890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3880/7737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:38 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:39.974274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:39.975440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:39.982465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:39.982972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:39.983429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:39.984164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:39.984643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:39.985092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:40.119952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:40.127702 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25d3ac14-9d6b-4deb-afd2-1a3fe053ae5c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1684 microversion: 2.1 time: 0.157338 Oct 04 19:21:40.128289 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3858/7738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:39 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:41.152616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:41.153241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:41.160561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:41.165704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:41.165704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:41.165704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:41.165704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:41.165704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:41.358652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:41.367197 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2be9a98f-5a8a-4b62-9a76-01702fd768d6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1683 microversion: 2.1 time: 0.218711 Oct 04 19:21:41.382520 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3881/7739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:41 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:41.382878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "name": "network-vif-unplugged", "status": "completed", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:41.390118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:41.390611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:41.391058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:41.404018 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Creating event network-vif-unplugged:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h2-833090-21 Oct 04 19:21:41.409343 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:21:41.420331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cc99eb35-a430-4b30-97aa-f5af017b706e req-91480603-83c3-4981-b038-cde636e8d6f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045410 Oct 04 19:21:41.421002 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3859/7740] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:42.393094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:42.393711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:42.401201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:42.401630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:42.402072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:42.402903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:42.403243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:42.403700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:42.578459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:42.586215 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f40533b1-67ad-44a0-b68e-fb9ba75d41d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1683 microversion: 2.1 time: 0.197106 Oct 04 19:21:42.596514 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3882/7741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:42 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:43.436455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:43.446415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:43.446902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:43.447344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:43.458492 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Creating event network-changed:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h2-833090-21 Oct 04 19:21:43.464265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:21:43.474909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-511cc87d-1988-411c-bfce-ae21a439588e req-84c32bde-950f-41a6-a9c9-6b246f0f6e21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043416 Oct 04 19:21:43.475530 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3860/7742] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:43.610583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:43.611580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:43.618985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:43.619482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:43.619944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:43.620641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:43.621103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:43.621534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:43.752009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:43.760349 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3c5c1d6-1bf8-4e8e-a572-4723b1293a00 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1681 microversion: 2.1 time: 0.154001 Oct 04 19:21:43.760944 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3883/7743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:43 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:44.786384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:44.787112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:44.794018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:44.794531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:44.794912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:44.795666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:44.796145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:44.796595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:44.927799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:44.935796 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69c1267b-6e73-4764-bd8c-f5659be1c7c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1681 microversion: 2.1 time: 0.154403 Oct 04 19:21:44.936760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3861/7744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:44 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:45.961873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:45.962563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:45.969956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:45.970451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:45.970894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:45.971634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:45.972095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:45.981212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:46.102622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:46.110431 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc8290b0-ce7d-49a7-b65a-3f463044a0bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1681 microversion: 2.1 time: 0.153407 Oct 04 19:21:46.113309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3884/7745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:45 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:47.135840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:47.136383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:47.143260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.143800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.144252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.144998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.145470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.145914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.279802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:47.287778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac868b1c-5259-4f54-bdd0-9916371e34b5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1678 microversion: 2.1 time: 0.156445 Oct 04 19:21:47.288378 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3862/7746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:47 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:47.311461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:47.312034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:47.319188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.319703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.322226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.322226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.322226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.322226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.361545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:47.507904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b4498a05-295e-4326-945d-170a39680188 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/action" status: 204 len: 0 microversion: 2.1 time: 0.200243 Oct 04 19:21:47.508559 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3885/7747] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:21:47 2022] POST /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:21:47.516878 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:47.517557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:47.524007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.524514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.524975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.525691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:47.526170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:47.526616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:47.657749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:47.661371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:47.666069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9b589b81-bfa0-4b06-86ee-edab6dcfa54b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1678 microversion: 2.1 time: 0.153110 Oct 04 19:21:47.666664 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3863/7748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:47 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:48.691692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:48.692403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:48.699150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.699679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.700125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.700813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.701272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.701702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.822999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "name": "network-vif-plugged", "status": "completed", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:48.834532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:48.835681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:48.836137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:48.842236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:48.849024 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Creating event network-vif-plugged:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h2-833090-21 Oct 04 19:21:48.850361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5fec555c-d9b3-4a00-9ae8-6db150a69bfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1678 microversion: 2.1 time: 0.163877 Oct 04 19:21:48.851124 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3886/7749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:48 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:48.854059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:21:48.867713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e8a4976d-1384-4e34-97bd-690b43d0cb10 req-c03b4ccb-72f6-455c-9e9c-28bd75bd44b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050489 Oct 04 19:21:48.868317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3864/7750] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:49.876170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:49.876850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:49.879665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=35 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:49.884421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:49.884908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:49.885346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:49.886034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:49.886517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:49.886945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.013940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:50.021720 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de693778-e7a9-4a77-a39c-ad7975ca8519 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.149474 Oct 04 19:21:50.022814 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3887/7751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:49 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:50.047254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:50.048022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:50.050056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=39 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:21:50.055266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.055791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.056254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.056992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.057470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.057966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.187560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:50.195907 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-375c6988-645c-437c-af5c-2259cfc90b87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.154170 Oct 04 19:21:50.196489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3865/7752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:50 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:50.218984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:50.219678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:50.225683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.226171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.226612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.227302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.227786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.228345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.362875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:50.370999 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-45922f39-8bef-4657-a688-c242cc98a5bc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1670 microversion: 2.1 time: 0.155865 Oct 04 19:21:50.371599 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3888/7753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:50 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:50.395381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:50.395875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:50.402531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.403020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.403499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.404213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.404723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.405198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.430312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:21:50.679955 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-60ca401a-57c8-454d-a28d-5e23a505d8e6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 204 len: 0 microversion: 2.1 time: 0.288184 Oct 04 19:21:50.680479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3866/7754] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:21:50 2022] DELETE /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:21:50.688590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:50.689257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:50.695866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.696344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.696776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.697654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:50.698111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:50.698532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:50.827324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:50.835095 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9e6bbb5-1078-4f42-934f-3d891e4f19e8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1676 microversion: 2.1 time: 0.150373 Oct 04 19:21:50.835706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3889/7755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:50 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:51.859764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:51.860473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:51.867577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.868073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.868515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:51.869210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:51.869673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:51.870110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:52.005864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:52.014240 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d434e0d5-de74-4401-bb11-f56130da4beb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1676 microversion: 2.1 time: 0.158812 Oct 04 19:21:52.014818 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3867/7756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:51 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:53.038687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:53.039408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:53.047036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.047552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.047991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.048695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.049144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.049565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.250409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:53.258564 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbf74f0f-518a-435e-9c18-556e51e92ce0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 200 len: 1609 microversion: 2.1 time: 0.224457 Oct 04 19:21:53.259155 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3890/7757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:53 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 1609 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:53.522647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44", "name": "network-vif-deleted", "tag": "6dbed1e7-d251-426b-95c9-2244e41cfd5f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:53.532815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:53.533316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:53.533768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:53.545106 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] Creating event network-vif-deleted:6dbed1e7-d251-426b-95c9-2244e41cfd5f for instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 on n-h2-833090-21 Oct 04 19:21:53.550449 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-22f4575e-48f7-4201-8379-5fca21499d31 req-eafbba70-03b5-40d0-8733-8cd0bbf58962 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031526 Oct 04 19:21:53.551294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3868/7758] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:54.282411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:54.288240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:54.291401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.291922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.292354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.293081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.293532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.293955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.309021 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 HTTP/1.1 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44'} Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:54.322263 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39bb73a6-8d50-4ab6-946a-746e06c66f63 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 404 len: 111 microversion: 2.1 time: 0.033737 Oct 04 19:21:54.328583 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3891/7759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:54 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:54.336423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:54.337158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:54.343877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.344375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.344891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.345653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.346122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.346589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.363400 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 HTTP/1.1 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44'} Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:21:54.365509 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5ec92720-4d43-4291-bfe3-0db58804c2bd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 404 len: 111 microversion: 2.1 time: 0.036244 Oct 04 19:21:54.369694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3869/7760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:54 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:21:54.417867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-349486410", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "6d3be960-37b3-4342-aa11-bb9333fbb54d"}], "security_groups": [{"name": "tempest-securitygroup--611608038"}], "key_name": "tempest-keypair-488682173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:54.524135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] validate_networks() for [('6d3be960-37b3-4342-aa11-bb9333fbb54d', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:21:54.897944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:21:54.898455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:21:54.898935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:21:54.899347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:21:54.899812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:21:54.908663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.909156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.909596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.910325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:54.910782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:54.911231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:54.927961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:21:54.933236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:21:54.946189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:21:54.948507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:21:55.079366 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff33f288-65bc-455c-9629-137561028b17 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.666891 Oct 04 19:21:55.080052 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3892/7761] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:21:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:21:55.091552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4fe52f3-440c-4e77-b9ce-1255f7b23742 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:55.092205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4fe52f3-440c-4e77-b9ce-1255f7b23742 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:55.147939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b4fe52f3-440c-4e77-b9ce-1255f7b23742 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:55.155759 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4fe52f3-440c-4e77-b9ce-1255f7b23742 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1237 microversion: 2.1 time: 0.068220 Oct 04 19:21:55.156317 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3870/7762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:55 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:56.180339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:56.180947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:56.187796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:56.188284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:56.188726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.189421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:56.189875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:56.190302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:56.255730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:56.263531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4f90a63b-5cfb-41b9-886d-5d3ad06e2942 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1241 microversion: 2.1 time: 0.088739 Oct 04 19:21:56.264114 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3893/7763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:56 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:57.286778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:57.287486 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:57.294398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:57.294990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:57.295548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:57.296277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:57.296758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:57.297223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:57.372184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:57.379909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2ae0a799-2c26-4bd7-9f91-e20bef560869 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1307 microversion: 2.1 time: 0.097170 Oct 04 19:21:57.380489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3871/7764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:57 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:21:58.404578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:58.405301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:58.411801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:58.417914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:58.417914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:58.417914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:58.417914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:58.417914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:58.545486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:58.553410 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-546cc9b4-a6db-4f79-b68e-437c07f56bb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.152728 Oct 04 19:21:58.554630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3894/7765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:58 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:21:59.142078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:21:59.153502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:59.154055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:59.154510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:59.166342 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] Creating event network-changed:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h1-833090-21 Oct 04 19:21:59.171323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ceb71867-e2cc-4c7d-84c2-c54c3f965a5a req-46607b41-49a4-4b03-9d63-b0aa1efad191 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Oct 04 19:21:59.171977 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3872/7766] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:21:59.577756 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:21:59.578364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:21:59.585568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:59.586055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:59.586484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:59.587171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:21:59.587655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:21:59.588084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:21:59.718268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:21:59.726153 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cad72c06-1125-4959-bead-ad062006e326 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.152126 Oct 04 19:21:59.726665 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3895/7767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:21:59 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:00.750818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:00.751586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:00.758492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:00.759036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:00.759563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:00.760276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:00.760753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:00.761201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:00.894011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:00.902392 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14590476-9a3c-4984-9fc2-82ee48808c64 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.156821 Oct 04 19:22:00.902970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3873/7768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:00 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:01.925977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:01.926585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:01.933595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:01.934105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:01.934545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:01.935253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:01.935726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:01.936156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:02.070258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:02.078023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01c40991-2ce3-40ba-9aec-0a10f168e7f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.156027 Oct 04 19:22:02.078605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3896/7769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:01 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:03.102251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:03.102928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:03.110002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:03.110510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:03.111228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:03.111966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:03.112447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:03.112899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:03.241610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:03.250074 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d23b8566-6870-4fbd-9ae8-4bfb5946cb3e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.151791 Oct 04 19:22:03.250650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3874/7770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:03 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:04.273459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:04.274075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:04.281578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.282016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.282497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.283194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:04.283695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:04.284397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:04.418231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:04.425888 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03207285-96c3-43da-917d-d3c236433f9b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.156366 Oct 04 19:22:04.429942 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3897/7771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:04 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:05.030563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "name": "network-vif-plugged", "status": "completed", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:05.043921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.044424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.044880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.056130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] Creating event network-vif-plugged:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h1-833090-21 Oct 04 19:22:05.061568 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-de7e8444-518a-4637-bbc9-a515745486e5 req-dc9b93cf-f0d8-493f-90d8-d427c265206f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035346 Oct 04 19:22:05.062160 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3875/7772] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:05.449499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:05.450125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:05.452009 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:05.452665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:05.458237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.458715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.459152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.459895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:05.462854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:05.462854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:05.596025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:05.604243 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ba6a6bdc-266a-4996-829a-7679758ad428 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1362 microversion: 2.1 time: 0.158097 Oct 04 19:22:05.604815 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3898/7773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:05 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:06.625359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:06.630465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:06.631179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:06.637972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.638466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.638917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.639685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.640188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.640630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.777432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:06.785292 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7657ad90-4236-4341-aa02-cbb345e01c9c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1549 microversion: 2.1 time: 0.160940 Oct 04 19:22:06.785884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3876/7774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:06 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:06.809111 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:06.809613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:06.816907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.817466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.817913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.819001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:06.819090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:06.819508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:06.898497 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9b8f7a5-45f9-489c-8f55-b2c9cba78cde tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093723 Oct 04 19:22:06.899108 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3899/7775] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:22:06 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:07.874308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:07.885272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:07.885776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:07.886806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:07.897909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] Creating event network-changed:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h1-833090-21 Oct 04 19:22:07.903859 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d6485a48-e280-481c-a2d3-04a310e18e4c req-e42aa97e-0ae7-4dc3-84df-1f89405bcda7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Oct 04 19:22:07.904512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3877/7776] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:48.599941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:48.600699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:48.604741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:48.610945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.613474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.613474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.634505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Going to try to stop instance {{(pid=123887) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:22:48.793073 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87f7a494-ed42-400f-8a2d-b00b2ebe2c32 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action" status: 202 len: 0 microversion: 2.1 time: 0.194920 Oct 04 19:22:48.793675 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3900/7777] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:48 2022] POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:22:48.803050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:48.803817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:48.806311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:48.807015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:48.812342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.812852 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.813313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.814033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:48.815250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:48.815740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:48.953112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:48.961137 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-642a98c4-16db-4226-8f85-b78577a3ce0d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.162852 Oct 04 19:22:48.961680 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3878/7778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:48 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:49.988299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:49.989004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:49.995415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.995933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.996379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:49.997070 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:49.997530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:49.997957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:50.131156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:50.138961 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-383f6e59-a911-4841-95f5-607f09167760 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.156497 Oct 04 19:22:50.139565 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3901/7779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:49 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:51.163927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:51.164541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:51.172085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.172595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.173054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.173799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:51.174281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:51.174736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.303708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:51.311414 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8cea456-90fd-4903-aa0a-1f44dfa4adab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.152004 Oct 04 19:22:51.312011 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3879/7780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:51 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:52.334780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:52.335335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:52.342372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:52.342866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:52.343315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:52.344044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:52.344512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:52.344945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:52.474032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:52.481755 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d114697-c63c-4d27-967b-ee11350c8cfd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.150986 Oct 04 19:22:52.482338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3902/7781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:52 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:53.506121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:53.506792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:53.513867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.519142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.519142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.519142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:53.519142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:53.519142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:53.651255 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:53.659152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5ce5c75-0231-42ee-9651-57cc909568f1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.157029 Oct 04 19:22:53.663109 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3880/7782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:53 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:54.682913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:54.683557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:54.690637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:54.691131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:54.691614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:54.692323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:54.692788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:54.693218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:54.825333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:54.833665 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f38810d-d98f-4f7e-beb9-a46f37c0a8c0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.154729 Oct 04 19:22:54.834266 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3903/7783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:54 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:55.857819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:55.858462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:55.866298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:55.866810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:55.867271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:55.868011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:55.868491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:55.868941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:55.999391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:56.007171 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cd84dd1-f41c-4abc-a19a-1d2760593d9e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.153385 Oct 04 19:22:56.007780 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3881/7784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:55 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:22:57.030219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:57.030843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:57.037345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.037837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.038280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.038971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:57.039428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:57.039880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:57.165854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:57.173603 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1302729-706f-4eda-be5c-a256600d2abe tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.147281 Oct 04 19:22:57.174860 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3904/7785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:57 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:58.198479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:58.199111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:58.205449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.205966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.206417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.207110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.207602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.208048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.339457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:58.347949 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dd4e52b7-a0f2-418f-a6be-9e2fe47f91a7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.153435 Oct 04 19:22:58.348535 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3882/7786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:58 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:22:59.374292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:22:59.375199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:59.384099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.384580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.385318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.386561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:59.387391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:59.387982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:59.519359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:22:59.527256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b3b5825a-2c64-4870-aab4-cf66a013fbe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.158029 Oct 04 19:22:59.527865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3905/7787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:22:59 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:00.551749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:00.552390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:00.559538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.560913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.560913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:00.561278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:00.561755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:00.562202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:00.697158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:00.704942 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfd5fe88-4c0c-4522-813e-12aef187555f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.157326 Oct 04 19:23:00.706064 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3883/7788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:00 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:01.729146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:01.729762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:01.737562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:01.738048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:01.738482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:01.739171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:01.739672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:01.740117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:01.868993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:01.876744 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9de981c6-8bda-4931-891a-ca713a7ff2c5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.151499 Oct 04 19:23:01.877540 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3906/7789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:01 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:02.899845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:02.900492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:02.907428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:02.907992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:02.908955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:02.909718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:02.910238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:02.910688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:03.041117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:03.048882 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1d559c4f-a3c4-472b-8941-56cac6932dfc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.153258 Oct 04 19:23:03.049452 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3884/7790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:02 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:04.072581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:04.073189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:04.080098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:04.081232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:04.081672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:04.082353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:04.082800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:04.083221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:04.211196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:04.218960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e69a4cb1-0ef7-472d-a29a-2e4c2e86cba4 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.150764 Oct 04 19:23:04.219559 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3907/7791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:04 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:05.242426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:05.243096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:05.250091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.250590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.251047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.251778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.252257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.252700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.379209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:05.386967 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88f4c6b3-b376-427d-b39b-a7ee065d7bcb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1655 microversion: 2.1 time: 0.148494 Oct 04 19:23:05.387563 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3885/7792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:05 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:05.410767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:05.413187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:05.420198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.420689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.421149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.421836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.422300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.422734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.500108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:05.505556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=123887) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:23:05.512108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:23:05.512537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:23:05.513016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:23:05.513430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:23:05.513842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:23:05.755817 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a626199f-dea4-46af-bd6d-f2374d804388 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action" status: 202 len: 0 microversion: 2.1 time: 0.349526 Oct 04 19:23:05.756732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3908/7793] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:05 2022] POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:23:05.765260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:05.766016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:05.773174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.773687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.774147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.774866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.775348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.775828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.896763 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:23:05.899450 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd (ip 10.222.0.40) !!! Oct 04 19:23:05.909471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:05.917699 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-798eb21a-6cbc-43d2-8f7e-29065f1e8769 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.156476 Oct 04 19:23:05.918291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3886/7794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:05 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:06.943595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:06.944216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:06.951213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:06.951722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:06.952164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:06.952919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:06.953383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:06.953810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.068950 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:23:07.069203 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd (ip 10.222.0.40) !!! Oct 04 19:23:07.089684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:07.098330 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c7f65397-8a31-4561-88cd-108cecdce1ce tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.160564 Oct 04 19:23:07.098913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3909/7795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:06 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:08.122975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:08.123654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:08.131158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.136006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.136006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.136006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.136006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.136006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.276102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:08.284725 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3b0788b-c61a-406c-95cd-f05bcea9fc02 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1678 microversion: 2.1 time: 0.165840 Oct 04 19:23:08.290626 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3887/7796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:08 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:23:09.308440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:09.309063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:09.316842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:09.317350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:09.317807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:09.318516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:09.318978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:09.319412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:09.450268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:09.458045 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da61022d-670c-4f2d-9db8-f70b0441109d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1683 microversion: 2.1 time: 0.153642 Oct 04 19:23:09.458629 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3910/7797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:09 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:10.482148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:10.483577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:10.491761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:10.493415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:10.493415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:10.493698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:10.493965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:10.494413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:10.632625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:10.640650 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48102cd0-7bd0-49ee-ab31-40f2150c4196 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1683 microversion: 2.1 time: 0.162507 Oct 04 19:23:10.641224 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3888/7798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:10 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:11.665116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:11.665736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:11.672878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:11.677262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:11.677262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:11.677262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:11.677262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:11.677262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:11.889010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:11.897428 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80691f1f-dcd5-46e6-9c9d-eacbf091f992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1682 microversion: 2.1 time: 0.236694 Oct 04 19:23:11.898028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3911/7799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:11 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:12.117556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:12.128832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:12.129330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:12.129783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:12.144716 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Creating event network-vif-unplugged:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h2-833090-21 Oct 04 19:23:12.150058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] Instance 2947ea4e-871b-409a-bc97-b6c7854109bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:23:12.161194 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d2e4923a-37b8-4fb6-8803-07cd5909f3f2 req-eb680257-fd24-465a-b313-47e759b0db4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047469 Oct 04 19:23:12.161822 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3889/7800] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:12.921799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:12.922512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:12.929524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:12.930042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:12.930486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:12.931189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:12.931679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:12.932114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:13.131105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:13.139089 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f8464f7-a3d2-460b-88c0-c73ae0e3d32e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1682 microversion: 2.1 time: 0.221441 Oct 04 19:23:13.139936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3912/7801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:12 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:14.166875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:14.167634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:14.175793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:14.176005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:14.176459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:14.176741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:14.177456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:14.177931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:14.178404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:14.186318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:14.186801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:14.187237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:14.198985 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Creating event network-changed:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h2-833090-21 Oct 04 19:23:14.204652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] Instance 2947ea4e-871b-409a-bc97-b6c7854109bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:23:14.216160 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-11f99ea5-cfbe-4502-b9e8-5c3eb879b208 req-ad10e58d-a437-4b4e-a4c0-db7b96667b4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044482 Oct 04 19:23:14.216771 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3913/7802] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:14.394984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:14.403027 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-05e4587a-0078-4811-9a75-158e15080310 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1680 microversion: 2.1 time: 0.243102 Oct 04 19:23:14.403655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3890/7803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:14 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:15.429717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:15.430452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:15.436747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:15.437237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:15.437676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:15.438366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:15.438826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:15.439320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:15.457733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:15.569695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:15.577556 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f1b98c4-8c52-4f9a-b104-09f8de3aa098 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1680 microversion: 2.1 time: 0.153691 Oct 04 19:23:15.578131 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3914/7804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:15 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:16.601197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:16.601823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:16.608706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.609465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.609913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.610611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.611078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.612062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.742121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:16.749965 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e7f4c8c-01fa-43f0-b1ba-64cf0ac2a5c3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1676 microversion: 2.1 time: 0.152804 Oct 04 19:23:16.750545 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3891/7805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:16 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:16.773818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:16.774357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:16.781251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.781741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.782185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.782882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.783390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.783854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.950873 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0366a7c9-73b1-4c79-a980-d34048d80379 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action" status: 204 len: 0 microversion: 2.1 time: 0.180706 Oct 04 19:23:16.951677 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3915/7806] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:16 2022] POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:23:16.960073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:16.960774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:16.966971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.967491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.971964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.971964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:16.971964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:16.971964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:17.116699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:17.125801 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e4fe1e4-2dd6-4de6-b40c-7f5a369d4af5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1676 microversion: 2.1 time: 0.169707 Oct 04 19:23:17.128884 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3892/7807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:16 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:18.150515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:18.151223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:18.158522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:18.159003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:18.159441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:18.160312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:18.160721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:18.161150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:18.295825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:18.304532 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b75dd637-653b-42ca-9793-d0c4fcfa510d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1676 microversion: 2.1 time: 0.158285 Oct 04 19:23:18.305178 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3916/7808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:18 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:19.248499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "name": "network-vif-plugged", "status": "completed", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:19.255029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=31 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:19.260219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.260718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.261172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.272711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] Creating event network-vif-plugged:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h2-833090-21 Oct 04 19:23:19.278084 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d3111c8a-9a5b-4367-a0a1-c06b94743336 req-bcab72c8-631a-4675-8412-5c6806bc317a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Oct 04 19:23:19.278699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3893/7809] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:19.328556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:19.329101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:19.332537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=39 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:19.337383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.337851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.338287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.339002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.339455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.339903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.471241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:19.479041 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1f3b7cad-825f-43a0-9862-d42cc0a1a5b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1655 microversion: 2.1 time: 0.154505 Oct 04 19:23:19.479689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3917/7810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:19 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:19.504315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:19.505042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:19.511792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.512297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.512758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.513468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.513946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.514477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.644554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:19.652462 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06aa212b-ed04-419b-995d-1395f8e0db1b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1655 microversion: 2.1 time: 0.153294 Oct 04 19:23:19.653043 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3894/7811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:19 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:19.675523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:19.681580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.682067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.682509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.704706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Going to try to start instance {{(pid=123887) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:23:19.889440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4840a6b3-60bf-498a-af3a-65ee2ad3d090 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action" status: 202 len: 0 microversion: 2.1 time: 0.217699 Oct 04 19:23:19.889971 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3918/7812] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:23:19 2022] POST /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:23:19.898996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:19.899659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:19.905875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.906375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.906829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.907644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.908104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.908540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.926699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=100 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:20.046134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:20.054948 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5588c454-ef04-4f63-8312-7169d777ceb7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1664 microversion: 2.1 time: 0.159894 Oct 04 19:23:20.055559 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3895/7813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:19 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:21.081183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:21.081885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:21.088370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:21.088862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:21.089304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:21.089995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:21.090448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:21.090879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:21.229740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:21.237899 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8124ac75-a1b4-4ac0-a31c-b7c512e6306e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1664 microversion: 2.1 time: 0.162360 Oct 04 19:23:21.238484 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3919/7814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:21 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:22.261287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:22.261919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:22.269563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.270063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.270532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.271222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.271730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.272175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.405882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:22.413824 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf2a4b53-58e1-4150-838f-badcd6fc7a76 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1668 microversion: 2.1 time: 0.156493 Oct 04 19:23:22.414381 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3896/7815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:22 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:22.436789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:22.437295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:22.444852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.445341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.445778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.446469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.446920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.447344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.472390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:23:22.727541 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-50bcf29d-1920-4f60-8ef0-06adb046cb94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 204 len: 0 microversion: 2.1 time: 0.294292 Oct 04 19:23:22.728180 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3920/7816] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:23:22 2022] DELETE /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:23:22.737571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:22.738246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:22.744583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.745102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.745550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.746330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.746816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.747266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.882279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:22.890617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-935bdc35-e402-4107-886d-272b9588e39f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1674 microversion: 2.1 time: 0.157952 Oct 04 19:23:22.891193 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3897/7817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:22 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:23.915785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:23.916485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:23.923269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:23.923773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:23.924837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:23.925511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:23.925961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:23.926380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:24.059651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:24.067879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b6a96e88-9c79-4778-af12-aeb170f42a6c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1674 microversion: 2.1 time: 0.156296 Oct 04 19:23:24.068473 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3921/7818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:23 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:25.093125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:25.093764 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:25.100934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.101433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.101900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.102623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.103101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.103585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.171437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:25.179623 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5020a4b7-54f9-4b86-8b0c-e94cf9de67f6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 200 len: 1607 microversion: 2.1 time: 0.090664 Oct 04 19:23:25.180622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3898/7819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:25 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 1607 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:25.208137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947ea4e-871b-409a-bc97-b6c7854109bd", "name": "network-vif-deleted", "tag": "7eb0ac4e-a40e-491e-a928-3e25b2b76790"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:25.218912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:25.219553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:25.223581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:25.232352 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] Creating event network-vif-deleted:7eb0ac4e-a40e-491e-a928-3e25b2b76790 for instance 2947ea4e-871b-409a-bc97-b6c7854109bd on n-h2-833090-21 Oct 04 19:23:25.238097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-da1bf914-4735-4f39-994b-4d9e7c70cc04 req-9bd9bb59-ea45-4a64-aff0-fd7bc9d42832 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034087 Oct 04 19:23:25.238711 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3922/7820] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:26.204488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:26.205677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:26.214241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.214753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.215215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.215967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.216442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.216920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.232391 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd HTTP/1.1 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2947ea4e-871b-409a-bc97-b6c7854109bd'} Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:26.234398 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bb2f467a-f048-419f-9ec6-2d0563d3f14c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 404 len: 111 microversion: 2.1 time: 0.035461 Oct 04 19:23:26.244021 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3899/7821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:26 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:26.253894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:26.254650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:26.261282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.261773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.262218 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.262914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.263376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.263833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.277727 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd HTTP/1.1 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2947ea4e-871b-409a-bc97-b6c7854109bd'} Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:23:26.279379 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cc60519b-4bfb-49c0-86da-aee526f88b0f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 404 len: 111 microversion: 2.1 time: 0.032330 Oct 04 19:23:26.284065 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3923/7822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:26 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:23:26.348173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1383788197", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "6d3be960-37b3-4342-aa11-bb9333fbb54d"}], "security_groups": [{"name": "tempest-securitygroup--611608038"}], "key_name": "tempest-keypair-488682173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:26.463211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] validate_networks() for [('6d3be960-37b3-4342-aa11-bb9333fbb54d', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:23:27.178628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:23:27.179097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:23:27.179641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:23:27.180066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:23:27.180494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:23:27.189224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:27.190294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:27.190746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:27.191506 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:27.191983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:27.192428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:27.208908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:27.214166 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:27.226550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:23:27.228877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:23:27.364088 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89d454ab-c5a0-4272-9f97-9d71c60d54dc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020329 Oct 04 19:23:27.364650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3900/7823] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:23:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:23:27.376247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3fb95a2d-78ec-4964-86cc-690fcc256b86 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:27.377042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3fb95a2d-78ec-4964-86cc-690fcc256b86 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:27.433552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3fb95a2d-78ec-4964-86cc-690fcc256b86 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:27.440879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3fb95a2d-78ec-4964-86cc-690fcc256b86 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1238 microversion: 2.1 time: 0.068614 Oct 04 19:23:27.441347 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3924/7824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:27 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:28.464641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:28.465275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:28.475534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:28.536668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:28.544528 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67af2b06-b429-40db-8d2d-a0c44d783421 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1242 microversion: 2.1 time: 0.084836 Oct 04 19:23:28.545108 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3901/7825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:28 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:29.569499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:29.570107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:29.578021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:29.578506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:29.578944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:29.579763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:29.580886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:29.581319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:29.643499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:29.651443 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-27d76a3a-dfe7-47fd-8e0a-201e92c3a7de tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1308 microversion: 2.1 time: 0.086031 Oct 04 19:23:29.652048 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3925/7826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:29 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:30.675705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:30.676289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:30.683345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:30.683916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:30.684381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:30.685104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:30.685581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:30.686031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:30.905482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:30.913461 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1184863c-1498-4b42-ad48-d2687b3b9cb5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.242285 Oct 04 19:23:30.914052 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3902/7827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:30 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:31.087356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:31.098586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:31.098994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:31.099422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:31.112073 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] Creating event network-changed:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h1-833090-21 Oct 04 19:23:31.117105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b6b199cd-b77c-4145-88a7-4244b1237058 req-e243433b-6264-45d5-bb4f-f7bcef2c8e13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Oct 04 19:23:31.117716 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3926/7828] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:31.938545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:31.939098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:31.946536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:31.947037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:31.947517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:31.948233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:31.948705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:31.949149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:32.082550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:32.090354 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51c62a0f-0f98-45bb-aca8-3a7c5151b451 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.156003 Oct 04 19:23:32.090928 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3903/7829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:31 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:33.115733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:33.116371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:33.122707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.123192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.123680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.124377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:33.124837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:33.125269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:33.259899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:33.267714 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28a17448-0e00-47b0-94be-0d443686d099 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.157195 Oct 04 19:23:33.268794 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3927/7830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:33 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:34.293129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:34.293713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:34.301287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:34.301804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:34.302257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:34.302970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:34.303449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:34.303926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:34.436896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:34.444771 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca4fb1bc-cd02-40b4-9ffa-3298b5216992 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.155911 Oct 04 19:23:34.445349 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3904/7831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:34 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:35.470259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:35.470872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:35.477809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.478322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.478755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.479511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:35.479965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:35.480388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:35.643796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:35.643796 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40732d9e-3513-4503-812d-181428f85fe8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.158405 Oct 04 19:23:35.643796 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3928/7832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:35 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:36.667275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:36.667859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:36.674805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:36.675304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:36.675800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:36.676501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:36.676977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:36.677419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:36.804948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:36.812890 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90b975da-235e-40f3-ac45-dde4ee772a45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.149615 Oct 04 19:23:36.813480 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3905/7833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:36 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:37.457606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "name": "network-vif-plugged", "status": "completed", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:37.463482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:37.468752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.469242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.469678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.480816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] Creating event network-vif-plugged:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h1-833090-21 Oct 04 19:23:37.485989 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c72bb711-1780-4b2a-99eb-133c2957d6d3 req-893389a2-b671-4ae2-b269-f3098af8b887 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Oct 04 19:23:37.486591 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3929/7834] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:37.837581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:37.838128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:37.840059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:37.840799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:37.847130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.848493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.848493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.848873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:37.849353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:37.849806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:37.978788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:37.987723 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d351340f-2073-452c-b82c-421eeb840662 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1363 microversion: 2.1 time: 0.153932 Oct 04 19:23:37.988304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3906/7835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:37 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:39.013294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:39.014007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:39.020708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.021109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.022173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.023110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.023615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.024232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.159174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:39.167081 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f07d56f4-ab2f-4af5-b751-75f361fccf77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1551 microversion: 2.1 time: 0.159393 Oct 04 19:23:39.167701 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3930/7836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:39 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:39.191440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:39.191961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:39.198784 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.199279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.199766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.200465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:39.200934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:39.201375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:39.277679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8c4f814c-ff5c-460c-a926-6f9cdcd1082b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090795 Oct 04 19:23:39.278281 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3907/7837] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:23:39 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:40.260124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:40.269758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:40.270179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:40.270608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:40.274562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:40.282021 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] Creating event network-changed:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h1-833090-21 Oct 04 19:23:40.287448 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b76f6f25-67b3-42c9-b94e-8f1fdbc90fe9 req-fe5dfbd0-3604-4d54-8c12-2ef3abf50bbf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032103 Oct 04 19:23:40.288234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3931/7838] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:20.703526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:20.704605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=64 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:20.708718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:20.711137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:20.719382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:20.720378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:20.721245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:20.722474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:20.723188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:20.723730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:20.756569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:20.769709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:24:20.769887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:24:20.770237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:24:20.770734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:24:20.771160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:24:20.771617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:24:20.982846 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-97afc5be-00b5-42cc-b473-9c67ae0dcd4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/action" status: 202 len: 0 microversion: 2.1 time: 0.280969 Oct 04 19:24:20.983402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3908/7839] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:20 2022] POST /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:24:20.990489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:20.995601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:20.995876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:21.002186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:21.002669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:21.003103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:21.003815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:21.004344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:21.010018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:21.243130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:21.250680 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-05b8e295-a70e-47d3-b64a-b7af668e56d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1679 microversion: 2.1 time: 0.262796 Oct 04 19:24:21.251274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3932/7840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:20 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:22.274584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:22.275487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:22.284077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:22.284525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:22.284979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:22.285721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:22.286192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:22.286637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:22.477280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:22.486270 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94ee29bc-141e-482e-9abc-6ebb6113667f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1679 microversion: 2.1 time: 0.215768 Oct 04 19:24:22.487363 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3909/7841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:22 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:23.512356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:23.513155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:23.520665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:23.521190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:23.521628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:23.522320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:23.522810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:23.523238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:23.657694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:23.665614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dceddbf0-0d16-4368-8655-c07d0e362b9d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1679 microversion: 2.1 time: 0.158490 Oct 04 19:24:23.666849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3933/7842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:23 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:24.689407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:24.690038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:24.696955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:24.697453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:24.697911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:24.698666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:24.699141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:24.699617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:24.828945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:24.836854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c826fe2-a54f-4b6f-baf7-73c3e2bf59b2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.151415 Oct 04 19:24:24.837433 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3910/7843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:24 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:25.861597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:25.862128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:25.868895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:25.869375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:25.870386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:25.871062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:25.871535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:25.871960 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:26.001247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:26.009031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3e154b3b-ea1b-4f8f-9936-081e4350faa9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.151731 Oct 04 19:24:26.009638 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3934/7844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:25 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:27.033197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:27.033867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:27.040884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:27.041409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:27.041870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:27.042581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:27.043059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:27.043531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:27.176035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:27.184413 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cc0354b-5632-4f72-a7f3-0c40c4155c60 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.155253 Oct 04 19:24:27.184994 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3911/7845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:27 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:28.207923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:28.208532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:28.215333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:28.215846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:28.216279 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:28.216958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:28.217407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:28.217827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:28.350294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:28.359161 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4ea05036-5f7d-47f0-9fef-e4355bfc20d8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.155221 Oct 04 19:24:28.359813 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3935/7846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:28 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:29.383007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:29.383665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:29.390909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:29.391401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:29.391880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:29.392579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:29.393076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:29.393513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:29.520483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:29.528903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b911f63b-a413-4289-a53b-b163bf475595 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.149815 Oct 04 19:24:29.529480 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3912/7847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:29 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:30.551673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:30.552293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:30.559760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:30.561171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:30.561171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:30.561371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:30.561801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:30.562259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:30.690379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:30.698238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdf8a092-f9a0-47ab-aabe-4d14fb713844 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.150525 Oct 04 19:24:30.699378 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3936/7848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:30 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:31.722634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:31.723320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:31.730584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:31.731087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:31.731584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:31.732555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:31.733029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:31.733475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:31.863338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:31.871106 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aa6c29f5-f476-4bfc-b2fc-44179c70915f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.152506 Oct 04 19:24:31.873030 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3913/7849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:31 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:32.895276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:32.898892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:32.903181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:32.903704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:32.904134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:32.904811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:32.905259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:32.905684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:33.038777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:33.046662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f51699cc-7c61-4db8-9214-23ccbf31f607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.155329 Oct 04 19:24:33.047236 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3937/7850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:32 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:34.070184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:34.070827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:34.077850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:34.078353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:34.078813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:34.079551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:34.080032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:34.080484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:34.211079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:34.219399 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-abadb94a-d032-416c-8f49-be567a37ac50 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.153162 Oct 04 19:24:34.220067 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3914/7851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:34 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:35.244140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:35.244761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:35.252238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:35.252730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:35.253174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:35.253870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:35.254329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:35.254762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:35.382775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:35.390553 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-991d20b0-4a7e-4ea5-b8c3-8b669dedeb42 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.150384 Oct 04 19:24:35.391147 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3938/7852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:35 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:36.414402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:36.415027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:36.421979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:36.422488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:36.422940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:36.423684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:36.424163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:36.424610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:36.606130 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:36.612258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5989dc16-d174-4d40-9a46-4e0898a0ea43 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1684 microversion: 2.1 time: 0.201895 Oct 04 19:24:36.612827 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3915/7853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:36 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1684 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:37.464904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "name": "network-vif-unplugged", "status": "completed", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:37.474570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:37.475052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:37.475514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:37.488885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Creating event network-vif-unplugged:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h2-833090-21 Oct 04 19:24:37.494967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] Instance 9c873837-a201-448f-a2ae-bd3533c66331 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:24:37.507229 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-0719d04c-42f8-4330-b3fc-4dbd7dcef0c3 req-57a43c3f-d6a8-4688-9a80-f5bdc1e6cf00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103784 Oct 04 19:24:37.508111 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3939/7854] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:37.636174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:37.636839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:37.643886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:37.644392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:37.644851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:37.645568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:37.646045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:37.646494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:37.779970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:37.787733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2efd568c-9480-4b66-b361-19c2e9ec80d9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1683 microversion: 2.1 time: 0.155452 Oct 04 19:24:37.788324 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3916/7855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:37 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:38.812868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:38.813580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:38.820645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:38.821142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:38.821580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:38.822275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:38.822734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:38.823162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:38.961373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:38.969216 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b8ab834-210c-4eb7-99ea-2f6eee4266a6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1681 microversion: 2.1 time: 0.161110 Oct 04 19:24:38.969805 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3940/7856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:38 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:39.527194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:39.537433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:39.537928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:39.538382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:39.549909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Creating event network-changed:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h2-833090-21 Oct 04 19:24:39.555136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] Instance 9c873837-a201-448f-a2ae-bd3533c66331 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:24:39.568265 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-9ef65d50-d5a6-4e83-93a0-b6fb7abb02cd req-aa590e02-52ee-41fc-87f4-e8d87499fa00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044758 Oct 04 19:24:39.568913 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3917/7857] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:39.993272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:39.993909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:40.001625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:40.002106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:40.002536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:40.003232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:40.003747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:40.004225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:40.138621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:40.146576 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c08e0c20-ac93-45d6-b95e-02bc8270e9f5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1681 microversion: 2.1 time: 0.157234 Oct 04 19:24:40.147165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3941/7858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:39 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:41.171964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:41.172676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:41.179776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.180306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.180765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.181482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:41.181966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:41.182424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:41.325406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:41.333462 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-63ff9025-eea0-4852-b7b6-dea5f648c155 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1681 microversion: 2.1 time: 0.167042 Oct 04 19:24:41.334050 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3918/7859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:41 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:42.358662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:42.359284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:42.366591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.367198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.367680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.368396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.368855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.369285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.598396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:42.606188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87b1232a-16fe-4f39-a5c7-4a5453bbcdae tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1678 microversion: 2.1 time: 0.251749 Oct 04 19:24:42.606769 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3942/7860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:42 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:42.629710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:42.630266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:42.638124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.638544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.639001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.639746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.640509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.640654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.678038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.678537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.678993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.679756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:42.680228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:42.680668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:42.701762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:24:42.707020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:24:43.146806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5cb7c7d3-fa64-4041-a7fd-ad550f566029 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/action" status: 202 len: 0 microversion: 2.1 time: 0.520731 Oct 04 19:24:43.147433 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3919/7861] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:42 2022] POST /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:24:43.157036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:43.157712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:43.163905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:43.164397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:43.164835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:43.165530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:43.165986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:43.166416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:43.360612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:43.371373 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-73a00839-c0c2-4479-b0f6-f679661e3102 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.219567 Oct 04 19:24:43.372249 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3943/7862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:43 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:44.397172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:44.397843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:44.405128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:44.405624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:44.406078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:44.406782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:44.407258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:44.407728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:44.425886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:44.536565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:44.544788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c359ed20-d221-47f1-87a6-208da76f50f3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.152906 Oct 04 19:24:44.545359 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3920/7863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:44 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:45.568853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:45.569465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:45.577102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:45.577592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:45.578026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:45.578743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:45.579440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:45.580040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:45.712173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:45.725640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dbe8adc5-da6c-46bc-b4f6-c0d7c76d2c77 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.155049 Oct 04 19:24:45.725640 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3944/7864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:45 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:46.743775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:46.744499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:46.752875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:46.753375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:46.753824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:46.754528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:46.754994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:46.755433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:46.979856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:46.988604 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc05ec85-4876-49f3-969d-c28db2e60cc2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.248740 Oct 04 19:24:46.989205 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3921/7865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:46 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:47.744572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:47.755794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:47.756412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:47.756915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:47.769296 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Creating event network-changed:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h1-833090-21 Oct 04 19:24:47.774766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] Instance 9c873837-a201-448f-a2ae-bd3533c66331 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:24:47.785557 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-97a8b308-34c8-44b7-896c-c3ff5d807c68 req-895b6a26-3462-4fb6-90d3-3b48f9730edd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110115 Oct 04 19:24:47.786377 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3945/7866] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:48.012924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:48.013572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:48.021366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:48.022226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:48.022922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:48.023911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:48.024594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:48.025044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:48.238520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:48.246622 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a5c1d76-1041-43a5-9ee5-e534cda724da tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.237933 Oct 04 19:24:48.247216 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3922/7867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:48 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:49.272720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:49.273433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:49.279749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:49.280238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:49.280681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:49.281377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:49.281834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:49.282261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:49.414632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:49.423006 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1421d5e2-e4d2-4342-8c06-e3a564ec5ac3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1677 microversion: 2.1 time: 0.155475 Oct 04 19:24:49.423621 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3946/7868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:49 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:50.447367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:50.448027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:50.455434 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.455966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.456419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.457132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.457601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.458045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.588785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:50.596711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d182b8bd-0b9f-4ea7-8aec-397e89da4de8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1670 microversion: 2.1 time: 0.153315 Oct 04 19:24:50.597362 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3923/7869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:50 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:50.620382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:50.629873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:50.629873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.629873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.629873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.630383 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.630877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.631306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.764726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:50.773526 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-636111ba-2dc1-4c2a-af72-a096a550647e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1670 microversion: 2.1 time: 0.157057 Oct 04 19:24:50.774136 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3947/7870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:50 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:24:50.796451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:50.797124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:50.803260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.803791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.804253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.804968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.805446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.805895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.938147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:50.945908 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa388152-11bc-4b1f-aef5-8bc267325b19 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1670 microversion: 2.1 time: 0.153491 Oct 04 19:24:50.946492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3924/7871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:50 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:50.968223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:50.968717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:50.974614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.975092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.975552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:50.976240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:50.976694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:50.977120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:51.002891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:24:51.015264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=100 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:51.309694 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-736c2ddf-74c6-400a-9ab4-2f859b863301 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 204 len: 0 microversion: 2.1 time: 0.344842 Oct 04 19:24:51.310440 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3948/7872] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:24:50 2022] DELETE /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:24:51.319152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:51.319842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:51.324325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:51.326745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:51.327257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:51.327755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:51.328499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:51.329042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:51.329496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:51.458149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:51.466045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78aee582-5cfe-44a6-8a6d-0c5a0cf453a0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1676 microversion: 2.1 time: 0.150887 Oct 04 19:24:51.466646 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3925/7873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:51 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:52.491754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:52.492465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:52.499270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:52.500454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:52.500895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:52.501586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:52.502039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:52.502465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:52.628842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:52.636630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-510f79ad-0cd3-411e-92e0-73737aadeecd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1676 microversion: 2.1 time: 0.149255 Oct 04 19:24:52.637211 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3949/7874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:52 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:53.557183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c873837-a201-448f-a2ae-bd3533c66331", "name": "network-vif-deleted", "tag": "6dce7cee-dd91-41c8-9c77-a89cf1a20a58"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:53.563510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:53.569060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:53.569563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:53.570014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:53.582717 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] Creating event network-vif-deleted:6dce7cee-dd91-41c8-9c77-a89cf1a20a58 for instance 9c873837-a201-448f-a2ae-bd3533c66331 on n-h1-833090-21 Oct 04 19:24:53.587924 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-86bcf169-88e7-4d72-9647-93d31b1d73a3 req-6564be05-ad9f-48eb-acd3-571cdee719f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034715 Oct 04 19:24:53.588525 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3926/7875] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:53.660804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:53.662022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:53.665046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:53.670540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:53.671043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:53.673659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:53.673659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:53.673659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:53.673659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:53.750513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:53.759517 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d1e28b62-5b8a-4804-ae25-5c684efac702 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 200 len: 1323 microversion: 2.1 time: 0.102693 Oct 04 19:24:53.760125 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3950/7876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:53 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:24:54.784971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:54.785666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:54.792324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.792831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.793291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.794087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.794568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.795017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.809402 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 HTTP/1.1 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9c873837-a201-448f-a2ae-bd3533c66331'} Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:54.811128 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-17516511-103a-4bdd-a124-7c98a2da24d3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 404 len: 111 microversion: 2.1 time: 0.034122 Oct 04 19:24:54.815419 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3927/7877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:54 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:24:54.831059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:54.831889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:54.839086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.839722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.840169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.840881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:54.841342 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:54.841772 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.856056 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 HTTP/1.1 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9c873837-a201-448f-a2ae-bd3533c66331'} Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:24:54.857980 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b42113b3-5746-44be-8fb2-6858099dc80d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 404 len: 111 microversion: 2.1 time: 0.033179 Oct 04 19:24:54.862219 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3951/7878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:54 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:24:54.908765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-836698075", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "6d3be960-37b3-4342-aa11-bb9333fbb54d"}], "security_groups": [{"name": "tempest-securitygroup--611608038"}], "key_name": "tempest-keypair-488682173", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:55.017249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] validate_networks() for [('6d3be960-37b3-4342-aa11-bb9333fbb54d', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:24:55.678883 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:24:55.679360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:24:55.679877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:24:55.680306 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:24:55.680765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:24:55.690310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:55.694993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:55.694993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:55.694993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:55.694993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:55.694993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:55.709863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:24:55.715241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:24:55.727875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:24:55.730192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:24:55.899892 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7059a856-69e7-4c48-a2ad-d2bf50f39fc8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.995515 Oct 04 19:24:55.900571 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3928/7879] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:24:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:24:55.912592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0fcb3a3f-6313-443a-9ff5-c2f841e00904 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:55.913202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0fcb3a3f-6313-443a-9ff5-c2f841e00904 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:55.971445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0fcb3a3f-6313-443a-9ff5-c2f841e00904 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:55.979406 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0fcb3a3f-6313-443a-9ff5-c2f841e00904 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1237 microversion: 2.1 time: 0.070853 Oct 04 19:24:55.980364 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3952/7880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:55 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:57.005002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:57.005629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:57.012596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.013087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.013532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.014232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:57.014702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:57.015173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:57.080571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:57.088340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8cf658f2-a6d4-44da-9b05-27b7e7de3468 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1241 microversion: 2.1 time: 0.087407 Oct 04 19:24:57.088938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3929/7881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:56 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:58.113875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:58.114539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:58.121395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:58.121878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:58.122552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.123698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:58.124179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:58.125104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.197705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:58.206325 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2bbac862-cc5f-4f82-9aae-010928c6a3ba tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1307 microversion: 2.1 time: 0.096754 Oct 04 19:24:58.206919 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3953/7882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:58 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:59.230588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:24:59.231225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:59.237801 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.238855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.239370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.242537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.242537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.242537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.373018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:24:59.380898 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4a4ce413-e913-4bfd-afcd-eeacf7b6c8dd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.154677 Oct 04 19:24:59.381492 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3930/7883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:24:59 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:24:59.565888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:59.576575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:59.577065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:59.577504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:59.589022 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] Creating event network-changed:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:24:59.594505 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-a4b07958-7b74-4990-93c1-06f056920702 req-403b1758-7c08-41d6-8f4b-2ad03c64a555 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032593 Oct 04 19:24:59.597304 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3954/7884] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:00.406183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:00.406814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:00.413635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.414128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.414581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:00.415280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:00.415783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:00.416223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:00.543862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:00.552489 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a62db5b8-28d4-412a-b21f-517d68f516fb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.150719 Oct 04 19:25:00.553007 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3931/7885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:00 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:01.577233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:01.577979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:01.584294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:01.584780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:01.585224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:01.585914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:01.586397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:01.586863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:01.720862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:01.728684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3217f1b9-a13f-4af0-a06d-892cd3e8050b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.156729 Oct 04 19:25:01.729282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3955/7886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:01 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:02.754161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:02.754829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:02.761900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.762405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.762872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.763615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:02.764095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:02.764543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:02.894265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:02.901045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15ad3b8d-b3ca-4aa8-a924-09d3e24129bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.151375 Oct 04 19:25:02.901622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3932/7887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:02 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:03.925408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:03.926024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:03.932963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:03.933446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:03.933910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:03.934600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:03.935055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:03.935488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:04.064372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:04.072148 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-021f087f-d65f-421c-92a9-e6a094cf6671 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.151317 Oct 04 19:25:04.072731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3956/7888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:03 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:05.096639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:05.097275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:05.104291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:05.104808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:05.105249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:05.106019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:05.106750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:05.107225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:05.239456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:05.247164 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-279a7842-3ab3-4a3a-baa8-87a7995a8795 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.154984 Oct 04 19:25:05.247777 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3933/7889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:05 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:06.271531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:06.272153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:06.274996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:06.279978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:06.280410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:06.280851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:06.281618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:06.282538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:06.282981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:06.415151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:06.423757 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7fa4670e-d8bd-4915-8a1b-bbe9c8bdc457 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.156016 Oct 04 19:25:06.424353 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3957/7890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:06 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:25:07.447481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:07.448136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:07.450164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:07.450862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:07.456658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:07.457161 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:07.457646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:07.458395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:07.458872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:07.459321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:07.598097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:07.606251 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33413ecc-9c8c-428d-8d23-c7bea272cbff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.162747 Oct 04 19:25:07.607090 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3934/7891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:07 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:07.827833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-plugged", "status": "completed", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:07.837406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:07.837884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:07.838315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:07.850153 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] Creating event network-vif-plugged:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:25:07.855224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c7a89ef7-2cd4-426c-8df7-e98556b95941 req-b0029e09-8e2a-422b-b25b-18c62ecd691a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090058 Oct 04 19:25:07.855905 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3958/7892] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:08.631039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:08.631754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:08.638547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:08.639045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:08.639525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:08.640236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:08.640708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:08.641155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:08.772219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:08.779923 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8b2881ca-a2e3-42da-a494-bc85cbf6a80c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1362 microversion: 2.1 time: 0.153540 Oct 04 19:25:08.780495 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3935/7893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:08 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:09.805913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:09.806578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:09.812917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.813404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.814463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.815152 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.815647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.816078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.944096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:09.951855 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a3f234fd-fb9f-4f47-9c18-57371b7a7c55 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1549 microversion: 2.1 time: 0.151200 Oct 04 19:25:09.959290 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3959/7894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:09 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:09.975480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:09.976006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:09.983101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.987981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.987981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.987981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.987981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.987981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:10.066943 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f157aa7b-cc67-42e8-aa28-2a00104ded04 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095492 Oct 04 19:25:10.067598 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3936/7895] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:25:09 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:11.076837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:11.090955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:11.091439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:11.092157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:11.104647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] Creating event network-changed:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:25:11.111701 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f2203ea4-a02a-403a-bb19-5355f2d2057b req-4f973898-9bac-48bb-8554-87108b348ed1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037642 Oct 04 19:25:11.112738 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3960/7896] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:15.294229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:15.295004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=84 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:15.299123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:15.299771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:15.305520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.306010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.306456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:15.307146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.307643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.308080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:15.439910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:15.448214 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b696fa80-bfb7-48c4-90c7-5eabc8141cab tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1668 microversion: 2.1 time: 0.156453 Oct 04 19:26:15.448793 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3937/7897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:15 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:15.469532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=23 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:15.470284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:15.474692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a50b6fd-e9fc-48de-8601-36f94e25b8f1"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:15.477176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:15.483554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.486013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.486013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:15.486013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:15.486013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:15.486013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:16.242759 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-12df1ee0-930b-4304-b6bc-0552271723ca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775118 Oct 04 19:26:16.243624 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3961/7898] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:26:15 2022] POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:28.035334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:28.037783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:28.040743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:28.041410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:28.042675 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:26:28.042822 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/action (ip 10.222.0.40) !!! Oct 04 19:26:28.049252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:28.053405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:28.053405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:28.053405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:28.053405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:28.053405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:28.080875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:28.086962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=123886) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:26:28.093732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:26:28.094173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:26:28.094663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:26:28.095090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:26:28.095540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:26:28.316755 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b9a2727-c68c-412c-a0af-63327210a67f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/action" status: 202 len: 0 microversion: 2.1 time: 0.285313 Oct 04 19:26:28.317365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3938/7899] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:26:28 2022] POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:26:28.323847 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:26:28.324766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:28.325540 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:28.326721 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:26:28.326863 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 (ip 10.222.0.40) !!! Oct 04 19:26:28.331236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:28.331983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:28.340702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:28.341192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:28.341628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:28.342326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:28.342784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:28.343211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:28.478658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:28.487105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e4869ae-5eca-4b4a-a59a-0abbff064538 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1723 microversion: 2.1 time: 0.164777 Oct 04 19:26:28.487722 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3962/7900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:28 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:29.513578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:29.514284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:29.520359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:29.520860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:29.521346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:29.522060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:29.522534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:29.522982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:29.665009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:29.673554 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dc0d7511-e273-4712-acc1-223b96797607 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1723 microversion: 2.1 time: 0.165382 Oct 04 19:26:29.674114 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3939/7901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:29 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:30.697946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:30.698593 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:30.707850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:30.708260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:30.708706 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:30.709408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:30.709862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:30.710374 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:30.715786 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45066. Oct 04 19:26:30.904813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:30.913117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59c09063-8efa-43da-ad4b-24a539525e45 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1723 microversion: 2.1 time: 0.219491 Oct 04 19:26:30.913706 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3963/7902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:30 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:31.937158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:31.937927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:31.944809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:31.945304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:31.945754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:31.946445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:31.946910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:31.947345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:32.076794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:32.084973 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6b9705d-097b-4dc8-a7d4-ca41a0f7814d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.151745 Oct 04 19:26:32.085555 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3940/7903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:31 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:33.108712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:33.109336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:33.116220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:33.116745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:33.117684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:33.118375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:33.118834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:33.119264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:33.251194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:33.259416 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26b29309-7f86-4ac2-87d6-e9e0579f8a06 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.154952 Oct 04 19:26:33.260020 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3964/7904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:33 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:34.283828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:34.284385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:34.292275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:34.292781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:34.293249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:34.293969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:34.294448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:34.294902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:34.422626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:34.432342 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28c6b719-12fa-4e5f-abd8-8c3bc43ae3c7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.152630 Oct 04 19:26:34.432931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3941/7905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:34 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:35.458466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:35.459086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:35.466254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:35.466745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:35.467184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:35.467917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:35.468376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:35.468806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:35.597866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:35.606324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de98617c-00be-4b5b-8081-5c7eac5a7a8a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.151908 Oct 04 19:26:35.606896 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3965/7906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:35 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:36.630181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:36.630817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:36.638237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:36.638739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:36.639200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:36.639952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:36.640409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:36.640851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:36.774989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:36.783288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29ea1504-d61d-4b42-b33b-203276f35086 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.157100 Oct 04 19:26:36.783893 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3942/7907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:36 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:37.807006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:37.807655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:37.816227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:37.816925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:37.817370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:37.818084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:37.818545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:37.818974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:37.951235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:37.957500 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-40b54708-962b-40b4-b2fa-b36b850c790f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.154512 Oct 04 19:26:37.958085 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3966/7908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:37 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:38.981990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:38.982625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:38.989840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:38.990344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:38.990803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:38.991535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:38.992024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:38.992477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:39.122572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:39.130904 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad48a921-c37d-465c-8276-8148fc995276 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.153620 Oct 04 19:26:39.131513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3943/7909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:38 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:40.154380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:40.154996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:40.162058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:40.162543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:40.162986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:40.163703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:40.164167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:40.164596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:40.298611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:40.307663 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a813d33b-e697-41c5-95d8-e96142737cd1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.157200 Oct 04 19:26:40.308251 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3967/7910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:40 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:41.331416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:41.331998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:41.339001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:41.339527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:41.339984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:41.340690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:41.341167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:41.341612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:41.475939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:41.486525 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a71ceab7-8fd2-4e2f-b4a5-a0709b6a3c59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.158807 Oct 04 19:26:41.487625 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3944/7911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:41 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:42.513607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:42.514199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:42.521004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:42.521485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:42.521912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:42.522588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:42.523035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:42.523452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:42.650887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:42.659169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c204b49-0673-45f6-9918-d9d1d099e596 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.150043 Oct 04 19:26:42.659803 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3968/7912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:42 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:43.682979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:43.683635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:43.690556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:43.691055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:43.691602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:43.692308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:43.692779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:43.693222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:43.823284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:43.831599 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e43cd50-547a-4fb8-9b0e-12a2cce1760d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.152679 Oct 04 19:26:43.832204 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3945/7913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:43 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:44.858752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:44.859360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:44.866734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:44.867225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:44.867714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:44.868417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:44.869453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:44.869887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:45.001829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:45.010131 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5327adc-f815-4d87-a045-845abf4a70b7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.155582 Oct 04 19:26:45.010717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3969/7914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:44 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:46.034253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:46.035065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:46.042075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:46.042567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:46.043064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:46.043818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:46.044286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:46.044770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:46.173625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:46.182526 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2564b120-526b-4eb7-a48e-3acc96983a37 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.152231 Oct 04 19:26:46.183117 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3946/7915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:46 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:47.206293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:47.206809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:47.214485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.214968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.215404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.216117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:47.216571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:47.216997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:47.345530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:47.353859 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d1d2d55-5d82-4026-91a7-4f208fd40a2e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.151634 Oct 04 19:26:47.354694 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3970/7916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:47 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:48.378072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:48.378647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:48.386327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:48.386889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:48.387344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:48.388089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:48.388586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:48.389027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:48.525658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:48.533858 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd880260-5bd7-482c-b19f-a0bdf4cf9b94 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.159864 Oct 04 19:26:48.534437 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3947/7917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:48 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:49.557589 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:49.558127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:49.565125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:49.565610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:49.566046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:49.566739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:49.567192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:49.567654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:49.700556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:49.709059 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c7f3043-c26c-4abd-bc8a-7983d68532e2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.155529 Oct 04 19:26:49.709649 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3971/7918] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:49 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:50.733269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:50.733953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:50.741018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:50.741521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:50.741979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:50.742689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:50.743162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:50.743637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:50.889912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:50.898565 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d6c8c682-24c3-4238-96ab-2f24f9b3d613 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1728 microversion: 2.1 time: 0.169381 Oct 04 19:26:50.899184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3948/7919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:50 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:51.923573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:51.924196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:51.931264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:51.931794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:51.932248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:51.933059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:51.933530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:51.933967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:52.067276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:52.075769 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-79052d9f-1e26-4cab-a9c4-23bf3f61cece tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1727 microversion: 2.1 time: 0.156186 Oct 04 19:26:52.076355 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3972/7920] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:51 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:52.096108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:52.107318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:52.107875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:52.108290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:52.119944 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Creating event network-vif-unplugged:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h1-833090-21 Oct 04 19:26:52.125157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:26:52.136761 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b0ccd4d4-435a-4723-8f97-b683dca08127 req-9a0d9f5d-7828-4be9-833f-ebfd0a705baa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044546 Oct 04 19:26:52.137382 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3949/7921] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:53.100198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:53.100836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:53.108654 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:53.109145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:53.109591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:53.110287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:53.110743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:53.111172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:53.252034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:53.260439 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6e7e49e-9548-4ccb-b8cf-03b201439bd9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1727 microversion: 2.1 time: 0.164358 Oct 04 19:26:53.261035 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3973/7922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:53 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:54.153116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:26:54.164575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:54.165089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:54.165541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:54.178645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Creating event network-changed:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h1-833090-21 Oct 04 19:26:54.185112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:26:54.196352 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3f85adf2-dc28-496e-b419-536fd042a8ff req-853dd6eb-199c-42bb-93ee-f156238514a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048462 Oct 04 19:26:54.197575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3950/7923] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:26:54.288189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:54.290378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:54.297967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:54.298743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:54.299407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:54.300554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:54.301245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:54.301897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:54.532921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:54.548823 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8f1f0a84-9fcc-4b0a-9986-095a1c251a4d tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.267000 Oct 04 19:26:54.549972 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3974/7924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:54 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:55.575519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:55.576360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:55.582737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:55.583318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:55.583803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:55.584518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:55.584992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:55.585435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:55.725426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:55.735031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d12ed14f-f801-4ef3-83b5-4fc41bf0458c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.164666 Oct 04 19:26:55.735657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3951/7925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:55 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:56.760207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:56.760822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:56.767641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:56.768132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:56.768578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:56.769270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:56.769728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:56.770159 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:56.908660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:56.917533 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb6cbb96-8891-4370-8a8d-86c51b7c0fa1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.161783 Oct 04 19:26:56.918119 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3975/7926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:56 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:26:57.942129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:57.942772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:57.949631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:57.950138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:57.950595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:57.951308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:57.951816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:57.952267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:58.081915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:58.090406 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9e1142ab-957e-423a-99dc-ae1617bc9964 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.152548 Oct 04 19:26:58.091012 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3952/7927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:57 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:26:59.114692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:26:59.115308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:26:59.118018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=29 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:26:59.122809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:59.123294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:59.123768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:59.124464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:26:59.124923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:26:59.125351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:26:59.258983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:26:59.267766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3a9dc37-52bb-4c95-9af5-be1e8c92aa2a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.156996 Oct 04 19:26:59.268358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3976/7928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:26:59 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:00.292044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:00.292647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:00.295553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=35 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:00.300368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.300872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.301333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.302040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:00.302519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:00.303020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:00.307558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:00.438416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:00.447274 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4f3577b-8ef6-4329-aebb-6063e506df87 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.158918 Oct 04 19:27:00.447564 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3953/7929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:00 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:01.470745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:01.471367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:01.478586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.479324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.479800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.480491 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:01.480950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:01.481379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:01.485527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=91 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:01.614777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:01.623901 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1d0e295b-7578-4bb5-8d2b-8edf5310dcc9 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.157385 Oct 04 19:27:01.624486 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3977/7930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:01 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:02.646738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:02.647379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:02.654438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.654943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.655402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:02.656141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:02.656620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:02.657067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:02.786623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:02.795598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4fb770e8-4dec-4953-8942-46f1e13b2be3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.152905 Oct 04 19:27:02.796197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3954/7931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:02 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:03.820136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:03.820753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:03.828682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:03.829174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:03.829618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.830416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:03.830879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:03.831310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:03.962076 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:03.970358 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f7b5ad58-d177-41dd-ae8e-bf9a2c670a41 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.154177 Oct 04 19:27:03.970936 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3978/7932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:03 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:04.993549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:04.994183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:05.001119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:05.001620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:05.002075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:05.002777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:05.003251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:05.003717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:05.132734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:05.141679 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9376b0bd-bc14-49ac-a3d1-883e614dbcec tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.151956 Oct 04 19:27:05.142274 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3955/7933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:04 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:06.166039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:06.167273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:06.174196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:06.174681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:06.175122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:06.175837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:06.176294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:06.176720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:06.317328 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:06.327569 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9e672a58-a3da-47b5-aeb2-a79c77c76ca7 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1725 microversion: 2.1 time: 0.165350 Oct 04 19:27:06.329592 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3979/7934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:06 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:07.352020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:07.352716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:07.360418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.367656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.367656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.367656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.367656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.367656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.503046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:07.511710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-88f038a3-aa39-4a4e-ae6c-c4e4c02abaff tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1722 microversion: 2.1 time: 0.163441 Oct 04 19:27:07.512371 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3956/7935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:07 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:07.535394 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:07.535947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:07.543577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.549552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.549552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.549552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.549552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.549552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.588775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.589262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.589696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.590443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:07.590892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:07.591319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:07.612610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:27:07.617806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Getting quotas for user d3143de7ff02461584f21dc314fd9f58 and project ea9d48aa443e4de1b7f5902f5e7300a2. Resources: {'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:27:08.044055 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-70e2fc1d-5e75-40f2-9299-51d01c6788b1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/action" status: 202 len: 0 microversion: 2.1 time: 0.512382 Oct 04 19:27:08.044703 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3980/7936] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:27:07 2022] POST /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:27:08.053364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:08.053997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:08.060690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:08.061204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:08.062268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:08.062574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:08.063051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:08.063553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:08.252922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:08.275580 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5205c4e7-89ea-46fd-aae5-98f156d04572 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.213251 Oct 04 19:27:08.275580 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3957/7937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:08 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:09.290818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:09.292157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:09.299384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:09.299892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:09.300325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:09.301006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:09.301457 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:09.301878 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:09.433843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:09.442088 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-95182405-8cfc-4bfe-8a0f-6e0cc917dbdc tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.156514 Oct 04 19:27:09.442662 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3981/7938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:09 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:10.466717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:10.469678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:10.474537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:10.475048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:10.475526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:10.476395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:10.476863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:10.477327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:10.518921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-plugged", "status": "completed", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:10.531157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:10.531751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:10.532273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:10.544792 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Creating event network-vif-plugged:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h1-833090-21 Oct 04 19:27:10.550236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:27:10.562671 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-8a288a93-612d-4ab5-9dbf-e90ff7f16a5e req-388bd124-0168-42e4-8c64-89ec6b1b1458 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047928 Oct 04 19:27:10.563295 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3982/7939] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:27:10.613810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:10.623189 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ee61364-8bcc-4d90-8efd-05778550ed67 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.161643 Oct 04 19:27:10.624020 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3958/7940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:10 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:11.649445 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:11.650172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:11.657528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:11.658007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:11.658440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:11.659129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:11.659678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:11.660104 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:11.794165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:11.803594 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-952f1f7b-d83b-4141-8c91-d5ab6176b0a3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.159030 Oct 04 19:27:11.804439 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3983/7941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:11 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:12.889511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:12.890089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:12.897209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:12.897752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:12.898211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:12.898925 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:12.899395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:12.899865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:13.046089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:13.054651 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-25f1eea3-f5ee-4971-b343-3631a5136258 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.169749 Oct 04 19:27:13.055242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3959/7942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:12 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:14.083241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:14.083882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:14.090860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:14.091350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:14.091824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:14.092518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:14.092977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:14.093403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:14.237657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:14.247151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b0979a98-c48d-4d81-8dda-576823505434 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.167771 Oct 04 19:27:14.247795 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3984/7943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:14 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:14.354835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:14.367598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:14.368102 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:14.368566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:14.382733 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Creating event network-vif-unplugged:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:27:14.388795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:27:14.400543 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-500a950e-754f-46fa-be71-ad9861cf03a1 req-d6ada9b7-209e-4abe-904a-297654fb3e40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051207 Oct 04 19:27:14.401667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3960/7944] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:15.271146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:15.271785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:15.279213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:15.279734 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:15.280177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:15.280866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:15.281319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:15.281745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:15.555042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:15.563391 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69d847ec-0dd8-4fde-86d5-6d65cb4a6487 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.296100 Oct 04 19:27:15.564231 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3985/7945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:15 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:27:15.922006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:15.932553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:15.933189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:15.933652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:15.946577 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Creating event network-changed:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:27:15.952766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:27:15.964323 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6a838d9a-5edc-4ddf-b596-8e578e4a3bc1 req-8d577d6c-08bc-4ed9-a054-e8e8e2df0543 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046788 Oct 04 19:27:15.965321 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3961/7946] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:27:16.590943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:16.592487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:16.609682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:16.610983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:16.612186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:16.613745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:16.614827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:16.615869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:17.052212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:17.067552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-36779946-376d-440a-a9a9-70f45af9ce0a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.483268 Oct 04 19:27:17.068564 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3986/7947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:16 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:18.108017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:18.108777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:18.115210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:18.115755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:18.116222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:18.116938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:18.117416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:18.117881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:18.257378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:18.266464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-feac7058-9b77-4119-8d7e-9b7592a5cf4e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.163906 Oct 04 19:27:18.267041 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3962/7948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:18 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:19.291018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:19.292058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:19.295024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:19.300296 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:19.300799 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:19.301241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:19.301946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:19.302401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:19.302828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:19.452288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:19.462513 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cbb7d639-96bc-456b-870c-6e8f0987d813 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.175628 Oct 04 19:27:19.479495 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3987/7949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:19 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:20.488342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:20.489098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:20.496471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:20.497065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:20.497590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:20.498377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:20.498942 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:20.499452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:20.641877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:20.651844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eb06f99c-b7e3-45cb-8aea-2be0402f6e7b tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.166698 Oct 04 19:27:20.652511 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3963/7950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:20 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:21.676535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:21.677147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:21.685045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:21.685532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:21.685974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:21.686794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:21.687254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:21.687721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:21.824605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:21.834801 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-faa9d805-8797-44b5-8b23-3581139eaeb3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.162169 Oct 04 19:27:21.835717 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3988/7951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:21 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:22.860937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:22.861576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:22.868578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:22.869087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:22.870119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:22.870835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:22.871314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:22.871792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:23.006330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:23.015177 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7839e100-63e5-47e7-af61-20fba86c9779 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.158171 Oct 04 19:27:23.015882 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3964/7952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:22 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:24.042325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:24.042969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:24.049912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:24.050401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:24.050843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:24.051610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:24.052021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:24.057112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:24.185182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:24.193966 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3b464415-6621-436d-b0c7-a8e091c269cd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.155754 Oct 04 19:27:24.194557 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3989/7953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:24 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:25.219608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:25.220197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:25.227275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:25.227892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:25.232259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:25.232259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:25.232259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:25.232259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:25.365985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:25.374380 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4bb718a7-c720-46ed-9c4c-88188e518ab1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.159453 Oct 04 19:27:25.374959 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3965/7954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:25 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:26.398393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:26.398913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:26.405953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:26.406438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:26.406872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:26.407591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:26.408047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:26.408474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:26.538020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:26.546439 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-76acd2b8-ff89-4fd6-9ff7-69eab2fbaccd tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.152069 Oct 04 19:27:26.547019 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3990/7955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:26 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:27.570305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:27.570973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:27.577859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:27.584397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:27.584397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:27.584397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:27.584397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:27.584397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:27.714936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:27.723398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e2613dd6-ecec-4312-891a-9ae03e18bfa2 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.157217 Oct 04 19:27:27.724004 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3966/7956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:27 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:28.748560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:28.749168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:28.756195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:28.756681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:28.757117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:28.757811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:28.758263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:28.758683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:28.762071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:28.898321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:28.906763 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22613c0f-e527-4562-a01f-aad118a0d0fa tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.162602 Oct 04 19:27:28.907338 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3991/7957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:28 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:29.930579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:29.931251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:29.939638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:29.940207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:29.940666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:29.941385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:29.941868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:29.942311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:30.079078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:30.087560 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8a1061a6-ca0f-4c68-a2fd-ba05d4002d9a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1721 microversion: 2.1 time: 0.161092 Oct 04 19:27:30.088166 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3967/7958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:29 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:31.112069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:31.112681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:31.115315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:31.120653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.121134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.121575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.122263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.122717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.123139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.257958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:31.266440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9145e196-c971-45fb-a914-8083fe2dcd6e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1714 microversion: 2.1 time: 0.158264 Oct 04 19:27:31.267219 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3992/7959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:31 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:31.289847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:31.290577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:31.296414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=30 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:31.298391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.298896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.299344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.300082 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.300789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.301232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.303950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=86 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:31.439423 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:31.447895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b8fcd7c4-63fc-4780-a2de-1ccd8fbcecca tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1714 microversion: 2.1 time: 0.162439 Oct 04 19:27:31.448482 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3968/7960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:31 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:31.471351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:31.471994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:31.479030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.479546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.479986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.480672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.481128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.481605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.617143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:31.625614 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26e8d562-30a5-4b87-b2dd-0a3346d01006 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1714 microversion: 2.1 time: 0.158539 Oct 04 19:27:31.626203 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3993/7961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:31 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:31.647875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:31.648399 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:31.655818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.656322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.656777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.657484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.657952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.658394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.684527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:27:31.975217 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cf16e826-3577-49f8-9057-1d456eddbef6 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 204 len: 0 microversion: 2.1 time: 0.330933 Oct 04 19:27:31.975890 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3969/7962] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:31 2022] DELETE /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:27:31.984718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:31.985338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:31.991738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.992231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.992675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:31.993373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:31.993844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:31.994281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:32.126527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:32.135413 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6ebc832-5210-42a6-817c-ccf872f599b8 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1720 microversion: 2.1 time: 0.154131 Oct 04 19:27:32.136029 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3994/7963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:31 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:33.160516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:33.161204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:33.168888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:33.169383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:33.169830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:33.170531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:33.170995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:33.171436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:33.301549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:33.310124 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba7197b6-f014-4378-96ee-1519c4cf0fa3 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1720 microversion: 2.1 time: 0.153967 Oct 04 19:27:33.310703 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3970/7964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:33 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:34.334759 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:34.336317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:34.344137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:34.345395 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:34.345929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:34.346770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:34.347361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:34.347891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:34.362652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-plugged", "status": "completed", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:34.374092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:34.374590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:34.375040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:34.388795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] Creating event network-vif-plugged:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:27:34.394407 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2ce425fe-e7d1-452e-91b4-234cbe9bfe26 req-3f5c8a38-01b2-4d32-9ad0-0fd01fa258dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035423 Oct 04 19:27:34.395191 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3971/7965] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:27:34.770291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:34.779651 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ffff02ac-bcc1-414a-beef-e848e0b864c1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1720 microversion: 2.1 time: 0.448993 Oct 04 19:27:34.781117 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3995/7966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:34 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1720 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:35.237390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e499f5a-01d5-46a5-b09c-7d9af53478d5", "name": "network-vif-deleted", "tag": "f47a30a9-246e-420a-be75-585ab3aec4c1"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:35.249346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:35.249863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:35.250329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:35.262686 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] Creating event network-vif-deleted:f47a30a9-246e-420a-be75-585ab3aec4c1 for instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 on n-h2-833090-21 Oct 04 19:27:35.268711 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ff515a3f-510d-4784-8979-198309208047 req-5da0510d-c7ca-4e64-8ce8-31e029b9bd46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Oct 04 19:27:35.269547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3972/7967] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:27:35.805292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:35.806187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:35.814985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:35.815714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:35.816266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:35.817084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:35.817659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:35.818223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:35.886802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:35.896885 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6775b9b0-3ec6-4282-bcee-50036639e704 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1368 microversion: 2.1 time: 0.096972 Oct 04 19:27:35.911497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3996/7968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:35 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:36.921581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:36.922611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:36.929804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:36.930309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:36.930767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:36.932124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:36.932605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:36.933052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:37.000089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:37.008721 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d2dd695b-d6bd-4c0d-9be6-170a47d85427 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1368 microversion: 2.1 time: 0.091613 Oct 04 19:27:37.009295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3973/7969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:36 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:27:38.032723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:38.033350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:38.040417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:38.040943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:38.041400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:38.042107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:38.042573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:38.043006 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:38.106294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:38.115096 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f9e61c9b-2cf8-49a1-a3eb-250da881861e tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1368 microversion: 2.1 time: 0.086175 Oct 04 19:27:38.120289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3997/7970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:38 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:39.140800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:39.141435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:39.149079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:39.149648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:39.150106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:39.152897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:39.152897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:39.152897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:39.219953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:39.228779 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-017bb504-70b4-4cc7-aeca-54997dca60d1 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1368 microversion: 2.1 time: 0.091906 Oct 04 19:27:39.229305 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3974/7971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:39 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:27:40.252466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:40.253124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:40.260556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.261072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.261512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.262231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.262690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.263120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.298713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:40.299208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:40.299677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:40.300135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lazy-loading 'fault' on Instance uuid 4e499f5a-01d5-46a5-b09c-7d9af53478d5 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:27:40.345297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3143de7ff02461584f21dc314fd9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea9d48aa443e4de1b7f5902f5e7300a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:27:40.354753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-feea48cb-dce5-4121-99f0-845456bda59a tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 200 len: 1373 microversion: 2.1 time: 0.106416 Oct 04 19:27:40.355337 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3998/7972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:40 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 1373 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:27:41.386358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:41.386902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:41.393862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.394357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.394805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.395523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.396025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.396492 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.410608 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 HTTP/1.1 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4e499f5a-01d5-46a5-b09c-7d9af53478d5'} Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.412318 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8eb721f3-d931-4a31-862b-7d281d513723 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 404 len: 111 microversion: 2.1 time: 0.031465 Oct 04 19:27:41.417420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3975/7973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:41 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:41.479498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:41.481693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:41.488910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.489402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.489846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.490573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:41.491035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:41.491495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:41.505676 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-volume_attachments HTTP/1.1 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '4e499f5a-01d5-46a5-b09c-7d9af53478d5'} Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:41.507434 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0486439c-b9da-4879-ab39-a529570519a5 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034240 Oct 04 19:27:41.511921 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 3999/7974] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:27:41 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.112709 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.113301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.120988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.121524 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.121984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.122706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.123181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.123776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.139134 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 HTTP/1.1 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '4e499f5a-01d5-46a5-b09c-7d9af53478d5'} Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.140740 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0893c295-601c-4ee0-ad1d-644c36f201bb tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 404 len: 111 microversion: 2.1 time: 0.033861 Oct 04 19:27:45.145353 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3976/7975] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:45 2022] DELETE /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:27:45.150792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.151425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 4e499f5a-01d5-46a5-b09c-7d9af53478d5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.159098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.159610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.160047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.160739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.161186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.161635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.175522 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 HTTP/1.1 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4e499f5a-01d5-46a5-b09c-7d9af53478d5'} Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.177054 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 4e499f5a-01d5-46a5-b09c-7d9af53478d5 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5200fa5c-4187-42e5-8d09-44b66d8b7f20 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5" status: 404 len: 111 microversion: 2.1 time: 0.031595 Oct 04 19:27:45.181424 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4000/7976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:45 2022] GET /compute/v2.1/servers/4e499f5a-01d5-46a5-b09c-7d9af53478d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.188542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.189055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.195122 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.195730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.196178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.196881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.197346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.197776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.212712 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 HTTP/1.1 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9c873837-a201-448f-a2ae-bd3533c66331'} Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.214927 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ecfe58c8-094f-4efb-a45e-e96e8e962137 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 404 len: 111 microversion: 2.1 time: 0.032554 Oct 04 19:27:45.219120 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3977/7977] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:45 2022] DELETE /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.225956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.226567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9c873837-a201-448f-a2ae-bd3533c66331] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.233254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.233777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.234243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.235062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.235588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.236014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.250278 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 HTTP/1.1 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9c873837-a201-448f-a2ae-bd3533c66331'} Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.259041 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9c873837-a201-448f-a2ae-bd3533c66331 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c6f8a42-1fde-4726-8998-e5c43d8fc02f tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331" status: 404 len: 111 microversion: 2.1 time: 0.031567 Oct 04 19:27:45.264516 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4001/7978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:45 2022] GET /compute/v2.1/servers/9c873837-a201-448f-a2ae-bd3533c66331 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.267615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.268124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.274474 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.274997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.275445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.276172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.277226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.277643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.295094 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd HTTP/1.1 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '2947ea4e-871b-409a-bc97-b6c7854109bd'} Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.296594 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1374c77-4bbf-48ab-8ef8-6b58cad95d31 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 404 len: 111 microversion: 2.1 time: 0.034730 Oct 04 19:27:45.301345 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3978/7979] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:45 2022] DELETE /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.306861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.307363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 2947ea4e-871b-409a-bc97-b6c7854109bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.314053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.314531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.314963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.315788 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.316146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.316615 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.330868 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd HTTP/1.1 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2947ea4e-871b-409a-bc97-b6c7854109bd'} Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.332441 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 2947ea4e-871b-409a-bc97-b6c7854109bd could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fcf78262-8485-4a1f-9123-efa172229f59 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd" status: 404 len: 111 microversion: 2.1 time: 0.031055 Oct 04 19:27:45.336945 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4002/7980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:45 2022] GET /compute/v2.1/servers/2947ea4e-871b-409a-bc97-b6c7854109bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:27:45.343337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.343868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.350010 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.350508 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.350956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.351685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.352151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.352585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.367378 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 HTTP/1.1 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44'} Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.369012 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15ceee15-b848-4ddb-a27f-c2b33e57e75c tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 404 len: 111 microversion: 2.1 time: 0.031507 Oct 04 19:27:45.373446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3979/7981] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:27:45 2022] DELETE /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:27:45.378958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.379594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] [instance: 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:27:45.385685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.386175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.386610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.387293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:45.387827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:45.388256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:45.402268 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] HTTP exception thrown: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Request method failure captured: Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 HTTP/1.1 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPId4olnWfdyAn_V1kveT6t8E-3JSGpJ7AVUXqAIY_whiEVVTVhOMKX8v3OLB8IZsnAjxQpBsxfe33BfsBCppL2t8PlIat99pX7sP7CY_cTMPCGWOXn6IGYnyhtM7B0OEFRyLQKrDgydgBjcZYh021AZIhSf4JkrxSbCiHESylRpr4H4 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea9d48aa443e4de1b7f5902f5e7300a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea9d48aa443e4de1b7f5902f5e7300a2"}]}] Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: ea9d48aa443e4de1b7f5902f5e7300a2 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServerActionsTestJSON-1699784893 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: d3143de7ff02461584f21dc314fd9f58 Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServerActionsTestJSON-1699784893-project Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44'} Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:27:45.403814 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Returning 404 to user: Instance 9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-adaa888f-c041-4bb5-a55b-2b5a793d9119 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44" status: 404 len: 111 microversion: 2.1 time: 0.030077 Oct 04 19:27:45.408117 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4003/7982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:27:45 2022] GET /compute/v2.1/servers/9a70ca9d-4fad-432c-8a4d-3e2d5d96dd44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:27:45.414346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44520067-5489-4647-9265-acc1cf1968d0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] Calling method '.version_select at 0x7f90082dfb80>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:27:45.491639 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44520067-5489-4647-9265-acc1cf1968d0 tempest-ServerActionsTestJSON-1699784893 tempest-ServerActionsTestJSON-1699784893-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488682173" status: 202 len: 0 microversion: 2.1 time: 0.081287 Oct 04 19:27:45.492660 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3980/7983] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 4 19:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488682173 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:27:58.455553 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=25 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:58.456321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=59 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:27:58.600761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-204621197", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "f81b5eea-5e5c-4abc-a032-0046eea852d2"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:27:58.659977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] validate_networks() for [('f81b5eea-5e5c-4abc-a032-0046eea852d2', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:27:59.112458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:27:59.113086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:27:59.113748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:27:59.114170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:27:59.114595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:27:59.125614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.126194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.126700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.127535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:27:59.128123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:27:59.128555 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:27:59.147124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Getting quotas for project 9de866e9fb814a0098b49d1efe3a1752. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:27:59.153080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Getting quotas for user f6a36be6ce564e0ba690d275cba685f9 and project 9de866e9fb814a0098b49d1efe3a1752. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:27:59.166924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:27:59.169367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:27:59.329126 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:28:00.337431 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45328. Oct 04 19:28:00.342651 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d387ca0-f913-4859-b35b-2c445b868b06 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888987 Oct 04 19:28:00.343356 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4004/7984] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:28:00.358505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9b4887d-9bed-486a-b2b2-e6e42021d701 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:00.359138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9b4887d-9bed-486a-b2b2-e6e42021d701 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:00.361473 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:00.362522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:00.417932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a9b4887d-9bed-486a-b2b2-e6e42021d701 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:00.426792 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9b4887d-9bed-486a-b2b2-e6e42021d701 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1216 microversion: 2.1 time: 0.074458 Oct 04 19:28:00.427384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3981/7985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:00 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:01.455932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c127cba6-d397-4d21-a2e7-48b52cf91848 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:01.458324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c127cba6-d397-4d21-a2e7-48b52cf91848 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:01.516802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c127cba6-d397-4d21-a2e7-48b52cf91848 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:01.524902 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c127cba6-d397-4d21-a2e7-48b52cf91848 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1216 microversion: 2.1 time: 0.077765 Oct 04 19:28:01.532274 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4005/7986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:01 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:02.548452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7a4ab1d2-96a3-44f1-a101-6d66198f4840 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:02.549089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7a4ab1d2-96a3-44f1-a101-6d66198f4840 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:02.606273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7a4ab1d2-96a3-44f1-a101-6d66198f4840 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:02.613398 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7a4ab1d2-96a3-44f1-a101-6d66198f4840 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1216 microversion: 2.1 time: 0.069456 Oct 04 19:28:02.613978 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3982/7987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:02 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:03.639774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d8c4997-ed09-4ed1-bfcd-b6c15727e530 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:03.640651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d8c4997-ed09-4ed1-bfcd-b6c15727e530 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:03.714295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d8c4997-ed09-4ed1-bfcd-b6c15727e530 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:03.722085 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d8c4997-ed09-4ed1-bfcd-b6c15727e530 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1216 microversion: 2.1 time: 0.088870 Oct 04 19:28:03.722721 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4006/7988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:03 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:04.746287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:04.746974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:04.756121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.756625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.757081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.757853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:04.758321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:04.758765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:04.836384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:04.844424 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-799ad4af-44b4-4be6-89c1-ae17221fe29f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1220 microversion: 2.1 time: 0.102511 Oct 04 19:28:04.845012 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3983/7989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:04 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:05.868727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:05.869390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:05.877999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:05.878493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:05.878935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:05.879679 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:05.880264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:05.880601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:05.946471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:05.956928 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c4c8b75d-9c2b-48b1-96f2-75baed55cafc tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1220 microversion: 2.1 time: 0.091980 Oct 04 19:28:05.957644 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4007/7990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:05 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:06.981254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:06.981891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:06.990191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:06.990860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:06.991346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:06.992059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:06.992530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:06.992964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:07.069937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:07.075666 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7e6da2f6-a1ec-4759-9960-b436dd578f2f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1276 microversion: 2.1 time: 0.098678 Oct 04 19:28:07.076904 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3984/7991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:06 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:08.100162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:08.101063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:08.108301 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:08.108784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:08.109214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:08.109918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:08.110362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:08.110778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:08.246477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:08.255286 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-095d4ae3-a6fb-4f83-9398-cc49b8525697 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.159113 Oct 04 19:28:08.255909 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4008/7992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:08 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:09.289941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:09.289941 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:09.293404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:09.293923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:09.294408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:09.294903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f61bb1-f9e5-463d-a9b0-ff843f2ec53f", "tag": "566e7d44-99c9-4474-a709-55e0fdef16d8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:09.295322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:09.295748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:09.296200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:09.306535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:09.308804 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:09.309273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:09.309933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:09.324821 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] Creating event network-changed:566e7d44-99c9-4474-a709-55e0fdef16d8 for instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f on n-h1-833090-21 Oct 04 19:28:09.331136 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-7e90d186-b6cc-45a0-bd9b-cc49f9cc266a req-5f13199e-11c2-452d-b34b-8e0ad754c09f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042814 Oct 04 19:28:09.332095 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4009/7993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:09.536159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:09.543863 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1e8851a-f14d-4f65-be90-f55ce88548c9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.267118 Oct 04 19:28:09.544434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3985/7994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:09 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:10.570077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:10.570811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:10.577075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:10.577551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:10.577984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:10.578665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:10.579114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:10.579613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:10.715251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:10.723797 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-28b2e1e8-2108-4327-9756-6859202c4656 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.159408 Oct 04 19:28:10.724375 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4010/7995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:10 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:11.749347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:11.749908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:11.757198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:11.757710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:11.758173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:11.758891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:11.759643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:11.760091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:11.898403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:11.906915 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a6ecc59b-0417-486c-862e-147d39b6fbd7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.162394 Oct 04 19:28:11.907508 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3986/7996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:11 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:12.931030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:12.931680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:12.939417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:12.940782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:12.940782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:12.941191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:12.941651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:12.942080 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:13.081947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:13.090031 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-856b1e07-84fe-406e-a048-ff24f2e60ce7 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.162996 Oct 04 19:28:13.090617 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4011/7997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:12 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:14.114097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:14.114689 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:14.116645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:14.123015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.124073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.124534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.125281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.125788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.126228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.270167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:14.278518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-afe02253-8901-4146-b6c4-fa0a1514c590 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.168428 Oct 04 19:28:14.279054 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3987/7998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:14 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:14.906271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f61bb1-f9e5-463d-a9b0-ff843f2ec53f", "name": "network-vif-plugged", "status": "completed", "tag": "566e7d44-99c9-4474-a709-55e0fdef16d8"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:14.914976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=10 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:14.917521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:14.918029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:14.918468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:14.931102 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] Creating event network-vif-plugged:566e7d44-99c9-4474-a709-55e0fdef16d8 for instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f on n-h1-833090-21 Oct 04 19:28:14.936326 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-925671d7-a58e-44e0-9afb-671519850d0e req-93008686-192b-4c2e-93b2-4054a9822e4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034675 Oct 04 19:28:14.936956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4012/7999] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:15.301778 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:15.302430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:15.309391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:15.309885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:15.310332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:15.311031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:15.311517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:15.311967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:15.445420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:15.454152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dea832ac-a192-43d7-aa4a-27713c2b6951 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.156319 Oct 04 19:28:15.454800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3988/8000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:15 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:16.484665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:16.485506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:16.493236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:16.493720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:16.494161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:16.494860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:16.495314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:16.495766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:16.631595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:16.639437 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a1b736c8-a1d5-4056-8e9d-a84dac0fdde0 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1316 microversion: 2.1 time: 0.160005 Oct 04 19:28:16.640044 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4013/8001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:16 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:17.664443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:17.665079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:17.672724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:17.673237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:17.673697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:17.674406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:17.674903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:17.675355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:17.809408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:17.817778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-782d1fba-19b5-40b4-accf-78a14ffb65a9 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.157446 Oct 04 19:28:17.818365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3989/8002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:17 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:17.882566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1575314615", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "f81b5eea-5e5c-4abc-a032-0046eea852d2"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:17.937042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] validate_networks() for [('f81b5eea-5e5c-4abc-a032-0046eea852d2', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:28:18.312052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:28:18.312481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:28:18.312961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:28:18.313439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:28:18.313905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:28:18.322986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:18.323495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:18.323934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:18.324688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:18.325145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:18.325573 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:18.344439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Getting quotas for project 9de866e9fb814a0098b49d1efe3a1752. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:28:18.350116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Getting quotas for user f6a36be6ce564e0ba690d275cba685f9 and project 9de866e9fb814a0098b49d1efe3a1752. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:28:18.363092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:28:18.365475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:28:18.493186 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c413a72-83b9-45e3-a3a8-8591417a5a15 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614525 Oct 04 19:28:18.493938 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4014/8003] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:28:18.505322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a81cb9d7-6496-413b-a1fe-a618b26b828b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:18.506121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a81cb9d7-6496-413b-a1fe-a618b26b828b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:18.563817 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a81cb9d7-6496-413b-a1fe-a618b26b828b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:18.567072 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a81cb9d7-6496-413b-a1fe-a618b26b828b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1217 microversion: 2.1 time: 0.065953 Oct 04 19:28:18.567681 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3990/8004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:18 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:19.592460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7712fb70-6261-4db0-997d-4d3904e2bac1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:19.593084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7712fb70-6261-4db0-997d-4d3904e2bac1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:19.646695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7712fb70-6261-4db0-997d-4d3904e2bac1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:19.653751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7712fb70-6261-4db0-997d-4d3904e2bac1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1217 microversion: 2.1 time: 0.067449 Oct 04 19:28:19.657095 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4015/8005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:19 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:20.677729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:20.678362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:20.686287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:20.686800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:20.687282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:20.688034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:20.688547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:20.688999 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:20.754980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:20.763353 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-650b77f7-24a7-4463-a4c6-502cf43f4860 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1269 microversion: 2.1 time: 0.089775 Oct 04 19:28:20.764582 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3991/8006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:20 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:21.793865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:21.794477 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:21.802224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:21.802686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:21.803124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:21.803870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:21.804321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:21.804741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:22.055746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:22.065305 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-77f641b0-867a-43e3-b5c2-dc09a8350bec tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.275115 Oct 04 19:28:22.072024 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4016/8007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:21 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:23.070587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1851cbee-d603-45ae-8676-e46ca5688b32", "tag": "2132eb7f-23e4-42a8-b962-9c44f98c924f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:23.082047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:23.082692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:23.083451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:23.097250 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] Creating event network-changed:2132eb7f-23e4-42a8-b962-9c44f98c924f for instance 1851cbee-d603-45ae-8676-e46ca5688b32 on n-h2-833090-21 Oct 04 19:28:23.103288 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5d84430f-1971-4ff1-9018-4491763ef7ee req-4abcc03f-720d-4f53-975a-65728d4c4c58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036853 Oct 04 19:28:23.104289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:23.105016 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3992/8008] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:23.106828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:23.125088 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:23.125738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:23.126348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:23.127257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:23.127870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:23.128499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:23.385466 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:23.387922 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de39305b-cb95-4078-9189-737fca137ab3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.296793 Oct 04 19:28:23.389610 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4017/8009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:23 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:24.414777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:24.415557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:24.422603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:24.423113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:24.423602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:24.424318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:24.424794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:24.425245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:24.575036 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:24.585135 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fca21898-138f-4e23-b561-256bb421e56f tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.175792 Oct 04 19:28:24.585723 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3993/8010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:24 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:25.610588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:25.611348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:25.619112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:25.619718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:25.620163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:25.620950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:25.621341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:25.621825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:25.771444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:25.781122 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38858c1a-f857-4f26-9dae-d09eb1869715 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.175063 Oct 04 19:28:25.781736 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4018/8011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:25 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:26.805803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:26.806435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:26.813501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:26.813998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:26.814443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:26.815145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:26.815642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:26.816078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:26.956105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:26.965487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b0941d45-a2e0-4a1d-838a-c223f4479b09 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.163501 Oct 04 19:28:26.966089 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3994/8012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:26 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:27.992234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:27.992859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:28.000484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:28.000973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:28.001421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:28.002165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:28.002798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:28.003371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:28.140813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:28.149577 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e99f28d3-8f5d-45c2-8d1d-ce03c2e37642 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.161855 Oct 04 19:28:28.150191 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4019/8013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:27 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:29.174707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:29.175354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:29.177913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:29.182900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:29.183408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:29.183892 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:29.184621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:29.185142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:29.185594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:29.334715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:29.342964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c02f9013-02ab-4af6-9f3f-c7324de77f2a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.172132 Oct 04 19:28:29.343694 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3995/8014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:29 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:30.366736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:30.367276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:30.369292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:30.370795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:30.371428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:30.376413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:30.376942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:30.377377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:30.378072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:30.378520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:30.378943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:30.381828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=63 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:30.525421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:30.534057 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8c6891e4-6487-4149-9908-6cb8bb4d5eb4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.171418 Oct 04 19:28:30.534655 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4020/8015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:30 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:30.670668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1851cbee-d603-45ae-8676-e46ca5688b32", "name": "network-vif-plugged", "status": "completed", "tag": "2132eb7f-23e4-42a8-b962-9c44f98c924f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:30.681769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:30.682262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:30.682712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:30.694980 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] Creating event network-vif-plugged:2132eb7f-23e4-42a8-b962-9c44f98c924f for instance 1851cbee-d603-45ae-8676-e46ca5688b32 on n-h2-833090-21 Oct 04 19:28:30.700320 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-169fae5b-457a-4c55-a7d5-98f92141c6d6 req-03cf1409-7b20-4788-8c6f-74d924cceaf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033403 Oct 04 19:28:30.700934 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3996/8016] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:31.558526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:31.559163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:31.568364 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:31.569193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:31.569842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:31.570768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:31.571725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:31.572274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:31.708952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:31.717726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84bb83f6-bfff-482f-a770-a7f13646dbcb tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1317 microversion: 2.1 time: 0.163847 Oct 04 19:28:31.718318 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4021/8017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:31 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:32.743259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:32.744043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:32.750705 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:32.751231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:32.751739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:32.752463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:32.752981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:32.753435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:32.894867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:32.904202 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14b8bb13-6404-472f-9d29-9e467f04d262 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1505 microversion: 2.1 time: 0.166651 Oct 04 19:28:32.904792 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3997/8018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:32 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:32.928984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:32.933731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:32.936723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:32.937215 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:32.937661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:32.938429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:32.939443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:32.939966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:32.967753 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:28:33.216551 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93bb6e45-b6de-4643-ad66-0e8a8fcf3e6b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 204 len: 0 microversion: 2.1 time: 0.291204 Oct 04 19:28:33.217188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4022/8019] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:28:32 2022] DELETE /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:28:33.225958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:33.226599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:33.234580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:33.235018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:33.235989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:33.236769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:33.237419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:33.237872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:33.374891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:33.384234 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ffebbecf-c561-4b55-b33f-6b894318122c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1511 microversion: 2.1 time: 0.162751 Oct 04 19:28:33.384813 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3998/8020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:33 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:34.408959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:34.410118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:34.417133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:34.417638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:34.418095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:34.418831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:34.419326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:34.419834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:34.574686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:34.583242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b40be37-a136-4e95-a233-96e21c685c81 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1511 microversion: 2.1 time: 0.178910 Oct 04 19:28:34.583854 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4023/8021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:34 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:35.358736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1851cbee-d603-45ae-8676-e46ca5688b32", "name": "network-vif-deleted", "tag": "2132eb7f-23e4-42a8-b962-9c44f98c924f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:35.366466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=43 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:35.373773 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:35.375019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:35.376304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:35.389215 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=83 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:28:35.398516 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] Creating event network-vif-deleted:2132eb7f-23e4-42a8-b962-9c44f98c924f for instance 1851cbee-d603-45ae-8676-e46ca5688b32 on n-h2-833090-21 Oct 04 19:28:35.403852 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c98a4908-0056-4127-a095-3de9ce99dee6 req-21bce8fa-e72a-465f-a8b9-4f486693b7d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049247 Oct 04 19:28:35.404650 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 3999/8022] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:35.607292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:35.607976 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:35.615079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:35.615625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:35.616105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:35.616827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:35.617304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:35.617744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:35.688123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:35.697432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-80813ede-5d9a-496e-a5ba-b2b5349491a4 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1302 microversion: 2.1 time: 0.094208 Oct 04 19:28:35.698038 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4024/8023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:35 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:28:36.725729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:36.726363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:36.734669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:36.735133 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:36.736548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:36.737262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:36.737743 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:36.738195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:36.773895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:36.774395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:36.774933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:36.775540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lazy-loading 'fault' on Instance uuid 1851cbee-d603-45ae-8676-e46ca5688b32 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:28:36.821298 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:36.832368 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bd56ee8f-a4cf-4291-b06e-054731b42cc3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 200 len: 1307 microversion: 2.1 time: 0.112216 Oct 04 19:28:36.833655 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4000/8024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:36 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:37.857130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:37.857748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:37.866677 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:37.867207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:37.867714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:37.868454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:37.868949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:37.869435 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:37.884833 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 HTTP/1.1 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1851cbee-d603-45ae-8676-e46ca5688b32'} Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:37.886629 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 404 to user: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebac1f78-b009-4629-a0b3-802991cdb026 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 404 len: 111 microversion: 2.1 time: 0.034987 Oct 04 19:28:37.892747 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4025/8025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:37 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:28:37.899245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:37.899911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:37.907268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:37.908437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:37.908893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:37.909604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:37.910077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:37.910518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.044532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.053158 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3d6221e5-baa5-4050-8be2-32058a2f19d1 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.158378 Oct 04 19:28:38.053792 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4001/8026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:37 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:38.078308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:38.081413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 2f5b347a-ed14-4591-b38e-b5e2d73210bd] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.087092 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/2f5b347a-ed14-4591-b38e-b5e2d73210bd/action HTTP/1.1 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 32 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: {"resize": {"flavorRef": "452"}} Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '2f5b347a-ed14-4591-b38e-b5e2d73210bd', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:28:38.088757 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 404 to user: Instance 2f5b347a-ed14-4591-b38e-b5e2d73210bd could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d208446-6d58-4fce-a1fd-2951f4d6f997 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "POST /compute/v2.1/servers/2f5b347a-ed14-4591-b38e-b5e2d73210bd/action" status: 404 len: 111 microversion: 2.1 time: 0.016220 Oct 04 19:28:38.094562 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4026/8027] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:28:38 2022] POST /compute/v2.1/servers/2f5b347a-ed14-4591-b38e-b5e2d73210bd/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:28:38.100249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:38.100882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.107226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.107750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.108199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.108899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.109362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.109797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.248979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.259060 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9d1d790-4425-44ec-b12a-f195c33322b2 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.163460 Oct 04 19:28:38.259699 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4002/8028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:38 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:38.283143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:38.283851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.291169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.291732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.292181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.292896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.293359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.293790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.436170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.446549 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff5fb715-8051-4424-93ba-e1824e43fbbf tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.167536 Oct 04 19:28:38.447176 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4027/8029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:38 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:38.470062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "afc82269-e742-4d91-8438-167f6cdcc34c"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:38.472593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.479520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.480013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.480545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.481275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.481739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.482249 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.577461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.584479 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: request: POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action HTTP/1.1 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 65 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: {"resize": {"flavorRef": "afc82269-e742-4d91-8438-167f6cdcc34c"}} Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: exception: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '49f61bb1-f9e5-463d-a9b0-ff843f2ec53f', 'body': {'resize': {'flavorRef': 'afc82269-e742-4d91-8438-167f6cdcc34c'}}} Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:38.586669 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 400 to user: Flavor afc82269-e742-4d91-8438-167f6cdcc34c could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-645cbb3a-a294-4a1d-b087-2a54577a2c28 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action" status: 400 len: 107 microversion: 2.1 time: 0.122442 Oct 04 19:28:38.591365 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4003/8030] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:28:38 2022] POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action => generated 107 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:28:38.599311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:38.600020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.606715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.607234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.607716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.608462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.608932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.609384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.745911 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.756635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6499c72-b99f-43fd-a8d7-16532309ea74 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.161332 Oct 04 19:28:38.757378 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4028/8031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:38 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:38.780607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:38.781995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.788443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.788923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.789395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.790146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.790639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.791110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.930373 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:38.938512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7c2f6a8-1755-4ac3-ba16-a9986b29b73e tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.162070 Oct 04 19:28:38.939101 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4004/8032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:38 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:38.961782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ae7074c-1b8f-4303-a72b-967015754f69 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ae7074c-1b8f-4303-a72b-967015754f69 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: request: POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action HTTP/1.1 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 29 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: {"resize": {"flavorRef": ""}} Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '49f61bb1-f9e5-463d-a9b0-ff843f2ec53f', 'body': {'resize': {'flavorRef': ''}}} Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise error Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi '' Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.966504 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ae7074c-1b8f-4303-a72b-967015754f69 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ae7074c-1b8f-4303-a72b-967015754f69 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action" status: 400 len: 113 microversion: 2.1 time: 0.010713 Oct 04 19:28:38.971913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4029/8033] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:28:38 2022] POST /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 19:28:38.978250 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:38.978882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:38.985000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.986184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.986644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:38.987357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:38.987873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:38.988320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.128103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:39.136131 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff44367a-7d4e-4b80-af78-8efe0ee40c5b tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1504 microversion: 2.1 time: 0.162191 Oct 04 19:28:39.136701 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4005/8034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:38 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:39.164327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:39.164983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:39.173651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.174185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.174647 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.175376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.175869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.176343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.190422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 HTTP/1.1 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '1851cbee-d603-45ae-8676-e46ca5688b32'} Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:28:39.192141 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 404 to user: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-206b6b5f-6002-45dd-ad21-d211687f694c tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 404 len: 111 microversion: 2.1 time: 0.034168 Oct 04 19:28:39.197012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4030/8035] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:28:39 2022] DELETE /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:28:39.202636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:39.203293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 1851cbee-d603-45ae-8676-e46ca5688b32] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:39.211610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.212179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.212720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.213480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.213961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.214408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.229397 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 HTTP/1.1 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '1851cbee-d603-45ae-8676-e46ca5688b32'} Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:39.230993 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 404 to user: Instance 1851cbee-d603-45ae-8676-e46ca5688b32 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae14f34a-5091-46f2-a023-14a41c371b4a tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32" status: 404 len: 111 microversion: 2.1 time: 0.034189 Oct 04 19:28:39.235409 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4006/8036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:39 2022] GET /compute/v2.1/servers/1851cbee-d603-45ae-8676-e46ca5688b32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:28:39.242930 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:39.248386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:39.250539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.251255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.251886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.252884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.253544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.254190 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.286543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:28:39.662392 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b077580-79f9-41ee-9f47-f953d0554133 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 204 len: 0 microversion: 2.1 time: 0.423641 Oct 04 19:28:39.663199 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4031/8037] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:28:39 2022] DELETE /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:28:39.673656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:39.674284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:39.682611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.683146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.683640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.684558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:39.685251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:39.685746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:39.831344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:39.841857 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3cca10f3-bbfc-486e-8861-eee4d468c683 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1510 microversion: 2.1 time: 0.173606 Oct 04 19:28:39.842447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4007/8038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:39 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:40.867124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:40.867867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:40.875023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:40.875525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:40.875959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:40.876652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:40.877099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:40.877518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:41.023684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:41.032550 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b8d47e06-6239-4ef3-a55e-d11566c0ebdd tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1510 microversion: 2.1 time: 0.169890 Oct 04 19:28:41.033781 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4032/8039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:40 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:41.750523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f61bb1-f9e5-463d-a9b0-ff843f2ec53f", "name": "network-vif-deleted", "tag": "566e7d44-99c9-4474-a709-55e0fdef16d8"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:28:41.762432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:41.763111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:41.763393 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:41.776567 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] Creating event network-vif-deleted:566e7d44-99c9-4474-a709-55e0fdef16d8 for instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f on n-h1-833090-21 Oct 04 19:28:41.781909 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5d6bb106-24e5-49a4-bbcb-4ce88392c0c4 req-0db16c75-3e41-458e-aac9-6aed4eb8cbdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035335 Oct 04 19:28:41.783634 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4008/8040] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:28:42.058145 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:42.059165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:42.067506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:42.068017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:42.068459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:42.069173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:42.069631 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:42.070064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:42.105806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:42.106451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:42.106938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:42.107359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lazy-loading 'fault' on Instance uuid 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:28:42.150516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a36be6ce564e0ba690d275cba685f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de866e9fb814a0098b49d1efe3a1752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:28:42.158748 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3ce097c1-a5ee-45e5-8187-e51ac2954749 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 200 len: 1306 microversion: 2.1 time: 0.105209 Oct 04 19:28:42.163526 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4033/8041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:42 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:28:43.183810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:28:43.184536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] [instance: 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:28:43.191023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:43.191551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:43.192006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:43.192723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:28:43.193230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:28:43.193679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:28:43.208372 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] HTTP exception thrown: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Request method failure captured: Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f HTTP/1.1 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIk-_oDUlxHP0lNLwkhGq2vQq-V5i9GoJPwSNPajrGOAEDkoJi45mEii9krTgWPQ8GJqgt_zDhnpcSXEOwkkwLaLkaEUnNa_tY0flK69SmR5QGmx-FgilSdTKVD_CpsbIjbJPyCZX-48cbfMM32WQ3vJugQKdlFrpEitX82Z4Qafkxc Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de866e9fb814a0098b49d1efe3a1752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de866e9fb814a0098b49d1efe3a1752"}]}] Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 9de866e9fb814a0098b49d1efe3a1752 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865787576 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: f6a36be6ce564e0ba690d275cba685f9 Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-ServersNegativeTestJSON-1865787576-project Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '49f61bb1-f9e5-463d-a9b0-ff843f2ec53f'} Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:28:43.210098 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] Returning 404 to user: Instance 49f61bb1-f9e5-463d-a9b0-ff843f2ec53f could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51493e2f-0d35-4297-88a8-ba5df92635e3 tempest-ServersNegativeTestJSON-1865787576 tempest-ServersNegativeTestJSON-1865787576-project] 10.222.0.40 "GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f" status: 404 len: 111 microversion: 2.1 time: 0.033191 Oct 04 19:28:43.215331 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4009/8042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:28:43 2022] GET /compute/v2.1/servers/49f61bb1-f9e5-463d-a9b0-ff843f2ec53f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 19:29:32.091822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:32.092601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:32.250517 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: .version_select at 0x7f900d69ed30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1616117999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqheRVj/SClivAid02t9EgqA4XWwjSwe+Q7SGHKlR7qDqqil0bx5vmBoXxq0K6BCgcMsHldTaFklJFFqd9ckbtS5JxieFHTZXvsIgqDv7P4JkU8mapg93eN2l4uXOZB/A=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:32.268889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:29:32.274392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:29:32.288270 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:29:33.296966 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45744. Oct 04 19:29:33.447188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6ce26f25-342f-4280-8b1b-40770bfa4802 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.360578 Oct 04 19:29:33.448027 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4034/8043] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:29:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:33.503593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-112442765", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1616117999", "networks": [{"uuid": "47180040-66e9-407c-888c-6a7263dcd0cb"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:33.512785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=25 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:33.513461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=49 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:33.694471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] validate_networks() for [('47180040-66e9-407c-888c-6a7263dcd0cb', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:29:34.237738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:29:34.238559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:29:34.239457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:29:34.240231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:29:34.240987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:29:34.255004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:34.255815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:34.256520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:34.257665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:34.258404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:34.259101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:34.287621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:29:34.295120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:29:34.315455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:29:34.319496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:29:34.448083 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:29:35.461438 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45764. Oct 04 19:29:35.465783 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-516478b6-29fc-4ae1-b81e-fe6aa34de16c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.966463 Oct 04 19:29:35.472972 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4010/8044] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:29:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:29:35.478310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe232bba-8a40-4c33-8faa-f1558a57e021 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:35.479919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe232bba-8a40-4c33-8faa-f1558a57e021 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:35.684791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fe232bba-8a40-4c33-8faa-f1558a57e021 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:35.695354 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe232bba-8a40-4c33-8faa-f1558a57e021 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1262 microversion: 2.1 time: 0.221180 Oct 04 19:29:35.696073 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4035/8045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:35 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1262 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:29:36.720959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:36.721604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:36.728387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.728895 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.729350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.730069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:36.730543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:36.730988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:36.799576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:36.807487 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89a9c6ca-6af2-4e27-9cd7-b21f9df9635e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1266 microversion: 2.1 time: 0.092933 Oct 04 19:29:36.809562 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4011/8046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:36 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:37.834972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:37.835676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:37.843559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:37.844083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:37.844530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:37.845915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:37.846452 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:37.846894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:37.915910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:37.924467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-745f3407-574d-4d9c-9528-c00039afa20f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1322 microversion: 2.1 time: 0.093471 Oct 04 19:29:37.931300 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4036/8047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:37 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1322 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:38.948281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:38.948978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:38.957283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:38.957823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:38.958284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:38.959079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:38.959648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:38.960123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:39.126470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:39.131861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e63e2602-1608-4ccf-958d-4386d76a7616 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.187818 Oct 04 19:29:39.132434 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4012/8048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:38 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:39.594473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c0286c-829f-451f-980b-04bece3b4f3d", "tag": "cb178a36-5a38-42f5-b6f2-79002e8111b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:39.605735 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:39.606269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:39.606695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:39.618535 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] Creating event network-changed:cb178a36-5a38-42f5-b6f2-79002e8111b9 for instance 89c0286c-829f-451f-980b-04bece3b4f3d on n-h1-833090-21 Oct 04 19:29:39.623656 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ed2de2ea-764d-4cfb-85b2-fbfe6473f8c7 req-3306fd21-1599-420a-af20-932f82b3f332 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033720 Oct 04 19:29:39.624452 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4037/8049] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:40.155818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:40.156386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:40.163664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:40.164178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:40.164642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:40.165391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:40.166054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:40.166693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:40.371934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:40.381409 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8293afcf-53e9-4c55-b9a1-15567f6b2d17 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.229636 Oct 04 19:29:40.382008 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4013/8050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:40 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:41.407651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:41.408934 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:41.415777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:41.416275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:41.416721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:41.417421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:41.417925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:41.418359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:41.566277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:41.574256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9287c784-ba75-4b8b-9ecc-c48246790f25 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.172126 Oct 04 19:29:41.574842 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4038/8051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:41 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:42.598453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:42.598984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:42.609077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:42.609577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:42.610031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:42.610755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:42.611230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:42.611703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:42.762090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:42.773381 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c762998-4699-4430-a337-568751b181dd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.178736 Oct 04 19:29:42.774226 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4014/8052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:42 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:43.802388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:43.802908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:43.810455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:43.810938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:43.811375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:43.812098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:43.812554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:43.812985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:43.957138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:43.973898 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f888669e-b3d8-455c-8139-7e001e6fab97 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.175493 Oct 04 19:29:43.974492 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4039/8053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:43 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:29:44.998069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:44.998694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:45.001519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:45.002633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:45.007894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:45.008397 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:45.008844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:45.009553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:45.010021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:45.010459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:45.147455 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:45.155894 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1c251f7-bd48-4ef2-a987-111a3fe5d5c5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.161642 Oct 04 19:29:45.163810 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4015/8054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:44 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:45.232608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c0286c-829f-451f-980b-04bece3b4f3d", "name": "network-vif-plugged", "status": "completed", "tag": "cb178a36-5a38-42f5-b6f2-79002e8111b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:45.245725 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:45.246251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:45.246754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:45.260409 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] Creating event network-vif-plugged:cb178a36-5a38-42f5-b6f2-79002e8111b9 for instance 89c0286c-829f-451f-980b-04bece3b4f3d on n-h1-833090-21 Oct 04 19:29:45.265467 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ff878dd7-8c3b-43e0-85a6-a006a29da559 req-ec95704c-8371-4f5e-b716-852d707acd06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037043 Oct 04 19:29:45.268155 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4040/8055] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:29:46.180383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:46.181007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:46.187948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:46.188443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:46.189551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.190251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:46.190719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:46.191158 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:46.337680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:46.342195 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-07ef795d-30e2-4837-b7d7-146016c26402 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1362 microversion: 2.1 time: 0.165756 Oct 04 19:29:46.342830 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4016/8056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:46 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:47.364447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:29:47.369579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:47.370292 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:47.377334 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.377829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.378300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.378983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.379443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.379897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.517071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:47.525333 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-221d13ea-f635-4855-a698-0fba75f70487 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1554 microversion: 2.1 time: 0.161870 Oct 04 19:29:47.525928 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4041/8057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:47 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:47.548805 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:29:47.549421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:47.556545 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.557058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.557516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.558236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:47.558714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:47.559154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:47.692101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:29:47.699926 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-710f9012-98d0-49ea-8aff-974f262d4186 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1554 microversion: 2.1 time: 0.155514 Oct 04 19:29:47.700504 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4017/8058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:29:47 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:29:50.843074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9205c9a-17cb-415a-8d6b-d9ed00cad295"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:29:50.845707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:29:50.853480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.853969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.854415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:50.855115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:29:50.855603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:29:50.856036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:29:51.600986 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c59ccc30-4cb0-449a-a57e-789f970e1477 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761656 Oct 04 19:29:51.601788 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4042/8059] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:29:50 2022] POST /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:03.461767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:03.462345 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:03.465690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:03.466415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=44 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:03.475520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.476247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.476998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.478193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.478821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.479422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.570334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lazy-loading 'services' on Instance uuid 89c0286c-829f-451f-980b-04bece3b4f3d {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:30:03.797237 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b5338126-cb12-416f-b8e0-cc01c1241d63 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments/a9205c9a-17cb-415a-8d6b-d9ed00cad295" status: 202 len: 0 microversion: 2.1 time: 0.339556 Oct 04 19:30:03.798384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4018/8060] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:30:03 2022] DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments/a9205c9a-17cb-415a-8d6b-d9ed00cad295 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:03.806474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:03.807320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:03.812316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:03.815058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:03.822578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.823113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.823582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.824306 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:03.824768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:03.825202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:03.864824 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-157c8723-0561-46c3-ba98-5838f3fe43d0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060495 Oct 04 19:30:03.865414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4043/8061] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:03 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:30:04.880980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:04.883315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:04.889909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:04.890415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:04.890875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:04.891642 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:04.892123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:04.892585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:04.925130 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-13214bdc-dfdc-41f0-9ff6-3e1aa64e01a4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050913 Oct 04 19:30:04.925934 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4019/8062] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:04 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:05.939164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:05.941716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:05.950992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.951507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.951953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.952670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:05.953171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:05.955305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:05.987359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87f56643-97ac-4903-9b24-c77087f608d8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053330 Oct 04 19:30:05.988004 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4044/8063] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:05 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:30:07.000615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:07.002898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:07.010009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:07.010511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:07.010973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:07.011720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:07.012192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:07.012633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:07.056273 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8dcc360a-5323-47b4-a9a0-fd1dc604a75c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059706 Oct 04 19:30:07.056871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4020/8064] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:06 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:08.070486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:08.072769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:08.079563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:08.079988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:08.080450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:08.081143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:08.081596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:08.082016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:08.118384 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-42d3fbbf-549d-440a-bd8e-4d9e85574a65 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053416 Oct 04 19:30:08.118989 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4045/8065] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:08 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:09.132313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:09.133993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:09.141388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:09.141848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:09.142800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:09.143335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:09.143829 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:09.144299 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:09.175276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-48178108-f4f5-4287-be8b-9bd2235b86b7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047437 Oct 04 19:30:09.175961 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4021/8066] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:09 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:30:09.190868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:09.196447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:09.198528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:09.199343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:09.199524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:09.200144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:09.200597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:09.201024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:09.277725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 89c0286c-829f-451f-980b-04bece3b4f3d is not attached to volume a9205c9a-17cb-415a-8d6b-d9ed00cad295 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments/a9205c9a-17cb-415a-8d6b-d9ed00cad295 HTTP/1.1 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 89c0286c-829f-451f-980b-04bece3b4f3d is not attached to volume a9205c9a-17cb-415a-8d6b-d9ed00cad295 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '89c0286c-829f-451f-980b-04bece3b4f3d', 'id': 'a9205c9a-17cb-415a-8d6b-d9ed00cad295'} Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9205c9a-17cb-415a-8d6b-d9ed00cad295. Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c0286c-829f-451f-980b-04bece3b4f3d is not attached to volume a9205c9a-17cb-415a-8d6b-d9ed00cad295 Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:09.293123 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c0286c-829f-451f-980b-04bece3b4f3d is not attached to volume a9205c9a-17cb-415a-8d6b-d9ed00cad295 Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 89c0286c-829f-451f-980b-04bece3b4f3d is not attached to volume a9205c9a-17cb-415a-8d6b-d9ed00cad295 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-710b1637-efa6-491c-9c2b-6d57c1682a15 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments/a9205c9a-17cb-415a-8d6b-d9ed00cad295" status: 404 len: 154 microversion: 2.1 time: 0.109063 Oct 04 19:30:09.298227 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4046/8067] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:30:09 2022] DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d/os-volume_attachments/a9205c9a-17cb-415a-8d6b-d9ed00cad295 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:13.011997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:13.012670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:13.021048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:13.021542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:13.022013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:13.022724 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:13.023366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:13.023824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:13.054235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:30:13.401964 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ff5956fa-83e6-4a6f-8bd2-4ab32438d3f7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 204 len: 0 microversion: 2.1 time: 0.394325 Oct 04 19:30:13.402551 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4022/8068] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:30:13 2022] DELETE /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:30:13.411651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:13.412483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:13.420495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:13.421029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:13.421474 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:13.423231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:13.423231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:13.423231 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:13.570987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:13.579308 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68c6eda6-d96b-4636-8fb5-dc065a0d8af7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1560 microversion: 2.1 time: 0.172216 Oct 04 19:30:13.580480 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4047/8069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:13 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:14.604861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:14.605571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:14.612690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:14.613190 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:14.613652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:14.614374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:14.614840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:14.615286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:14.756452 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:14.765314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94f718f4-93f8-4154-b08b-e3a6f46d80f1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1560 microversion: 2.1 time: 0.164787 Oct 04 19:30:14.765911 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4023/8070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:14 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:15.790529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:15.791264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c0286c-829f-451f-980b-04bece3b4f3d", "name": "network-vif-deleted", "tag": "cb178a36-5a38-42f5-b6f2-79002e8111b9"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:15.791693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:15.805050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:15.805821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:15.805951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:15.806437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:15.806617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:15.806876 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:15.807616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:15.808342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:15.809174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:15.820476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] Creating event network-vif-deleted:cb178a36-5a38-42f5-b6f2-79002e8111b9 for instance 89c0286c-829f-451f-980b-04bece3b4f3d on n-h1-833090-21 Oct 04 19:30:15.826233 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-aa043875-79ac-4f9a-939c-c57ed911fb7f req-37be4a5b-58d3-4e52-9636-47801078cafe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101780 Oct 04 19:30:15.826865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4048/8071] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:30:15.885172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:15.893795 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dfcac8b0-3888-4de5-80b4-d02cd5f915fe tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1518 microversion: 2.1 time: 0.107176 Oct 04 19:30:15.894390 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4024/8072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:15 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1518 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:30:16.921339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:16.922132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:16.928241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:16.928722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:16.929160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:16.929900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:16.930338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:16.930792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:16.964561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:16.965052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:16.965519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:16.965970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lazy-loading 'fault' on Instance uuid 89c0286c-829f-451f-980b-04bece3b4f3d {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:30:17.012796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:17.020980 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a91274c1-53b0-4357-869a-d135460c795a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 200 len: 1352 microversion: 2.1 time: 0.105914 Oct 04 19:30:17.024732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4049/8073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:16 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:18.046151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:18.046787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 89c0286c-829f-451f-980b-04bece3b4f3d] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:18.054517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:18.055026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:18.055511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:18.056281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:18.056750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:18.057200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:18.071625 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d HTTP/1.1 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '89c0286c-829f-451f-980b-04bece3b4f3d'} Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:18.073321 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 89c0286c-829f-451f-980b-04bece3b4f3d could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea91d8d5-5ab5-4526-929a-fa70decba6c0 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d" status: 404 len: 111 microversion: 2.1 time: 0.032560 Oct 04 19:30:18.078149 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4025/8074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:18 2022] GET /compute/v2.1/servers/89c0286c-829f-451f-980b-04bece3b4f3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:18.083741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54d57ea8-6257-478c-946f-1795cafeb3ca tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '.version_select at 0x7f900d81e280>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:18.207830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54d57ea8-6257-478c-946f-1795cafeb3ca tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1616117999" status: 202 len: 0 microversion: 2.1 time: 0.127840 Oct 04 19:30:18.208421 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4050/8075] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 4 19:30:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1616117999 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:18.226496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a146623a-6161-451b-b2f6-a5a3ad750fda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: .version_select at 0x7f90097da820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-746798802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeKIO3jnWYUigng2oAGfSgYmHVWeo+wPtlXUAZq1BCxeM1Iye9xmsxYcJUr/w3B6N5eGnx8TTWUH9ofIA97tribC6tDSwfZ5QE8ezPQ//B0vxzatS7zMMXZXsTZgEI/6g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:18.242979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a146623a-6161-451b-b2f6-a5a3ad750fda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:18.248382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a146623a-6161-451b-b2f6-a5a3ad750fda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:18.357395 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a146623a-6161-451b-b2f6-a5a3ad750fda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.135014 Oct 04 19:30:18.357936 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4026/8076] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:30:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:18.412715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1689511423", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-746798802", "networks": [{"uuid": "47180040-66e9-407c-888c-6a7263dcd0cb"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:18.467595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] validate_networks() for [('47180040-66e9-407c-888c-6a7263dcd0cb', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:30:18.845100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:30:18.845532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:30:18.846014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:30:18.846429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:30:18.846853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:30:18.856197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:18.856684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:18.857131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:18.857871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:18.858327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:18.858755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:18.878813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:30:18.884771 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:30:18.897471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:30:18.899942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:30:19.066387 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e7e2ae3-a5bd-4486-a389-9fbec764f7e9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657655 Oct 04 19:30:19.070987 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4051/8077] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:30:19.083291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2164952-eaf1-4a82-abba-74426c6d7401 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:19.084049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2164952-eaf1-4a82-abba-74426c6d7401 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:19.142499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2164952-eaf1-4a82-abba-74426c6d7401 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:19.149663 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2164952-eaf1-4a82-abba-74426c6d7401 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1262 microversion: 2.1 time: 0.072120 Oct 04 19:30:19.150446 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4027/8078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:19 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:20.174587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:20.175299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:20.182434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:20.182924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:20.183368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:20.184115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:20.184567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:20.185043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:20.251943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:20.260249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aefd1f60-ee7b-4685-884b-8f4c0e8260a2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1266 microversion: 2.1 time: 0.090708 Oct 04 19:30:20.260853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4052/8079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:20 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:21.285861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:21.286460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:21.293781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:21.294293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:21.294750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:21.295699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:21.296176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:21.296630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:21.372346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:21.380983 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2f480e9-86ec-4529-903b-78bd7c37ee1d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1322 microversion: 2.1 time: 0.099688 Oct 04 19:30:21.381565 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4028/8080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:21 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:22.408185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:22.409586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:22.422154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:22.423563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:22.424776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:22.425652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:22.426282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:22.427003 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:22.658731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:22.667726 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-69d04649-a638-4ce6-8517-5550769181b2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.264601 Oct 04 19:30:22.668414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4053/8081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:22 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:23.249116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ed5464-0df7-4b06-9ec7-8588f6f23858", "tag": "5eabf32b-e425-4bca-8ee2-0ee6c74ad741"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:23.259181 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:23.259725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:23.260173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:23.272324 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] Creating event network-changed:5eabf32b-e425-4bca-8ee2-0ee6c74ad741 for instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 on n-h2-833090-21 Oct 04 19:30:23.277143 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-55f9df55-c7a3-4dc5-957a-ed7eef0695dd req-baee2559-e9ba-406e-9e91-fc0ff96eeeb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096575 Oct 04 19:30:23.277750 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4029/8082] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:23.701010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:23.701616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:23.708969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:23.711060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:23.711060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:23.711060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:23.711060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:23.711533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:23.923795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:23.932766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bec28816-8bdf-4afe-b2bb-e43e551452cd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.235636 Oct 04 19:30:23.933381 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4054/8083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:23 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:24.958553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:24.959294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:24.965969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:24.966542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:24.967053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:24.967853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:24.968347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:24.968794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:25.104521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:25.112788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d4aaf6bb-0512-4d5e-9e1e-1d1ae76875fb tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.159810 Oct 04 19:30:25.113358 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4030/8084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:24 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:26.136786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:26.137405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:26.145036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:26.145522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:26.145964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:26.146655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:26.147108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:26.147570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:26.280415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:26.288628 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7104f768-ed1f-458e-8a98-0e9e8934c7e7 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.155727 Oct 04 19:30:26.289224 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4055/8085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:26 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:27.313484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:27.314100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:27.320777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:27.321292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:27.323899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:27.323899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:27.323899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:27.324410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:27.478978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:27.487311 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51e9e9c3-cdb3-466a-93f9-a6e264c1f23c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.178028 Oct 04 19:30:27.487965 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4031/8086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:27 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:28.512463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:28.513079 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:28.519923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:28.520407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:28.520850 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:28.521579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:28.522029 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:28.522460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:28.665762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:28.673682 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-38f6d21d-5b5b-4c02-a218-ea37ff86fc33 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.165995 Oct 04 19:30:28.674265 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4056/8087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:28 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:29.697387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:29.698002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:29.700822 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:29.705581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:29.706073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:29.706528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:29.707225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:29.707791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:29.708233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:29.841696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:29.850520 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3adb078c-3d92-47f0-8cc8-5b6ae3c716d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.157037 Oct 04 19:30:29.851105 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4032/8088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:29 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:30.875851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:30.877097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:30.879235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:30.879946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:30.885699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:30.890700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:30.890700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:30.890700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:30.890700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:30.890700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:31.021505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:31.030267 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5e08a2f2-f3c9-4205-82fb-73138fa7fb6b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.159292 Oct 04 19:30:31.041497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4057/8089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:30 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:31.168788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ed5464-0df7-4b06-9ec7-8588f6f23858", "name": "network-vif-plugged", "status": "completed", "tag": "5eabf32b-e425-4bca-8ee2-0ee6c74ad741"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:31.179217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:31.179769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:31.180216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:31.192594 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] Creating event network-vif-plugged:5eabf32b-e425-4bca-8ee2-0ee6c74ad741 for instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 on n-h2-833090-21 Oct 04 19:30:31.197699 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6a96d10a-7cf8-4233-95dd-d5bc479d1293 req-7fac1781-1236-4828-86fe-66f7fbd67176 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088448 Oct 04 19:30:31.198382 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4033/8090] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:32.053663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:32.054270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:32.061473 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:32.061979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:32.062534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:32.063793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:32.064784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:32.064784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:32.198545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:32.207099 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-845bb6a7-af67-481c-8b08-cfa7a5926652 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1362 microversion: 2.1 time: 0.157737 Oct 04 19:30:32.207743 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4058/8091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:32 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:33.231725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:33.232477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:33.239253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.239372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.239871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.240532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.241002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.241448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.374824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:33.386510 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-598051be-e517-4b9f-8074-35016e4b8dda tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1554 microversion: 2.1 time: 0.159901 Oct 04 19:30:33.387101 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4034/8092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:33 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:33.410465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:33.411103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:33.418338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.418830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.419293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.420022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:33.420475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:33.420899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:33.556433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:33.565119 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d876c22-9b98-443d-abb6-7b816ab5c274 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1554 microversion: 2.1 time: 0.159261 Oct 04 19:30:33.565696 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4059/8093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:33 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:30:36.618613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff127b56-b808-42b3-855c-7b8097542e88"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:30:36.621101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:36.624304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:36.629148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:36.629660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:36.630106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:36.630900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:36.631348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:36.631811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:36.634270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:37.461990 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-662f243b-ef91-46ff-af97-38758916f7bd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847327 Oct 04 19:30:37.468008 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4035/8094] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:30:36 2022] POST /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:49.253396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:49.258283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:49.258283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:49.258524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=90 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:49.263314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:49.263840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:49.264282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:49.265049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:49.265534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:49.265965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:49.350438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lazy-loading 'services' on Instance uuid 59ed5464-0df7-4b06-9ec7-8588f6f23858 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:30:49.622094 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-89b05449-dfb7-4d99-85fc-247eec10244a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments/ff127b56-b808-42b3-855c-7b8097542e88" status: 202 len: 0 microversion: 2.1 time: 0.372619 Oct 04 19:30:49.622750 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4060/8095] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:30:49 2022] DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments/ff127b56-b808-42b3-855c-7b8097542e88 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:30:49.631042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:49.632142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:30:49.637041 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:49.639733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:49.646282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:49.646815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:49.647277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:49.648121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:49.648618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:49.649119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:49.681276 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7ab38c22-aaa2-4ed6-9845-eeab07683169 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053344 Oct 04 19:30:49.681851 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4036/8096] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:49 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:30:50.695069 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:50.697554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:50.705695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:50.706185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:50.706628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:50.707338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:50.707938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:50.708378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:50.740963 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1873af8f-96dc-451f-a858-93800be073f2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Oct 04 19:30:50.741537 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4061/8097] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:50 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:51.753581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:51.756493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:51.764140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:51.764639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:51.765093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:51.765809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:51.766281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:51.766727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:51.801513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f163ad4-ed81-4af4-8f58-99401be5f7ad tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051897 Oct 04 19:30:51.802760 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4037/8098] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:51 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:52.815286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:52.817547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:52.823705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:52.824185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:52.824620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:52.825316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:52.825765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:52.826194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:52.857598 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-206023be-bcd9-4de7-817f-332116076885 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047275 Oct 04 19:30:52.858180 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4062/8099] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:52 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:53.870644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:53.873665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:53.881352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:53.881853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:53.882337 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:53.883076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:53.883566 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:53.890263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:53.917634 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e345b9aa-6962-488a-84fe-ceff4099177a tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051106 Oct 04 19:30:53.918228 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4038/8100] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:53 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:30:54.930698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:54.932943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:54.939919 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.940402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.940840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:54.941531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.941985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.942408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:54.971725 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5f212773-804f-4d6b-a2b3-798a60565393 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045617 Oct 04 19:30:54.972298 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4063/8101] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:30:54 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:30:54.983601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:54.984096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:54.991432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.991954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.992413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:54.993119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:54.993588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:54.994031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:55.070040 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 is not attached to volume ff127b56-b808-42b3-855c-7b8097542e88 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments/ff127b56-b808-42b3-855c-7b8097542e88 HTTP/1.1 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 is not attached to volume ff127b56-b808-42b3-855c-7b8097542e88 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': '59ed5464-0df7-4b06-9ec7-8588f6f23858', 'id': 'ff127b56-b808-42b3-855c-7b8097542e88'} Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff127b56-b808-42b3-855c-7b8097542e88. Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 is not attached to volume ff127b56-b808-42b3-855c-7b8097542e88 Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:30:55.072056 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 is not attached to volume ff127b56-b808-42b3-855c-7b8097542e88 Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 is not attached to volume ff127b56-b808-42b3-855c-7b8097542e88 {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8de6739c-b026-4c5c-aa45-0024c47a4510 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments/ff127b56-b808-42b3-855c-7b8097542e88" status: 404 len: 154 microversion: 2.1 time: 0.093989 Oct 04 19:30:55.076701 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4039/8102] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:30:54 2022] DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858/os-volume_attachments/ff127b56-b808-42b3-855c-7b8097542e88 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:30:58.717991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:58.723719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:58.726416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.726915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.727360 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.728174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:58.728660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:58.729098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:58.762185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:30:59.119023 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b130cbc-7095-4d1b-926a-e74367012746 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 204 len: 0 microversion: 2.1 time: 0.405364 Oct 04 19:30:59.119659 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4064/8103] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:30:58 2022] DELETE /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:30:59.129875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:30:59.130954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:30:59.138957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.139535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.140007 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.140786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:30:59.141276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:30:59.141729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:30:59.282144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:30:59.290775 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0e0de690-b6a2-4c95-aa03-db480521d316 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1560 microversion: 2.1 time: 0.166414 Oct 04 19:30:59.291355 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4040/8104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:30:59 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:00.315978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:00.316728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:00.324551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.325034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.325468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.326157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:00.326609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:00.327062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:00.466909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:00.475791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0916cffd-bf34-4270-9eab-fb8a6f4bd4d1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1560 microversion: 2.1 time: 0.164071 Oct 04 19:31:00.477404 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4065/8105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:00 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:01.504997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:01.506821 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:01.514340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:01.516435 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:01.516913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:01.517652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:01.518156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:01.518607 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:01.538229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ed5464-0df7-4b06-9ec7-8588f6f23858", "name": "network-vif-deleted", "tag": "5eabf32b-e425-4bca-8ee2-0ee6c74ad741"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:01.550157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:01.550867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:01.551312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:01.563499 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] Creating event network-vif-deleted:5eabf32b-e425-4bca-8ee2-0ee6c74ad741 for instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 on n-h2-833090-21 Oct 04 19:31:01.569118 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6337d037-891a-4c5f-895f-b78743505961 req-dfd72d37-8cde-4249-97b7-53599ea20814 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Oct 04 19:31:01.570009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4066/8106] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:31:01.606059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:01.614436 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b584ed8-6af1-4371-b5e3-b9b81397b6ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 200 len: 1518 microversion: 2.1 time: 0.115645 Oct 04 19:31:01.619622 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4041/8107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:01 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 1518 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:02.642054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:02.642730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 59ed5464-0df7-4b06-9ec7-8588f6f23858] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:02.649826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:02.650318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:02.650762 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:02.651495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:02.651949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:02.652386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:02.667783 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 HTTP/1.1 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '59ed5464-0df7-4b06-9ec7-8588f6f23858'} Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:02.669472 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 59ed5464-0df7-4b06-9ec7-8588f6f23858 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-37b4d50f-ec6c-47e9-bd13-4c4bcb4748ce tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858" status: 404 len: 111 microversion: 2.1 time: 0.034544 Oct 04 19:31:02.674707 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4067/8108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:02 2022] GET /compute/v2.1/servers/59ed5464-0df7-4b06-9ec7-8588f6f23858 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:02.680160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61adec5d-7aae-4348-af1d-8f03a28a6439 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '.version_select at 0x7f90097e59d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:02.772314 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61adec5d-7aae-4348-af1d-8f03a28a6439 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-746798802" status: 202 len: 0 microversion: 2.1 time: 0.095675 Oct 04 19:31:02.772915 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4042/8109] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:31:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-746798802 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:31:02.792535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c9baa11-034a-4060-a7b6-03c35e4a9eb2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: .version_select at 0x7f900d6a33a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-843031892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSFtT1mTZBQzDUzEi1DQhVgbX+JApRB9Fv+ZvwbmSqTWOzkk3Kln6esdFbmxLCK61DB1ZaNIt7b85S3fF/sYbWi4BeAkZ1IOUN8054j+sQjDl2mRQUQDbYfyCTM7rgEGQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:02.808443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6c9baa11-034a-4060-a7b6-03c35e4a9eb2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:31:02.813699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-6c9baa11-034a-4060-a7b6-03c35e4a9eb2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:31:02.909367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c9baa11-034a-4060-a7b6-03c35e4a9eb2 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.120782 Oct 04 19:31:02.909902 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4068/8110] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:31:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:02.961599 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1553438089", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-843031892", "networks": [{"uuid": "47180040-66e9-407c-888c-6a7263dcd0cb"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:03.015972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] validate_networks() for [('47180040-66e9-407c-888c-6a7263dcd0cb', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:31:03.719522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:31:03.720212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:31:03.720722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:31:03.721150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:31:03.721597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:31:03.730791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.731291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.731781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.732522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:03.732993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:03.733437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:03.751963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:31:03.757880 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Getting quotas for user 2d76b3ef8bfb45ccae0066576f3e68b8 and project 27a2eccd367c4d7ea3fe1e07c97eadef. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:31:03.770688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:31:03.773756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:31:03.905315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d9fbd12e-200d-490a-bfc6-7c0ef438edf4 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948302 Oct 04 19:31:03.906237 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4043/8111] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:31:03.918161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d0e9c0f9-a87a-43c7-95b0-4346f287e894 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:03.918765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d0e9c0f9-a87a-43c7-95b0-4346f287e894 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:03.981854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d0e9c0f9-a87a-43c7-95b0-4346f287e894 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:03.990967 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d0e9c0f9-a87a-43c7-95b0-4346f287e894 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1262 microversion: 2.1 time: 0.077280 Oct 04 19:31:03.991579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4069/8112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:03 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:05.014499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:05.015174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:05.023702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.024217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.024799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:05.025611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:05.026229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:05.026675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:05.092360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:05.101579 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35411f85-ff87-426f-8db5-d11819e3194c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1266 microversion: 2.1 time: 0.091027 Oct 04 19:31:05.102190 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4044/8113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:05 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:06.125226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:06.125830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:06.133144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:06.133635 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:06.134077 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:06.134778 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:06.135239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:06.135714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:06.199731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:06.207743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9c258143-1127-406e-9e42-f8f171c100be tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1322 microversion: 2.1 time: 0.086370 Oct 04 19:31:06.208340 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4070/8114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:06 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:07.233490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:07.234054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:07.243259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.243804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.244264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.245287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:07.245789 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:07.246234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:07.465836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:07.474214 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ba97d00c-5e04-43f5-8abd-89280d0a8e08 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.245101 Oct 04 19:31:07.474826 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4045/8115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:07 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:08.053858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f3ae59-2584-4356-8f3c-8927f4049eb0", "tag": "b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:08.064855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.065423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.065924 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.079681 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] Creating event network-changed:b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc for instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 on n-h1-833090-21 Oct 04 19:31:08.084822 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-670bf5cf-484b-4644-a20b-a032e0a86d57 req-1b291328-ddb6-47b7-b4e4-393e88db8ab2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035208 Oct 04 19:31:08.085450 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4071/8116] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:08.504012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:08.504661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:08.514721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.515429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.515634 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.516364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:08.517192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:08.517316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:08.695620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:08.704457 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-61e57bc5-f963-484a-a1c3-0e79dc3992fd tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.204466 Oct 04 19:31:08.705066 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4046/8117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:08 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:09.730031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:09.730737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:09.737129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:09.737622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:09.738068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:09.738769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:09.739227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:09.739695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:09.869761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:09.877893 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afaf4075-6aed-4269-8680-cf29023f1eff tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.153235 Oct 04 19:31:09.878506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4072/8118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:09 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:10.902579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:10.903362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:10.910779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:10.911119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:10.912243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:10.912969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:10.913449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:10.913903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:11.048820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:11.056710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-035cb8ab-245a-4baf-8650-2f672cee48d9 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.158205 Oct 04 19:31:11.057294 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4047/8119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:10 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:12.080173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:12.080774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:12.087786 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:12.088258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:12.088700 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:12.089400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:12.089853 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:12.090278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:12.226197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:12.234051 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3760156d-04b7-4535-b0cf-2f4309fe0c8d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.157780 Oct 04 19:31:12.234638 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4073/8120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:12 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:13.262673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:13.262673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:13.266518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.267024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.267494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.268217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:13.268714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:13.269137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:13.402861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:13.410715 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-125a7b54-268e-424b-b8d5-7eb67f9e11ee tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.156738 Oct 04 19:31:13.411822 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4048/8121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:13 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:14.436277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:14.436856 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:14.439793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:14.445193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.445683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.446121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.446820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:14.447275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:14.447732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:14.580055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:14.587766 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-03c46fe0-6c94-4670-8b91-137724e6f9b8 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.155480 Oct 04 19:31:14.588345 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4074/8122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:14 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:15.612798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:15.613430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:15.615359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:15.616081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:15.621950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.622478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.622930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.623678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.624327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.624808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.761324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:15.769186 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8200242e-3ae7-413d-a168-40d8542a4673 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.160275 Oct 04 19:31:15.769995 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4049/8123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:15 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:15.787716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f3ae59-2584-4356-8f3c-8927f4049eb0", "name": "network-vif-plugged", "status": "completed", "tag": "b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:15.798699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:15.799115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:15.799576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:15.811433 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] Creating event network-vif-plugged:b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc for instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 on n-h1-833090-21 Oct 04 19:31:15.816765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-aade5b36-528d-4026-a223-10871d5d68f9 req-bdf4700a-4182-4e79-8da0-806cc3348e1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033131 Oct 04 19:31:15.818966 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4075/8124] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:16.792625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:16.793251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:16.800191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.800690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.801135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:16.802344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:16.802810 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:16.803247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:16.950275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:16.958163 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-134f9951-cf00-4915-af1c-3e8394499fab tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1362 microversion: 2.1 time: 0.169439 Oct 04 19:31:16.958792 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4050/8125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:16 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:17.984472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:17.985177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:17.991875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:17.992361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:17.992801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:17.993497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:17.993952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:17.994378 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.125482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:18.133996 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17462d8d-e793-4076-8920-3c8eb055824b tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1554 microversion: 2.1 time: 0.155046 Oct 04 19:31:18.134579 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4076/8126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:17 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:18.157426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:18.158054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:18.165021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.165523 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.165973 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.166696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:18.167165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:18.167633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:18.302975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:18.310906 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae00cc02-4a45-4a50-9535-b44340f4c3a1 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1554 microversion: 2.1 time: 0.157407 Oct 04 19:31:18.311521 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4051/8127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:18 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:21.508444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ba5c006-6138-4df7-ac6e-7f298ca59053"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:21.510839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:21.513751 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:21.518618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.519110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.519596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.520322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:21.520776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:21.521238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:21.523848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:22.230590 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f5b765ae-8da1-4f18-bf72-afe87c4bced5 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "POST /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726727 Oct 04 19:31:22.231370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4077/8128] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:31:21 2022] POST /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:34.015823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:34.016422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:34.018738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:34.019426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=86 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:34.024944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.025137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.025478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.026400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.026833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.027279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.108837 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lazy-loading 'services' on Instance uuid 45f3ae59-2584-4356-8f3c-8927f4049eb0 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:31:34.374209 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2007a8f0-ed01-48ed-92e9-37c1016744cf tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments/4ba5c006-6138-4df7-ac6e-7f298ca59053" status: 202 len: 0 microversion: 2.1 time: 0.362284 Oct 04 19:31:34.374831 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4052/8129] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:31:34 2022] DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments/4ba5c006-6138-4df7-ac6e-7f298ca59053 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:31:34.382978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:34.383851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:31:34.388284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:34.390701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:34.398114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.398602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.399047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.399781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:34.400267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:34.400792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:34.431589 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0b22242c-0008-4440-852a-612c2412627d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052080 Oct 04 19:31:34.432087 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4078/8130] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:34 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:35.446905 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:35.449368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:35.455943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:35.456472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:35.456954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:35.457664 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:35.458136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:35.458581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:35.489575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1c6b02bf-37ef-4531-8265-2138eab7311e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048469 Oct 04 19:31:35.490155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4053/8131] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:35 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:36.503439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:36.506337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:36.514254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.514783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.515372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.516024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:36.516485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:36.516921 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:36.553371 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c0cf427-df67-46b4-810c-041f168ae946 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054716 Oct 04 19:31:36.554048 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4079/8132] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:36 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:37.567040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:37.569734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:37.577767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:37.578326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:37.578786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:37.579531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:37.580112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:37.580623 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:37.614985 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d0f4c2d2-c9ea-43e3-bbe6-eb52954d06af tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052206 Oct 04 19:31:37.615590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4054/8133] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:37 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:38.627722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:38.629829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:38.637981 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:38.638719 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:38.638978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:38.639702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:38.640155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:38.640614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:38.679608 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8d9f336-c67a-423a-ae04-6b7ad931c5b6 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055541 Oct 04 19:31:38.680198 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4080/8134] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:38 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:39.692332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:39.694569 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:39.702147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.702647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.703099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.703851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.704324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.704763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.735279 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-665ec647-f863-4857-832b-0efc3c9ac93f tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047050 Oct 04 19:31:39.735909 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4055/8135] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:31:39 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:31:39.746848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:39.747340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:39.754367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.754901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.755341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.756068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:39.756530 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:39.756966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:39.834209 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 is not attached to volume 4ba5c006-6138-4df7-ac6e-7f298ca59053 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments/4ba5c006-6138-4df7-ac6e-7f298ca59053 HTTP/1.1 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 is not attached to volume 4ba5c006-6138-4df7-ac6e-7f298ca59053 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': '45f3ae59-2584-4356-8f3c-8927f4049eb0', 'id': '4ba5c006-6138-4df7-ac6e-7f298ca59053'} Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4ba5c006-6138-4df7-ac6e-7f298ca59053. Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 is not attached to volume 4ba5c006-6138-4df7-ac6e-7f298ca59053 Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:39.836440 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 is not attached to volume 4ba5c006-6138-4df7-ac6e-7f298ca59053 Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 is not attached to volume 4ba5c006-6138-4df7-ac6e-7f298ca59053 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a99d668b-ceed-44d4-a78f-ca210f90d35d tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments/4ba5c006-6138-4df7-ac6e-7f298ca59053" status: 404 len: 154 microversion: 2.1 time: 0.095332 Oct 04 19:31:39.842312 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4081/8136] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:31:39 2022] DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0/os-volume_attachments/4ba5c006-6138-4df7-ac6e-7f298ca59053 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:43.398271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:43.398807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:43.406601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:43.407115 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:43.407609 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:43.408325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:43.408797 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:43.409242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:43.435820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:31:43.738642 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-36fb1764-5750-4f77-80f9-18bf6ae0fb31 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 204 len: 0 microversion: 2.1 time: 0.344098 Oct 04 19:31:43.739285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4056/8137] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:31:43 2022] DELETE /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:31:43.749043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:43.749655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:43.757943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:43.758432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:43.759497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:43.760224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:43.760676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:43.761097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:43.904026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:43.912146 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7b952b5a-4fd2-438d-9234-c3211a8d4d8c tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1560 microversion: 2.1 time: 0.167406 Oct 04 19:31:43.912733 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4082/8138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:43 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:44.936388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:44.937096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:44.944201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:44.944727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:44.945180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:44.946359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:44.946866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:44.947302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:45.085021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:45.093681 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f03d41e7-8976-43c9-9a7c-0b24ba889d09 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1560 microversion: 2.1 time: 0.161306 Oct 04 19:31:45.094266 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4057/8139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:44 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:31:46.002013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f3ae59-2584-4356-8f3c-8927f4049eb0", "name": "network-vif-deleted", "tag": "b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:31:46.013633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:46.014114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:46.014544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:46.026252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] Creating event network-vif-deleted:b5e7b50f-abe2-42ac-aeb8-bd6ab76bcbbc for instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 on n-h1-833090-21 Oct 04 19:31:46.031516 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-279f0371-a665-4d1f-85c1-0c4f121fcab5 req-dd4ec6bc-6ccd-443e-a336-29e5a48ee1e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Oct 04 19:31:46.032208 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4083/8140] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:31:46.118953 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:46.119631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:46.126668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:46.129348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:46.129348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:46.129348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:46.129348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:46.129348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:46.197004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d76b3ef8bfb45ccae0066576f3e68b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a2eccd367c4d7ea3fe1e07c97eadef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:31:46.205187 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d28cc191-0dcb-4ae9-a615-a24e03f01c5e tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 200 len: 1518 microversion: 2.1 time: 0.090692 Oct 04 19:31:46.205713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4058/8141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:46 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 1518 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:31:47.231165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:47.231925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] [instance: 45f3ae59-2584-4356-8f3c-8927f4049eb0] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:31:47.238271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:47.238752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:47.239194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:47.239907 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:31:47.240365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:31:47.240792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:31:47.255367 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] HTTP exception thrown: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Request method failure captured: Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 HTTP/1.1 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPImVhbHHZIfFsXhHKwAC6Csxdh7ktm8h4nSLCb_xzEUU8vFB2sVospcRkgCziu-HjSgru9ALvmd_0wZqJEt8EWP_NWQDRF72a5liFlLXNghFKbG66ZD1VV6L6x10j6yaHXMgv1rz5u-EXPGQDQkhmBiuZEr3WM1SB91d1MKLrJLzKfk Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/27a2eccd367c4d7ea3fe1e07c97eadef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/27a2eccd367c4d7ea3fe1e07c97eadef"}]}] Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 27a2eccd367c4d7ea3fe1e07c97eadef Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-33796483 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 2d76b3ef8bfb45ccae0066576f3e68b8 Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestEncryptedCinderVolumes-33796483-project Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '45f3ae59-2584-4356-8f3c-8927f4049eb0'} Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:31:47.257179 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Returning 404 to user: Instance 45f3ae59-2584-4356-8f3c-8927f4049eb0 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3594ec9-cb24-41f7-8910-8b72f889df78 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0" status: 404 len: 111 microversion: 2.1 time: 0.033171 Oct 04 19:31:47.261644 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4084/8142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:31:47 2022] GET /compute/v2.1/servers/45f3ae59-2584-4356-8f3c-8927f4049eb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:31:47.267577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae4ef3e2-2d7a-4e3f-b03e-4182fc1b8170 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] Calling method '.version_select at 0x7f90098ed0d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:31:47.350364 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae4ef3e2-2d7a-4e3f-b03e-4182fc1b8170 tempest-TestEncryptedCinderVolumes-33796483 tempest-TestEncryptedCinderVolumes-33796483-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-843031892" status: 202 len: 0 microversion: 2.1 time: 0.086497 Oct 04 19:31:47.350999 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4059/8143] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 4 19:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-843031892 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:32:22.288106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:22.290182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=34 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:22.294410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61c9bf63-6320-4f5d-858d-326e577d77a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: .version_select at 0x7f900990baf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-179766629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSNKAxtI3Tj+Oh2dfOT/GDK8UzXAN+xN0qihBNVgiJB9w1tYHNWWiiUq1Pq5lp5eF5tNB3vmGd69GBnp4/X9mbBYzFLSd4cSY1k4Nof4J/P12rXL3ZXXTAmZMaXoubYwA=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:22.311520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-61c9bf63-6320-4f5d-858d-326e577d77a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for project 337039868a764744bd300718eef8dbeb. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:22.318572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-61c9bf63-6320-4f5d-858d-326e577d77a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for user 002dafe8b108437fb786c9c26aac271d and project 337039868a764744bd300718eef8dbeb. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:22.452020 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61c9bf63-6320-4f5d-858d-326e577d77a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.165367 Oct 04 19:32:22.452633 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4085/8144] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:32:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:22.508428 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:22.510097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:22.515631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2033928989", "imageRef": "2f55b5ab-6051-4537-8769-414d1ae18f35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-179766629", "networks": [{"uuid": "7505bed7-66e7-4308-96b6-cda5209176ff"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:22.573023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] validate_networks() for [('7505bed7-66e7-4308-96b6-cda5209176ff', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:32:23.322601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:32:23.323740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:32:23.324688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:32:23.325424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:32:23.326180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:32:23.337334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.337923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.338447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.339237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:23.339729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:23.340173 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:23.360445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for project 337039868a764744bd300718eef8dbeb. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:32:23.366449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for user 002dafe8b108437fb786c9c26aac271d and project 337039868a764744bd300718eef8dbeb. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:32:23.381964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:32:23.384935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f55b5ab-6051-4537-8769-414d1ae18f35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:32:23.566533 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5862c44-5b0e-4f20-89b4-1f78953c3da7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061527 Oct 04 19:32:23.567541 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4060/8145] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:32:23.580944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7c2ccee6-5338-4f9d-a494-4c5556d2574f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:23.581550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7c2ccee6-5338-4f9d-a494-4c5556d2574f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:23.637887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7c2ccee6-5338-4f9d-a494-4c5556d2574f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:23.645219 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7c2ccee6-5338-4f9d-a494-4c5556d2574f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1258 microversion: 2.1 time: 0.069473 Oct 04 19:32:23.645824 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4086/8146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:23 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:24.670273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0a618d87-bc60-452a-82d0-4e922ea82e71 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:24.670960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0a618d87-bc60-452a-82d0-4e922ea82e71 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:24.726032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0a618d87-bc60-452a-82d0-4e922ea82e71 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:24.733624 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0a618d87-bc60-452a-82d0-4e922ea82e71 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1258 microversion: 2.1 time: 0.068206 Oct 04 19:32:24.734205 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4061/8147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:24 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:25.757542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:25.758744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:25.766625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.767045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.767505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.768210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:25.768668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:25.769096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:25.832132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:25.840424 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-deae4862-d67d-467d-a53d-1b0ff2f839ee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1310 microversion: 2.1 time: 0.087045 Oct 04 19:32:25.841262 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4087/8148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:25 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:26.872462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:26.873683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:26.892626 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:26.893717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:26.895188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:26.896657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:26.897442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:26.917454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:27.191525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:27.203023 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2cd0e12a-517c-4d1d-b6bf-e2e1387c8ee0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.337813 Oct 04 19:32:27.215027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4062/8149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:26 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:28.230752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:28.231489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:28.238407 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.239001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.239543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.240323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:28.240847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:28.241344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:28.396812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:28.405704 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c9adea2b-724b-491f-b3c4-a8119ee12311 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.179477 Oct 04 19:32:28.406687 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4088/8150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:28 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:29.432482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:29.433025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:29.440344 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.440872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.441316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.442045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:29.442520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:29.442969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:29.594409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:29.602393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-41b7829d-9064-4f70-9b96-d799882b9255 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.176038 Oct 04 19:32:29.602981 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4063/8151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:29 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:30.626424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:30.627061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:30.634551 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.635116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.635651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.636386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:30.636844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:30.637305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:30.784202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:30.794624 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2897985e-1336-431a-b957-22eb484fc683 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.171968 Oct 04 19:32:30.807865 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4089/8152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:30 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:31.818165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:31.822290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:31.826031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.826567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.827103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.827864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:31.828347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:31.828851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:31.986637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:31.990645 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1baea74f-9d8c-47e1-895a-9bc2dfa17854 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.176306 Oct 04 19:32:31.991252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4064/8153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:31 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:33.014363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:33.016021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:33.026078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.026988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.028451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.029418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:33.030141 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:33.030797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:33.185622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:33.193782 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-344dc178-d1bd-45d7-b7eb-a7fafbb7546b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.183745 Oct 04 19:32:33.210884 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4090/8154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:33 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:34.216629 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:34.222026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:34.222662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:34.230093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.232279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.232279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.232279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:34.232279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:34.232792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:34.377513 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:34.386322 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c8d814c8-49d1-443e-8dc9-27f194796b07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.171758 Oct 04 19:32:34.387304 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4065/8155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:34 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:35.410016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:35.410651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:35.412869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:35.419559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.420061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.420506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.421259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:35.421720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:35.422222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:35.568507 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:35.576695 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bad71621-1f4d-44a9-8f5d-3935b4ee1dcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.170763 Oct 04 19:32:35.577287 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4091/8156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:35 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:36.071243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:36.077224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:32:36.083969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.088292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.088292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:36.097870 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] Creating event network-changed:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:32:36.103423 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-11512b12-0d54-4a39-adee-7caf05471262 req-1497a022-21ef-4f01-b593-569343513c44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Oct 04 19:32:36.105280 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4066/8157] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:36.601235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:36.602326 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:36.612199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.613078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.614024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:36.615276 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:36.616113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:36.616884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:36.782192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:36.790647 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-154131ed-b45c-4d18-b774-0d91362ff393 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.193333 Oct 04 19:32:36.791342 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4092/8158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:36 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:37.815736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:37.816482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:37.824099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.824600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.825052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.825768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:37.826234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:37.826674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:37.963065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:37.971140 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03af22c9-9de8-4ded-846b-54ea44b84220 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.160532 Oct 04 19:32:37.971764 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4067/8159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:37 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:32:38.994067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:38.994728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:39.002084 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:39.002562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:39.002996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.003709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:39.004158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:39.004580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:39.136309 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:39.150696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c461261b-d8a9-4db4-9084-cf6dd7d2c14a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.160033 Oct 04 19:32:39.152050 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4093/8160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:38 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:40.175583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:40.176207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:40.183339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.183893 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.184921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.185597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:40.186105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:40.186804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:40.325456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:40.333667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c5ebb7bc-6c9f-4076-9d67-ec4960abef07 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.162091 Oct 04 19:32:40.337241 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4068/8161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:40 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:41.357514 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:41.358131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:41.366857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.367345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.367806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.368512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:41.368959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:41.369392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:41.514743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:41.522650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-54562b2d-2549-4630-8872-440c1b349dee tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.169081 Oct 04 19:32:41.523333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4094/8162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:41 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:42.213549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "name": "network-vif-plugged", "status": "completed", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:42.224571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.225067 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.225515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.237806 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] Creating event network-vif-plugged:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:32:42.243030 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-d438f3f7-5f35-4cfe-a176-dc1063f63fd2 req-a2c0711a-6b11-4885-b28b-e694cdd3fda3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033264 Oct 04 19:32:42.246502 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4069/8163] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:32:42.546345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:42.547053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:42.554319 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.554802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.555238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.555973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:42.556421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:42.556846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:42.691818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:42.703194 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bfa6148c-57a3-4665-ae3b-f16fd3a2e3c1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1358 microversion: 2.1 time: 0.160385 Oct 04 19:32:42.703978 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4095/8164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:42 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:43.734694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:43.735417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:43.743815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.744331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.745054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.747177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.747848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.748309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.890978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:43.899181 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24cd9f77-edbc-4c14-8e1a-bcf2ff4d2f9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1547 microversion: 2.1 time: 0.169570 Oct 04 19:32:43.899816 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4070/8165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:43 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:43.923790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:43.924410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:43.931608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.932101 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.932547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:43.933239 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:43.933690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:43.934643 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.075886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:44.083972 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-062969c1-4572-498f-82de-e9ed001235a0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1547 microversion: 2.1 time: 0.164168 Oct 04 19:32:44.084563 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4096/8166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:43 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:44.108256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:44.112971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:44.113760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Searching by: {'deleted': False, 'project_id': '337039868a764744bd300718eef8dbeb'} {{(pid=123886) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:32:44.119212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.119751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.120354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.121125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.121631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.122074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.149755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.multi_cell_list [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:32:44.178617 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c7ec5eae-5972-446a-be09-7530d1bef8d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.074379 Oct 04 19:32:44.179231 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4071/8167] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 19:32:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:32:44.196187 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:32:44.196802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:44.203047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.203556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.203995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.204688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:44.205142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:44.205571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:44.346068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:32:44.354158 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ab84fe01-219e-4034-85c2-b5ed0d7499ad tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1547 microversion: 2.1 time: 0.161828 Oct 04 19:32:44.354751 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4097/8168] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:32:44 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:32:47.442760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3e75ee0-b979-454b-8a89-13bdc95ca94e"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:32:47.445185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:32:47.452404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.452908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.453365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:47.454078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:32:47.454552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:32:47.455075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:32:48.241844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e4bf5840-7e60-4ca7-bdde-d806cdda83b6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803027 Oct 04 19:32:48.242827 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4072/8169] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:32:47 2022] POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:02.735584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:02.736230 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:02.738444 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:02.739113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=66 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:02.744047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.744534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.744970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.745675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:02.746124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:02.746544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:02.895668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:02.904883 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5d625570-9adb-45bf-9d05-eed740a8817e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1593 microversion: 2.1 time: 0.173630 Oct 04 19:33:02.905467 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4098/8170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:02 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1593 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:33:05.052465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:05.058979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:05.061507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:33:05.073153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:05.085536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:05.089983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:05.089983 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:05.101175 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] Creating event network-changed:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:33:05.106778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-b51d97e6-7365-4407-80a9-0e5513d53d9d req-fd66849d-941c-4d3b-8dd8-e50fe6143140 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056258 Oct 04 19:33:05.107575 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4073/8171] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:07.813500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-364557237"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:07.814167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:07.821638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.822133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.822556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.823295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:07.823776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:07.824203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:07.970010 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.network.security_group_api [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Adding security group 976c5578-ff06-4c3e-b1e0-557ebe4642d5 to port 2a7b64e3-aca6-449e-925b-180193066173 Oct 04 19:33:08.380141 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c3f3b5e8-d511-498c-ad87-c4cd8c0a79a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action" status: 202 len: 0 microversion: 2.1 time: 0.571284 Oct 04 19:33:08.381354 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4099/8172] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:33:07 2022] POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:33:08.395335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:33:08.396686 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:33:08.397684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:33:08.416126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:08.416917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:08.417482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.418315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:08.419046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:08.419782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.421348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:33:08.421827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:33:08.422335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:33:08.447235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] Creating event network-changed:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:33:08.449982 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e79bc060-a112-4749-9118-5624d362325f req-83e7a6d2-c33f-4b11-b5be-5346d57f401d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058423 Oct 04 19:33:08.451309 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4100/8173] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:33:09.015616 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:33:09.031249 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9046803c-6d32-4f8c-b718-7f827081e547 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1758 microversion: 2.1 time: 0.639622 Oct 04 19:33:09.032103 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4074/8174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:33:08 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1758 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:34:46.663753 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:34:46.664577 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:34:46.665412 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:34:46.665582 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action (ip 10.222.0.40) !!! Oct 04 19:34:46.666907 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:34:46.667066 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action (ip 10.222.0.40) !!! Oct 04 19:34:46.667950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:46.668713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=12 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:46.674106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:34:46.676461 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:46.688256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.688256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.688531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.689092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.689552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.689986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.898860 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-eb9066dd-3727-4081-9a26-cdaa6e3da8e1 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action" status: 202 len: 0 microversion: 2.1 time: 0.236918 Oct 04 19:34:46.899800 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4101/8175] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:34:46 2022] POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:34:46.906395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:46.907171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:34:46.908401 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:34:46.908542 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca (ip 10.222.0.40) !!! Oct 04 19:34:46.909802 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:34:46.910147 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca (ip 10.222.0.40) !!! Oct 04 19:34:46.914957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:46.915620 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:46.925548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.926054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.926575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:46.927339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:46.927862 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:46.928308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:47.337739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:47.346507 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fbf59bf2-94d5-40f2-a08b-c345ce3d777c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1760 microversion: 2.1 time: 0.442342 Oct 04 19:34:47.347165 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4075/8176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:46 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1760 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:34:48.381807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:34:48.382433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:34:48.385945 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46624. Oct 04 19:34:48.390831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.391311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.391768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.392462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:34:48.392908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:34:48.393401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:34:48.402939 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46622. Oct 04 19:34:48.608053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:34:48.616578 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-791b6e3c-a2af-4168-b8ec-c7736abfeae2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1758 microversion: 2.1 time: 0.248876 Oct 04 19:34:48.617168 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4102/8177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:34:48 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1758 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:03.373194 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:36:03.374068 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:36:03.378091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-364557237"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:03.378651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:03.380725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:03.381447 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:03.386287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.386794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.387246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.387997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:03.388480 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:03.392885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:03.530427 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Removing security group 976c5578-ff06-4c3e-b1e0-557ebe4642d5 from port 2a7b64e3-aca6-449e-925b-180193066173 Oct 04 19:36:03.920420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-10d504a4-cb6d-4ce9-b525-e2b35ae44906 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action" status: 202 len: 0 microversion: 2.1 time: 0.541131 Oct 04 19:36:03.920420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4076/8178] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:36:03 2022] POST /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:36:03.922074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:03.922803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:04.016632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:04.028845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:04.029346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:04.029782 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:04.043407 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] Creating event network-changed:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:36:04.050256 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-315dc77c-a15f-4679-b794-0c54d95e78de req-352bb659-57fd-4c2e-80fb-f7a23267d36f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131183 Oct 04 19:36:04.051528 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4103/8179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:05.276519 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46670. Oct 04 19:36:05.289977 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46668. Oct 04 19:36:05.318855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:05.320064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:05.328827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.329322 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.329769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.330485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.331234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.331695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.357531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:05.374621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.375374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.375959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.387824 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] Creating event network-changed:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:36:05.391913 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] [d50ac40d-a1ff-4055-a41e-0e74d3333188] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:36:05.424723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lazy-loading 'services' on Instance uuid 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:36:05.614874 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9725e618-7cae-43ad-a160-c43afdd5b456 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments/c3e75ee0-b979-454b-8a89-13bdc95ca94e" status: 202 len: 0 microversion: 2.1 time: 0.302040 Oct 04 19:36:05.615524 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4104/8180] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:36:05 2022] DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments/c3e75ee0-b979-454b-8a89-13bdc95ca94e => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:36:05.625886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:05.629024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:05.635831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.636329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.636824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.637570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:05.638082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:05.638515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:05.672639 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e70f62d-10aa-425a-a990-858f93071b64 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052312 Oct 04 19:36:05.673242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4105/8181] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:05 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:36:06.400488 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] [d50ac40d-a1ff-4055-a41e-0e74d3333188] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 46688. Oct 04 19:36:06.404191 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-562e1ba5-ff46-46f6-8719-68a54a922148 req-3f15e2dd-0f21-43f8-b046-b5de682deecc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.148527 Oct 04 19:36:06.404881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4077/8182] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:06.688724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:06.692227 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:06.700968 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.701455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.701894 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.702714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:06.703823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:06.703823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:06.739173 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-afb9c1ac-36bc-4bbb-9bb8-4d1cfb8ed9d5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057155 Oct 04 19:36:06.739895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4106/8183] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:06 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:07.755970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:07.759105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:07.769319 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:07.769827 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:07.770276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:07.770994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:07.771491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:07.771932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:07.810059 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03caf0a2-6f61-46f5-95ef-88bfa5987966 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059125 Oct 04 19:36:07.811155 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4078/8184] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:07 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:08.823386 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:08.825714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:08.833147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:08.833668 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:08.834117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:08.835362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:08.835900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:08.836330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:08.868337 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6f5f5bed-3151-490a-b3a9-41d13434c8bc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049773 Oct 04 19:36:08.868930 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4107/8185] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:08 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:09.881322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:09.883681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:09.892352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:09.892873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:09.893336 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:09.894066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:09.894547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:09.894995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:09.930170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-66ac7227-da21-4d89-8382-ef79dad857ed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053111 Oct 04 19:36:09.930734 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4079/8186] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:09 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:10.942688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:10.945035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:10.952273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:10.952752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:10.953193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:10.953936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:10.954356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:10.954785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:10.987029 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2376e0f4-8ca9-4215-93e6-19e00f39b441 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048352 Oct 04 19:36:10.987700 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4108/8187] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:36:10 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 19:36:11.000760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:11.003031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:11.008223 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:11.008718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:11.009184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:11.009889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:11.010358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:11.010923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:11.094031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] HTTP exception thrown: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca is not attached to volume c3e75ee0-b979-454b-8a89-13bdc95ca94e Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Request method failure captured: Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: request: DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments/c3e75ee0-b979-454b-8a89-13bdc95ca94e HTTP/1.1 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIo0aCIYbNINtu39dY6V9vCSoB8pCFYyYxPe4SECnoZkvbBRlilzXcWeYrGj_w9kwZ5AAQ0B8xtUHkN-u1-Jf-5x4579W4PSihhBGb8S_tDma7PjQ-vtsvKgh6iTrTBxrNy-KY-bS-gvFq77apnnEQQJtXLqkn1KtKOmV3ZqTgFobzI Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337039868a764744bd300718eef8dbeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337039868a764744bd300718eef8dbeb"}]}] Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 002dafe8b108437fb786c9c26aac271d Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca is not attached to volume c3e75ee0-b979-454b-8a89-13bdc95ca94e Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'server_id': '03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca', 'id': 'c3e75ee0-b979-454b-8a89-13bdc95ca94e'} Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c3e75ee0-b979-454b-8a89-13bdc95ca94e. Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca is not attached to volume c3e75ee0-b979-454b-8a89-13bdc95ca94e Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:11.095833 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca is not attached to volume c3e75ee0-b979-454b-8a89-13bdc95ca94e Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Returning 404 to user: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca is not attached to volume c3e75ee0-b979-454b-8a89-13bdc95ca94e {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-03a9d899-2ebc-4716-a69b-4b0852c4e982 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments/c3e75ee0-b979-454b-8a89-13bdc95ca94e" status: 404 len: 154 microversion: 2.1 time: 0.100970 Oct 04 19:36:11.102981 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4080/8188] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:36:10 2022] DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca/os-volume_attachments/c3e75ee0-b979-454b-8a89-13bdc95ca94e => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:36:15.599883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:15.600390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:15.608703 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.609188 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.609698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.610410 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.610860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.611332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.640504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:36:15.913104 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8fda7f37-f3c4-41ee-893b-40a48fa0fc03 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 204 len: 0 microversion: 2.1 time: 0.317407 Oct 04 19:36:15.914255 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4109/8189] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:36:15 2022] DELETE /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:36:15.922985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:15.924635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:15.932228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.932739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.933229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:15.933957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:15.934543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:15.934998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:16.078479 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:16.087317 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dcfa553a-e3f5-44ca-a245-00fcb8d6fb0e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1553 microversion: 2.1 time: 0.168266 Oct 04 19:36:16.087925 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4081/8190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:15 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:17.111278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:17.112014 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:17.119455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:17.119967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:17.120398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:17.121096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:17.121544 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:17.121956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:17.268965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:17.278021 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2f205599-d414-4912-a6dd-a5d1d62a8356 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1553 microversion: 2.1 time: 0.170977 Oct 04 19:36:17.278582 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4110/8191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:17 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:18.265831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca", "name": "network-vif-deleted", "tag": "2a7b64e3-aca6-449e-925b-180193066173"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:18.286069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.286069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.286069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.294303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] Creating event network-vif-deleted:2a7b64e3-aca6-449e-925b-180193066173 for instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca on n-h1-833090-21 Oct 04 19:36:18.301397 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0a9cddad-cc8d-4c78-96ff-adb79bfb45f0 req-7951f00d-3e7c-483e-b008-822856c1af2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042439 Oct 04 19:36:18.302188 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4082/8192] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:18.302369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:18.302973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:18.310323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.310807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.311742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.312240 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:18.314134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:18.314134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:18.381366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:18.390455 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-513ed316-10eb-4d50-ad8f-c64477fe4fd5 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 200 len: 1511 microversion: 2.1 time: 0.092738 Oct 04 19:36:18.391177 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4111/8193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:18 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:36:19.415808 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:19.416544 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:19.424234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.424794 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.425258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.425986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:19.426462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:19.426909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:19.442397 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] HTTP exception thrown: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Request method failure captured: Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca HTTP/1.1 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIo0aCIYbNINtu39dY6V9vCSoB8pCFYyYxPe4SECnoZkvbBRlilzXcWeYrGj_w9kwZ5AAQ0B8xtUHkN-u1-Jf-5x4579W4PSihhBGb8S_tDma7PjQ-vtsvKgh6iTrTBxrNy-KY-bS-gvFq77apnnEQQJtXLqkn1KtKOmV3ZqTgFobzI Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337039868a764744bd300718eef8dbeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337039868a764744bd300718eef8dbeb"}]}] Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 002dafe8b108437fb786c9c26aac271d Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca'} Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:36:19.444125 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Returning 404 to user: Instance 03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bca63b30-5b97-4a17-be14-c62aecdf0ce7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca" status: 404 len: 111 microversion: 2.1 time: 0.034882 Oct 04 19:36:19.453045 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4083/8194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:19 2022] GET /compute/v2.1/servers/03b4df3e-0ea4-4fe8-9f9a-9e6d034e57ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:36:19.456943 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cb952025-3314-4774-ba66-2ab147785984 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '.version_select at 0x7f900d8b84c0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:19.594810 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cb952025-3314-4774-ba66-2ab147785984 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-179766629" status: 202 len: 0 microversion: 2.1 time: 0.141727 Oct 04 19:36:19.722045 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4112/8195] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 4 19:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-179766629 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:36:31.399631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a45450f3-6f52-4960-bbe0-a452fbf341a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: .version_select at 0x7f9008c630d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2104969384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXNSsSdW6VWyWgO49J3kT6GtaQ6wM1NUffnKTDy4kgcNpym30iGGwcd7ChlNzpgDI2cj064ksua2teFFZeUPSdRmexoKR/7ZpmuIugsEKE50a+Sve1IX8ZQzYf5DyYfpw=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:31.407557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:31.408220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=34 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:31.421939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a45450f3-6f52-4960-bbe0-a452fbf341a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for project 337039868a764744bd300718eef8dbeb. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:36:31.427192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a45450f3-6f52-4960-bbe0-a452fbf341a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for user 002dafe8b108437fb786c9c26aac271d and project 337039868a764744bd300718eef8dbeb. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:36:31.508374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a45450f3-6f52-4960-bbe0-a452fbf341a9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.113170 Oct 04 19:36:31.508983 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4084/8196] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:36:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:31.563121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1331643038", "imageRef": "a0817e43-fa18-430f-b628-37e788beda1e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2104969384", "networks": [{"uuid": "7505bed7-66e7-4308-96b6-cda5209176ff"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:31.574552 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:31.575167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:31.621959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] validate_networks() for [('7505bed7-66e7-4308-96b6-cda5209176ff', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:36:32.059648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:36:32.060073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:36:32.060550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:36:32.060958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:36:32.061370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:36:32.071501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.071909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.072344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.073068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:32.073522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:32.073944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:32.092714 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for project 337039868a764744bd300718eef8dbeb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:36:32.098109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Getting quotas for user 002dafe8b108437fb786c9c26aac271d and project 337039868a764744bd300718eef8dbeb. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:36:32.110760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:36:32.113132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0817e43-fa18-430f-b628-37e788beda1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:36:32.269965 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58ee7a83-eb2f-4d34-890b-2d93cdc2bae0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713785 Oct 04 19:36:32.270630 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4113/8197] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:36:32.282653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-45280264-fd61-494f-b1da-93ddd242b625 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:32.283290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-45280264-fd61-494f-b1da-93ddd242b625 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:32.342024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-45280264-fd61-494f-b1da-93ddd242b625 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:32.349282 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-45280264-fd61-494f-b1da-93ddd242b625 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1259 microversion: 2.1 time: 0.070607 Oct 04 19:36:32.351228 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4085/8198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:32 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:33.373590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:33.374243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:33.382149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.382694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.383246 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.384013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:33.384519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:33.384950 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:33.455529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:33.463745 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a5636a92-8448-4023-a331-e86e9dbbe0a2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1263 microversion: 2.1 time: 0.094263 Oct 04 19:36:33.464327 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4114/8199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:33 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:34.487897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:34.488554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:34.496575 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.497089 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.497547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.498317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:34.499027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:34.499682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:34.567371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:34.576365 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-28ea1d4c-cab5-456a-bc39-fce7b60ce65e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1319 microversion: 2.1 time: 0.092514 Oct 04 19:36:34.576967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4086/8200] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:34 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:35.599922 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:35.600521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:35.614722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:35.615224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:35.622277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:35.623072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:35.623585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:35.624038 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:35.795510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:35.806391 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d616815b-a1bf-47e3-9db5-8ba640bfba3e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.210191 Oct 04 19:36:35.807002 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4115/8201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:35 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:36.834285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:36.836323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:36.843246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.844150 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.844691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:36.845495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:36.846046 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:36.849256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:37.001708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:37.012660 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc2f2816-ead9-4a9d-9f1d-a1f7b74ec14f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.183365 Oct 04 19:36:37.013847 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4087/8202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:36 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:38.037479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:38.038089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:38.045812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.046834 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.047596 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.048671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:38.049434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:38.049998 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:38.200492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:38.209771 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-26bd441e-0d40-4ee5-a245-41b591139779 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.176111 Oct 04 19:36:38.210513 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4116/8203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:38 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:39.234238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:39.234994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:39.243412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:39.243952 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:39.244742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:39.245761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:39.246556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:39.247225 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:39.388317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:39.396803 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-948cd1d8-936a-484f-847b-9841f001250c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.166388 Oct 04 19:36:39.397412 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4088/8204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:39 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:40.421109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:40.421973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:40.429560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.430197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.430651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.431358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:40.431869 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:40.432295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:40.592075 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:40.599992 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6eff0f9c-d466-430b-ab8e-57aa4f779295 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.183601 Oct 04 19:36:40.600995 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4117/8205] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:40 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:41.624183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:41.624922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:41.632528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.633033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.633482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:41.634212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:41.634679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:41.635123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:41.806944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:41.817789 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-435b3397-530c-476a-9643-bd7fecffa915 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.197398 Oct 04 19:36:41.818675 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4089/8206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:41 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:42.842233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:42.847718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:42.847718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:42.847718 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:42.851951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:42.852443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:42.852920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:42.853673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:42.854133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:42.854563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:42.986357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:42.994211 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e75bf5c4-8df9-46e7-9664-3e21495bc17a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.155963 Oct 04 19:36:42.994792 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4118/8207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:42 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:44.018548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:44.019174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:44.021106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:44.030603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:44.166971 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:44.174928 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-68c670f3-a0f2-4288-81f5-8bc3172ec8a6 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.160698 Oct 04 19:36:44.175522 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4090/8208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:44 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:45.198653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:45.201047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:45.206550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.207082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.207549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.208270 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:45.208716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:45.209144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:45.343122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:45.352105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8b756aa6-ff7e-4297-8547-8f390ca0e9d0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.157307 Oct 04 19:36:45.352715 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4119/8209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:45 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:46.379625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:46.380174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:46.387772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.388276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.388735 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:46.389444 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:46.389915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:46.390360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:46.521324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:46.529954 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22282713-240f-4590-978d-dc84cfa4ee15 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.154333 Oct 04 19:36:46.530539 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4091/8210] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:46 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:47.553302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:47.554026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:47.561055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.561622 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.562137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.562848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.563308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.563763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.768108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:47.777121 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8495bd11-cc2a-4d37-85fc-fa9b5acce0de tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.228187 Oct 04 19:36:47.778092 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4120/8211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:47 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:47.889851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:47.901779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:47.902282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:47.903119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:47.914977 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] Creating event network-changed:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:36:47.920628 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-408e15a0-f451-4e83-be90-76585d183011 req-55b8fab9-246e-4640-a23e-adbdda5d3c86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035715 Oct 04 19:36:47.921606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4092/8212] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:48.800600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:48.801220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:48.808621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.809116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.809559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:48.810275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:48.810736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:48.811164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:49.082015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:49.090602 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7a15406a-618b-4bb3-bf74-6c0a29af5fab tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.294149 Oct 04 19:36:49.091196 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4121/8213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:48 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:50.116172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:50.117440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:50.123897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.124401 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.124848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.125563 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:50.126029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:50.126468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:50.265325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:50.273013 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fd35153-1d1b-4391-8de7-aa5e8025f3fc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.162019 Oct 04 19:36:50.273601 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4093/8214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:50 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:51.296191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:51.303089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:51.304685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.305197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.305630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:51.306325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:51.306774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:51.307742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:51.446053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:51.455128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-779bf532-b636-409e-a7fa-598cfaea1812 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.162852 Oct 04 19:36:51.455988 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4122/8215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:51 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:52.486415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:52.487048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:52.494021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:52.494518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:52.494965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:52.495707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:52.496178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:52.496615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:52.635761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:52.643602 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e4b59f3-b7c9-4d31-bcc1-d50bb732a179 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.161093 Oct 04 19:36:52.644184 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4094/8216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:52 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:53.668483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:53.669073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:53.676217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.676707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.677150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.677847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:53.678623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:53.679056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:53.810016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:53.817916 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5923dda-b99a-4ef8-9953-98d25578c98c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.154057 Oct 04 19:36:53.818497 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4123/8217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:53 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:54.782167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "name": "network-vif-plugged", "status": "completed", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:36:54.788471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.788979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.789427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.801914 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] Creating event network-vif-plugged:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:36:54.807685 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-ce329820-b702-4813-b36c-678c04dcc94c req-4ba580ed-4c01-4bcd-84e6-0556b8b3dbbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092438 Oct 04 19:36:54.808489 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4095/8218] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:36:54.841016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:54.841629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:54.852527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.853440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.853619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:54.854739 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:54.855202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:54.856197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:55.050114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:55.058791 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3a65a76f-4b7e-49cb-a202-b4d5dd62d141 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.221763 Oct 04 19:36:55.059387 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4124/8219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:54 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:56.083011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:56.083766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:56.091619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.092120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.092580 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.093292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:56.093767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:56.094214 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:56.225197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:56.233016 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7190fcc-7f51-44de-bf7b-b18b1722aa4b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1359 microversion: 2.1 time: 0.154689 Oct 04 19:36:56.233611 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4096/8220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:56 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:57.257482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.258105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:57.265427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.265914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.266358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.267062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.267556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.267991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.406022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.413859 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dfe5bd05-4681-449c-93df-944f1871a6ce tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1548 microversion: 2.1 time: 0.160941 Oct 04 19:36:57.414431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4125/8221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:57.436728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.437360 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:57.450379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.451072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.451744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.452768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.453679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.454289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.599028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.607364 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6104585c-e5b4-4a20-8f74-f716041ad8c2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1548 microversion: 2.1 time: 0.174570 Oct 04 19:36:57.607996 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4097/8222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:36:57.632123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.637549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.638304 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Searching by: {'deleted': False, 'project_id': '337039868a764744bd300718eef8dbeb'} {{(pid=123887) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:36:57.643754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.644258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.644658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.645372 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.645822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.646244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.670881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.multi_cell_list [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123887) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:36:57.699120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-11fe5f0d-3835-4d1c-ab0f-f1f011458f36 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070848 Oct 04 19:36:57.699752 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4126/8223] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:36:57.712323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:36:57.712958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:36:57.718978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.719490 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.719969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.720721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:36:57.721229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:36:57.721676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:36:57.852219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:36:57.862420 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b1665d83-cf85-4fd9-a7d5-f1ec95592fe9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1548 microversion: 2.1 time: 0.151869 Oct 04 19:36:57.862420 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4098/8224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:36:57 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:00.727414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "053bd3c6-b6e2-40ff-b3cf-79b3bab59e26"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:00.729865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:00.736761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.737233 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.737662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:00.738349 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:00.738794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:00.739213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:01.401780 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e312d68a-6521-44d8-a74b-1d922ff4e34a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678134 Oct 04 19:37:01.402409 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4127/8225] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 4 19:37:00 2022] POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:13.385497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:13.386144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:13.388685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:13.389518 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=70 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:13.394286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:13.394783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:13.395229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:13.395969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:13.396717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:13.397162 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:13.536443 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:13.543133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eed9f118-32ed-4c0c-90ee-98ecfeac4e75 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1594 microversion: 2.1 time: 0.161469 Oct 04 19:37:13.546594 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4099/8226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:13 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:37:15.658862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:15.665464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:15.666204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:15.667024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:37:15.676829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:15.677327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:15.677766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:15.689328 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] Creating event network-changed:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:37:15.694842 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e546f5b7-d7c0-4f0a-8921-75256f6e7139 req-2f72c9be-d6d1-41b7-8498-930500f00da2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Oct 04 19:37:15.695382 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4128/8227] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:37:18.168639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-821693684"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:18.169264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:18.177290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.177759 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.178217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.179535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:18.180013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:18.180456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:18.324035 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Adding security group 81c6f458-6488-40ab-802f-04e8038ae5c9 to port 44f75764-bf63-4703-b01f-5fb108182897 Oct 04 19:37:19.061393 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-11032729-41ae-4f3c-80a6-e41c9c66b873 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.897393 Oct 04 19:37:19.065706 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4100/8228] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:37:18 2022] POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:37:19.072616 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:37:19.073488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:37:19.074324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:37:19.081491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:19.083406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:19.084109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:19.084266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:19.084796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:19.085409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:19.085690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:37:19.087043 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:37:19.087901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:37:19.100545 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] Creating event network-changed:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:37:19.106444 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4f9be826-18f6-44bf-965b-65f57a6b887f req-55081439-3989-4994-8565-5278fd57b297 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041019 Oct 04 19:37:19.107490 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4129/8229] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:37:19.276396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:37:19.290086 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c9838fa2-43ae-447e-bff9-cd6b1d83cc50 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1759 microversion: 2.1 time: 0.222675 Oct 04 19:37:19.291657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4101/8230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:37:19 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:07.451575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:38:07.453918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:07.462691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.463189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.463674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.469154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.469154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.469154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.694555 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0c237a24-9f24-4a92-9f7e-f4ed42f30f70 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.249502 Oct 04 19:38:07.695292 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4130/8231] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:38:07 2022] POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:38:07.705515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:07.706271 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:07.710311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:07.711260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:38:07.714681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.715199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.715750 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.716489 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:07.717034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:07.717560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:07.872572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:07.881587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1b22c3f4-cc76-4788-b018-fb2bc8deea23 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1751 microversion: 2.1 time: 0.180464 Oct 04 19:38:07.882333 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4102/8232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:07 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:08.909010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:08.909711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:08.916846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:08.917420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:08.917909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:08.918658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:08.919163 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:08.919684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:09.071844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:09.081386 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b75aae7-4a54-48a3-bd73-e0aebf867856 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.177561 Oct 04 19:38:09.081976 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4131/8233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:08 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:10.106475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:10.107094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:10.114595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:10.115109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:10.115591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:10.116310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:10.116783 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:10.117228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:10.263285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:10.272050 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-719ac882-820a-4044-8a89-bd8688c9cd2b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.170047 Oct 04 19:38:10.272698 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4103/8234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:10 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:11.302243 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:11.302864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:11.311169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:11.311717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:11.312165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:11.312903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:11.313362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:11.313789 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:11.463489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:11.472754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-885ffc36-0a8d-4150-9eb1-de862b77058a tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.174450 Oct 04 19:38:11.473342 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4132/8235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:11 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:12.497123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:12.497796 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:12.500988 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:38:12.501205 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b (ip 10.222.0.40) !!! Oct 04 19:38:12.508145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:12.508654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:12.509113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:12.509839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:12.510320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:12.510768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:12.662302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:12.671762 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fe7fdcf0-c5d4-41d4-82c9-ea0da8131bf4 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.178507 Oct 04 19:38:12.672352 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4104/8236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:12 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:13.695817 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:13.696839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:13.704936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:13.705431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:13.705873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:13.706580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:13.707042 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:13.707500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:13.861826 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:13.870377 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c46917ef-c7c6-4b80-ae2f-f3b44d9af82f tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.178586 Oct 04 19:38:13.871446 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4133/8237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:13 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:14.895094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:14.895756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:14.903521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:14.904034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:14.904497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:14.905233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:14.905699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:14.906148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:15.059826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:15.068363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22fcab40-12c2-4ff5-8110-c8e71bbc2e4d tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.177206 Oct 04 19:38:15.068970 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4105/8238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:14 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:16.093814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:16.094416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:16.101498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:16.101995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:16.102436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:16.103140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:16.103629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:16.104062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:16.251964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:16.260588 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81a447c0-7c42-42d4-a36a-d77706633c9c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.171303 Oct 04 19:38:16.261700 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4134/8239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:16 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:17.285254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:17.285860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:17.293638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:17.294134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:17.294586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:17.295296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:17.295835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:17.296396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:17.450532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:17.459012 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-eef65b77-1395-42d6-a33b-7c6206d78c37 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.177740 Oct 04 19:38:17.459619 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4106/8240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:17 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:18.485149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:18.485755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:18.492340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:18.493021 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:18.493316 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:18.494023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:18.494485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:18.495039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:18.642558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:18.651227 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3b024b64-a55f-4897-95be-dfcf40e675f0 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.171569 Oct 04 19:38:18.651890 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4135/8241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:18 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:19.675382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:19.675965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:19.684151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:19.684661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:19.685119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:19.685845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:19.686340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:19.686771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:19.833001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:19.841389 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-35db5dd6-fb32-4b15-820b-28830dbc9c2e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.170107 Oct 04 19:38:19.842033 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4107/8242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:19 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:20.865494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:20.866094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:20.873571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:20.880004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:20.880004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:20.880004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:20.880004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:20.880004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:21.032459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:21.041103 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01eadad9-f39d-456c-8f95-968ffe535925 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.179799 Oct 04 19:38:21.041689 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4136/8243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:20 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:22.064945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:22.065579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:22.073060 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:22.074163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:22.074621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:22.075654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:22.076140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:22.076590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:22.235804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:22.244792 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0f21c419-508a-41d0-89f2-73602b8dee8e tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.183838 Oct 04 19:38:22.245949 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4108/8244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:22 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:23.270290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:23.270914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:23.278880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:23.279300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:23.279777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:23.280487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:23.280946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:23.281402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:23.436529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:23.445399 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b822afd6-129f-49dd-867d-4f8687e2aae3 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.178960 Oct 04 19:38:23.446222 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4137/8245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:23 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:38:24.470275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:24.470902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:24.477886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.478379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.478825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.480070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:24.480536 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:24.480975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:24.631840 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:24.641120 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1131ba1d-c888-494b-a52d-4f6671e80beb tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1756 microversion: 2.1 time: 0.174628 Oct 04 19:38:24.641719 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4109/8246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:24 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:38:25.665242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:38:25.665801 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:38:25.673093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:25.673579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:25.674036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:25.674746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:38:25.675201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:38:25.675655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:38:26.140282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:38:26.148754 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-da145bc5-c878-435e-8248-73de0174b029 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1759 microversion: 2.1 time: 0.487519 Oct 04 19:38:26.149343 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4138/8247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:38:25 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1759 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:21.218169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-821693684"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:21.218818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:21.220803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:21.221543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=48 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:21.226898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:21.227427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:21.232013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:21.232013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:21.232013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:21.232013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:21.362014 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.network.security_group_api [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Removing security group 81c6f458-6488-40ab-802f-04e8038ae5c9 from port 44f75764-bf63-4703-b01f-5fb108182897 Oct 04 19:39:21.737295 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e76da062-7162-4a44-aeea-da17c0f68aed tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action" status: 202 len: 0 microversion: 2.1 time: 0.521655 Oct 04 19:39:21.737295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4110/8248] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:39:21 2022] POST /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:39:21.745899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:21.752062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=22 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:21.752785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:21.765743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:21.766245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:21.766691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:21.796702 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] Creating event network-changed:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:39:21.810479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c2b010df-5780-45af-81dc-f745fe512f52 req-6d48978c-004d-4d81-96e0-d2fd31ba768f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068554 Oct 04 19:39:21.811358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4139/8249] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:23.071280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:23.072033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:23.079052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:23.079585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:23.080044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:23.080758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:23.081229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:23.081674 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:23.168287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lazy-loading 'services' on Instance uuid b17f78b8-3f8a-4d0a-952d-6f979a595a6b {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:39:23.386573 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [d50ac40d-a1ff-4055-a41e-0e74d3333188] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:39:23.831519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:23.842437 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:23.842912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:23.843717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:23.855053 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] Creating event network-changed:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:39:23.860187 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3a5b1b48-910f-44b2-8cdb-3f9070d5035e req-b793800c-970d-4ec2-a12c-63ce1052d2a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Oct 04 19:39:23.860839 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4140/8250] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:39:24.393689 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [d50ac40d-a1ff-4055-a41e-0e74d3333188] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47110. Oct 04 19:39:24.397203 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9311ad50-c3f1-4e9a-a913-91f45d13c193 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments/053bd3c6-b6e2-40ff-b3cf-79b3bab59e26" status: 202 len: 0 microversion: 2.1 time: 1.330498 Oct 04 19:39:24.397934 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4111/8251] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:39:23 2022] DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments/053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:39:24.407400 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:24.410591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:24.418839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:24.419687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:24.420249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:24.421121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:24.421566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:24.422001 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:24.453324 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-35cdba25-102d-49b0-8f60-efc51e787cc7 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050633 Oct 04 19:39:24.453902 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4141/8252] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:24 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:25.468246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:25.470736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:25.478021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:25.478529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:25.479020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:25.479762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:25.480240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:25.480690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:25.510170 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-722fce27-13a4-4282-b395-e676766de189 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047425 Oct 04 19:39:25.510744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4112/8253] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:25 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:26.522763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:26.524966 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:26.531903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:26.532380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:26.532814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:26.533497 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:26.533949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:26.534368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:26.568826 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-01320cc5-b58a-430d-8a40-454343f46941 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050569 Oct 04 19:39:26.569395 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4142/8254] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:26 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:27.581967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:27.584232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:27.591278 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:27.591826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:27.592285 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:27.593027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:27.593559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:27.594015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:27.625206 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ad2421c2-136d-4b59-9fd3-3f41fd4c6fcc tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Oct 04 19:39:27.625700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4113/8255] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:27 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:28.638107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:28.640534 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:28.647440 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:28.647953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:28.648384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:28.649065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:28.649510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:28.649926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:28.678784 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2d917a3e-984a-446f-a295-29bae221a4f2 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Oct 04 19:39:28.679498 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4143/8256] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:28 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:29.690899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:29.694542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:29.702692 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:29.703274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:29.703767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:29.704924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:29.705407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:29.705859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:29.737770 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-734b3673-15f1-49ac-b288-54eef212b428 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051274 Oct 04 19:39:29.738337 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4114/8257] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 4 19:39:29 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:39:29.749686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:29.750182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:29.757110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:29.757588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:29.758030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:29.758820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:29.759273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:29.759727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:29.834388 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] HTTP exception thrown: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b is not attached to volume 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Request method failure captured: Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: request: DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments/053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 HTTP/1.1 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIo0aCIYbNINtu39dY6V9vCSoB8pCFYyYxPe4SECnoZkvbBRlilzXcWeYrGj_w9kwZ5AAQ0B8xtUHkN-u1-Jf-5x4579W4PSihhBGb8S_tDma7PjQ-vtsvKgh6iTrTBxrNy-KY-bS-gvFq77apnnEQQJtXLqkn1KtKOmV3ZqTgFobzI Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337039868a764744bd300718eef8dbeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337039868a764744bd300718eef8dbeb"}]}] Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 002dafe8b108437fb786c9c26aac271d Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b is not attached to volume 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'server_id': 'b17f78b8-3f8a-4d0a-952d-6f979a595a6b', 'id': '053bd3c6-b6e2-40ff-b3cf-79b3bab59e26'} Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26. Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b is not attached to volume 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:29.836126 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b is not attached to volume 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Returning 404 to user: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b is not attached to volume 053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea1cb8ab-0631-4466-b2c1-d84bc74ffff9 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments/053bd3c6-b6e2-40ff-b3cf-79b3bab59e26" status: 404 len: 154 microversion: 2.1 time: 0.091962 Oct 04 19:39:29.840678 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4144/8258] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 4 19:39:29 2022] DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b/os-volume_attachments/053bd3c6-b6e2-40ff-b3cf-79b3bab59e26 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:33.230227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:33.230839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:33.238140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.242908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.242908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.242908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.242908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.242908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.266404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:39:33.600756 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2d3c70e4-bc6d-4cd8-8ebb-fae3168ed3ac tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 204 len: 0 microversion: 2.1 time: 0.373809 Oct 04 19:39:33.601490 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4115/8259] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:39:33 2022] DELETE /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:39:33.609692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:33.610297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:33.617938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.618413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.618846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.619559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:33.620007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:33.620426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:33.753705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:33.761756 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aa15fb41-2458-450b-9561-8b7da904b45b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1554 microversion: 2.1 time: 0.155863 Oct 04 19:39:33.762359 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4145/8260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:33 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:39:34.786213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:34.786946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:34.794603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:34.795106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:34.795668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:34.796378 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:34.796848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:34.797292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:34.930948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:34.938911 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-84758130-1534-48e4-aab8-1310d372297c tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1554 microversion: 2.1 time: 0.156977 Oct 04 19:39:34.939512 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4116/8261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:34 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:35.962674 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:35.963293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:35.971531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:35.972232 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:35.972680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:35.974325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:35.974787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:35.975216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:36.066604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002dafe8b108437fb786c9c26aac271d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337039868a764744bd300718eef8dbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:39:36.067332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17f78b8-3f8a-4d0a-952d-6f979a595a6b", "name": "network-vif-deleted", "tag": "44f75764-bf63-4703-b01f-5fb108182897"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:36.075727 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-262fc737-a0b9-4157-a7c0-ae7376f62f6b tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 200 len: 1512 microversion: 2.1 time: 0.116997 Oct 04 19:39:36.076401 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4146/8262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:35 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 1512 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:39:36.078154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:36.078673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:36.079118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:36.091325 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] Creating event network-vif-deleted:44f75764-bf63-4703-b01f-5fb108182897 for instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b on n-h2-833090-21 Oct 04 19:39:36.096530 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-2a196f95-6fbb-4437-8abe-6fd9d43c4361 req-61795f16-0e0f-42bb-9d32-360f67b365b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Oct 04 19:39:36.097140 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4117/8263] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:39:37.101134 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:37.101814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [instance: b17f78b8-3f8a-4d0a-952d-6f979a595a6b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:39:37.109979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:37.110471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:37.110964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:37.111794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:39:37.112257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:39:37.112691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:39:37.126452 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] HTTP exception thrown: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Request method failure captured: Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b HTTP/1.1 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIo0aCIYbNINtu39dY6V9vCSoB8pCFYyYxPe4SECnoZkvbBRlilzXcWeYrGj_w9kwZ5AAQ0B8xtUHkN-u1-Jf-5x4579W4PSihhBGb8S_tDma7PjQ-vtsvKgh6iTrTBxrNy-KY-bS-gvFq77apnnEQQJtXLqkn1KtKOmV3ZqTgFobzI Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_337039868a764744bd300718eef8dbeb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/337039868a764744bd300718eef8dbeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/337039868a764744bd300718eef8dbeb"}]}] Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 337039868a764744bd300718eef8dbeb Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344299472 Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 002dafe8b108437fb786c9c26aac271d Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestMinimumBasicScenario-1344299472-project Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': 'b17f78b8-3f8a-4d0a-952d-6f979a595a6b'} Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:39:37.128028 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Returning 404 to user: Instance b17f78b8-3f8a-4d0a-952d-6f979a595a6b could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4bca96cf-a1f9-4c4f-99b4-31458528bc46 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b" status: 404 len: 111 microversion: 2.1 time: 0.033265 Oct 04 19:39:37.132605 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4147/8264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:39:37 2022] GET /compute/v2.1/servers/b17f78b8-3f8a-4d0a-952d-6f979a595a6b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:39:37.140296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a5c9434-b11c-4cb3-b4d9-b546385aef16 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] Calling method '.version_select at 0x7f90082bd940>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:39:37.144964 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a5c9434-b11c-4cb3-b4d9-b546385aef16 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [2486dde6-bef4-4f1f-9970-a457178f7981] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:39:38.152263 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a5c9434-b11c-4cb3-b4d9-b546385aef16 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] [2486dde6-bef4-4f1f-9970-a457178f7981] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47152. Oct 04 19:39:38.229993 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a5c9434-b11c-4cb3-b4d9-b546385aef16 tempest-TestMinimumBasicScenario-1344299472 tempest-TestMinimumBasicScenario-1344299472-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2104969384" status: 202 len: 0 microversion: 2.1 time: 1.094779 Oct 04 19:39:38.230587 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4118/8265] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 4 19:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2104969384 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:39:50.098586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:50.099482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=42 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:50.287493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1b1ff613-758a-4c8d-8eb9-ab4d4e733d6e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: .version_select at 0x7f9008910d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1925319714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiyk/O9j/rB1WGjqDtCehFAXEFOs/e8Z3SvFmtwdT6FS6Xvx3v3drY+AIT3rNjEOHjs5gMf8bzJbdLyh4Vt2Y78aHUy6LWB7tkAH0xotkz4/3YhLxVvwLXwdzn1+O/Y7g=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:50.303433 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b1ff613-758a-4c8d-8eb9-ab4d4e733d6e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:39:50.309149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1b1ff613-758a-4c8d-8eb9-ab4d4e733d6e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:39:50.418323 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1b1ff613-758a-4c8d-8eb9-ab4d4e733d6e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.325090 Oct 04 19:39:50.418862 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4148/8266] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:39:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:39:59.585448 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:59.586245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:39:59.593376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-300768239", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "e3c8b211-2d47-4826-8651-e94e074d2fe3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1925319714", "security_groups": [{"name": "tempest-secgroup-smoke-1993254327"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:39:59.885659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] validate_networks() for [('e3c8b211-2d47-4826-8651-e94e074d2fe3', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:40:00.365239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:40:00.365781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:40:00.366677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:40:00.367175 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:40:00.367652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:40:00.377533 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:00.378037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:00.378499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:00.379242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:00.379745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:00.380197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:00.399612 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:40:00.405687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:40:00.422543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:40:00.425359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:40:00.552701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce3c27c0-045c-4e15-85b7-e0de0ca9bc02 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.969592 Oct 04 19:40:00.553473 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4119/8267] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:39:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:40:00.563217 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:40:00.563824 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc (ip 10.222.0.40) !!! Oct 04 19:40:00.565645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:00.566414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:00.577815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-88f92b24-a5b5-475e-bd32-e03b0eb8c55e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:00.578450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-88f92b24-a5b5-475e-bd32-e03b0eb8c55e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:00.700794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-88f92b24-a5b5-475e-bd32-e03b0eb8c55e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:00.707899 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-88f92b24-a5b5-475e-bd32-e03b0eb8c55e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1266 microversion: 2.1 time: 0.146559 Oct 04 19:40:00.708485 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4149/8268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:00 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:01.734491 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1ee66f74-4210-4378-a7d6-caa72e6573a1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:01.735121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1ee66f74-4210-4378-a7d6-caa72e6573a1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:01.797437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1ee66f74-4210-4378-a7d6-caa72e6573a1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:01.804725 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1ee66f74-4210-4378-a7d6-caa72e6573a1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1266 microversion: 2.1 time: 0.076824 Oct 04 19:40:01.805726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4120/8269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:01 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:02.830317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:02.831095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:02.839226 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:02.839741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:02.840186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:02.840880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:02.841362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:02.841792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:02.909449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:02.917772 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-550a34e7-3fce-4596-b412-937930eba5dc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1318 microversion: 2.1 time: 0.092233 Oct 04 19:40:02.918361 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4150/8270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:02 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:03.942404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:03.943080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:03.951020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:03.951557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:03.952017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:03.952731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:03.953207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:03.953651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:04.030045 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:04.038879 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4525e7bc-40e3-4339-b18d-f28983af30d1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1324 microversion: 2.1 time: 0.100325 Oct 04 19:40:04.039510 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4121/8271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:03 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1324 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:40:05.063236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:05.063882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:05.070896 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:05.071687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:05.072260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:05.073914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:05.074052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:05.074492 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:05.217192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:05.225648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ebe0aedb-01ea-471b-a04e-204b1e727b63 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.166408 Oct 04 19:40:05.226524 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4151/8272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:05 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:40:05.503680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019f18a2-f97d-4e2d-b923-4ecfb93f19dc", "tag": "2bc9e130-0557-445f-b303-60fc0d00630c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:05.513956 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:05.514462 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:05.514915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:05.530430 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] Creating event network-changed:2bc9e130-0557-445f-b303-60fc0d00630c for instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc on n-h1-833090-21 Oct 04 19:40:05.535743 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f31aaf49-37ae-44de-8c4a-e8c8782d57c4 req-f1907b5a-cb82-47bf-83cc-b15dd67eed76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Oct 04 19:40:05.536657 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4122/8273] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:06.250971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:06.251810 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:06.259556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:06.263298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:06.263298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:06.263298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:06.263298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:06.263298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:06.402375 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:06.414285 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4529facb-50c9-4446-9438-0ba14352491a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.168002 Oct 04 19:40:06.415718 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4152/8274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:06 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:40:07.443791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:07.444503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:07.451528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:07.452023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:07.452466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:07.453154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:07.453635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:07.454073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:07.595966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:07.604144 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-11d549dd-302c-46fb-a826-0bdcaedf9074 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.165386 Oct 04 19:40:07.604726 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4123/8275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:07 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:08.631783 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:08.632396 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:08.639604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:08.640098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:08.640543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:08.641258 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:08.641710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:08.642146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:08.786747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:08.795397 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83c33ab1-4e13-4c39-8866-3b720a53284d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.167536 Oct 04 19:40:08.796028 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4153/8276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:08 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:09.824775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:09.825410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:09.832413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:09.832967 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:09.833472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:09.834194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:09.834669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:09.835123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:09.973017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:09.981296 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b40a90f8-fb64-42e1-83ea-136995ce31c8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.161090 Oct 04 19:40:09.981881 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4124/8277] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:09 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:10.515453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019f18a2-f97d-4e2d-b923-4ecfb93f19dc", "name": "network-vif-plugged", "status": "completed", "tag": "2bc9e130-0557-445f-b303-60fc0d00630c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:10.526048 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:10.526523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:10.526948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:10.538348 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] Creating event network-vif-plugged:2bc9e130-0557-445f-b303-60fc0d00630c for instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc on n-h1-833090-21 Oct 04 19:40:10.543536 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c2ea2cae-30c7-4795-b9d2-761762c7f50f req-30bba7b5-af1c-4ada-99bf-71e6b1c95315 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Oct 04 19:40:10.544275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4154/8278] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:11.003731 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:11.004361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:11.006346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:11.012100 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.012604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.013196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.013906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:11.014380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:11.014825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:11.148558 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:11.156449 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-513506d1-aec6-489e-90ea-01418460978c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1392 microversion: 2.1 time: 0.156599 Oct 04 19:40:11.157282 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4125/8279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:10 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:12.182211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:12.182917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:12.189624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.190181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.190660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.191393 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.191916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.192348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.330137 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:12.339343 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d5e55f12-873c-419a-8b2f-771c04403b1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1564 microversion: 2.1 time: 0.162392 Oct 04 19:40:12.339958 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4155/8280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:12 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:12.363745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:12.364476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:12.366505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=8 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:12.372465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.372964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.373425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.374143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:12.374622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:12.375070 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:12.507940 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:12.516226 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a601d8ee-a279-4d9e-b0ef-25a2cbefba5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1564 microversion: 2.1 time: 0.156491 Oct 04 19:40:12.516811 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4126/8281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:12 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:14.547794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:14.548269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:14.550009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019f18a2-f97d-4e2d-b923-4ecfb93f19dc", "tag": "2bc9e130-0557-445f-b303-60fc0d00630c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:14.553744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:14.556806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:14.557916 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:14.558426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:14.559087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:14.559583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:14.560095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:14.562919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:14.563597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:14.564146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:14.578384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] Creating event network-changed:2bc9e130-0557-445f-b303-60fc0d00630c for instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc on n-h1-833090-21 Oct 04 19:40:14.584461 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-690418e6-e442-4340-ae99-b2a5c4087e2f req-383ea453-a4fc-4def-ab6d-cec6581746bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038471 Oct 04 19:40:14.585159 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4127/8282] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:14.712554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:14.722230 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fbfdccc0-9769-41d8-b71d-81bba2f04d7a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1564 microversion: 2.1 time: 0.178080 Oct 04 19:40:14.728853 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4156/8283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:14 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:40.010084 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:40.010896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:40.015185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:40.017510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:40.024347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:40.024863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:40.025320 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:40.026093 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:40.026565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:40.027012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:40.082360 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-95453153-3c83-451e-adff-82326cfdde8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action" status: 200 len: 24568 microversion: 2.1 time: 0.075103 Oct 04 19:40:40.083021 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4128/8284] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:40 2022] POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:40:51.190449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:51.191053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:51.193202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:51.194768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=38 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:51.199727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:51.206336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:51.206336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:51.206336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:51.206336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:51.206336 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:51.468910 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c1773e47-eced-491f-a42a-272bb8daaf83 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action" status: 202 len: 0 microversion: 2.1 time: 0.282333 Oct 04 19:40:51.469519 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4157/8285] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:51 2022] POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:40:51.479291 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:51.480081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:51.483044 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:40:51.488588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:51.489094 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:51.489551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:51.490267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:51.490741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:51.491185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:51.638579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:51.646603 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0c2c5909-4a01-40d9-af60-e9c0f09bf9f5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1687 microversion: 2.1 time: 0.172053 Oct 04 19:40:51.647843 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4129/8286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:51 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:52.672814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:52.673525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:52.680453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:52.680942 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:52.681385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:52.682102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:52.682557 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:52.682984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:52.818122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:52.826879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-58a3fdb1-33c0-4737-8c3f-e9ade6b2a743 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1667 microversion: 2.1 time: 0.159425 Oct 04 19:40:52.827489 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4158/8287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:52 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:53.921730 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:53.924018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:53.930894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.931402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.931887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.932602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:53.933073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:53.933647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:53.996854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1335c1a8-4d4a-4208-9c1e-60355f86a8d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action" status: 200 len: 32639 microversion: 2.1 time: 0.079213 Oct 04 19:40:53.997532 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4130/8288] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:53 2022] POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action => generated 32639 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:40:54.009965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:54.010518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:54.017580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.018072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.018516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:54.019219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.019731 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.020173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:54.183493 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b95c5a87-a7a0-4d5a-96e1-ad7aca4b1b93 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action" status: 202 len: 0 microversion: 2.1 time: 0.177701 Oct 04 19:40:54.184070 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4159/8289] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:54 2022] POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:40:54.193322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:54.194901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:54.202385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.202898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.203347 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:54.204086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:54.204552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:54.204991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:54.341906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:54.350695 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-47c1b612-0b84-42d0-af5e-9de85ef51e3c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1674 microversion: 2.1 time: 0.161093 Oct 04 19:40:54.351288 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4131/8290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:54 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:55.377272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:55.377888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:55.384836 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:55.385329 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:55.385767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.386463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:55.386917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:55.387347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.529501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:55.537453 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-330da7aa-7019-4d79-87f8-33fd895cf061 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1682 microversion: 2.1 time: 0.165592 Oct 04 19:40:55.538046 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4160/8291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:55 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:55.637204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:55.639420 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:55.647318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:55.647898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:55.648361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.649088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:55.649561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:55.650005 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:55.710103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0abedbfb-2ea7-40a6-86bd-a8b155827322 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action" status: 200 len: 38394 microversion: 2.1 time: 0.076722 Oct 04 19:40:55.710751 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4132/8292] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:40:55 2022] POST /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc/action => generated 38394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:40:56.766815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:56.767358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:56.776144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.776644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.777089 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.777286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019f18a2-f97d-4e2d-b923-4ecfb93f19dc", "tag": "2bc9e130-0557-445f-b303-60fc0d00630c"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:56.777972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.778441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.779761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.791766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:56.792471 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:56.792955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:56.806481 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] Creating event network-changed:2bc9e130-0557-445f-b303-60fc0d00630c for instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc on n-h1-833090-21 Oct 04 19:40:56.807346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:40:56.811853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-11f31c11-bf82-4ac0-84c3-d5b3c27f53f2 req-5659334c-0d75-43a7-b8e4-1288c07a31fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038480 Oct 04 19:40:56.812480 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4133/8293] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:40:57.157340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7708a0ae-a836-4d5e-8567-a775917e4a8d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 204 len: 0 microversion: 2.1 time: 0.394284 Oct 04 19:40:57.158055 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4161/8294] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:40:56 2022] DELETE /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:40:57.167890 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:57.169179 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:57.177403 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.178845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.179410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.191412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:57.191412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:57.191412 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:57.354141 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:57.362446 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6e18f67e-f228-4f91-be71-c03915f789cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1688 microversion: 2.1 time: 0.199233 Oct 04 19:40:57.363250 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4134/8295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:57 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:58.389090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:58.389699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:58.396595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:58.397074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:58.397502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:58.398186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:58.398634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:58.399054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:58.533787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:58.542111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-49fac8dc-5daf-4c76-b74b-5aae5cca3ba2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1688 microversion: 2.1 time: 0.157585 Oct 04 19:40:58.542685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4162/8296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:58 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:59.566111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:40:59.566771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:40:59.574372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:59.574873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:59.575324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:59.576083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:59.576553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:59.576990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:59.749930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:40:59.758301 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4919c21-7ae5-49ae-aac3-392cd33fdf75 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1570 microversion: 2.1 time: 0.196151 Oct 04 19:40:59.758935 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4135/8297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:40:59 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:40:59.856865 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019f18a2-f97d-4e2d-b923-4ecfb93f19dc", "name": "network-vif-deleted", "tag": "2bc9e130-0557-445f-b303-60fc0d00630c"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:40:59.867184 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:40:59.867695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:40:59.868129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:40:59.884698 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] Creating event network-vif-deleted:2bc9e130-0557-445f-b303-60fc0d00630c for instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc on n-h1-833090-21 Oct 04 19:40:59.890360 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-02dfd157-6663-4b7e-9ec4-83bb2eb4da12 req-2ca78483-3413-4d9a-b3d9-68a35b57734b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037068 Oct 04 19:40:59.891138 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4163/8298] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:00.782273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:00.782937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:00.790550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.791066 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.791560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.792282 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.792765 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.793213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.826237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:00.826667 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:00.827128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:00.827636 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lazy-loading 'fault' on Instance uuid 019f18a2-f97d-4e2d-b923-4ecfb93f19dc {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:41:00.870515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:00.878369 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cbc3727-9d3b-4e69-847d-529862cba8e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 200 len: 1356 microversion: 2.1 time: 0.099997 Oct 04 19:41:00.878952 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4136/8299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:00 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:01.903216 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:01.903951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 019f18a2-f97d-4e2d-b923-4ecfb93f19dc] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:01.910248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:01.914957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:01.914957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:01.914957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:01.914957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:01.914957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:01.926770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] HTTP exception thrown: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Request method failure captured: Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc HTTP/1.1 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIwF0DuGVU0wh5ni8FAzc88IKaDjTMFC_iYVYx_rXIQTBlFmjE0WWJ5if9uLUVZ-gX_O2ffQ8l8HH4QUxypMeygP1iBLbKLjDTG7jRKfQ0mobFEoYWWEvQ8LaUBoe8OEivuPi7XMNzVM2mOI3fwcRoTXjU3P-60RTLTmxdOWv577GHU Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26b82e4aaca2487ea27c7c484a73edc0"}]}] Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 43d46d9f90b447788f064d33aed59442 Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '019f18a2-f97d-4e2d-b923-4ecfb93f19dc'} Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:41:01.929072 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Returning 404 to user: Instance 019f18a2-f97d-4e2d-b923-4ecfb93f19dc could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-83d0f48f-86d9-488f-b443-e05ff621ef41 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc" status: 404 len: 111 microversion: 2.1 time: 0.032506 Oct 04 19:41:01.943597 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4164/8300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:01 2022] GET /compute/v2.1/servers/019f18a2-f97d-4e2d-b923-4ecfb93f19dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:41:05.621413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4cd1cbea-170f-4a33-b782-5febb6a5f751 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '.version_select at 0x7f9009890dc0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:05.758728 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4cd1cbea-170f-4a33-b782-5febb6a5f751 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1925319714" status: 202 len: 0 microversion: 2.1 time: 0.142994 Oct 04 19:41:05.759329 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4137/8301] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 4 19:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1925319714 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:41:05.788082 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c584651a-476d-48ca-87bc-23177cea0540 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: .version_select at 0x7f900ad62700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-301346358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKAyVMFz7zxkcW56l6SVnwlcw8QAfBlg/JD5Ev+6V7GgJSoZItOyLwhoWSvfZUHijyElaTgXOHvkP7OUt4N2fhthoEz1PT4KfsgqhgAuA8GgQLgL0GdZMcfwWkLRmd70w=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:05.804621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c584651a-476d-48ca-87bc-23177cea0540 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:41:05.810675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-c584651a-476d-48ca-87bc-23177cea0540 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:41:05.947806 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c584651a-476d-48ca-87bc-23177cea0540 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.163579 Oct 04 19:41:05.959984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4165/8302] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:41:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:14.994541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-223832342", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "3ea96ae3-2ef3-4a29-8eb7-72958df7a5a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-301346358", "security_groups": [{"name": "tempest-secgroup-smoke-1195736684"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:15.007379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=42 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:15.160594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] validate_networks() for [('3ea96ae3-2ef3-4a29-8eb7-72958df7a5a5', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:41:15.740681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:41:15.740681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:41:15.740681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:41:15.741026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:41:15.741539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:41:15.753083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:15.754117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:15.754849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:15.757184 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:15.757944 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:15.758763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:15.782075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:41:15.788848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:41:15.804406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:41:15.806834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:41:15.927844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1e38cc20-b889-4f74-9b59-535cc3c3da97 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.937108 Oct 04 19:41:15.929213 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4138/8303] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:41:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:41:15.939078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:15.940387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:15.941202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:15.946158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0fe7f7e8-277c-47fa-b0c7-6a8d03b28ada tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:15.947955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0fe7f7e8-277c-47fa-b0c7-6a8d03b28ada tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:16.040957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0fe7f7e8-277c-47fa-b0c7-6a8d03b28ada tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:16.049561 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0fe7f7e8-277c-47fa-b0c7-6a8d03b28ada tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1265 microversion: 2.1 time: 0.111789 Oct 04 19:41:16.063952 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4166/8304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:15 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:17.075263 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:17.082192 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:17.085610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:17.086212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:17.086751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:17.087658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:17.088274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:17.088799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:17.160461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:17.168885 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7837090b-0cd3-4d2f-bd25-30bda1b57bac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1269 microversion: 2.1 time: 0.097790 Oct 04 19:41:17.170131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4139/8305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:17 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:18.194511 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:18.195140 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:18.204268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:18.208903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:18.208903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:18.208903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:18.208903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:18.208903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:18.276777 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:18.285091 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-beb483f1-2508-4772-8bc8-de5c43105f58 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1325 microversion: 2.1 time: 0.095635 Oct 04 19:41:18.285976 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4167/8306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:18 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1325 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:19.310969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:19.311972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:19.321987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:19.322807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:19.323441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:19.324372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:19.324949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:19.325483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:19.485699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:19.495647 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1495620-9195-4d8d-86b7-105f81ed11a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.188627 Oct 04 19:41:19.497003 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4140/8307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:19 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:20.154219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de23bd55-b4c9-44ef-b9fe-7e3a29c78100", "tag": "e63b2e72-6d9f-4d07-b7ff-66a7a8740b09"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:20.163737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.166672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.166672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.175794 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] Creating event network-changed:e63b2e72-6d9f-4d07-b7ff-66a7a8740b09 for instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 on n-h2-833090-21 Oct 04 19:41:20.180723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-93f0e39d-5020-414c-acb9-0f5d89901693 req-6b8a921c-4cbb-466c-b17f-6f2dbcd330ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098099 Oct 04 19:41:20.181411 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4168/8308] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:20.520427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:20.523453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:20.528675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.529176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.529625 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.530427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:20.530898 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:20.531339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:20.668002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:20.676899 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9a10ae58-9ba0-4ac4-874d-7549aef3f7ad tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.160492 Oct 04 19:41:20.677510 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4141/8309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:20 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:21.701979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:21.702726 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:21.711769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:21.712255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:21.712711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:21.713387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:21.713837 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:21.714257 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:21.846967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:21.855652 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-81019be0-8c61-4ef9-9fda-075c2b6920b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.158658 Oct 04 19:41:21.856247 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4169/8310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:21 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:22.880111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:22.880813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:22.884329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:22.895781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.898195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.898195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:22.898195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:22.898195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:22.898578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:23.070075 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:23.079374 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-24545cc2-6606-4849-a956-ff0a4346877c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.204063 Oct 04 19:41:23.087665 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4142/8311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:22 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:24.102566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:24.103211 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:24.110107 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.110588 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.111025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.111740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:24.112195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:24.112621 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:24.246603 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:24.254446 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c222ec8f-158c-47a3-a356-42e32424ef55 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.155908 Oct 04 19:41:24.255047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4170/8312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:24 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:25.278977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:25.279564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:25.286715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.287244 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.287734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.288442 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:25.288915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:25.289359 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:25.428684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:25.436701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72b7b1bb-d817-43f4-af16-557f9cea36d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.161973 Oct 04 19:41:25.437310 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4143/8313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:25 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:26.460670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:26.461287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:26.464384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:26.469289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:26.469781 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:26.470221 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:26.470914 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:26.471373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:26.471828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:26.606699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:26.614705 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecbab034-ca72-4c76-b405-65693b16f744 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.157989 Oct 04 19:41:26.615313 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4171/8314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:26 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:41:27.638335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:27.639001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:27.640963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:27.641699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:41:27.648049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.652272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.652272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.652272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:27.652272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:27.652272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:27.789613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:27.797357 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f1fbf59b-4188-49d3-bb1f-6d503bdffcb9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.163012 Oct 04 19:41:27.797936 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4144/8315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:27 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:28.058667 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de23bd55-b4c9-44ef-b9fe-7e3a29c78100", "name": "network-vif-plugged", "status": "completed", "tag": "e63b2e72-6d9f-4d07-b7ff-66a7a8740b09"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:28.070369 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.070857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.071294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.086359 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] Creating event network-vif-plugged:e63b2e72-6d9f-4d07-b7ff-66a7a8740b09 for instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 on n-h2-833090-21 Oct 04 19:41:28.091856 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-79bab880-a5cc-4507-9a50-4441b08618cf req-a8e1e97c-30b1-474d-b869-111075fb1081 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037199 Oct 04 19:41:28.092487 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4172/8316] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:28.820782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:28.821340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:28.828283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.828790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.829251 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.829961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:28.830440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:28.830894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:28.962307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:28.970082 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fc1d8a8b-677e-4cc7-a714-e50b8536970a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1391 microversion: 2.1 time: 0.153577 Oct 04 19:41:28.970662 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4145/8317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:28 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:29.995086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:29.995822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:30.002346 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.002866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.003318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.004054 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.004607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.005100 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.142011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:30.150867 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8fec6245-f050-407f-8534-1037b426df2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1563 microversion: 2.1 time: 0.160952 Oct 04 19:41:30.158782 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4173/8318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:29 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:30.173745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:30.174375 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:30.181338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.187330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.187330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.187330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:30.187330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:30.187330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:30.325049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:30.333090 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-90a4d191-bf74-4761-b6fb-013f4b7f4652 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1563 microversion: 2.1 time: 0.163279 Oct 04 19:41:30.333676 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4146/8319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:30 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:41:32.635298 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:41:32.635944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:41:32.637560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de23bd55-b4c9-44ef-b9fe-7e3a29c78100", "tag": "e63b2e72-6d9f-4d07-b7ff-66a7a8740b09"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:41:32.643402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:32.643932 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:32.644376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.645085 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:32.645787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:32.646219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.648834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:41:32.649591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:41:32.650159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:41:32.661774 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] Creating event network-changed:e63b2e72-6d9f-4d07-b7ff-66a7a8740b09 for instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 on n-h2-833090-21 Oct 04 19:41:32.667865 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-bfb1aab4-fe6d-4091-842f-01699bfe641f req-d3a5fade-87c5-44b0-8365-a625372df138 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034093 Oct 04 19:41:32.668808 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4147/8320] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:41:32.862902 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:41:32.871707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4c66967d-2f86-4f3a-aaf7-189f0f5339bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1563 microversion: 2.1 time: 0.240293 Oct 04 19:41:32.872397 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4174/8321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:41:32 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:06.168209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=11 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:06.168962 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=52 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:06.173736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:06.181165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:06.183404 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:06.183936 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:06.184395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.185105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:06.185582 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:06.186047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:06.255576 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-69a729e2-6d05-4d61-8776-4f41382b24cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action" status: 200 len: 24556 microversion: 2.1 time: 0.090055 Oct 04 19:42:06.256255 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4148/8322] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:42:06 2022] POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action => generated 24556 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:42:36.698081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=20 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:36.698838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=40 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:36.702843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:42:36.705105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:36.712197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.715037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.715037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:36.715037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.715037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.715037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:36.921905 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0277b71e-2069-4ce6-91b3-d2441ea4983b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action" status: 202 len: 0 microversion: 2.1 time: 0.226311 Oct 04 19:42:36.922859 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4175/8323] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:42:36 2022] POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:42:36.934147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:36.935334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:36.943349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:36.972054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:37.090684 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:37.098303 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ca6b937-2084-4dda-9fa0-7ec5287ca678 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1674 microversion: 2.1 time: 0.169907 Oct 04 19:42:37.098877 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4149/8324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:36 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:38.124820 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:38.125532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:38.131832 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.132318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.132767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.133462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:38.133920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:38.134352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:38.272707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:38.280566 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-61acd116-98ea-45b9-8651-a9c0df52368e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.161010 Oct 04 19:42:38.281076 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4176/8325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:38 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:39.306410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:39.306980 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:39.314274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.319310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.319310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.319310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:39.319310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:39.319310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:39.447598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:39.455321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa1a67fd-9ee8-4210-83c9-cc209b409cf8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.153547 Oct 04 19:42:39.455924 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4150/8326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:39 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:40.480067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:40.480682 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:40.487620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.488109 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.488554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.489269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:40.489730 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:40.490160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:40.619785 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:40.627734 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3508de06-881a-4282-b74b-50670cc6f675 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.152266 Oct 04 19:42:40.628319 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4177/8327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:40 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:41.652085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:41.652749 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:41.659732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.660519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.660982 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.661696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:41.662197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:41.662648 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:41.794400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:41.802069 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-196e767d-fb29-4e5a-9a2c-27de6ff2ef1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.154606 Oct 04 19:42:41.802649 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4151/8328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:41 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:42.826267 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:42.826880 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:42.833852 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:42.834525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:42.834970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:42.835693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:42.836160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:42.836587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:42.973036 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:42.981770 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d0bc2a2-2f18-4936-8977-25368de29ce7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.159424 Oct 04 19:42:42.982351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4178/8329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:42 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:44.005838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:44.006501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:44.014201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.014702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.015152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.015929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:44.016398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:44.016839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:44.148530 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:44.156609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5b7347df-54f6-4550-a8a4-cabc4b50c3e4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.154724 Oct 04 19:42:44.157219 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4152/8330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:44 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:45.180561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:45.181178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:45.188095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.188582 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.189023 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.189708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:45.190167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:45.190845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:45.320196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:45.328531 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aaa1edd1-70f9-4d80-be28-b068cf10b6f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.151882 Oct 04 19:42:45.329112 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4179/8331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:45 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:46.353834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:46.354370 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:46.361887 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.362390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.362842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.363589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:46.364091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:46.364529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:46.500054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:46.507737 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1581288d-920f-4e72-bc1b-acd266c21a5f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.158910 Oct 04 19:42:46.508315 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4153/8332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:46 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:47.531108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:47.531745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:47.538792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.539274 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.539755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.540441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:47.540892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:47.541332 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:47.674426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:47.682340 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e381a4ea-1117-4161-8d14-2e598f0ef318 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.155212 Oct 04 19:42:47.682921 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4180/8333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:47 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:48.707120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:48.725021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:48.850096 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:48.857942 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f38c604e-8ffb-470d-8cc7-9516ebf35983 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1679 microversion: 2.1 time: 0.154806 Oct 04 19:42:48.858516 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4154/8334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:48 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:42:49.881584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:42:49.882195 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:42:49.888469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:49.888958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:49.889401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:49.890093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:42:49.890550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:42:49.890979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:42:50.025312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:42:50.033938 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1fe9ce90-3871-4fe6-9d0a-0bfb4ef22f31 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1682 microversion: 2.1 time: 0.156476 Oct 04 19:42:50.034525 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4181/8335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:42:49 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:22.255392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:22.257627 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:22.259877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:22.260691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:22.265576 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:22.266074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:22.266579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:22.267297 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:22.267786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:22.271087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:22.339991 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cd401f7-b4bc-414e-8b27-716562a33e72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action" status: 200 len: 69104 microversion: 2.1 time: 0.088664 Oct 04 19:43:22.348687 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4155/8336] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:43:22 2022] POST /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100/action => generated 69104 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:43:46.266425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:46.266425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:46.266425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=14 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:46.270875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:46.271630 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de23bd55-b4c9-44ef-b9fe-7e3a29c78100", "tag": "e63b2e72-6d9f-4d07-b7ff-66a7a8740b09"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:46.276092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:46.276842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:46.277339 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:46.277481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:46.278053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:46.278176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:43:46.278521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:46.278940 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:46.279068 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:43:46.279243 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 04 19:43:46.291292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:46.291815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:46.294207 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:46.304845 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] Creating event network-changed:e63b2e72-6d9f-4d07-b7ff-66a7a8740b09 for instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 on n-h2-833090-21 Oct 04 19:43:46.307303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:43:46.310297 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-24883eea-949b-440f-8a81-4fe16c0c92b3 req-a64f5bf5-954b-4594-b1a3-5ac65c603a8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042551 Oct 04 19:43:46.311556 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4156/8337] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:46.660020 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d9a94ead-92a7-4091-8261-201626cef30e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 204 len: 0 microversion: 2.1 time: 0.401041 Oct 04 19:43:46.660642 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4182/8338] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:43:46 2022] DELETE /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:43:46.670658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:46.672621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:46.683268 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:46.688803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:46.688803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:46.688803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:46.688803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:46.688803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:46.839006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:46.848107 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6247804e-25d6-43b0-a02a-ce8665fa90f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1688 microversion: 2.1 time: 0.182155 Oct 04 19:43:46.848861 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4157/8339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:46 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:47.875368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:47.875992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:47.883669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:47.884148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:47.884580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:47.885275 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:47.885705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:47.886126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:48.080766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:48.088724 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-93a78a54-9f4f-4741-af4a-f4eb06fd606d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1688 microversion: 2.1 time: 0.218209 Oct 04 19:43:48.089300 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4183/8340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:47 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:43:49.113192 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:49.113859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:49.120157 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:49.120639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:49.121096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:49.121766 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:49.122262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:49.122693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:49.164496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de23bd55-b4c9-44ef-b9fe-7e3a29c78100", "name": "network-vif-deleted", "tag": "e63b2e72-6d9f-4d07-b7ff-66a7a8740b09"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:49.174677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:49.175248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:49.175721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:49.187969 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] Creating event network-vif-deleted:e63b2e72-6d9f-4d07-b7ff-66a7a8740b09 for instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 on n-h2-833090-21 Oct 04 19:43:49.194325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:43:49.194963 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-cb291975-2fc1-4692-be3e-1b49b34e9132 req-95b781d9-977b-4bb2-a80b-756068ec7a8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113887 Oct 04 19:43:49.194963 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4158/8341] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:43:49.200621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a076f4b-477a-4db0-9b7c-f1c656cb2ab8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 200 len: 1501 microversion: 2.1 time: 0.091718 Oct 04 19:43:49.201206 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4184/8342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:49 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 1501 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:43:50.226328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:50.227049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: de23bd55-b4c9-44ef-b9fe-7e3a29c78100] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:43:50.233266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:50.233760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:50.234871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:50.235603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:43:50.236073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:43:50.236519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:43:50.249778 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] HTTP exception thrown: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Request method failure captured: Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 HTTP/1.1 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIwF0DuGVU0wh5ni8FAzc88IKaDjTMFC_iYVYx_rXIQTBlFmjE0WWJ5if9uLUVZ-gX_O2ffQ8l8HH4QUxypMeygP1iBLbKLjDTG7jRKfQ0mobFEoYWWEvQ8LaUBoe8OEivuPi7XMNzVM2mOI3fwcRoTXjU3P-60RTLTmxdOWv577GHU Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26b82e4aaca2487ea27c7c484a73edc0"}]}] Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 43d46d9f90b447788f064d33aed59442 Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'de23bd55-b4c9-44ef-b9fe-7e3a29c78100'} Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:43:50.251402 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Returning 404 to user: Instance de23bd55-b4c9-44ef-b9fe-7e3a29c78100 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a103b8c0-2da3-45d2-b788-8a87456371c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100" status: 404 len: 111 microversion: 2.1 time: 0.031782 Oct 04 19:43:50.256606 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4159/8343] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:43:50 2022] GET /compute/v2.1/servers/de23bd55-b4c9-44ef-b9fe-7e3a29c78100 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:43:53.681099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e0eaff66-deac-4182-aa40-5975a33fcf1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '.version_select at 0x7f90083b89d0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:43:53.686429 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e0eaff66-deac-4182-aa40-5975a33fcf1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:43:54.698791 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-e0eaff66-deac-4182-aa40-5975a33fcf1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [cf5bd6cf-1f30-4e32-97f7-ae7531f0af5d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47684. Oct 04 19:43:54.781879 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e0eaff66-deac-4182-aa40-5975a33fcf1b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-301346358" status: 202 len: 0 microversion: 2.1 time: 1.105675 Oct 04 19:43:54.782481 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4185/8344] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 19:43:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-301346358 => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:43:54.811038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f355fbf4-0782-4f35-97bb-8972098b8967 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: .version_select at 0x7f9008129820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1039916639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVcc8knZ+9dnUIJ1ePqeyj5eQGiSL5bPuvhmhFwPJiOiScWuYAguCpiX33cGevjHlW7aVDxeLHO+AE7VS1rL/50tKrFpy++L8Mj7y7RRkR4v8z8KRvMxWHosYkUxAsg+g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:43:54.828655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f355fbf4-0782-4f35-97bb-8972098b8967 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:43:54.834514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f355fbf4-0782-4f35-97bb-8972098b8967 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:43:54.913126 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f355fbf4-0782-4f35-97bb-8972098b8967 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.105907 Oct 04 19:43:54.913728 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4160/8345] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:43:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:44:03.750594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:03.756268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1467112766", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "c9a7dbda-0ca7-4df0-9acb-741a8eb5d589"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1039916639", "security_groups": [{"name": "tempest-secgroup-smoke-604369807"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:03.926671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] validate_networks() for [('c9a7dbda-0ca7-4df0-9acb-741a8eb5d589', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:44:04.435199 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:44:04.435671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:44:04.436153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:44:04.436570 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:44:04.437040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:44:04.446594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:04.447142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:04.447636 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:04.448382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:04.448847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:04.449282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:04.467097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:44:04.473311 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:44:04.487619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:44:04.490060 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:44:04.607172 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:44:05.615599 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47734. Oct 04 19:44:05.629723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-740dddb6-b7f4-4c84-b1a7-51813fc20065 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.881377 Oct 04 19:44:05.630394 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4186/8346] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:44:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:44:05.652804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-15fe9f3c-7d8f-4f83-9352-75e6b3e288df tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:05.653459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-15fe9f3c-7d8f-4f83-9352-75e6b3e288df tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:05.657257 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:05.657990 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:05.662364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:05.721137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-15fe9f3c-7d8f-4f83-9352-75e6b3e288df tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:05.729667 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-15fe9f3c-7d8f-4f83-9352-75e6b3e288df tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1267 microversion: 2.1 time: 0.091629 Oct 04 19:44:05.730590 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4161/8347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:05 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:06.753814 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:06.754536 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:06.761859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:06.762421 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:06.762959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:06.765973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:06.765973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:06.765973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:06.832283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:06.840374 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ee4d05f5-9d5e-4359-923a-7b33435fe6f6 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1271 microversion: 2.1 time: 0.091219 Oct 04 19:44:06.840977 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4187/8348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:06 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:07.863899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:07.865117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:07.873889 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:07.874453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:07.875433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:07.876216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:07.876699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:07.882137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:07.939538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:07.947490 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c6ab8378-d03d-469d-a6ae-f265b42b0107 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1319 microversion: 2.1 time: 0.087394 Oct 04 19:44:07.948071 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4162/8349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:07 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:08.970390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:08.974744 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:08.977991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:08.978478 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:08.979151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:08.979645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:08.980168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:08.980543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:09.136728 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:09.145428 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-34285f15-6f78-41ae-af89-c0f3f8c5958c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.178961 Oct 04 19:44:09.146289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4188/8350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:08 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:09.792546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:09.803825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:09.804316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:09.804763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:09.822429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] Creating event network-changed:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h1-833090-21 Oct 04 19:44:09.822429 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6348da02-7459-43e3-b45b-de2a45446bd0 req-188e7120-e2ec-4a5b-b134-351c9452b7aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034892 Oct 04 19:44:09.822941 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4163/8351] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:10.170723 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:10.171927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:10.179632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:10.180203 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:10.180684 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:10.181397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:10.181935 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:10.182509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:10.327362 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:10.336062 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6228872a-1197-4a0b-8186-c3ead9e498a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.169533 Oct 04 19:44:10.336672 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4189/8352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:10 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:11.361441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:11.362196 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:11.368619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:11.370475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:11.370475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:11.370475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:11.370816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:11.371157 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:11.509153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:11.517590 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3199bed6-2ad0-4b4f-a828-7ee8bc1d92e2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.161428 Oct 04 19:44:11.518173 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4164/8353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:11 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:12.541344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:12.541988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:12.548984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:12.549475 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:12.549915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:12.550613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:12.551068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:12.551523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:12.684402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:12.692884 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-190fce00-2b6a-4dc2-97cb-48f3c117027c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.155572 Oct 04 19:44:12.693470 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4190/8354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:12 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:13.716867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:13.717899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:13.724539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:13.725052 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:13.725485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:13.728955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:13.728955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:13.728955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:13.862029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:13.869802 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ac7665e-e4d2-4aef-92a9-378bff2f3bf4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.156915 Oct 04 19:44:13.870415 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4165/8355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:13 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:14.893327 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:14.893918 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:14.896663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:14.897351 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:14.902127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:14.902604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:14.903034 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:14.903749 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:14.904201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:14.904619 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:15.040191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:15.048837 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e41165e6-c9a6-4d44-ba08-52dfab7a129a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.159346 Oct 04 19:44:15.049433 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4191/8356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:14 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:15.807744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "name": "network-vif-plugged", "status": "completed", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:15.817661 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:15.818156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:15.818602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:15.830351 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] Creating event network-vif-plugged:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h1-833090-21 Oct 04 19:44:15.835258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c89a4cd5-e509-4fdf-8287-937efc47e877 req-6f4ddabd-d48b-4431-b748-dc9ab7a27b70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089660 Oct 04 19:44:15.835938 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4166/8357] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:16.073212 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:16.074566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:16.083432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:16.084350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:16.084802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:16.085547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:16.086096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:16.086532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:16.237116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:16.245242 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7bff7a06-617e-4b5f-b523-a4ad5f720008 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.176403 Oct 04 19:44:16.245843 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4192/8358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:16 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:17.270392 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:17.271288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:17.277729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:17.278160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:17.278615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:17.279329 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:17.279830 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:17.280806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:17.423430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:17.431728 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ccf57166-7807-4e5d-9a23-f3cc56c3a7cd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1392 microversion: 2.1 time: 0.166328 Oct 04 19:44:17.432318 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4167/8359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:17 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:18.456112 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:18.456870 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:18.460376 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:18.468282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:18.468768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:18.469204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:18.471915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:18.471915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:18.471915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:18.616420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:18.624500 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ace04cc-7103-49ce-add2-a6bcecbb8f0b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1564 microversion: 2.1 time: 0.172437 Oct 04 19:44:18.626682 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4193/8360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:18 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:18.648071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:18.648775 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:18.651554 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:18.657231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:18.657741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:18.658199 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:18.658924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:18.659433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:18.659903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:18.803806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:18.811794 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c20f8481-8728-49aa-9f7d-d6de3c47ca5e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1564 microversion: 2.1 time: 0.167698 Oct 04 19:44:18.812667 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4168/8361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:18 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:20.929547 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:20.930863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:20.931947 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:20.941675 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:20.946260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:20.946260 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:20.946510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:20.946510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:20.946510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:20.946808 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:20.947610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:20.948321 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:20.956321 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] Creating event network-changed:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h1-833090-21 Oct 04 19:44:20.962326 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5e349d63-d2fe-4c19-bb9a-6e3aa08320ed req-7ca622b8-673d-4584-b66b-ed35ec0a2fe3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036402 Oct 04 19:44:20.963295 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4169/8362] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:44:21.118305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:21.129523 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e044c9c5-162f-42eb-8194-0a82e8730615 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1564 microversion: 2.1 time: 0.203850 Oct 04 19:44:21.129523 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4194/8363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:20 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:44:44.419204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=20 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:44.419920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:44.424972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:44.430516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:44.433427 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:44.433935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:44.434395 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:44.435108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:44.435611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:44.438468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:44.492556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2e6fb753-b7c8-46b6-9363-fff9c49a0f54 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action" status: 200 len: 24560 microversion: 2.1 time: 0.075491 Oct 04 19:44:44.493253 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4170/8364] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:44:44 2022] POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action => generated 24560 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:44:55.403941 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:55.405713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=50 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:55.494646 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:44:55.497164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:55.503767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:55.504249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:55.504687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:55.505409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:55.505861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:55.506286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:55.547414 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:55.553872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Old instance type m1.heat2, new instance type m1.heat {{(pid=123887) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:44:55.561567 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:44:55.564843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:44:55.564843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:44:55.564843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:44:55.564843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:44:55.761111 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0e661051-00e7-448b-b62f-a9abce9a5088 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action" status: 202 len: 0 microversion: 2.1 time: 0.362779 Oct 04 19:44:55.761748 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4195/8365] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:44:55 2022] POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:44:55.771398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:55.772147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:55.775330 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:55.776016 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:44:55.781708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:55.782212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:55.782662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:55.783377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:55.783870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:55.784342 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:55.925514 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:55.933612 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ac89e1a0-129f-40ea-b892-2595f6c90b52 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1691 microversion: 2.1 time: 0.166608 Oct 04 19:44:55.934197 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4171/8366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:55 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:56.963331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:56.963331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:56.970456 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:56.970955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:56.971416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:56.972122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:56.972580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:56.973007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:57.115673 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:57.123805 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-32f71850-7056-4f81-a2c5-f136eef11b88 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1691 microversion: 2.1 time: 0.167184 Oct 04 19:44:57.124734 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4196/8367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:56 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:58.147985 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:58.148622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:58.156234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:58.159287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:58.159287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:58.159287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:58.159287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:58.159287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:58.296006 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:58.304141 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51194545-63ae-4652-a331-b29a80046f69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1691 microversion: 2.1 time: 0.160053 Oct 04 19:44:58.304754 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4172/8368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:58 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:44:59.328051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:44:59.328695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:44:59.336361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:59.336867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:59.337315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:59.338027 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:44:59.338539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:44:59.338999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:44:59.479010 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:44:59.487436 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bd4b79b1-9efc-4d31-b71e-0cf1ab43a618 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.163417 Oct 04 19:44:59.488038 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4197/8369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:44:59 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:00.511734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:00.512363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:00.519742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:00.520235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:00.520685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:00.521381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:00.521847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:00.522284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:00.696966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:00.705366 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1a216229-14aa-457b-a6fa-c2f98fbd3813 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.197507 Oct 04 19:45:00.705945 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4173/8370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:00 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:01.729176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:01.729795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:01.737063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.737554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.737995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.738699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:01.739156 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:01.739632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:01.921936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:01.929858 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7d340484-b8e4-4dea-b8d9-a0ae7f3e6471 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.204680 Oct 04 19:45:01.930447 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4198/8371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:01 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:02.954125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:02.954754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:02.962031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:02.962532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:02.962987 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:02.963734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:02.964209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:02.964652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:03.113062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:03.120941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d5d23a8c-48d5-4d62-b52c-902f561280f8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.170806 Oct 04 19:45:03.121529 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4174/8372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:02 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:04.144289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:04.144931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:04.152057 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:04.152547 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:04.152986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:04.153689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:04.154858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:04.155295 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:04.289809 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:04.297743 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-557984ec-7559-4e54-b022-76e4c9a2dc3a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.157391 Oct 04 19:45:04.298344 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4199/8373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:04 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:05.322593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:05.323147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:05.330272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:05.330779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:05.331269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:05.332219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:05.332694 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:05.333142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:05.465946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:05.474519 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29e3308e-f811-43d4-b892-786e4bbe7d1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.156235 Oct 04 19:45:05.475100 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4175/8374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:05 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:06.498639 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:06.499252 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:06.506572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:06.507281 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:06.507758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:06.508465 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:06.508927 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:06.509355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:06.645446 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:06.654640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a9ff47ae-c784-45dd-98c2-4a55d96f27bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.159365 Oct 04 19:45:06.655233 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4200/8375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:06 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:07.679723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:07.680381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:07.687966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:07.688476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:07.688938 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:07.689672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:07.690176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:07.690621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:07.833405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:07.841327 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3ea79885-979c-4754-aac8-dca94d0b0264 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.165671 Oct 04 19:45:07.845776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4176/8376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:07 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:45:08.866071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:08.866705 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:08.873931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:08.874423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:08.874867 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:08.875594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:08.876052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:08.876481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:09.014167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:09.022350 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0aa5145e-4ff0-4fa5-89f8-4bcf6159ae1e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.160187 Oct 04 19:45:09.022954 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4201/8377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:08 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:45:10.047092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:10.047875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:10.055027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:10.055564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:10.056028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:10.056754 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:10.057231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:10.057678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:10.195365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:10.203289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-94b73678-fa76-41ee-97c4-0d3721ea4df4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.160865 Oct 04 19:45:10.203914 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4177/8378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:10 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:11.227566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:11.228186 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:11.235499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:11.236005 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:11.236455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:11.237165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:11.237628 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:11.238062 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:11.374165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:11.382376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-643c41a3-9ced-4765-8b60-581588b68c4c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.158754 Oct 04 19:45:11.383059 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4202/8379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:11 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:12.406937 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:12.407622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:12.414659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:12.415163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:12.415659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:12.416374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:12.416847 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:12.417293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:12.555475 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:12.564375 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-76675941-2f9a-4f94-b8ea-f60a2a21b58f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.162067 Oct 04 19:45:12.573393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4178/8380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:12 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:13.589685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:13.590382 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:13.598033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:13.598520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:13.598972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:13.599691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:13.600150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:13.600688 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:13.741524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:13.749380 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ee6f93c-b154-41c0-bc0c-f0df87feb429 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.163847 Oct 04 19:45:13.749970 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4203/8381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:13 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:14.773656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:14.774289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:14.781903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:14.782411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:14.782873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:14.783618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:14.784103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:14.784559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:15.235153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:15.243129 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e438d00d-ca53-4ce1-958d-2cbdc448bd72 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.473407 Oct 04 19:45:15.243822 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4179/8382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:14 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:16.266991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:16.267658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:16.274833 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:16.275324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:16.275795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:16.276495 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:16.277004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:16.277384 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:16.422974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:16.431105 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7eb8a508-5216-4635-a10b-11de61cfc2f1 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1696 microversion: 2.1 time: 0.168128 Oct 04 19:45:16.432012 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4204/8383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:16 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:17.456077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:17.456711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:17.463915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:17.464429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:17.464879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:17.465598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:17.466109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:17.467386 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:17.674123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:17.682765 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e39688a2-f76a-40bf-82f0-c2dfa75d12f9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1695 microversion: 2.1 time: 0.230536 Oct 04 19:45:17.683374 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4180/8384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:17 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1695 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:17.692845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "name": "network-vif-unplugged", "status": "completed", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:17.705855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:17.706418 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:17.706859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:17.720113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Creating event network-vif-unplugged:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h2-833090-21 Oct 04 19:45:17.725713 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:45:17.736751 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-81f19d9b-0f88-4379-b0dd-82e73afc3913 req-c18250d9-ba9e-42c8-88d3-7d02a54b7558 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047769 Oct 04 19:45:17.737370 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4205/8385] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:18.708220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:18.709015 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:18.715850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:18.716361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:18.716836 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:18.717527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:18.717995 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:18.718432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:18.917134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:18.925921 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-44fb18bd-131f-4f55-940c-f1944cdfa755 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1695 microversion: 2.1 time: 0.221536 Oct 04 19:45:18.929986 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4181/8386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:18 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:19.753002 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:19.763022 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:19.764017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:19.764450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:19.776298 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Creating event network-changed:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h2-833090-21 Oct 04 19:45:19.782581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-21', 'n-h2-833090-21'} {{(pid=123887) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:45:19.793799 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c622cd19-611f-41d2-98b2-d4b54e2a02d6 req-135239f5-d837-4074-b294-a8686fdfedf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045850 Oct 04 19:45:19.794420 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4206/8387] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:19.950415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:19.951713 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:19.959058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:19.959600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:19.960085 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:19.960819 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:19.961327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:19.961781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:20.183050 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:20.191861 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a9c162c-bf64-4a8b-bfed-594f00357d61 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1693 microversion: 2.1 time: 0.245356 Oct 04 19:45:20.192473 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4182/8388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:19 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1693 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:45:21.218843 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:21.219565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:21.225898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:21.226379 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:21.226815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:21.227537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:21.227994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:21.228420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:21.381586 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:21.390047 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e301100b-8bf7-45a0-adc6-2d4c69c23c25 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1693 microversion: 2.1 time: 0.176989 Oct 04 19:45:21.390641 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4207/8389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:21 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:22.415300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:22.416681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:22.425465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.426308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.427074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.437200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.437200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.437200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.572236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:22.580256 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-8f95b36d-c35c-4b08-87c2-a8024174ec42 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1690 microversion: 2.1 time: 0.169261 Oct 04 19:45:22.580834 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4183/8390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:22 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:22.603451 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:22.604011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:22.611428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.611948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.612416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.613128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.613587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.614018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.773584 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-aec8606d-6785-45ee-b94d-d7482a721c2c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action" status: 204 len: 0 microversion: 2.1 time: 0.173948 Oct 04 19:45:22.774405 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4208/8391] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:45:22 2022] POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:45:22.782744 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:22.783416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:22.799165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.799716 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.800283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:22.801020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:22.801504 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:22.801960 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:23.019103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:23.041195 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a279ca7-a277-4552-a7fd-838b276b7533 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1690 microversion: 2.1 time: 0.262183 Oct 04 19:45:23.041800 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4184/8392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:22 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:23.067164 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:23.067893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:23.074645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:23.075431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:23.076623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:23.077525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:23.078200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:23.078793 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:23.237099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:23.239623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:23.247247 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1b428b7-83ed-472b-a3b7-9fc0687355f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1690 microversion: 2.1 time: 0.184071 Oct 04 19:45:23.263745 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4209/8393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:23 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:24.274413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:24.275017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:24.282521 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:24.283017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:24.283525 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:24.284384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:24.284704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:24.285144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:24.425185 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:24.433017 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f25fcf83-bdff-4c32-bc52-a42f09ab2104 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1690 microversion: 2.1 time: 0.162607 Oct 04 19:45:24.433594 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4185/8394] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:24 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:25.134431 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "name": "network-vif-plugged", "status": "completed", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:25.152664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.153945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.154704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.174415 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] Creating event network-vif-plugged:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h2-833090-21 Oct 04 19:45:25.181915 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-5de7b719-430b-448f-b438-6e8789565f00 req-c97fb813-5c48-4da6-870a-a6b67806a79b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054074 Oct 04 19:45:25.182558 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4210/8395] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:45:25.458461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:45:25.459119 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:25.466881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.467390 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.467877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.468596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:25.469069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:25.469517 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:25.607422 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:45:25.616443 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-72754a1d-3cca-4520-b4b0-44eb474ee6bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1682 microversion: 2.1 time: 0.161832 Oct 04 19:45:25.617095 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4186/8396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:45:25 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:45:55.831385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=36 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:45:55.836229 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:45:55.838644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:45:55.845829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:55.853556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:55.853556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:55.853556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:45:55.853556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:45:55.853556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:45:55.920802 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe246b87-2225-49ba-8f05-3b1595c5693d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action" status: 200 len: 24578 microversion: 2.1 time: 0.091213 Oct 04 19:45:55.921802 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4211/8397] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:45:55 2022] POST /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f/action => generated 24578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:46:13.568649 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:13.569253 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:13.570963 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:13.571962 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:46:13.575167 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f (ip 10.222.0.40) !!! Oct 04 19:46:13.575167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=32 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:13.575167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=96 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:13.581581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.582088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.582685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.583414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.583910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.584355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.587909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:13.591493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.592039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.592483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.606615 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] Creating event network-changed:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h2-833090-21 Oct 04 19:46:13.613128 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2ef79274-b205-4d95-86b3-c6e3b048a914 req-b01e23f6-2430-4b99-924c-e0dd61ba38d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045271 Oct 04 19:46:13.613128 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4212/8398] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:13.614121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:46:13.944518 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67bda80b-c522-4ce4-bdb9-1b5674c102a4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 204 len: 0 microversion: 2.1 time: 0.379788 Oct 04 19:46:13.945359 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4187/8399] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:46:13 2022] DELETE /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:46:13.954745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:13.955841 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:13.965565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:14.114875 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:14.123708 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4a2d21cb-e22f-4a72-8abb-274292e5b7ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1688 microversion: 2.1 time: 0.173851 Oct 04 19:46:14.124322 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4213/8400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:13 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:15.149002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:15.149732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:15.157231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:15.157742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:15.158200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:15.158928 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:15.159406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:15.159877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:15.562844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:15.570767 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-82d704e6-dc6a-40c5-a151-bb929a73fd22 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1688 microversion: 2.1 time: 0.426081 Oct 04 19:46:15.571363 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4188/8401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:15 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1688 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:16.015642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c561ab-98bb-4a18-b091-0f2332b1c35f", "name": "network-vif-deleted", "tag": "bbff5441-f51c-48f8-bd62-94605ddd0686"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:16.025994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:16.037055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:16.037055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:16.039259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] Creating event network-vif-deleted:bbff5441-f51c-48f8-bd62-94605ddd0686 for instance 97c561ab-98bb-4a18-b091-0f2332b1c35f on n-h2-833090-21 Oct 04 19:46:16.045150 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-955f890f-8523-4dd2-a329-c020938bb249 req-b05d6ac0-5bf7-478d-81d5-7ca77a038ed7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Oct 04 19:46:16.045749 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4214/8402] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:16.598099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:16.599426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:16.606107 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:16.606617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:16.607069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:16.607823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:16.608294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:16.608758 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:16.643202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:16.643825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:16.644290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:16.644761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lazy-loading 'fault' on Instance uuid 97c561ab-98bb-4a18-b091-0f2332b1c35f {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:46:16.687156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:16.695401 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6841d4d9-6cc0-4a91-b1aa-300da9c282bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 200 len: 1357 microversion: 2.1 time: 0.102416 Oct 04 19:46:16.696333 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4189/8403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:16 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:17.720774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:17.721476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 97c561ab-98bb-4a18-b091-0f2332b1c35f] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:17.729096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:17.729594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:17.730044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:17.730760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:17.731223 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:17.731897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:17.745714 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] HTTP exception thrown: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Request method failure captured: Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f HTTP/1.1 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIwF0DuGVU0wh5ni8FAzc88IKaDjTMFC_iYVYx_rXIQTBlFmjE0WWJ5if9uLUVZ-gX_O2ffQ8l8HH4QUxypMeygP1iBLbKLjDTG7jRKfQ0mobFEoYWWEvQ8LaUBoe8OEivuPi7XMNzVM2mOI3fwcRoTXjU3P-60RTLTmxdOWv577GHU Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26b82e4aaca2487ea27c7c484a73edc0"}]}] Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 43d46d9f90b447788f064d33aed59442 Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '97c561ab-98bb-4a18-b091-0f2332b1c35f'} Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:46:17.747406 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Returning 404 to user: Instance 97c561ab-98bb-4a18-b091-0f2332b1c35f could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cee17461-0345-496d-832c-99deb5fdc296 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f" status: 404 len: 111 microversion: 2.1 time: 0.032534 Oct 04 19:46:17.752430 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4215/8404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:17 2022] GET /compute/v2.1/servers/97c561ab-98bb-4a18-b091-0f2332b1c35f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:46:21.275261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f3bc7d9-0fc5-472d-b3d1-ba0bd572379b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '.version_select at 0x7f9008c630d0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:21.402284 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f3bc7d9-0fc5-472d-b3d1-ba0bd572379b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1039916639" status: 202 len: 0 microversion: 2.1 time: 0.130752 Oct 04 19:46:21.402785 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4190/8405] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 4 19:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1039916639 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:46:21.431641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1e04a1db-a7ea-4680-9c72-d745b81a52dd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: .version_select at 0x7f9008076160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1220562365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaIodupDLAPfdREK+zTKbz/YLi0abcOysCWqFeJu5SuANjyhENI0mhok0qoZDCDoIIZRzUQ7exCnAZmA0LwYsWmvuK3LXhYJietM8dh+VjaRIKw0H4Bf2eWmsIVCwah0A=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:21.448917 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1e04a1db-a7ea-4680-9c72-d745b81a52dd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:46:21.455098 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-1e04a1db-a7ea-4680-9c72-d745b81a52dd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:46:21.559309 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1e04a1db-a7ea-4680-9c72-d745b81a52dd tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.130842 Oct 04 19:46:21.560014 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4216/8406] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:46:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:30.589637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:30.598425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2077866789", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "8f71825b-d8c0-48ae-bd8b-e82dbd045417"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1220562365", "security_groups": [{"name": "tempest-secgroup-smoke-2088185247"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:30.720991 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] validate_networks() for [('8f71825b-d8c0-48ae-bd8b-e82dbd045417', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:46:31.240968 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:46:31.241411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:46:31.241904 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:46:31.242332 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:46:31.242766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:46:31.252136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.252645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.253099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:31.253842 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:31.254318 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:31.254762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:31.273814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:46:31.280099 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:46:31.293907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:46:31.296472 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:46:31.411447 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f641c400-6410-4939-ad97-7bea67d157eb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822962 Oct 04 19:46:31.411447 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4191/8407] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:46:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:46:31.423028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8a727347-46f9-47b9-a39c-34f70d3542e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:31.423698 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8a727347-46f9-47b9-a39c-34f70d3542e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:31.426666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=19 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:31.466769 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:31.506047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8a727347-46f9-47b9-a39c-34f70d3542e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:31.514573 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8a727347-46f9-47b9-a39c-34f70d3542e3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1267 microversion: 2.1 time: 0.095444 Oct 04 19:46:31.517164 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4217/8408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:31 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:32.538467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:32.539101 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:32.547169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:32.547631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:32.548088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:32.548806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:32.549275 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:32.549714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:32.623745 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:32.632233 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-933b891d-cc8b-42bd-8161-5762cbaa67de tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1271 microversion: 2.1 time: 0.097687 Oct 04 19:46:32.632967 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4192/8409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:32 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:33.658792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:33.659405 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:33.669260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.669995 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.670453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:33.671181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:33.675868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:33.676822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:33.768486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:33.777843 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-59de9f91-1280-4ac0-85c3-3292078fabed tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1327 microversion: 2.1 time: 0.125169 Oct 04 19:46:33.778431 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4218/8410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:33 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:34.802488 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:34.803088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:34.811142 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.811723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.812183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:34.812912 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:34.813391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:34.813839 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:35.042265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:35.051026 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5cb2534e-f196-402a-b87b-ea291b8baa3b tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.252556 Oct 04 19:46:35.051651 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4193/8411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:34 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:35.600423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dfa34-464b-4285-b1c0-5c082a823386", "tag": "fa00235b-2aee-4148-a0b2-889c298e1172"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:35.616037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:35.616037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:35.616037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:35.627849 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] Creating event network-changed:fa00235b-2aee-4148-a0b2-889c298e1172 for instance 556dfa34-464b-4285-b1c0-5c082a823386 on n-h1-833090-21 Oct 04 19:46:35.633552 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6364dc69-604d-4c37-b9a7-76beb4473d77 req-77c7eadb-3921-46e4-a167-d735c175785f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036665 Oct 04 19:46:35.634252 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4219/8412] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:36.077079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:36.077702 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:36.083993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:36.085151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:36.085619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:36.086350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:36.086824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:36.087266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:36.328907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:36.337044 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7d599420-e63a-442a-b2e7-25a2c2aa5885 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.264703 Oct 04 19:46:36.337776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4194/8413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:36 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:37.361118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:37.361770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:37.369217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.369710 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.370158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:37.370871 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:37.371333 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:37.371794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:37.515115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:37.523151 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fb42055c-a9e7-427a-8d9b-b5462451c24e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.166504 Oct 04 19:46:37.523787 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4220/8414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:37 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:38.548149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:38.548761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:38.555663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.556273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.556727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.557457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:38.558211 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:38.558680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:38.703897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:38.711572 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-daa6be05-fd5f-47d4-a8e2-05fccb908c01 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.167323 Oct 04 19:46:38.712152 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4195/8415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:38 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:39.735556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:39.736097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:39.743289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.743805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.744244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.744959 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:39.745417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:39.745845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:39.890761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:39.898894 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d4414af3-afd7-41c5-8a11-f8be9008d5f3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.167321 Oct 04 19:46:39.900063 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4221/8416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:39 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:40.922532 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:40.923349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:40.930266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.930769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.931227 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:40.932038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:40.932511 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:40.933210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:41.074696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:41.082880 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fa033dfa-67ab-443c-91a4-9833e72ac4ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.164289 Oct 04 19:46:41.083520 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4196/8417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:40 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:42.107663 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:42.108272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:42.115617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.116114 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.116558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.117271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.117736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.118167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.261977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:42.271255 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b9dff59d-0fa3-46e5-9b32-3468e77a9caa tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.167629 Oct 04 19:46:42.271881 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4222/8418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:42 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:42.361930 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dfa34-464b-4285-b1c0-5c082a823386", "name": "network-vif-plugged", "status": "completed", "tag": "fa00235b-2aee-4148-a0b2-889c298e1172"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:42.367573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:42.371017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:42.375500 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:42.376063 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:42.376584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:42.389216 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] Creating event network-vif-plugged:fa00235b-2aee-4148-a0b2-889c298e1172 for instance 556dfa34-464b-4285-b1c0-5c082a823386 on n-h1-833090-21 Oct 04 19:46:42.394418 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-f53ac507-6b99-490a-8dc0-68574df85f60 req-c50ab9fe-23e1-43da-bd88-f1a3375fc69a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037160 Oct 04 19:46:42.436455 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4197/8419] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:46:43.295165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:43.295740 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:43.303056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.303574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.304017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:43.304724 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:43.305182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:43.305614 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:43.441469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:43.449391 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-21195c11-84f2-4184-ae75-d5f537ccf828 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1393 microversion: 2.1 time: 0.158296 Oct 04 19:46:43.449981 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4223/8420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:43 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:46:44.475866 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:44.476631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:44.479703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:44.486001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.486516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.486976 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.487770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.488254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.488698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.690949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:44.693856 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-49ae5804-a7e2-4290-8a15-5fc11de32a0e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1565 microversion: 2.1 time: 0.223635 Oct 04 19:46:44.694455 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4198/8421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:44 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:44.717505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:44.720200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:44.720200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:44.721693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:46:44.726408 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.726913 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.727347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.728064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:44.728516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:44.728967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:44.868844 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:44.877238 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-abef68a7-e833-48f3-a466-77da6afb9544 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1565 microversion: 2.1 time: 0.164135 Oct 04 19:46:44.877868 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4224/8422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:44 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:46:46.809586 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:46:46.810230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:46:46.818382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.819003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.819494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.820239 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.820712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.821197 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.870056 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dfa34-464b-4285-b1c0-5c082a823386", "tag": "fa00235b-2aee-4148-a0b2-889c298e1172"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:46:46.882800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:46:46.883285 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:46:46.883967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:46:46.897187 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] Creating event network-changed:fa00235b-2aee-4148-a0b2-889c298e1172 for instance 556dfa34-464b-4285-b1c0-5c082a823386 on n-h1-833090-21 Oct 04 19:46:46.902715 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-372353b4-b9d8-463d-863c-58d8278b109a req-5d896c5b-6b9c-4b8e-8121-870ce1cabbde service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095974 Oct 04 19:46:46.903377 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4225/8423] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:46:47.040978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:46:47.051206 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b3c5a411-3d62-4943-9955-bbafadc1a67a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1565 microversion: 2.1 time: 0.247361 Oct 04 19:46:47.064506 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4199/8424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:46:46 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:12.310543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:12.311284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=40 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:12.315389 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:12.317658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:12.323795 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:12.326521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:12.326521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:12.326521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:12.326521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:12.326521 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:12.379852 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b714f45a-f5a8-49e9-a393-e75398a50515 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action" status: 200 len: 24570 microversion: 2.1 time: 0.071032 Oct 04 19:47:12.380741 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4226/8425] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:12 2022] POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:47:23.515091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:23.518535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:23.519356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=46 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:23.524891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.531156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.531156 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.552682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Going to try to stop instance {{(pid=123886) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:47:23.741289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fd3ae0a3-06b7-413f-8512-6fc523caa8cf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action" status: 202 len: 0 microversion: 2.1 time: 0.230729 Oct 04 19:47:23.742079 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4200/8426] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:23 2022] POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:47:23.751884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:23.752598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:23.755170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:47:23.760915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.761403 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.761840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.762539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:23.763196 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:23.763658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:23.917377 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:23.926067 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-31cefccb-89d6-483f-a02e-1685225231f7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.179243 Oct 04 19:47:23.926670 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4227/8427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:23 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:24.952059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:24.952787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:24.959733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.960242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.960700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:24.961425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:24.961901 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:24.962348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:25.110781 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:25.118897 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-16c5c52a-f940-47cc-b416-a52b1ff2131f tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.172201 Oct 04 19:47:25.119531 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4201/8428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:24 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:26.142600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:26.143263 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:26.150656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.151149 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.151633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:26.152343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:26.152802 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:26.153234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:26.289657 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:26.297752 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bcfbba65-cdb7-478c-b86f-cc481093399a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.159078 Oct 04 19:47:26.298351 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4228/8429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:26 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:27.321918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:27.322549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:27.330314 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:27.330820 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:27.331274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:27.332020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:27.332493 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:27.333535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:27.472356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:27.480950 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-778321de-9a37-4893-8107-3f94a835912c tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.162973 Oct 04 19:47:27.481568 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4202/8430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:27 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:28.505925 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:28.506610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:28.513556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.514045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.514488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.515193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:28.515687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:28.516146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:28.651858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:28.659839 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90ee1972-daea-4cec-aa52-aa0805551aa8 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.158299 Oct 04 19:47:28.660426 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4229/8431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:28 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:29.684539 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:29.685219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:29.692841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.693346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.693798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.694512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:29.694988 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:29.695436 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:29.834301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:29.842128 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ab24902-0640-429b-8fee-8ebd18a09d33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.162211 Oct 04 19:47:29.842742 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4203/8432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:29 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:30.867659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:30.868305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:30.875172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.875685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.876120 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:30.876806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:30.877261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:30.878169 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:31.018664 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:31.027395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-dd36394e-6c8d-4c5f-979d-78ff590fc000 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.162967 Oct 04 19:47:31.027683 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4230/8433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:30 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:32.050358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:32.051267 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:32.058367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.058870 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.059325 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:32.060091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:32.060567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:32.061013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:32.200746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:32.209322 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-01d931d0-ee7f-4b1f-8c07-b0eefc78d86e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.162859 Oct 04 19:47:32.209923 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4204/8434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:32 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:33.234367 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:33.236004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:33.242787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:33.243272 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:33.243736 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:33.244430 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:33.244884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:33.245302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:33.384144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:33.393201 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-02c1b8e1-06f8-46c8-8536-4b6bb115022e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1693 microversion: 2.1 time: 0.162668 Oct 04 19:47:33.393799 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4231/8435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:33 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:34.418202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:34.418863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:34.426917 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:34.427152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:34.427519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:34.428272 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:34.428922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:34.429376 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:34.569603 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:34.577874 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5644a1c2-87bb-418c-9ff2-67310f4a9edb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1670 microversion: 2.1 time: 0.163634 Oct 04 19:47:34.578470 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4205/8436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:34 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:35.679438 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:35.682095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:35.689179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:35.689655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:35.690755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:35.691479 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:35.691933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:35.692357 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:35.755030 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-386e3099-3460-4e36-bf2b-eb4b3f975bd9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action" status: 200 len: 38438 microversion: 2.1 time: 0.079365 Oct 04 19:47:35.759674 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4232/8437] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:35 2022] POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action => generated 38438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:47:35.770065 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:47:35.776685 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:35.777191 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:35.777644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:35.801541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Going to try to start instance {{(pid=123886) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:47:36.008748 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98c0e52b-53f6-491a-84b0-ba30440ff4ac tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action" status: 202 len: 0 microversion: 2.1 time: 0.242550 Oct 04 19:47:36.009547 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4206/8438] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:47:35 2022] POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:47:36.018398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:36.023599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:36.026690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:36.027722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:36.027722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:36.028344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:36.028807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:36.029235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:36.175733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:36.184163 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3957b75f-3298-42fc-b003-1af04d934998 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1679 microversion: 2.1 time: 0.170007 Oct 04 19:47:36.184771 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4233/8439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:36 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:37.209909 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:37.211080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:37.223543 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:37.224459 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:37.225277 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:37.226589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:37.227433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:37.228246 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:37.371377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:37.384775 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-80acb80a-3bad-4241-bd2f-4bf2d1bd5491 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1679 microversion: 2.1 time: 0.179260 Oct 04 19:47:37.385439 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4207/8440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:37 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:47:38.409324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:47:38.409877 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:47:38.417116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:38.417604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:38.418039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:38.418741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:47:38.419193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:47:38.419659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:47:38.558168 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:47:38.561844 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7d2d332-85aa-41cd-8402-ecbfa6a6edc5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1683 microversion: 2.1 time: 0.156630 Oct 04 19:47:38.562444 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4234/8441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:47:38 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:04.774899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:04.777231 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:04.780793 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:04.781538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:04.787203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:04.788316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:04.788777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:04.789503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:04.789975 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:04.790441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:04.857289 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-406bb2f0-30cb-47f5-9272-f99daeee1bc2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action" status: 200 len: 62998 microversion: 2.1 time: 0.086775 Oct 04 19:48:04.858008 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4208/8442] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:48:04 2022] POST /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386/action => generated 62998 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:48:12.168522 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:12.169106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:12.173001 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dfa34-464b-4285-b1c0-5c082a823386", "tag": "fa00235b-2aee-4148-a0b2-889c298e1172"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:12.173501 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=16 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:12.174106 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=50 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:12.174870 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:48:12.175063 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 (ip 10.222.0.40) !!! Oct 04 19:48:12.180442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.181242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.181862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.182690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.183153 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.183608 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.187845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.187845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.187845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.203513 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] Creating event network-changed:fa00235b-2aee-4148-a0b2-889c298e1172 for instance 556dfa34-464b-4285-b1c0-5c082a823386 on n-h1-833090-21 Oct 04 19:48:12.208713 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-e7a4be3c-95dc-4bee-a108-4ef920240e57 req-c0fbf966-208f-4cb8-90cf-1c372a295813 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041138 Oct 04 19:48:12.209383 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4209/8443] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:12.214181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:48:12.608225 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7ac6438e-9550-4b12-9bb1-a76a75ec64ca tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 204 len: 0 microversion: 2.1 time: 0.443391 Oct 04 19:48:12.609806 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4235/8444] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:48:12 2022] DELETE /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:48:12.623188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:12.623188 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:12.628767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.629281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.630083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:12.631095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:12.632103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:12.632782 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:13.111721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:13.121752 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6bd676a0-d4ba-4516-83b8-0579c1cbc6d9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1689 microversion: 2.1 time: 0.506000 Oct 04 19:48:13.122343 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4210/8445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:12 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1689 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:14.147028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:14.147774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:14.154905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:14.155398 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:14.157103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:14.157103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:14.157103 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:14.157463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:14.302471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:14.311398 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8d33beb4-49e9-44ff-b618-81b2a32e9a89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1689 microversion: 2.1 time: 0.168626 Oct 04 19:48:14.312086 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4236/8446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:14 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:14.800666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dfa34-464b-4285-b1c0-5c082a823386", "name": "network-vif-deleted", "tag": "fa00235b-2aee-4148-a0b2-889c298e1172"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:14.812482 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:14.812981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:14.813438 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:14.825258 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] Creating event network-vif-deleted:fa00235b-2aee-4148-a0b2-889c298e1172 for instance 556dfa34-464b-4285-b1c0-5c082a823386 on n-h1-833090-21 Oct 04 19:48:14.830738 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-835628af-b367-43e0-8b38-df226d78d460 req-d792beb7-946b-485a-bd03-79976a4146d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033762 Oct 04 19:48:14.831356 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4211/8447] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:15.334581 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:15.335197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:15.342207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:15.342693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:15.343136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:15.343862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:15.344320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:15.344746 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:15.377505 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:15.377997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:15.378442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:15.378901 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lazy-loading 'fault' on Instance uuid 556dfa34-464b-4285-b1c0-5c082a823386 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:48:15.420350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:15.429042 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-cdc7f3e8-d2fe-4c26-87b9-29164af3c868 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 200 len: 1357 microversion: 2.1 time: 0.097756 Oct 04 19:48:15.429895 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4237/8448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:15 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:16.454528 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:16.455237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 556dfa34-464b-4285-b1c0-5c082a823386] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:16.462126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.462619 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.463069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.463790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:16.464261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:16.464698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:16.478186 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] HTTP exception thrown: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Request method failure captured: Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 HTTP/1.1 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPIwF0DuGVU0wh5ni8FAzc88IKaDjTMFC_iYVYx_rXIQTBlFmjE0WWJ5if9uLUVZ-gX_O2ffQ8l8HH4QUxypMeygP1iBLbKLjDTG7jRKfQ0mobFEoYWWEvQ8LaUBoe8OEivuPi7XMNzVM2mOI3fwcRoTXjU3P-60RTLTmxdOWv577GHU Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26b82e4aaca2487ea27c7c484a73edc0"}]}] Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 43d46d9f90b447788f064d33aed59442 Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '556dfa34-464b-4285-b1c0-5c082a823386'} Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:48:16.479877 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Returning 404 to user: Instance 556dfa34-464b-4285-b1c0-5c082a823386 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c099fc27-672b-438c-9a07-09b2fa8bf26e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386" status: 404 len: 111 microversion: 2.1 time: 0.031996 Oct 04 19:48:16.485587 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4212/8449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:16 2022] GET /compute/v2.1/servers/556dfa34-464b-4285-b1c0-5c082a823386 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:48:20.224898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6916fd9a-f3d0-4944-8cf7-4226595e0907 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '.version_select at 0x7f900d7ee5e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:20.340709 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6916fd9a-f3d0-4944-8cf7-4226595e0907 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1220562365" status: 202 len: 0 microversion: 2.1 time: 0.120171 Oct 04 19:48:20.341317 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4238/8450] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 4 19:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1220562365 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:48:20.375816 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e7a1019f-71ca-46b2-8ce2-0eab3c8af931 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: .version_select at 0x7f9008aad940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-233694532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWtMAhJWjNjVIZjtNyKa9CyEl0rpJVzYRB+iJhr9oXj3Dgw5eZUjqmIP9rUd1htHEhKLyHSFw09++7/HNKnHNnl7bgqn7BcX57mNAS1a0ZgLXG8m6sWIbPlb8pub+9rCg=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:20.394109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-e7a1019f-71ca-46b2-8ce2-0eab3c8af931 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:48:20.400213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-e7a1019f-71ca-46b2-8ce2-0eab3c8af931 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:48:20.534691 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e7a1019f-71ca-46b2-8ce2-0eab3c8af931 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.163062 Oct 04 19:48:20.535309 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4213/8451] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:48:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:29.789686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-243981139", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "networks": [{"uuid": "ae6c49fd-2e1a-47fc-afab-4c28a7779147"}], "key_name": "tempest-TestNetworkAdvancedServerOps-233694532", "security_groups": [{"name": "tempest-secgroup-smoke-1953449712"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:29.814618 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:29.929617 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] validate_networks() for [('ae6c49fd-2e1a-47fc-afab-4c28a7779147', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:48:30.351099 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:48:30.351545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:48:30.352024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:48:30.352432 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:48:30.352857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:48:30.362058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:30.362539 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:30.362973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:30.363727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:30.364180 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:30.364599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:30.383242 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:48:30.388962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Getting quotas for user 43d46d9f90b447788f064d33aed59442 and project 26b82e4aaca2487ea27c7c484a73edc0. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:48:30.402559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:48:30.405096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:48:30.572927 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-db6318e8-259d-47d2-895d-c59850f3a1bb tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787323 Oct 04 19:48:30.573442 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4239/8452] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:48:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:48:30.582672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=16 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:30.585017 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:30.585233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:30.589752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-558e0ff8-2b92-46d7-9aae-d88bd19df5a2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:30.594437 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-558e0ff8-2b92-46d7-9aae-d88bd19df5a2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:30.683135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-558e0ff8-2b92-46d7-9aae-d88bd19df5a2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:30.701180 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-558e0ff8-2b92-46d7-9aae-d88bd19df5a2 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1265 microversion: 2.1 time: 0.118488 Oct 04 19:48:30.701983 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4214/8453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:30 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:31.729458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:31.730102 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:31.742515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:31.743238 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:31.743737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:31.744471 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:31.744923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:31.745348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:31.829893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:31.838440 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6aa1ee0f-f6a5-4120-a14a-e3fef113119d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1269 microversion: 2.1 time: 0.116522 Oct 04 19:48:31.839064 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4240/8454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:31 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:32.862353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:32.863029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:32.872806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:32.873338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:32.873812 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:32.874556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:32.875056 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:32.875446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:32.940668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:32.953992 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ddc2ace4-8e2b-44e3-9f01-cac80f88bc89 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1317 microversion: 2.1 time: 0.091105 Oct 04 19:48:32.953992 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4215/8455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:32 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:33.973948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:33.974652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:33.988325 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:33.988855 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:33.989297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:33.990019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:33.990974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:33.991436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:34.170265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:34.180026 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b69d4b8-0ad1-4a51-8940-cc7e851a1e46 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.210477 Oct 04 19:48:34.180866 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4241/8456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:33 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:34.880081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d74a31c-4e61-437e-853c-f2a645e9fbb5", "tag": "98ca3934-7311-4c45-91de-ba4388f4a53a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:34.891869 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:34.892367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:34.892850 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:34.904758 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] Creating event network-changed:98ca3934-7311-4c45-91de-ba4388f4a53a for instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 on n-h1-833090-21 Oct 04 19:48:34.909857 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-5b65c229-7b02-41b2-96b3-9a8f239f7cfd req-3a1a2509-0000-4836-861e-228056b1d0f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Oct 04 19:48:34.910466 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4216/8457] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:35.205289 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:35.205898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:35.213024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:35.213516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:35.213957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:35.214658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:35.215194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:35.215662 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:35.351779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:35.359630 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-68657bdb-6f4d-4e08-812a-3461d5ca215e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.158290 Oct 04 19:48:35.360218 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4242/8458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:35 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:36.387868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:36.388596 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:36.394914 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:36.395419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:36.395907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:36.396617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:36.397090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:36.397538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:36.538647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:36.546664 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-55452f41-2bb6-46dc-b426-af383197ac8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.164085 Oct 04 19:48:36.547252 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4217/8459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:36 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:37.571629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:37.572241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:37.579300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:37.579975 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:37.580450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:37.581129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:37.581591 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:37.582020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:37.720370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:37.728368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fa113f80-baac-4337-8192-2fd574d3e8d3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.161495 Oct 04 19:48:37.728956 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4243/8460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:37 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:38.752205 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:38.761660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:38.761660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.761660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.761660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.762780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:38.762780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:38.762780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:38.902264 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:38.910644 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c36f4554-1a61-480c-a62e-35ca13070ed5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.162415 Oct 04 19:48:38.911242 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4218/8461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:38 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:39.934991 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:39.935576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:39.942776 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:39.943847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:39.944340 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:39.945065 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:39.945527 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:39.945955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:40.084813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:40.092925 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e5adcceb-5263-4f2a-ac57-e9cb31eabe1a tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.162015 Oct 04 19:48:40.093561 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4244/8462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:39 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:40.867769 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d74a31c-4e61-437e-853c-f2a645e9fbb5", "name": "network-vif-plugged", "status": "completed", "tag": "98ca3934-7311-4c45-91de-ba4388f4a53a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:40.878310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:40.878804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:40.879269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:40.891941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] Creating event network-vif-plugged:98ca3934-7311-4c45-91de-ba4388f4a53a for instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 on n-h1-833090-21 Oct 04 19:48:40.898703 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-27e70dd6-4a17-454c-be74-4c5e0baf7a70 req-174a2359-91b1-4972-b9c4-8678ba0a2338 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Oct 04 19:48:40.898703 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4219/8463] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:48:41.117556 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:41.118170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:41.120096 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:41.120780 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:41.126909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:41.127330 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:41.127794 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:41.128502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:41.129004 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:41.129427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:41.270158 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:41.278120 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-71cb91db-84fc-4509-98bd-efa1398cdf8e tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.164713 Oct 04 19:48:41.278711 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4245/8464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:41 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:42.303624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:42.304509 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:42.310855 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:42.311366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:42.311844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:42.313309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:42.313309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:42.313572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:42.467678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:42.475559 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-664267af-625f-4a38-b670-9ba5d96ac7b4 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1391 microversion: 2.1 time: 0.177248 Oct 04 19:48:42.476161 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4220/8465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:42 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:43.500574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:43.501194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:43.504035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:43.509455 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.509980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.510423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.511124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.511651 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.518823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.660469 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:43.668960 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bba9c88f-23c3-4cfb-8c4a-e95aa0fbdc33 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1562 microversion: 2.1 time: 0.172646 Oct 04 19:48:43.669588 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4246/8466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:43 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:43.694584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:43.695287 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:43.697365 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:48:43.703409 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.703996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.704432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.705189 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:43.705669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:43.706163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:43.845105 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:43.853786 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-358fe05f-38ac-4c8a-b7ce-dab8e734f7a3 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1562 microversion: 2.1 time: 0.163639 Oct 04 19:48:43.854651 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4221/8467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:43 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:48:45.925864 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:48:45.926524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:48:45.927682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d74a31c-4e61-437e-853c-f2a645e9fbb5", "tag": "98ca3934-7311-4c45-91de-ba4388f4a53a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:48:45.934305 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:45.934800 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:45.935237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:45.936245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:45.936665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:45.937097 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:45.939512 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:48:45.940129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:48:45.940583 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:48:45.952682 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] Creating event network-changed:98ca3934-7311-4c45-91de-ba4388f4a53a for instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 on n-h1-833090-21 Oct 04 19:48:45.958142 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-88185e30-7c55-4114-a606-1ca186515f7f req-30c6ae8b-ec95-4613-b601-c1ade7a6d052 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034297 Oct 04 19:48:45.959010 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4222/8468] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:48:46.105178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:48:46.116979 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ef36d9b-cb80-4680-970d-441010f7a3bf tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1562 microversion: 2.1 time: 0.198708 Oct 04 19:48:46.117594 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4247/8469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:48:45 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:09.390738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=20 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:09.391550 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:09.395857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:09.398193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:09.405515 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:09.406026 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:09.406478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:09.407200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:09.407727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:09.408169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:09.462772 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b32a3652-fb12-4502-b493-37db54bd6044 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action" status: 200 len: 24569 microversion: 2.1 time: 0.076350 Oct 04 19:49:09.463485 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4223/8470] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:09 2022] POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action => generated 24569 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:20.428118 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:20.428686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:20.430760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:20.431419 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=50 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:20.436208 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:20.436694 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:20.437132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:20.437824 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:20.438280 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:20.438707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:20.461312 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lazy-loading 'flavor' on Instance uuid 8d74a31c-4e61-437e-853c-f2a645e9fbb5 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:49:20.752733 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c5b410cc-cad3-4546-9ee8-8661e96a23bc tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action" status: 202 len: 0 microversion: 2.1 time: 0.328960 Oct 04 19:49:20.753415 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4248/8471] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:20 2022] POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:20.762803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:20.763548 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:20.766451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:20.767116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=4 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:20.772317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:20.772825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:20.773281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:20.773998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:20.774477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:20.774920 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:20.911379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:20.919853 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-dbb9b55f-03fc-4f66-99c4-3d9c29db2c1d tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1688 microversion: 2.1 time: 0.161863 Oct 04 19:49:20.920424 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4224/8472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:20 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:21.946979 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:21.947717 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:21.954661 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:21.955150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:21.955815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:21.956525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:21.956984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:21.957412 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:22.109284 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:22.117621 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b16b4abd-1084-4b26-80a3-be2e3c359ac7 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1671 microversion: 2.1 time: 0.176012 Oct 04 19:49:22.122188 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4249/8473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:21 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:23.212851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:23.215080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:23.222897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.223400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.223879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.224590 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.225069 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.225510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.288287 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b4b358fa-5f36-4ccd-9970-67fa37c358a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action" status: 200 len: 37623 microversion: 2.1 time: 0.078958 Oct 04 19:49:23.288888 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4225/8474] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:23 2022] POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action => generated 37623 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:23.301392 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:23.303888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:23.310132 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.310629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.311174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.311806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.312265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.312692 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.555237 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-90d88cce-addb-4ee7-80ae-b010c09c08ba tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action" status: 202 len: 0 microversion: 2.1 time: 0.252055 Oct 04 19:49:23.555237 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4250/8475] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:23 2022] POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:23.560718 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:23.561502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:23.569780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.570476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.570943 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.571992 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:23.572195 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:23.572645 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:23.736961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:23.745328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7bffe85f-4b9d-48c4-ba67-c25f42dac3c9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1677 microversion: 2.1 time: 0.189981 Oct 04 19:49:23.746513 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4226/8476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:23 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:49:24.772266 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:24.772965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:24.782509 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.782999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.783448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:24.784173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:24.784632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:24.785063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:24.918074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:24.925847 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b5ff6d0b-a4ef-4187-a2b6-d98edb02d731 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1677 microversion: 2.1 time: 0.159376 Oct 04 19:49:24.926417 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4251/8477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:24 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:25.950734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:25.951400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:25.958290 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:25.958787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:25.959241 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:25.959981 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:25.960454 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:25.960899 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.098581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:26.106356 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-092c0a73-dd7d-48ca-9c63-3f073a42cb07 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1680 microversion: 2.1 time: 0.160185 Oct 04 19:49:26.106931 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4227/8478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:25 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:26.200898 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:26.203160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:26.210150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.210637 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.211081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.211805 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:26.212264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:26.212695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:26.255386 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6db25ef-3303-4a2e-92a5-eec9ed6869a0 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action" status: 200 len: 37623 microversion: 2.1 time: 0.058914 Oct 04 19:49:26.256033 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4252/8479] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:49:26 2022] POST /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5/action => generated 37623 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:49:27.343766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:27.344338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:27.352164 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.352849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.353304 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.354009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.354753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.355371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.390059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:49:27.406764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d74a31c-4e61-437e-853c-f2a645e9fbb5", "tag": "98ca3934-7311-4c45-91de-ba4388f4a53a"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:27.420385 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.421441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.422123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.435808 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] Creating event network-changed:98ca3934-7311-4c45-91de-ba4388f4a53a for instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 on n-h1-833090-21 Oct 04 19:49:27.442161 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-652884d0-9103-47f2-940a-baf75edc69af req-029fc093-8cbe-440b-ba72-5b3c3c3d244e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099570 Oct 04 19:49:27.443413 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4253/8480] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:27.677247 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-33b0d4c8-20f2-42ba-be78-f2fdba49a166 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 204 len: 0 microversion: 2.1 time: 0.337634 Oct 04 19:49:27.686272 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4228/8481] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:49:27 2022] DELETE /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:49:27.688892 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:27.689587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:27.696343 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.696861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.697401 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.698174 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:27.698695 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:27.699182 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:27.841504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:27.849479 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-643f300d-895e-48da-88be-be4876060857 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1686 microversion: 2.1 time: 0.165261 Oct 04 19:49:27.850069 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4254/8482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:27 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:28.877165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:28.877872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:28.884814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:28.885312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:28.885756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:28.886453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:28.886951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:28.887385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:29.030380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:29.038867 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-89c6f933-5745-42d0-9787-888e545215b9 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1686 microversion: 2.1 time: 0.166219 Oct 04 19:49:29.039458 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4229/8483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:28 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:30.064049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:30.064929 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:30.072459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.072956 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.073409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.074126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.075290 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.075970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.232363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d46d9f90b447788f064d33aed59442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b82e4aaca2487ea27c7c484a73edc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:30.241362 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c6cf409a-0cfa-402e-be76-936dc39ac532 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 200 len: 1568 microversion: 2.1 time: 0.181139 Oct 04 19:49:30.242377 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4255/8484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:30 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:30.255537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d74a31c-4e61-437e-853c-f2a645e9fbb5", "name": "network-vif-deleted", "tag": "98ca3934-7311-4c45-91de-ba4388f4a53a"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:30.266494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:30.275038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:30.275038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:30.278710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] Creating event network-vif-deleted:98ca3934-7311-4c45-91de-ba4388f4a53a for instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 on n-h1-833090-21 Oct 04 19:49:30.283939 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a9b9fe96-0f30-4c0d-8f91-b59a2a18d3e7 req-8e170d6c-37b4-4f51-b930-aa21f3fc18f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032344 Oct 04 19:49:30.284565 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4230/8485] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:31.265861 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:31.266758 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] [instance: 8d74a31c-4e61-437e-853c-f2a645e9fbb5] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:31.274013 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:31.274503 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:31.274945 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:31.275720 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:31.276162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:31.276590 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:31.291723 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] HTTP exception thrown: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Request method failure captured: Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 HTTP/1.1 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPIwF0DuGVU0wh5ni8FAzc88IKaDjTMFC_iYVYx_rXIQTBlFmjE0WWJ5if9uLUVZ-gX_O2ffQ8l8HH4QUxypMeygP1iBLbKLjDTG7jRKfQ0mobFEoYWWEvQ8LaUBoe8OEivuPi7XMNzVM2mOI3fwcRoTXjU3P-60RTLTmxdOWv577GHU Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/26b82e4aaca2487ea27c7c484a73edc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/26b82e4aaca2487ea27c7c484a73edc0"}]}] Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 26b82e4aaca2487ea27c7c484a73edc0 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629543044 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 43d46d9f90b447788f064d33aed59442 Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629543044-project Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '8d74a31c-4e61-437e-853c-f2a645e9fbb5'} Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.294287 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Returning 404 to user: Instance 8d74a31c-4e61-437e-853c-f2a645e9fbb5 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6c682849-b4a5-45f1-8d00-add42deeac69 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5" status: 404 len: 111 microversion: 2.1 time: 0.033934 Oct 04 19:49:31.299765 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4256/8486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:31 2022] GET /compute/v2.1/servers/8d74a31c-4e61-437e-853c-f2a645e9fbb5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:49:35.240110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1450409-b2bf-4820-a1f6-e7c1db8505a5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] Calling method '.version_select at 0x7f90007c65e0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:35.341793 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1450409-b2bf-4820-a1f6-e7c1db8505a5 tempest-TestNetworkAdvancedServerOps-629543044 tempest-TestNetworkAdvancedServerOps-629543044-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-233694532" status: 202 len: 0 microversion: 2.1 time: 0.105939 Oct 04 19:49:35.342393 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4231/8487] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 4 19:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-233694532 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:49:50.976689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=18 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:50.977454 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:51.186938 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5033c994-d935-4ee1-8798-eb23abce5299 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'create', calling method: .version_select at 0x7f900833da60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1939910074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEF1Pzd6TqWF6pSdg6gJan+2k0jMkJYZferSuCjwJIyl70lTo8xF+RbLZ2foC+ZxiFrPJC1b8fPBbngKlEZzQTyPrNz2tjzA0HFVpUZn6zh75rEz9J4vyRMs1s4Eh+FAtQ=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:51.203879 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-5033c994-d935-4ee1-8798-eb23abce5299 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for project 50f5827ff0724bcb87bd31a73d374180. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:49:51.209413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-5033c994-d935-4ee1-8798-eb23abce5299 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for user 7dad49266dd84065b68e3a9060bd732d and project 50f5827ff0724bcb87bd31a73d374180. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:49:51.298005 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5033c994-d935-4ee1-8798-eb23abce5299 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.327185 Oct 04 19:49:51.299009 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4257/8488] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:49:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:53.737896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:53.739576 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:49:53.739576 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 04 19:49:53.742125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:49:53.747309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1289428744", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1939910074", "security_groups": [{"name": "tempest-secgroup-smoke-1868790174"}], "networks": [{"uuid": "55a68a6a-0c4f-4c4a-9f5e-16fa180bddcf"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:53.875908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] validate_networks() for [('55a68a6a-0c4f-4c4a-9f5e-16fa180bddcf', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:49:54.267333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:49:54.267838 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:49:54.268324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:49:54.268746 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:49:54.269169 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:49:54.280729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:54.281441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:54.281918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:54.282682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:54.283149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:54.283617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:54.302834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for project 50f5827ff0724bcb87bd31a73d374180. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:49:54.309242 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for user 7dad49266dd84065b68e3a9060bd732d and project 50f5827ff0724bcb87bd31a73d374180. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:49:54.323153 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:49:54.325811 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:49:54.452812 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-aed24994-eb3e-4508-8347-eab69c6daf5a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716539 Oct 04 19:49:54.453812 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4232/8489] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:49:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:49:54.466599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d040ba1-61a4-43b7-ad37-80f38d4cab48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:54.467315 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d040ba1-61a4-43b7-ad37-80f38d4cab48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:54.541886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d040ba1-61a4-43b7-ad37-80f38d4cab48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:54.550471 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d040ba1-61a4-43b7-ad37-80f38d4cab48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1247 microversion: 2.1 time: 0.089396 Oct 04 19:49:54.551062 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4258/8490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:54 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:55.574932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:55.575641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:55.584672 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:55.585183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:55.585635 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:55.586353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:55.586825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:55.587256 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:55.661495 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:55.670761 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f7fab26d-43a2-48e2-9426-2f94a724e366 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1251 microversion: 2.1 time: 0.099947 Oct 04 19:49:55.671377 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4233/8491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:55 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1251 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:56.694480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:56.695090 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:56.702873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:56.703366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:56.703845 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:56.704533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:56.704985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:56.705409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:56.814434 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:56.822282 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d8245069-3853-4db7-866b-daf65fade737 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1307 microversion: 2.1 time: 0.131646 Oct 04 19:49:56.822870 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4259/8492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:56 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:57.846485 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:57.847774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:57.855302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:57.856090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:57.856535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:57.858311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:57.858311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:57.858311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:58.009408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:58.025814 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0fdaf238-4a4c-43c2-ab34-3bbb5dd732a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.175004 Oct 04 19:49:58.025814 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4234/8493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:57 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:49:58.677423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:49:58.688738 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:58.689500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:58.689681 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:58.701710 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] Creating event network-changed:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h2-833090-21 Oct 04 19:49:58.707758 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-b5f9c114-824c-4bcf-9f4e-ae80c6e59398 req-df8b97ef-003f-4dfe-aa55-3694f8ed12d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Oct 04 19:49:58.712151 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4260/8494] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:49:59.041030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:49:59.042220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:49:59.049176 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:59.049681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:59.050134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:59.050922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:49:59.051669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:49:59.052123 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:49:59.242383 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:49:59.250794 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9842b46b-5cf5-405a-8026-f5a4f92e5f97 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.213678 Oct 04 19:49:59.251376 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4235/8495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:49:59 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:00.277210 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:00.277818 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:00.284147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:00.284630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:00.285068 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:00.285761 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:00.286214 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:00.286648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:00.474439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:00.482260 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a6d52452-a488-4df0-9a8b-c6b29feeebd5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.211029 Oct 04 19:50:00.482849 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4261/8496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:00 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:01.505688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:01.506300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:01.513217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:01.513717 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:01.514171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:01.514875 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:01.515348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:01.515823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:01.645824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:01.654009 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7b96a5d2-3014-4386-b696-271b1e2a1d63 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.152273 Oct 04 19:50:01.654588 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4236/8497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:01 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:02.678059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:02.678620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:02.686489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:02.686973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:02.687415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:02.688143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:02.688604 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:02.689028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:02.823659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:02.831880 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5db6d775-35a8-44b7-a540-b02a2d1e50e4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.157939 Oct 04 19:50:02.832696 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4262/8498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:02 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:03.856555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:03.857187 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:03.864171 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:03.864670 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:03.865126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:03.865831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:03.866307 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:03.866755 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:04.004400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:04.012464 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-32d872cd-8840-4d93-9a3b-4dd5562c0090 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.160182 Oct 04 19:50:04.013049 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4237/8499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:03 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:04.348480 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "name": "network-vif-plugged", "status": "completed", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:04.359988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:04.360463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:04.360887 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:04.373926 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] Creating event network-vif-plugged:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h2-833090-21 Oct 04 19:50:04.379094 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4f1cd382-f49a-4642-b372-83802f95778e req-0bfe4eb0-23b9-445b-8cd2-327c87028f30 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089816 Oct 04 19:50:04.379740 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4263/8500] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:50:05.035785 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:05.036419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:05.038357 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:05.039053 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:05.044876 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:05.048644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:05.048644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:05.048644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:05.048644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:05.048644 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:05.187954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:05.196354 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a695c745-f07e-4802-91dd-ee16893b772a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1373 microversion: 2.1 time: 0.164391 Oct 04 19:50:05.196950 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4238/8501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:05 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:06.216721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=6 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:50:06.222300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:06.223858 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:06.229397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:06.229912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:06.230359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:06.231052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:06.231532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:06.231961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:06.369354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:06.377266 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-701cecc9-9df5-477d-925a-0b9965b1c12d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1556 microversion: 2.1 time: 0.161566 Oct 04 19:50:06.377874 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4264/8502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:06 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:06.403825 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:50:06.404463 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:50:06.411073 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:06.411618 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:06.412083 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:06.412831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:06.413308 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:06.413757 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:06.547996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:50:06.555941 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-02dac9cc-b07e-4682-b308-f9ec0b1b423d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1556 microversion: 2.1 time: 0.156595 Oct 04 19:50:06.556521 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4239/8503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:50:06 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:50:09.380072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:50:09.392043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:50:09.392559 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:50:09.392989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:50:09.405707 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] Creating event network-changed:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h2-833090-21 Oct 04 19:50:09.411228 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-e0f821d1-e928-4676-881d-ae26dab3b30a req-bbbfdb3c-d7b1-4180-96ee-1f513f5a8772 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035345 Oct 04 19:50:09.413022 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4265/8504] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:52:36.120612 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:52:36.121565 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:52:36.122155 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:36.122918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=44 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:36.123757 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:52:36.123949 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action (ip 10.222.0.40) !!! Oct 04 19:52:36.124876 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:52:36.124986 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action (ip 10.222.0.40) !!! Oct 04 19:52:36.129841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:36.134926 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:36.140193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.140696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.141152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.141860 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.142327 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.142766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.167274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lazy-loading 'flavor' on Instance uuid 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:52:36.670619 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-633940b8-92fd-452c-a98d-2a0667c0504e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action" status: 202 len: 0 microversion: 2.1 time: 0.551805 Oct 04 19:52:36.671225 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4240/8505] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:52:36 2022] POST /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:52:36.678348 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:52:36.679982 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:52:36.680658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:36.681563 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=30 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:52:36.682708 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:52:36.682855 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 (ip 10.222.0.40) !!! Oct 04 19:52:36.683924 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:52:36.684046 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 (ip 10.222.0.40) !!! Oct 04 19:52:36.689696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:36.692903 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:36.699173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.699693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.700136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.700951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:36.701417 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:36.701851 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:36.838715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:36.846713 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2ae9a58a-bbc2-4218-8a8f-cdad130216db tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.170550 Oct 04 19:52:36.847655 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4266/8506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:36 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:37.875024 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:37.875922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:37.890364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:37.890888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:37.891352 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:37.892109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:37.892584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:37.893027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:37.893784 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48568. Oct 04 19:52:37.900905 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48570. Oct 04 19:52:38.029972 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:38.037888 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-214aa96e-b336-4c18-9f7b-5264eb12bec8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.168878 Oct 04 19:52:38.038468 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4241/8507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:37 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:39.063236 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:39.064041 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:39.075363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:39.075885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:39.076320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:39.077025 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:39.077484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:39.077904 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:39.081980 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48578. Oct 04 19:52:39.085251 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48576. Oct 04 19:52:39.223874 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:39.232315 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-708e24b8-8bf8-4721-a7eb-980be8ee5872 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.173369 Oct 04 19:52:39.232913 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4267/8508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:39 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:40.256699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:40.257833 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:40.265004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:40.265510 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:40.265966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:40.266687 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:40.267159 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:40.267708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:40.406381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:40.414152 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-128e5fec-ced0-4d29-8261-e694f43fd67b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.161404 Oct 04 19:52:40.414722 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4242/8509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:40 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:41.437323 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:41.437873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:41.444884 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:41.445363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:41.446371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:41.447067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:41.447537 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:41.447964 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:41.581531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:41.589431 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e6b2e3cf-26b5-4879-a661-d2b87ed253d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.156065 Oct 04 19:52:41.590005 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4268/8510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:41 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:42.612885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:42.613430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:42.620813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:42.621354 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:42.621809 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:42.622535 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:42.623011 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:42.623457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:42.760752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:42.768466 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-06183e77-4a75-4954-9915-b9c52e65d2dd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.159680 Oct 04 19:52:42.769053 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4243/8511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:42 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:52:43.792958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:43.793571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:43.800669 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:43.801144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:43.801574 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:43.802253 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:43.802699 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:43.803113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:43.933665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:43.941465 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b2e7ca0-cc53-4c5a-95e1-5d9448fd6b40 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.153140 Oct 04 19:52:43.942047 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4269/8512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:43 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:44.967324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:44.967963 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:44.975429 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:44.975970 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:44.976421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:44.977638 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:44.978110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:44.978553 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:45.114296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:45.122903 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ce5c9cf1-30b8-4a96-8849-1d0a5f9646bd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.160445 Oct 04 19:52:45.123497 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4244/8513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:44 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:46.146462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:46.147053 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:46.154047 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:46.154533 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:46.154977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:46.155712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:46.156173 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:46.156600 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:46.290123 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:46.298857 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e62bb38e-822b-41f8-9170-90a6809adbf7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.156458 Oct 04 19:52:46.299446 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4270/8514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:46 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:47.323907 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:47.324477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:47.331790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:47.332296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:47.332753 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:47.333461 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:47.333933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:47.334377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:47.470481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:47.478201 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-51cd2ded-501d-4b5f-b8b2-b64f1956f8b3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.158832 Oct 04 19:52:47.478776 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4245/8515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:47 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:48.502094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:48.502722 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:48.510548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:48.511105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:48.511577 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:48.512282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:48.512973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:48.513406 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:48.647201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:48.655953 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-82a86def-15e1-439c-a095-9621c3fa475b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.157735 Oct 04 19:52:48.656555 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4271/8516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:48 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:49.680426 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:49.681111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:49.688074 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:49.688584 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:49.689040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:49.689756 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:49.690234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:49.690679 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:49.828079 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:49.836475 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-29d7e0f1-2ba4-4d9d-89c7-52222577e33d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.159341 Oct 04 19:52:49.837057 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4246/8517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:49 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:50.861371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:50.861978 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:50.869754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:50.870235 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:50.870666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:50.871350 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:50.871827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:50.872249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:51.013300 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:51.043323 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-140497b2-9062-475c-a5ff-de9eb1362ed2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.170438 Oct 04 19:52:51.043323 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4272/8518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:50 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:51.074726 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "name": "network-vif-plugged", "status": "completed", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:52:51.085763 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:51.086441 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:51.086896 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:51.098654 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] Creating event network-vif-plugged:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h2-833090-21 Oct 04 19:52:51.104701 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-13221cf9-12b4-4470-8dca-030e0291b33b req-75190217-5b22-48bb-953b-96d06df8966a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033762 Oct 04 19:52:51.105351 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4247/8519] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:52:52.052486 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:52.053033 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:52.060485 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:52.060969 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:52.061402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:52.062094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:52.062545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:52.062970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:52.192583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:52.200988 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e1a6a220-9e79-4c25-bfda-a6ebc3e8370b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.152582 Oct 04 19:52:52.201567 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4273/8520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:52 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:53.225259 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:53.225977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:53.233194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:53.233693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:53.234143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:53.234849 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:53.235326 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:53.235791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:53.371881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:53.379556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a4f6fda8-a129-42b8-aa06-ac1215d4d36b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.158560 Oct 04 19:52:53.380128 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4248/8521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:53 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:54.404562 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:54.405165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:54.412584 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:54.413063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:54.413496 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:54.414912 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:54.415443 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:54.415897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:54.560752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:54.568650 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b942ee6-89cb-40f2-8309-6164651034a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1702 microversion: 2.1 time: 0.168246 Oct 04 19:52:54.569234 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4274/8522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:54 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1702 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:55.594466 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:55.595803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:55.604496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:55.605002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:55.605453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:55.606172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:55.606647 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:55.607213 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:55.780557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:55.789870 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-bc352aa0-7a11-4dbd-94c4-a5a2820e2534 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.199612 Oct 04 19:52:55.790627 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4249/8523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:55 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:56.815993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:56.817453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:56.825558 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:56.826130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:56.826638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:56.827442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:56.827994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:56.828493 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:56.990228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:56.999556 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-274d7232-4bce-4fba-8ff6-841f7c6f1798 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.187677 Oct 04 19:52:57.025983 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4275/8524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:56 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:58.030245 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:58.030986 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:58.040315 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:58.040484 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:58.042568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:58.042568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:58.042568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:58.043147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:58.197737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:58.207010 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0559fdef-3121-47e2-b58e-2a45294571e3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.180481 Oct 04 19:52:58.207010 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4250/8525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:58 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:52:59.230264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:52:59.231086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:52:59.238510 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:59.238997 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:59.239429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:59.240150 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:52:59.240601 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:52:59.241213 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:52:59.398899 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:52:59.408684 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1ff2a057-3f14-492e-a123-d5a529ef7f4c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.182193 Oct 04 19:52:59.415631 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4276/8526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:52:59 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:00.435872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:00.436720 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:00.444274 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:00.444776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:00.445368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:00.447262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:00.447921 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:00.448302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:00.603151 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:00.612424 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0ce893c8-7d5b-4185-ad12-496bd81917d8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.180480 Oct 04 19:53:00.614631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4251/8527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:00 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:01.637982 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:01.638992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:01.645790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:01.646565 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:01.646881 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:01.647390 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:01.647872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:01.650672 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:01.798607 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:01.807098 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ecb140c9-2919-48e8-b651-bc1d042a9bc1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.173078 Oct 04 19:53:01.823492 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4277/8528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:01 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:02.830792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:02.831613 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:02.846572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:02.847258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:02.847768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:02.849483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:02.850369 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:02.851029 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:03.043927 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:03.053184 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f5f75ad6-de76-4b92-9139-de9de2389004 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.226726 Oct 04 19:53:03.054102 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4252/8529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:02 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:04.081183 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:04.081908 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:04.089835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:04.090381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:04.090868 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:04.091983 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:04.092819 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:04.093468 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:04.258449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:04.268274 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae1a4722-9f45-44dc-9aa4-80a5060cf030 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.190763 Oct 04 19:53:04.268954 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4278/8530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:04 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:05.293900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:05.294606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:05.302868 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:05.303405 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:05.303923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:05.305572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:05.306366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:05.306918 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:05.454631 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:05.463059 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d051841c-a692-40cc-b079-bbe4b4c5d5aa tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1697 microversion: 2.1 time: 0.173208 Oct 04 19:53:05.463666 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4253/8531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:05 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:06.487822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:06.488441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:06.495318 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.495828 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.496265 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.496954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:06.497404 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:06.497827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:06.709387 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:06.718183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5cc8fc3c-7b34-4565-b759-2b8a300b75b7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1679 microversion: 2.1 time: 0.234281 Oct 04 19:53:06.718773 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4279/8532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:06 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:07.742433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:07.743126 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:07.746009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=29 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:07.750802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:07.751309 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:07.751802 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:07.752519 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:07.752993 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:07.753446 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:07.756200 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:07.889721 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:07.897609 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3c32c20e-1a1f-4bf3-a079-b362da9741a8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1679 microversion: 2.1 time: 0.159192 Oct 04 19:53:07.898907 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4254/8533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:07 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:08.922732 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:08.923313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:08.930957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:08.931448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:08.931923 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:08.932641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:08.933092 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:08.933520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:08.936348 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=85 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:09.091064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:09.091064 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5676d245-f7a8-44dc-bb2a-0855da140ff5 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1682 microversion: 2.1 time: 0.168500 Oct 04 19:53:09.091064 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4280/8534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:08 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:09.113322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:09.114033 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:09.121531 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.122138 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.122656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.123460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.124018 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.124538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.145742 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "name": "network-vif-unplugged", "status": "completed", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:09.157602 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=31 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:53:09.167185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:09.175031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:09.175031 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:09.180924 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] Creating event network-vif-unplugged:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h2-833090-21 Oct 04 19:53:09.184598 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] [72301689-fadb-4609-8d58-10a4a0542375] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:53:09.267118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123886) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:53:09.598530 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:53:10.191718 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] [72301689-fadb-4609-8d58-10a4a0542375] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48694. Oct 04 19:53:10.195904 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-6b73511d-eb5d-42a3-a315-f21f5327751d req-ca7994d0-c00d-4d18-863d-6001b9c5bf5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.057185 Oct 04 19:53:10.196663 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4281/8535] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:53:10.606033 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [cc76ba0a-b5e1-4360-b005-e00a0911dd53] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48696. Oct 04 19:53:10.609450 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-23757b62-bb97-4411-be2f-7f3a23b19ec2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action" status: 202 len: 0 microversion: 2.1 time: 1.500456 Oct 04 19:53:10.610078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4255/8536] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:53:09 2022] POST /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40/action => generated 0 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:53:10.619648 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:10.620355 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:10.627488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.627996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.628580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.629291 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:10.629748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:10.630177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:10.771529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:10.781142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6d7f478b-da8a-47b9-840e-84c9f1d752f6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1630 microversion: 2.1 time: 0.166450 Oct 04 19:53:10.781731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4282/8537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:10 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1630 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:11.807021 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:11.807680 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:11.814708 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.815209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.815688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.816416 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:11.816951 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:11.817398 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:11.949167 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:11.956927 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ceaec497-560b-4265-ac78-e53b5147ffdd tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1630 microversion: 2.1 time: 0.155294 Oct 04 19:53:11.958244 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4256/8538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:11 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:12.981613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:12.982366 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:12.989641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:12.990139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:12.996840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:12.996840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:12.996840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:12.996840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:13.146484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:13.155252 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-9d749581-87c5-4d42-b62a-ab35abc79b22 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.177803 Oct 04 19:53:13.156001 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4283/8539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:12 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:13.796204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:13.810683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:13.811258 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:13.811740 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:13.824333 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] Creating event network-changed:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h1-833090-21 Oct 04 19:53:13.830093 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-0a51e306-b39f-463b-9a57-0dadea726e3b req-0eed8a53-7e6e-4d0c-b861-0b40f867e7ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039301 Oct 04 19:53:13.831147 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4257/8540] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:14.180859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:14.181659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:14.189093 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:14.189594 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:14.190045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:14.190770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:14.191260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:14.191727 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:14.336952 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:14.344753 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-52bae596-40ac-440d-9c47-3db304af9ce2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.168376 Oct 04 19:53:14.345346 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4284/8541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:14 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:15.370719 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:15.371384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:15.378964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.379874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.380557 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.381487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:15.382031 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:15.382483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:15.549857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:15.558657 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-39a8ee8d-2014-4e13-83ca-2b57a0642162 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.192802 Oct 04 19:53:15.570944 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4258/8542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:15 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:16.582413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:16.583011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:16.591087 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:16.591629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:16.592307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:16.593040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:16.593502 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:16.593936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:16.746083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:16.757589 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-6cb5843e-8d7d-4f1c-a376-58a15b262f4d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.179002 Oct 04 19:53:16.759096 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4285/8543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:16 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:17.783261 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:17.783913 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:17.791385 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:17.791915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:17.792361 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:17.793103 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:17.793568 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:17.794003 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:17.944145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:17.952552 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4951c431-76c5-4083-98bf-0eb57ac6359d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.173066 Oct 04 19:53:17.953456 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4259/8544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:17 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:18.976644 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:18.977409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:18.984402 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:18.984886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:18.985361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:18.986012 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:18.986460 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:18.986886 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:19.128572 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:19.139648 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-b7e67816-f0e7-4eee-868a-4c7032bc41c3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.166825 Oct 04 19:53:19.140487 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4286/8545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:18 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:20.171160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:20.171845 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:20.179780 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:20.180340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:20.180795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:20.181516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:20.182028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:20.182497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:20.324384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:20.334103 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-91046e91-8eaf-4bd9-9d27-325d9b000062 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.167419 Oct 04 19:53:20.346177 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4260/8546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:20 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:21.360653 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:21.367787 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:21.369051 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:21.369609 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:21.370115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:21.370889 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:21.371422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:21.372058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:21.559715 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:21.567935 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5687ea66-b44f-4288-94d7-6592963b2c28 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.211680 Oct 04 19:53:21.585241 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4287/8547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:21 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:53:22.593254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:22.593897 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:22.601226 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:22.601739 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:22.602198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:22.602932 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:22.603408 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:22.603922 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:22.976004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:22.983710 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1cdd675f-ff18-41b2-96ca-4e2d6e6b2710 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.394436 Oct 04 19:53:22.984285 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4261/8548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:22 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:24.008516 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:24.009160 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:24.016039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:24.016526 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:24.016970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:24.017659 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:24.018117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:24.018542 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:24.151261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:24.159072 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-92e2738c-c2eb-4691-8615-8dc32250ca09 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.154613 Oct 04 19:53:24.159897 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4288/8549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:24 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:25.184704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:25.185728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:25.192165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:25.192662 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:25.193111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:25.193804 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:25.194969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:25.195451 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:25.332673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:25.340344 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ef597af7-f6d6-4a46-9a67-38156b2dad53 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.159514 Oct 04 19:53:25.340916 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4262/8550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:25 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:26.353743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "name": "network-vif-plugged", "status": "completed", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:53:26.363931 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:26.364447 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:26.364595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:26.364798 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:26.365228 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:26.372062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:26.372567 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:26.373059 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:26.373774 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:26.374248 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:26.374695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:26.377368 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] Creating event network-vif-plugged:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h1-833090-21 Oct 04 19:53:26.383144 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-4dc89d57-61bb-4703-8f4c-ebca532d7df9 req-6fb677b0-d59e-4202-86b8-921d0296e763 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033425 Oct 04 19:53:26.383910 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4289/8551] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:53:26.520143 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:26.528512 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c44b1bc-0714-44e3-ab2c-d6aeb4b4c2a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.168620 Oct 04 19:53:26.529124 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4263/8552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:26 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:53:27.554690 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:27.555381 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:27.561893 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:27.562373 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:27.562806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:27.563523 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:27.563973 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:27.564391 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:27.697476 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:27.705235 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-10c58f1f-15ac-4b98-8bb7-7f37033a11d3 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.156345 Oct 04 19:53:27.705803 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4290/8553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:27 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:28.729570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:28.730234 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:28.737233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:28.737737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:28.743312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:28.743312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:28.743312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:28.743312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:28.880292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:28.888115 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9c2407f7-93ca-4846-8ee3-5884b48e85a1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1688 microversion: 2.1 time: 0.163066 Oct 04 19:53:28.888697 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4264/8554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:28 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:53:29.913294 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:53:29.913944 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:53:29.921094 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:29.921579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:29.922018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:29.922707 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:53:29.923166 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:53:29.923629 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:53:30.054083 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:53:30.061828 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ea18cebe-aca5-4a50-92a1-9f804fcf2f8e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1675 microversion: 2.1 time: 0.152510 Oct 04 19:53:30.062398 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4291/8555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:53:29 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:44.605116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:44.606406 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:44.606641 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=21 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:44.607576 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=63 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:54:44.612154 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:44.612831 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:44.621520 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:44.621728 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:44.622217 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:44.623019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:44.624081 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:44.624622 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:44.653481 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:54:44.697439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:44.709264 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:44.714685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:44.714685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:44.721834 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] Creating event network-changed:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h1-833090-21 Oct 04 19:54:44.727258 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-ebd64ae5-e881-46e1-956d-550b6efe2e76 req-e41ca640-b9a6-489d-a443-6035862570b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122296 Oct 04 19:54:44.728128 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4292/8556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:54:44.966740 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-14f5d4bf-2c8b-42d2-ac1e-5a7d07ae794e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 204 len: 0 microversion: 2.1 time: 0.362959 Oct 04 19:54:44.968623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4265/8557] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 19:54:44 2022] DELETE /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:54:44.977219 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:44.978248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:44.985848 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:44.986670 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:44.987167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:44.988128 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:44.988645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:44.989133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:45.124073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:45.132309 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-14878695-20a9-437a-be1d-a4e4c1f6ec05 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.159232 Oct 04 19:54:45.132904 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4293/8558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:44 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:46.157371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:46.158051 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:46.165923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:46.166421 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:46.166865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:46.167606 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:46.168328 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:46.168761 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:46.372779 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:46.381335 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d89ea404-dbb1-4ed6-8496-e4b1afcd5e61 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1681 microversion: 2.1 time: 0.228923 Oct 04 19:54:46.382140 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4266/8559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:46 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:47.074072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a17c3fe-0092-4e50-aa71-94f6c0d28a40", "name": "network-vif-deleted", "tag": "a2ee39f9-8253-468d-99f3-81cb3dc61567"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:47.087775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:47.087775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:47.087775 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:47.099919 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] Creating event network-vif-deleted:a2ee39f9-8253-468d-99f3-81cb3dc61567 for instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 on n-h1-833090-21 Oct 04 19:54:47.105188 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3fa24054-2d62-4b8a-86a0-c6ceebfca071 req-8734ed54-858e-4fa8-977e-af1cf3c72e8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093030 Oct 04 19:54:47.105789 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4294/8560] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:54:47.406394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:47.407025 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:47.414183 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:47.414916 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:47.415377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:47.416170 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:47.416669 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:47.417322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:47.450433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:47.450933 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:47.451387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:47.452527 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lazy-loading 'fault' on Instance uuid 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:54:47.493002 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:54:47.501598 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-4c4b81a7-bdf3-40be-9129-697d20a81d48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 200 len: 1337 microversion: 2.1 time: 0.099132 Oct 04 19:54:47.502174 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4267/8561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:47 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:54:48.525409 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:48.526144 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 4a17c3fe-0092-4e50-aa71-94f6c0d28a40] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:54:48.533224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:48.533711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:48.534147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:48.534838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:54:48.535297 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:54:48.535755 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:54:48.549609 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.wsgi [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] HTTP exception thrown: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Request method failure captured: Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: request: GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 HTTP/1.1 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Accept: application/json Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Accept-Encoding: identity Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Connection: close Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Content-Length: 0 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Content-Type: application/json Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Host: 10.222.0.40 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: Openstack-System-Scope: None Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: User-Agent: python-urllib3/1.26.12 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Auth-Token: gAAAAABjPI5YKdhrTNEHGt2MYQxRAff_lG4JN-x4qqa8-zrxW00lB4OuQI0xYjJtVtKuPNU3X2yME8I5stdhQE5LVa1D2P6Y1gmuC6Ehlk4qQ5nVkbSDNotEueLrVi7Bvfo7QFggmdJL6oNDKHUCLyymKnJegJEHMt_-nW5kgNIoOEJmkyMOdNA Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Id: None Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Domain-Name: None Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Identity-Status: Confirmed Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Is-Admin-Project: True Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Id: default Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Domain-Name: Default Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Id: 50f5827ff0724bcb87bd31a73d374180 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Project-Name: tempest-TestShelveInstance-357074834 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Role: reader,member Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Roles: reader,member Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/50f5827ff0724bcb87bd31a73d374180"}]}] Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant: tempest-TestShelveInstance-357074834 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Id: 50f5827ff0724bcb87bd31a73d374180 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-Tenant-Name: tempest-TestShelveInstance-357074834 Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-User: tempest-TestShelveInstance-357074834-project Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Id: default Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-User-Domain-Name: Default Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-User-Id: 7dad49266dd84065b68e3a9060bd732d Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: X-User-Name: tempest-TestShelveInstance-357074834-project Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: method: > Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: exception: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: action_args: {'id': '4a17c3fe-0092-4e50-aa71-94f6c0d28a40'} Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:54:48.551222 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: ERROR nova.api.openstack.wsgi Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Returning 404 to user: Instance 4a17c3fe-0092-4e50-aa71-94f6c0d28a40 could not be found. {{(pid=123887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4e1b2724-9edc-4c5c-9e4b-62ff10f79e3f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40" status: 404 len: 111 microversion: 2.1 time: 0.032336 Oct 04 19:54:48.556977 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4295/8562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:54:48 2022] GET /compute/v2.1/servers/4a17c3fe-0092-4e50-aa71-94f6c0d28a40 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:54:48.765077 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a63ac036-266d-496f-a367-aa925dd90353 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '.version_select at 0x7f9008032ee0>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:54:48.850031 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a63ac036-266d-496f-a367-aa925dd90353 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1939910074" status: 202 len: 0 microversion: 2.1 time: 0.089311 Oct 04 19:54:48.850631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4268/8563] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 4 19:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1939910074 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:54:48.876464 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-51b53bac-46a0-40ce-b1ef-e319e6ef4c84 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'create', calling method: .version_select at 0x7f900833d8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-419307341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoy6UySdt3+wLkQuVEue/tXsxHxa8O7HHgW2+rAUItFlDI5oGx3lG+n/j8ai6YRNVJIl3YI0tfQKBAMitMB/hexuP7W1M9QC99EudW7w59zfjG7jIIVpSCGMIMQA1lw3Q=="}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:54:48.892866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-51b53bac-46a0-40ce-b1ef-e319e6ef4c84 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for project 50f5827ff0724bcb87bd31a73d374180. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:54:48.898064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-51b53bac-46a0-40ce-b1ef-e319e6ef4c84 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for user 7dad49266dd84065b68e3a9060bd732d and project 50f5827ff0724bcb87bd31a73d374180. Resources: {'key_pairs'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:54:48.992640 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-51b53bac-46a0-40ce-b1ef-e319e6ef4c84 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.120665 Oct 04 19:54:48.993240 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4296/8564] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 19:54:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:55:17.810124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:17.810902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:17.814806 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-291641752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-419307341", "security_groups": [{"name": "tempest-secgroup-smoke-863260755"}], "networks": [{"uuid": "55a68a6a-0c4f-4c4a-9f5e-16fa180bddcf"}], "block_device_mapping_v2": [{"uuid": "6ec263d1-0cd8-47aa-85f5-e8200d283ba1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:18.013964 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] validate_networks() for [('55a68a6a-0c4f-4c4a-9f5e-16fa180bddcf', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:55:18.388276 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:55:18.388722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:55:18.389222 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:55:18.389654 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:55:18.390080 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:55:18.399786 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:18.400283 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:18.400736 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:18.401476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:18.401945 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:18.402387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:18.421243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for project 50f5827ff0724bcb87bd31a73d374180. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:55:18.426707 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Getting quotas for user 7dad49266dd84065b68e3a9060bd732d and project 50f5827ff0724bcb87bd31a73d374180. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:55:18.485316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:55:18.487526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ec263d1-0cd8-47aa-85f5-e8200d283ba1',volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:55:18.919612 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-fdc8d6a9-dcf6-4e12-896f-13ff1e17207d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.111192 Oct 04 19:55:18.920700 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4269/8565] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 19:55:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:55:18.936317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-feb61967-71bd-46fb-882e-ffbecf72d817 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:18.936989 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-feb61967-71bd-46fb-882e-ffbecf72d817 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:18.939854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=12 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:18.940625 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=4 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:18.941310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:19.134170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-feb61967-71bd-46fb-882e-ffbecf72d817 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:19.143034 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-feb61967-71bd-46fb-882e-ffbecf72d817 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1087 microversion: 2.1 time: 0.211504 Oct 04 19:55:19.143637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4297/8566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:18 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1087 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:20.171695 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:20.172766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:20.183431 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:20.184368 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:20.185204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:20.186374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:20.187055 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:20.187673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:20.249501 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:20.257818 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d385fdc7-8596-4e4f-bdb6-0eb3f7f9fd49 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1137 microversion: 2.1 time: 0.094914 Oct 04 19:55:20.258384 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4270/8567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:20 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:21.280813 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:21.281429 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:21.288575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.289064 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.289512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.290204 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:21.290866 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:21.291354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:21.361241 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:21.370107 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0db0d1ff-af8b-434e-a2d3-20aee037234d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1203 microversion: 2.1 time: 0.093299 Oct 04 19:55:21.370999 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4298/8568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:21 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1203 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:55:22.397710 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:22.398946 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:22.407841 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:22.409116 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:22.413559 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:22.415224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:22.416366 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:22.417823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:22.595028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:22.605844 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-477ff5f8-ed2e-4b10-b4b0-c579c3d08a0e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1270 microversion: 2.1 time: 0.214687 Oct 04 19:55:22.606704 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4271/8569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:22 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:22.945197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:22.959055 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:22.974666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:22.974666 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:22.975394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] Creating event network-changed:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h2-833090-21 Oct 04 19:55:22.984395 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-25d27841-aecc-47ac-8de5-c8cc016759d3 req-82c68156-0099-425f-8ebd-fe0336be3710 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054048 Oct 04 19:55:22.985197 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4299/8570] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:55:23.631280 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:23.636387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:23.638723 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:23.639445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:23.639949 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:23.640659 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:23.641136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:23.641578 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:23.779387 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:23.788041 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f4d4723a-f702-46e2-a63d-f2b2b5d3c6b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1270 microversion: 2.1 time: 0.161951 Oct 04 19:55:23.788630 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4272/8571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:23 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:24.812773 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:24.813512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:24.821017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:24.821513 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:24.821954 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:24.822656 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:24.823116 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:24.823578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:24.958970 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:24.967353 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e221347-f050-452d-88c4-8587e161eb68 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1270 microversion: 2.1 time: 0.159740 Oct 04 19:55:24.968101 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4300/8572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:24 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:25.990507 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:25.991129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:25.998071 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:25.998561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:25.999009 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:25.999737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:26.000203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:26.000640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:26.140683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:26.149127 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ca3bcf94-7a2f-4edb-a337-8478c2af1c88 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1270 microversion: 2.1 time: 0.162535 Oct 04 19:55:26.149713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4273/8573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:25 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:27.173129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:27.174248 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:27.181198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:27.181683 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:27.182124 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:27.182838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:27.183278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:27.183733 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:27.314807 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:27.322662 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a474ee77-2b3c-4e6c-ad0e-eb4efef000a7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.153472 Oct 04 19:55:27.323242 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4301/8574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:27 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:28.346665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:28.347289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:28.354204 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:28.354698 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:28.355147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:28.355873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:28.356341 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:28.356776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:28.408699 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:28.435456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:28.489714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:28.497448 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ae351b01-2b82-4955-9ab4-96035ddc8b6f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.155216 Oct 04 19:55:28.498027 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4274/8575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:28 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:29.522543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:29.523162 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:29.526999 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:55:29.531873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:29.532359 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:29.532840 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:29.534058 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:29.534519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:29.534946 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:29.664071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:29.672181 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-22814249-b0ce-4755-a4ef-6ef05eaf897e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.153512 Oct 04 19:55:29.672766 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4302/8576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:29 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:30.694791 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:30.695424 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:30.702367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:30.705450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:30.705450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:30.705450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:30.705450 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:30.705908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:30.833146 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:30.840918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-407a4035-08f9-4193-b842-db0058228fe4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.150140 Oct 04 19:55:30.841496 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4275/8577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:30 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:31.863481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:31.864078 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:31.871310 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:31.871829 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:31.872269 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:31.872958 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:31.873411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:31.873835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:32.012086 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:32.020731 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-121e4e5d-c2a0-4fda-b697-169922de4261 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.161192 Oct 04 19:55:32.021333 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4303/8578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:31 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:33.044561 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:33.045230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:33.053186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:33.053690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:33.054144 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:33.054853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:33.055324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:33.055800 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:33.189160 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:33.196982 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a1c7eeb5-7d61-4944-b762-74f5eb7c86e0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.156657 Oct 04 19:55:33.197558 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4276/8579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:33 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:34.220170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:34.221420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:34.228494 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:34.228980 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:34.229422 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:34.230146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:34.231488 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:34.232307 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:34.367953 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:34.375803 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3eb59024-0c31-4310-9a0c-9b95080d1865 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.159489 Oct 04 19:55:34.376388 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4304/8580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:34 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:35.399203 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:35.399792 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:35.406600 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:35.407090 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:35.407564 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:35.408262 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:35.408751 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:35.409186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:35.542762 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:35.551056 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-570affdf-75e7-40c7-b385-225fa11dd84b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.155839 Oct 04 19:55:35.551683 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4277/8581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:35 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:36.577338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:36.577955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:36.585525 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:36.586011 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:36.586449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:36.587147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:36.587642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:36.588073 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:36.729933 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:36.737637 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-17a75c16-f718-45a8-baf5-b7c4f36583f2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.164172 Oct 04 19:55:36.738217 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4305/8582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:36 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:37.760814 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:37.761449 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:37.768396 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:37.768903 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:37.769358 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:37.770112 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:37.770588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:37.771035 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:37.920472 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "name": "network-vif-plugged", "status": "completed", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:37.921037 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:37.921037 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-78185529-1e69-472c-a815-a14c6b790b9b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.163182 Oct 04 19:55:37.921262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:37.921262 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:37.921455 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4278/8583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:37 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:37.921560 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:37.932773 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] Creating event network-vif-plugged:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h2-833090-21 Oct 04 19:55:37.937829 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-67b23900-e1d8-4292-9ac7-b7523c848517 req-10af3df8-a92b-4344-86ae-6b56ce2b164e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085826 Oct 04 19:55:37.938410 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4306/8584] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:55:38.944372 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:38.945004 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:38.952198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:38.969012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:38.969012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:38.969012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:38.969012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:38.969012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:39.089022 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:39.096758 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-5c834ddd-c0f9-4224-b38b-dd8fef6aabfe tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1258 microversion: 2.1 time: 0.156785 Oct 04 19:55:39.097344 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4279/8585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:38 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:40.121827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:40.122453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:40.128676 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.129154 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.129587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:40.130268 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.130716 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.131136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:40.261317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:40.269812 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-84cc3b24-b125-4259-9441-16d1b022a301 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1441 microversion: 2.1 time: 0.153309 Oct 04 19:55:40.270395 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4307/8586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:40 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:40.292604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:55:40.293238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:55:40.300148 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.300653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.301106 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:40.301815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:40.302312 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:40.302760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:40.434660 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:55:40.442976 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-99d69a7f-11a6-4330-aa76-deb1fec9f0e7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1441 microversion: 2.1 time: 0.154475 Oct 04 19:55:40.443569 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4280/8587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:55:40 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:55:42.434363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:55:42.445579 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:55:42.446143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:55:42.446645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:55:42.458224 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] Creating event network-changed:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h2-833090-21 Oct 04 19:55:42.463361 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-c191db07-2197-4f43-9ccc-d86ae7c605fc req-fdab20b8-321a-478a-af4c-defc2d9ca31a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Oct 04 19:55:42.464282 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4308/8588] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:58:08.446177 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:58:08.447416 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:58:08.448042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:08.448844 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=68 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:08.450069 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:58:08.450212 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action (ip 10.222.0.40) !!! Oct 04 19:58:08.452318 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:58:08.452456 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 19:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action (ip 10.222.0.40) !!! Oct 04 19:58:08.459201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:08.459768 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:08.468113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:08.474411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:08.474411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:08.474411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:08.474411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:08.474411 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:08.493815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.objects.instance [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lazy-loading 'flavor' on Instance uuid 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 {{(pid=123886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:58:08.798918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c2c761fc-6834-4edb-8cf3-b9875b6dc17d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.354123 Oct 04 19:58:08.799705 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4281/8589] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:58:08 2022] POST /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:58:08.805983 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:08.806806 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:08.807399 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=26 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:08.808201 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=54 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:08.809235 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:58:08.809387 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 (ip 10.222.0.40) !!! Oct 04 19:58:08.810962 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:58:08.811100 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 19:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 (ip 10.222.0.40) !!! Oct 04 19:58:08.819018 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:08.825115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:08.833193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:08.833680 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:08.834122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:08.834822 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:08.835282 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:08.835737 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:08.975702 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:08.983432 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3ce0c6ae-0228-44bf-8908-9cf75c50f298 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.179316 Oct 04 19:58:08.984025 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4309/8590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:08 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:10.009086 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:10.009823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:10.018349 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:10.018857 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:10.019310 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:10.020054 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:10.020526 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:10.020965 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:10.028493 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49220. Oct 04 19:58:10.029211 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49222. Oct 04 19:58:10.157232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:10.165788 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a837fa60-bf5b-4dbf-b033-2f25695767d0 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.162187 Oct 04 19:58:10.166370 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4282/8591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:10 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:11.189897 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:11.190499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:11.201498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:11.201987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:11.202428 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:11.203113 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:11.203595 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:11.204020 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:11.210743 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49228. Oct 04 19:58:11.211557 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49230. Oct 04 19:58:11.343765 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:11.351526 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-bc72b2d6-d2ee-452f-af53-a3c326900167 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.165525 Oct 04 19:58:11.352126 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4310/8592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:11 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:12.375497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:12.376202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:12.383072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:12.383604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:12.384062 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:12.384766 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:12.385238 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:12.385683 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:12.518333 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:12.526067 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9889d75e-b47f-43a4-9f76-2acb66166282 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.154626 Oct 04 19:58:12.526631 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4283/8593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:12 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:13.550839 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:13.551543 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:13.558554 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:13.559039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:13.559498 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:13.560245 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:13.560704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:13.561130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:13.760131 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:13.768142 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5b652062-e0ef-43b2-a5b6-40102512e570 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.221726 Oct 04 19:58:13.768731 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4311/8594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:13 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:14.792549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:14.793177 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:14.800906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:14.801414 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:14.801867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:14.802565 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:14.803038 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:14.803497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:14.936355 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:14.944773 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-56781d34-de12-4c6b-a84d-b8e9d7ced38b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.156122 Oct 04 19:58:14.945364 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4284/8595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:14 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:15.968696 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:15.969320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:15.977686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:15.978171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:15.978612 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:15.979308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:15.979803 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:15.980237 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:16.112344 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:16.120113 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c235ed67-39b9-4a74-a879-c43ac52a50b6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.155380 Oct 04 19:58:16.120704 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4312/8596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:15 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:17.144589 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:17.145193 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:17.152087 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:17.152570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:17.153023 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:17.153715 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:17.154229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:17.154655 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:17.288237 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:17.296061 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a9ae0f36-cbff-4779-ae1e-9e754bb92738 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.155907 Oct 04 19:58:17.296632 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4285/8597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:17 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:18.319189 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:18.319767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:18.326538 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:18.327016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:18.327448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:18.328148 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:18.328599 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:18.329045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:18.457127 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:18.464933 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a931dc53-9ad5-40c1-af9b-15c20c8ddd8b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.149758 Oct 04 19:58:18.465506 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4313/8598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:18 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:19.488216 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:19.488843 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:19.495787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:19.496288 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:19.496737 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:19.497440 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:19.497908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:19.498350 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:19.647068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:19.656699 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-ea08f361-0665-43b8-8cdc-7db1c18c24ce tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.172265 Oct 04 19:58:19.657291 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4286/8599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:19 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:20.680598 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:20.681217 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:20.688531 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:20.689550 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:20.689996 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:20.690693 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:20.691151 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:20.691606 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:20.824900 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:20.832777 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-63511b16-13e4-4c31-86a2-a6ac37106176 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.156096 Oct 04 19:58:20.833357 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4314/8600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:20 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:58:21.856834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:21.857460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:21.864433 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:21.864934 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:21.865388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:21.866095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:21.866573 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:21.867014 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:22.003340 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:22.011278 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-57e03630-f69b-4c4a-818c-7c13d46d3622 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.158360 Oct 04 19:58:22.011883 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4287/8601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:21 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:23.039987 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:23.040580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:23.047535 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:23.048015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:23.053450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:23.053450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:23.053450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:23.053450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:23.187202 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:23.195942 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-464d01e3-afcd-4592-913b-5ab4102f3b44 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.160166 Oct 04 19:58:23.196542 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4315/8602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:23 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:24.220374 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:24.220908 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:24.228588 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.229974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.229974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.230273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.230725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.231163 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.361551 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:24.369727 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-910fea74-7168-4d37-ad44-c53286004cd9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1507 microversion: 2.1 time: 0.153601 Oct 04 19:58:24.370299 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4288/8603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:24 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:58:24.393161 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:24.394177 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:24.401411 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.401905 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.402345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.403040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.403524 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.403992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.492685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=123887) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:58:24.535109 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "name": "network-vif-unplugged", "status": "completed", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:24.544885 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.545381 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.545834 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.560111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.compute.server_external_events [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] Unable to find a host for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77. Dropping event network-vif-unplugged {{(pid=123886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:58:24.561006 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-4629f346-dbb8-4d1f-b581-15e1566c9c08 req-f5fe5762-8fdf-4663-8d63-96061e0375e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030155 Oct 04 19:58:24.561677 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4289/8604] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 19:58:24.834520 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0a253c03-0749-405d-8916-9e16be71fbac tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "POST /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.445531 Oct 04 19:58:24.835165 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4316/8605] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 19:58:24 2022] POST /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:58:24.843232 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:24.844058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:24.850958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.851969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.851969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:24.852657 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:24.853134 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:24.853579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:25.260848 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:25.269055 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-602d17e8-199d-417b-b37a-8ea0eb1d872d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1515 microversion: 2.1 time: 0.429210 Oct 04 19:58:25.269635 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4290/8606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:24 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:26.294423 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:26.294962 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:26.301721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:26.302206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:26.302642 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:26.303361 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:26.303846 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:26.304271 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:26.438439 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:26.446394 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fd1be9a9-3123-4dc9-b449-7ddc9b610f48 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1517 microversion: 2.1 time: 0.156882 Oct 04 19:58:26.446980 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4317/8607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:26 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:27.469974 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:27.470610 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:27.478693 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:27.479209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:27.479725 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:27.480453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:27.480957 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:27.481419 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:27.617591 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:27.625384 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b2c4c8a5-0f25-42a4-84f7-51701c3f861b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1517 microversion: 2.1 time: 0.159446 Oct 04 19:58:27.625953 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4291/8608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:27 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:28.651529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:28.651529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:28.656652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:28.657130 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:28.657561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:28.658247 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:28.658697 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:28.659115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:28.791863 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:28.800690 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2e04da81-02fc-47cd-8534-4b29d3bbf810 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1517 microversion: 2.1 time: 0.154713 Oct 04 19:58:28.801280 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4318/8609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:28 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:29.824665 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:29.825477 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:29.832872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:29.833371 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:29.833823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:29.834643 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:29.835121 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:29.835729 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:29.970537 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:29.979207 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0d44a968-cc38-4969-b514-a0c9a5f49e69 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1517 microversion: 2.1 time: 0.158548 Oct 04 19:58:29.979798 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4292/8610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:29 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:31.005624 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:31.006251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:31.013352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:31.013891 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:31.014335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:31.015032 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:31.015515 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:31.015949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:31.146448 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:31.155039 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-de7257cd-8d1a-4a55-b26f-c2983ecee3d9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1517 microversion: 2.1 time: 0.153676 Oct 04 19:58:31.155975 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4319/8611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:30 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:32.180088 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:32.180919 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:32.188284 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:32.188788 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:32.189240 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:32.189959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:32.190430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:32.190900 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:32.403882 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:32.411918 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-65579411-c629-4f3e-a160-dc0fcab0ad4f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.235712 Oct 04 19:58:32.412479 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4293/8612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:32 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:33.435645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:33.436293 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:33.443313 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.443831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.444273 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.444967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.445424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.445854 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.531487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:33.543012 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:33.543823 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:33.544334 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:33.559751 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] Creating event network-changed:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h1-833090-21 Oct 04 19:58:33.565210 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-02e3636a-334d-4427-a600-aa162cb3a53e req-cd076c7b-4776-487e-b585-1bf5e26ee9e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037836 Oct 04 19:58:33.566268 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4294/8613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:58:33.598059 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:33.606939 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-5c26b3be-e5c7-48f4-854d-70cc8bceedf4 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.174817 Oct 04 19:58:33.607785 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4320/8614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:33 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:34.632174 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:34.632955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:34.639323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:34.639863 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:34.640363 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:34.641137 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:34.641615 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:34.642064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:34.856666 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:34.865133 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0244fab0-25b5-4b52-90fc-dd2eb72eba0f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.238149 Oct 04 19:58:34.865713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4295/8615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:34 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:35.890122 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:35.890701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:35.897655 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:35.898142 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:35.898587 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:35.899277 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:35.899767 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:35.900198 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:36.032143 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:36.038168 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a11680ad-9619-4d4f-8ce0-04e69a77c02e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.152043 Oct 04 19:58:36.038756 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4321/8616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:35 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:37.062201 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:37.062832 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:37.070592 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:37.071621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:37.071621 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:37.072611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:37.073092 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:37.073540 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:37.213676 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:37.217389 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:37.221895 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2a5ac1f6-94a3-47a3-8521-e62153fb3aa9 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.163591 Oct 04 19:58:37.222468 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4296/8617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:37 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:38.246368 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:38.246910 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:38.254371 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.254860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.255299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.256024 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:38.256484 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:38.256909 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:38.975711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:38.977949 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:38.984058 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-0abdadfd-4243-4d94-a09a-55de7a43ddb1 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.742889 Oct 04 19:58:38.984632 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4322/8618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:38 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:40.012078 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:40.012704 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:40.015534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=35 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:40.021856 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.022348 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.022795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.023522 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:40.023994 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:40.030879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:40.158113 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:40.166045 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-20168da3-f2f3-4cc0-88e0-4461c7e5d43a tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.158290 Oct 04 19:58:40.166623 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4297/8619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:40 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:41.191181 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:41.191827 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:41.194610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:58:41.199686 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.200175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.200645 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.201337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:41.201792 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:41.202220 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:41.333347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:41.341110 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-04ea9445-3451-4637-8be6-17cd95d0d35b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.154291 Oct 04 19:58:41.341685 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4323/8620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:41 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:42.365180 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:42.365818 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:42.372633 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:42.373132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:42.373585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:42.374286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:42.374760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:42.375202 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:42.508738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:42.516499 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-baee4066-ddb2-41d3-9815-af8192d62d21 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.155408 Oct 04 19:58:42.517078 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4298/8621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:42 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:43.541335 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:43.541951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:43.548816 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:43.549303 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:43.550354 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:43.550481 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:43.550862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:43.551885 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:43.688108 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:43.696097 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-f3211847-8f79-4b61-a537-ff7565f23b06 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.158660 Oct 04 19:58:43.706339 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4324/8622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:43 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:44.720499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:44.721135 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:44.728738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:44.729243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:44.729700 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:44.730407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:44.730884 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:44.735714 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:44.865289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:44.873002 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2dc21492-00ee-4cf6-b8cf-b259c697a7e8 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.156809 Oct 04 19:58:44.873571 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4299/8623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:44 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:45.788341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "name": "network-vif-plugged", "status": "completed", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:58:45.799415 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:45.800026 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:45.800442 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:45.812635 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] Creating event network-vif-plugged:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h1-833090-21 Oct 04 19:58:45.816191 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] [72301689-fadb-4609-8d58-10a4a0542375] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:58:45.896911 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:45.897542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:45.904733 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:45.905236 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:45.905711 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:45.906407 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:45.906881 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:45.907323 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:46.042228 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:46.050340 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-34577a32-9839-4dfc-be2f-96703a59b39d tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.157794 Oct 04 19:58:46.050852 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4300/8624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:45 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:58:46.822847 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] [72301689-fadb-4609-8d58-10a4a0542375] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49320. Oct 04 19:58:46.826475 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-65605039-5cf3-44e8-8dd9-9ec15e9ca249 req-270d0d57-3b8f-4528-ba07-951b1a949539 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.042792 Oct 04 19:58:46.827237 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4325/8625] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 19:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:58:47.074959 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:47.075552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:47.082771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:47.083269 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:47.083776 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:47.084476 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:47.084948 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:47.085391 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:47.218220 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:47.226425 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-f6aaa126-d587-48f7-ae8a-9502b6cc4e5f tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.155433 Oct 04 19:58:47.227001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4301/8626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:47 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:48.251356 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:48.252016 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:48.261815 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:48.262317 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:48.262747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:48.263441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:48.263926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:48.272665 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:48.402178 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:48.410040 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e06c1e90-f4d1-412f-80ce-f4ed907a401c tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1573 microversion: 2.1 time: 0.163894 Oct 04 19:58:48.411433 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4326/8627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:48 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:58:49.434541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:58:49.435108 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:58:49.444741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:49.445247 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:49.445697 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:49.446706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:58:49.447178 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:58:49.447646 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:58:49.585658 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:58:49.593404 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-2db4a165-6cf1-47a1-a24e-2b5d598a69e6 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1560 microversion: 2.1 time: 0.162915 Oct 04 19:58:49.594001 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4302/8628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 19:58:49 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:38.583490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=7 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:38.585081 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=21 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:38.587929 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=11 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:38.589068 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=36 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:00:38.589968 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:00:38.590105 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 20:00:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 04 20:00:38.591170 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:38.591721 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:38.598791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:38.599286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:38.599763 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:38.600532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:38.601353 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:38.601508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:38.629030 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:00:38.804000 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:38.814624 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:38.815120 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:38.815605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:38.826946 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] Creating event network-changed:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h1-833090-21 Oct 04 20:00:38.832307 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-68b6ece1-3546-45a3-b681-a03b99f65d00 req-8e363913-29de-4be0-96f6-b9f55a57c861 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246179 Oct 04 20:00:38.832898 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4303/8629] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:00:38.910376 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e64f1ed2-3dbe-4866-a1c4-46976ef3365e tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "DELETE /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 204 len: 0 microversion: 2.1 time: 0.328853 Oct 04 20:00:38.911595 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4327/8630] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 20:00:38 2022] DELETE /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:00:38.923984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:38.923984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:38.930541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:38.931296 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:38.931954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:38.933639 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:38.934281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:38.934891 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:39.141305 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:39.149232 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d892d957-65eb-4503-8517-5ddf2dc57a47 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.233287 Oct 04 20:00:39.149809 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4304/8631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:38 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:40.174988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:40.175743 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:40.183764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:40.184251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:40.184691 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:40.185413 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:40.185872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:40.186302 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:40.460774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:40.468816 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-8ef86d4a-e1a6-47f9-b12f-d56533c5f011 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1566 microversion: 2.1 time: 0.298177 Oct 04 20:00:40.469426 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4328/8632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:40 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:41.359020 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592a70bd-7b9f-4f4a-85c3-92c93aa5fb77", "name": "network-vif-deleted", "tag": "708b5ccb-f504-45ec-a151-47a83e757175"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:00:41.369013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:41.371013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:41.371013 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:41.380842 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] Creating event network-vif-deleted:708b5ccb-f504-45ec-a151-47a83e757175 for instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 on n-h1-833090-21 Oct 04 20:00:41.386157 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-fb840cc4-023d-4767-a422-f2453468bb2c req-0a9505cd-6055-4114-bd8b-27821168450c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Oct 04 20:00:41.386763 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4305/8633] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:00:41.493341 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:41.503043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:41.503043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:41.503043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:41.503043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:41.503043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:41.503748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:41.503748 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:41.570675 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:41.578863 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fbf178d4-0d2d-4d62-a3a2-575fa762381b tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1380 microversion: 2.1 time: 0.089775 Oct 04 20:00:41.584172 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4329/8634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:41 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:42.603997 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:42.604989 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:42.611598 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:42.612111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:42.612570 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:42.613295 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:42.613772 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:42.614218 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:42.762028 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:42.770176 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1341c8ed-4186-40ca-adc6-2499038408eb tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1218 microversion: 2.1 time: 0.171599 Oct 04 20:00:42.770871 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4306/8635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:42 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:43.795200 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:43.795988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:43.802986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:43.803512 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:43.803961 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:43.804660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:43.805136 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:43.805545 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:43.868711 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:43.877229 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-edb448f5-d54f-4f18-9ad3-ff805944c134 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1218 microversion: 2.1 time: 0.086611 Oct 04 20:00:43.877898 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4330/8636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:43 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:44.901165 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:44.901798 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:44.909790 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:44.910292 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:44.910748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:44.911456 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:44.911954 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:44.912402 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:44.978497 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:44.987240 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ebdf610-e2b2-43c7-a336-55d434832480 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1218 microversion: 2.1 time: 0.090030 Oct 04 20:00:44.987853 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4307/8637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:44 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:46.012019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:46.012632 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:46.019499 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:46.019985 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:46.020426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:46.021126 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:46.021583 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:46.022028 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:46.085320 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dad49266dd84065b68e3a9060bd732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f5827ff0724bcb87bd31a73d374180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:00:46.093442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e8482bc9-40bc-4cac-a207-c835f3c04ae2 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 200 len: 1218 microversion: 2.1 time: 0.086001 Oct 04 20:00:46.094029 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4331/8638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:46 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:00:47.116593 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:47.117229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] [instance: 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:00:47.124595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:47.125111 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:47.125602 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:47.126384 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:00:47.126888 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:00:47.127367 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:00:47.142408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] HTTP exception thrown: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Request method failure captured: Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 HTTP/1.1 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPI5YKdhrTNEHGt2MYQxRAff_lG4JN-x4qqa8-zrxW00lB4OuQI0xYjJtVtKuPNU3X2yME8I5stdhQE5LVa1D2P6Y1gmuC6Ehlk4qQ5nVkbSDNotEueLrVi7Bvfo7QFggmdJL6oNDKHUCLyymKnJegJEHMt_-nW5kgNIoOEJmkyMOdNA Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 50f5827ff0724bcb87bd31a73d374180 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestShelveInstance-357074834 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/50f5827ff0724bcb87bd31a73d374180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/50f5827ff0724bcb87bd31a73d374180"}]}] Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestShelveInstance-357074834 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 50f5827ff0724bcb87bd31a73d374180 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestShelveInstance-357074834 Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestShelveInstance-357074834-project Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: 7dad49266dd84065b68e3a9060bd732d Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestShelveInstance-357074834-project Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '592a70bd-7b9f-4f4a-85c3-92c93aa5fb77'} Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:00:47.144286 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Returning 404 to user: Instance 592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cfcb816b-509c-45a3-9901-0691794ba084 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77" status: 404 len: 111 microversion: 2.1 time: 0.033061 Oct 04 20:00:47.149637 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4308/8639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:00:47 2022] GET /compute/v2.1/servers/592a70bd-7b9f-4f4a-85c3-92c93aa5fb77 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:00:47.381324 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-c56982c4-b0eb-45a3-aef2-36874f169bb7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] Calling method '.version_select at 0x7f90096495e0>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:00:47.485508 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-c56982c4-b0eb-45a3-aef2-36874f169bb7 tempest-TestShelveInstance-357074834 tempest-TestShelveInstance-357074834-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-419307341" status: 202 len: 0 microversion: 2.1 time: 0.108192 Oct 04 20:00:47.486115 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4332/8640] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 4 20:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-419307341 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:01:09.182628 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=12 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:09.183394 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=24 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:09.381969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Action: 'create', calling method: .version_select at 0x7f900076cf70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1269233147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyIJrnBnqjLaiBk+xQYs7IQTIpic4BqfZr0CLxfYBytYw2ikgcmgpNKVzzDWDLrRvMj45bWkW9Xk8PbxOt/cXi3uXdzXpcC3Aqms2KS2XuLPzmjj8iM26Oc3csPOyw61g=="}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:09.399487 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:01:09.405502 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for user df6fa735ea6847d8911a8492838d160e and project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'key_pairs'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:01:09.421297 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [2486dde6-bef4-4f1f-9970-a457178f7981] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:01:10.428932 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [2486dde6-bef4-4f1f-9970-a457178f7981] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49528. Oct 04 20:01:10.513575 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-a3e00afa-47dd-478d-915f-ced93c3539fc tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.337166 Oct 04 20:01:10.514218 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4309/8641] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 4 20:01:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:13.109838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:13.110613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:13.114633 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-531043274", "imageRef": "60bf0052-3cfd-47a4-b26a-71b79179cfa6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1269233147", "security_groups": [{"name": "tempest-secgroup-smoke-1076685355"}], "networks": [{"uuid": "9cd464e6-6161-4539-a529-775d5fee4845"}]}} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:13.223365 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.network.neutron [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] validate_networks() for [('9cd464e6-6161-4539-a529-775d5fee4845', None, None, None, None, None)] {{(pid=123887) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:01:13.596176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Flavor limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:01:13.596597 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Image limits 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:01:13.597072 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Flavor pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:01:13.597482 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Image pref 0:0:0 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:01:13.597895 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.virt.hardware [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123887) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:01:13.607331 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:13.607842 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:13.608283 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:13.609008 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:13.609463 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:13.609888 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:13.629825 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:01:13.635225 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.quota [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for user df6fa735ea6847d8911a8492838d160e and project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'instances', 'ram', 'cores'} {{(pid=123887) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:01:13.647611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Going to run 1 instances... {{(pid=123887) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:01:13.649920 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60bf0052-3cfd-47a4-b26a-71b79179cfa6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123887) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:01:13.792552 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:01:14.800372 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [1c701fcb-64e1-4d63-bce2-a3296ff2122d] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49562. Oct 04 20:01:14.814199 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-fe8c61a7-7555-435a-9dc5-ffd95b1204ca tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.706239 Oct 04 20:01:14.814860 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4333/8642] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 20:01:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:01:14.827322 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-04badab9-dc90-4f85-b17e-15eeb90219e0 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:14.827998 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-04badab9-dc90-4f85-b17e-15eeb90219e0 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:14.884129 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-04badab9-dc90-4f85-b17e-15eeb90219e0 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:14.891315 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-04badab9-dc90-4f85-b17e-15eeb90219e0 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1248 microversion: 2.1 time: 0.068816 Oct 04 20:01:14.892022 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4310/8643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:14 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:15.915299 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2b6d0076-a694-4e79-bc3c-c5395a94967c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:15.915984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2b6d0076-a694-4e79-bc3c-c5395a94967c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:15.975623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2b6d0076-a694-4e79-bc3c-c5395a94967c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:15.983543 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2b6d0076-a694-4e79-bc3c-c5395a94967c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1248 microversion: 2.1 time: 0.073106 Oct 04 20:01:15.984131 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4334/8644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:15 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1248 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:17.006229 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:17.006872 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:17.015273 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:17.015824 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:17.020865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:17.020865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:17.020865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:17.020865 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:17.083641 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:17.092392 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-42b9ac02-0988-46d6-8b58-0f68bbf1e1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1300 microversion: 2.1 time: 0.090020 Oct 04 20:01:17.092980 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4311/8645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:17 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:18.115883 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:18.116489 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:18.124255 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:18.124745 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:18.125179 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:18.125882 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:18.126338 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:18.126760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:18.281416 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:18.289406 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-87e82f78-d8c3-4da5-a896-4a8ce6fbf3fa tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.177565 Oct 04 20:01:18.289984 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4335/8646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:18 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:19.138853 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:19.147924 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:19.148417 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:19.148864 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:19.163328 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] Creating event network-changed:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:01:19.165597 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-3b1ecdd3-98c7-4b68-815a-9ecb07a6715d req-fda910d5-65e9-4679-a89c-b7124c731d0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086406 Oct 04 20:01:19.166168 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4312/8647] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:19.313288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:19.314427 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:19.321784 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:19.322339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:19.322790 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:19.323518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:19.323986 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:19.324420 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:19.536352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:19.544112 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e16f444a-75dd-4b3f-bac3-d71d368ab356 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.234865 Oct 04 20:01:19.544719 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4336/8648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:19 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:20.569503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:20.570212 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:20.576555 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:20.577049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:20.577494 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:20.578186 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:20.578656 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:20.579095 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:20.710579 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:20.719316 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-98e17a58-764c-458d-a011-214a429e30a4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.154969 Oct 04 20:01:20.720087 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4313/8649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:20 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:21.742873 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:21.743500 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:21.750528 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:21.751015 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:21.751450 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:21.752167 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:21.752623 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:21.753049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:21.886823 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:21.894528 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4d7616f8-9673-4370-bafd-245e4e8c69d2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.155642 Oct 04 20:01:21.895134 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4337/8650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:21 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:22.918795 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:22.920042 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:22.927048 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:22.927605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:22.928064 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:22.928777 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:22.929252 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:22.929696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:23.070577 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:23.078884 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cd740192-aeff-4a08-b1ae-2f9bfa8e1ea2 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.164064 Oct 04 20:01:23.079482 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4314/8651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:22 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:24.102091 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:24.102764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:24.105519 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:24.111585 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:24.112146 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:24.112592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:24.113308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:24.113774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:24.114207 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:24.244994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:24.252830 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7abb5555-f827-4bb4-b01d-fae2c4d34fe1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.154625 Oct 04 20:01:24.253405 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4338/8652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:24 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:25.275677 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:25.276313 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:25.279210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:25.284356 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:25.289311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:25.289311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:25.289311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:25.289311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:25.289311 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:25.422690 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:25.430459 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-cb73144b-e649-43b2-ae36-a7f11a8d7b45 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.158675 Oct 04 20:01:25.431045 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4315/8653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:25 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:26.453984 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:26.454634 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:26.457314 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=8 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:01:26.462234 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:26.467193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:26.467193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:26.467193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:26.467193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:26.467193 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:26.598768 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:26.612678 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-2cc4dbbf-6b8d-4fab-9b95-e8019b933c14 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.162492 Oct 04 20:01:26.613275 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4339/8654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:26 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:27.637043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:27.637043 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:27.643175 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:27.643687 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:27.644117 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:27.644812 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:27.645261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:27.645685 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:27.658939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "name": "network-vif-plugged", "status": "completed", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:27.668663 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:27.669688 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:27.670132 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:27.681854 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] Creating event network-vif-plugged:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:01:27.688587 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a4016bf6-4ec7-46e0-a0ff-838633bf5681 req-974d9e5b-92e2-4341-a36a-b29290a0be6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081928 Oct 04 20:01:27.689402 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4316/8655] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:01:27.802044 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:27.815169 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a7576378-1472-44df-a270-3ac70642083a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.183428 Oct 04 20:01:27.815825 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4340/8656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:27 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:01:28.839770 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:28.840499 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:28.846742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:28.847243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:28.847722 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:28.848460 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:28.848935 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:28.849379 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:28.979382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:28.987541 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-3b0ab078-9581-4c40-8bf0-7fbfd5400633 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1374 microversion: 2.1 time: 0.153027 Oct 04 20:01:28.988116 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4317/8657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:28 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:01:30.011339 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:30.011974 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:30.018965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.019449 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.019915 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.020613 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.021074 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.021506 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.456791 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:30.464599 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d7abfdac-f29b-4af9-a18f-4926b4cad3b1 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1559 microversion: 2.1 time: 0.457201 Oct 04 20:01:30.465177 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4341/8658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:30 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1559 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:30.486915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:01:30.487581 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:01:30.494470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.494966 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.495415 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.496139 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:30.496604 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:30.497681 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:30.631445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:01:30.639896 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-09bad2b9-d31f-47d0-aa5f-6ebe7258ae8c tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1559 microversion: 2.1 time: 0.156695 Oct 04 20:01:30.640517 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4318/8659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:01:30 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:01:32.922244 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:01:32.932017 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:01:32.932520 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:01:32.932948 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:01:32.944249 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] Creating event network-changed:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:01:32.949599 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-3bb59164-8a8b-4a45-baa7-6e46519bd0f7 req-8ea8ff83-a994-4d1f-8e85-5716b8dd9bad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090118 Oct 04 20:01:32.951060 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4342/8660] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:03:58.679218 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:03:58.680159 n-d-833090-21 devstack@n-api.service[123886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:03:58.680915 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.681734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=40 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:03:58.683304 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:03:58.683451 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 20:03:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8/action (ip 10.222.0.40) !!! Oct 04 20:03:58.689465 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1118507079"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:03:58.691877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:03:58.698969 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:58.709977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:58.709977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:58.709977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:03:58.709977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:03:58.709977 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:03:59.144263 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-c0918b7e-22b7-4950-abf6-eb84adb62d13 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "POST /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.466693 Oct 04 20:03:59.146101 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4319/8661] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 20:03:58 2022] POST /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:04:06.356174 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:04:06.357345 n-d-833090-21 devstack@n-api.service[123887]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 20:04:06.357993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:06.358764 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=46 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:06.359680 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:04:06.359814 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 20:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 04 20:04:06.361600 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 20:04:06.361724 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 20:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 04 20:04:06.369425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "name": "network-vif-plugged", "status": "completed", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:06.385689 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:06.386165 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:06.386592 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:06.400259 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] Creating event network-vif-plugged:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:04:06.406442 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-993c7310-ae2f-4795-8da3-dc2a1ca6c5bf req-1bc4fcfd-027c-4811-93a4-6d24bff784ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052133 Oct 04 20:04:06.407078 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4343/8662] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:20.959961 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:20.960859 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:20.965230 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-216592627", "imageRef": "3bbff701-97ae-431d-9f44-88cbb6771297", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1269233147", "security_groups": [{"name": "tempest-secgroup-smoke-1076685355"}], "networks": [{"uuid": "9cd464e6-6161-4539-a529-775d5fee4845"}]}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:20.990869 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [17b9132a-95ea-4276-9b33-ecea8442183b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49858. Oct 04 20:04:20.992113 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] [aeecc545-0719-4180-a233-b3ebf63a74c4] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49860. Oct 04 20:04:21.096470 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.network.neutron [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] validate_networks() for [('9cd464e6-6161-4539-a529-775d5fee4845', None, None, None, None, None)] {{(pid=123886) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:04:21.564678 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Flavor limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:04:21.565209 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Image limits 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:04:21.565706 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Flavor pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:04:21.566140 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Image pref 0:0:0 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:04:21.566571 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.virt.hardware [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:04:21.580861 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:21.581432 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:21.581894 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:21.582640 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:21.583118 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:21.583601 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:21.605076 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:04:21.610467 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.quota [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Getting quotas for user df6fa735ea6847d8911a8492838d160e and project 3422e5bfc6cc4bcf961fbb930a5cabb1. Resources: {'instances', 'ram', 'cores'} {{(pid=123886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:04:21.623152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Going to run 1 instances... {{(pid=123886) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:04:21.625734 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bbff701-97ae-431d-9f44-88cbb6771297',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:04:21.749121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9ef1f567-d12a-41f3-8a1d-ec36bd07b39e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791338 Oct 04 20:04:21.749854 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4320/8663] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 4 20:04:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:04:21.763459 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a0c45547-859a-48cd-8168-0e9fe110be6d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:21.764185 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a0c45547-859a-48cd-8168-0e9fe110be6d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:21.781641 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [9ec78b7f-9f92-4966-8258-5d5d6a54144b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49892. Oct 04 20:04:21.785030 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] [55bee31f-db32-4bae-893b-ce24615b900a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49894. Oct 04 20:04:21.837704 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a0c45547-859a-48cd-8168-0e9fe110be6d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:21.847013 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a0c45547-859a-48cd-8168-0e9fe110be6d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1248 microversion: 2.1 time: 0.089104 Oct 04 20:04:21.847625 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4344/8664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:21 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:22.869468 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:22.870098 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:22.877996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:22.878516 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:22.878978 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:22.879752 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:22.880219 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:22.880668 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:22.950145 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:22.958556 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1162362d-ee28-4e34-879d-05c817330315 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1252 microversion: 2.1 time: 0.093232 Oct 04 20:04:22.959287 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4321/8665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:22 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:04:23.982847 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:23.983458 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:23.993741 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:23.994224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:23.994658 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:23.995352 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:23.995830 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:23.996251 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:24.064095 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:24.072048 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-4b5e5003-5861-432e-9ce2-f1ca3abb22cb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1300 microversion: 2.1 time: 0.093183 Oct 04 20:04:24.072637 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4345/8666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:23 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:25.097235 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:25.098556 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:25.113457 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:25.125380 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:25.126198 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:25.127362 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:25.128040 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:25.128682 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:25.324549 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:25.337260 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-6ab1bb88-945f-40bb-9f12-d23814955a1b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.244895 Oct 04 20:04:25.347510 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4322/8667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:25 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:26.364049 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:26.365796 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:26.373135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:26.373754 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:26.374206 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:26.375256 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:26.375709 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:26.376191 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:26.400019 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:26.418124 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:26.418653 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:26.419767 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:26.435939 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] Creating event network-vif-unplugged:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:04:26.443558 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-a0fcebd9-3753-4ebe-b1ed-69a5d386701b req-cad6060f-a774-4747-a944-9cfae21524a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047178 Oct 04 20:04:26.448567 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4323/8668] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:26.528037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:26.543372 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-470548f5-7558-494d-9890-bf16f60bbfd7 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.183561 Oct 04 20:04:26.544358 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4346/8669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:26 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:27.577542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:27.578270 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:27.585611 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:27.586125 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:27.586572 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:27.587294 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:27.587799 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:27.588254 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:27.742874 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:27.750739 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-b012b382-6c18-40d6-8509-e4fe1d8bccfd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.178267 Oct 04 20:04:27.751361 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4324/8670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:27 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:28.776811 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:28.777424 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:28.785529 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:28.786019 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:28.786638 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:28.787358 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:28.787831 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:28.788254 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:28.941957 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:28.950735 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-e3dc5872-31e5-46ff-a5fe-df82c259bf8f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.178043 Oct 04 20:04:28.951331 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4347/8671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:28 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:29.976172 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:29.976803 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:29.984353 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:29.984877 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:29.985828 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:29.986552 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:29.987030 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:29.987496 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:30.128886 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:30.136792 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-22895dcc-e329-4301-b6ab-c897ec043b9d tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.164545 Oct 04 20:04:30.137713 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4325/8672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:29 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:31.160838 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:31.161508 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:31.168490 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:31.168992 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:31.169436 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:31.170147 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:31.170605 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:31.171037 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:31.318580 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:31.327583 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-1800b154-c2db-4d84-a130-d8c9802fd743 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.170873 Oct 04 20:04:31.328363 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4348/8673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:31 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:32.351483 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:32.352034 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:32.354835 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.355541 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell0:SELECT=6 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:32.361032 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:32.361529 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:32.368210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:32.368210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:32.368210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:32.368210 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:32.496128 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:32.504102 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-67ac728b-2b76-4fef-978c-9fd6545b2c57 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.156697 Oct 04 20:04:32.504690 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4326/8674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:32 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:33.526770 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:33.527316 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:33.535630 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell0:SELECT=2 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:04:33.535760 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:33.538835 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:33.539345 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:33.539774 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:33.542546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:33.543058 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:33.544027 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:33.544958 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:33.545317 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:33.545771 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:33.551327 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] Creating event network-changed:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:04:33.557230 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-f1b6a426-d257-4590-a3e4-45212a5e0e66 req-8f968da2-3138-4994-89ee-e141ff0479cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034411 Oct 04 20:04:33.558046 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4349/8675] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:04:33.770617 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:33.778835 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-7f23d87e-6c1d-490f-ae06-24e481a1799b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.256175 Oct 04 20:04:33.779428 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4327/8676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:33 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:34.804155 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:34.804860 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:34.811337 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:34.811862 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:34.812288 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:34.812988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:34.813487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:34.814063 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:34.949040 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:34.957820 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ae4cd739-4a1a-47a4-a314-b9dd52908176 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.159363 Oct 04 20:04:34.958414 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4350/8677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:34 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:35.981813 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:35.982478 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:35.990091 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:35.990594 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:35.991049 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:35.991787 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:35.992266 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:35.992712 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:36.122413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:36.130363 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-9cd068fe-f648-4195-8672-76123481680a tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.152553 Oct 04 20:04:36.131119 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4328/8678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:35 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:37.153931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:37.154548 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:37.161483 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:37.161971 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:37.162441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:37.163133 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:37.163620 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:37.164052 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:37.303994 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:37.311804 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-196a0fd5-fc0f-40b4-9091-d038297b4b97 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.162188 Oct 04 20:04:37.312402 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4351/8679] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:37 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:38.334984 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:38.335574 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:38.342418 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:38.342923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:38.343377 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:38.344117 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:38.345097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:38.345546 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:38.474072 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:38.481790 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-d907db17-fcf7-4fb3-b6b2-07cc54242956 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.150909 Oct 04 20:04:38.482370 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4329/8680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:38 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:39.505760 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:39.506380 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:39.513561 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:39.514046 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:39.514487 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:39.515224 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:39.515708 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:39.516138 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:39.588727 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "name": "network-vif-plugged", "status": "completed", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:39.600224 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:39.600741 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:39.601194 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:39.613334 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] Creating event network-vif-plugged:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:04:39.618509 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-c56a9126-6708-41b7-83e4-ac74417fb0d1 req-e429a172-167e-42e6-95c0-3492e41bbdf1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034585 Oct 04 20:04:39.619118 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4330/8681] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:04:39.667197 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:39.675696 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-39d0a81e-3855-4ed1-accc-e72404260a75 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.174732 Oct 04 20:04:39.676289 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4352/8682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:39 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:40.699585 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:40.700302 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:40.706538 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:40.707039 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:40.707505 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:40.708206 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:40.708671 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:40.709110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:40.846136 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:40.854121 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-def40446-55ed-4e5c-9bd5-af2f01f1c99f tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1374 microversion: 2.1 time: 0.159638 Oct 04 20:04:40.854744 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4331/8683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:40 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:41.878039 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:41.878660 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:41.885640 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:41.886129 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:41.886568 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:41.887261 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:41.887747 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:41.888176 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:42.017045 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:42.025969 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-d2c8f43a-df80-42c2-8db2-859519647b35 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1559 microversion: 2.1 time: 0.152104 Oct 04 20:04:42.026504 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4353/8684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:41 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:42.053696 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:04:42.054324 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:04:42.061335 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:42.061871 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:42.062331 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:42.063047 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:42.063560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:42.064748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:42.199279 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:04:42.207436 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-1fcc0275-a830-43ad-96c9-67c35bb3e0e8 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1559 microversion: 2.1 time: 0.157758 Oct 04 20:04:42.208056 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4332/8685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:04:42 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:04:44.427857 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:04:44.438701 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:04:44.440936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:04:44.440936 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:04:44.452344 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] Creating event network-changed:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:04:44.459240 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-711a2e4a-707d-4b23-b85e-5351d20ac3cb req-b5d99e89-5f31-419a-8056-a088754b8e90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034859 Oct 04 20:04:44.459894 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4354/8686] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:11.613503 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:11.614281 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=66 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:11.615111 n-d-833090-21 devstack@n-api.service[123886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:06:11.615256 n-d-833090-21 devstack@n-api.service[123886]: Tue Oct 4 20:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b/action (ip 10.222.0.40) !!! Oct 04 20:06:11.716110 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1188563433"}} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:11.718560 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:11.724748 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:11.725243 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:11.725691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:11.726388 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:11.726851 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:11.727289 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:12.328469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-0b8ceda2-351a-4ae4-8155-4197953bdbf4 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "POST /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b/action" status: 202 len: 0 microversion: 2.1 time: 0.716871 Oct 04 20:06:12.329131 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4333/8687] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 4 20:06:11 2022] POST /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:06:18.177779 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_api:SELECT=26 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:18.184259 n-d-833090-21 devstack@n-api.service[123887]: DEBUG dbcounter [-] [123887] Writing DB stats nova_cell1:SELECT=54 {{(pid=123887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:18.184259 n-d-833090-21 devstack@n-api.service[123887]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 20:06:18.184259 n-d-833090-21 devstack@n-api.service[123887]: Tue Oct 4 20:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 04 20:06:18.184965 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "name": "network-vif-plugged", "status": "completed", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:18.196007 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:18.196518 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:18.196931 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:18.209772 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] Creating event network-vif-plugged:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:06:18.217732 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-2d5fcf4c-415b-48e9-920e-eb6b0160120f req-d1dc84c4-67ee-4b4e-84ee-2b74c91beed1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040033 Oct 04 20:06:18.217732 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4355/8688] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:06:28.947364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_api:SELECT=2 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:28.948453 n-d-833090-21 devstack@n-api.service[123886]: DEBUG dbcounter [-] [123886] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:06:28.952691 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:28.953303 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:28.955278 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:28.959650 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:28.960321 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:28.960950 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:28.961673 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:28.962149 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:28.962595 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:28.966115 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:28.966611 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:28.967035 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:28.978776 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.compute.server_external_events [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] Creating event network-changed:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:06:28.985625 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [req-cc0a0bf2-4b61-4e08-97f3-53d695fc15fc req-160ab8fc-dabb-4413-90fa-ba69ca6743b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037667 Oct 04 20:06:28.986251 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4356/8689] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:06:28.992301 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Going to try to terminate instance {{(pid=123886) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:06:29.328362 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-abce5334-9e79-4d9d-9d45-92e1e91b60de tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 204 len: 0 microversion: 2.1 time: 0.383221 Oct 04 20:06:29.333258 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4334/8690] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 20:06:28 2022] DELETE /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:06:29.340194 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:29.340972 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:29.347347 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:29.348125 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:29.348652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:29.349426 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:29.349951 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:29.350441 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:29.557249 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:29.565540 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-033d311f-fa6d-4bf5-9f8f-2ebbce7ae1e6 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1684 microversion: 2.1 time: 0.230395 Oct 04 20:06:29.566119 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4357/8691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:29 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1684 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:30.067879 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "name": "network-vif-unplugged", "status": "completed", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:30.078425 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:30.078939 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:30.079400 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:30.090145 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] Creating event network-vif-unplugged:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:06:30.095189 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-724b2190-22de-4447-a626-c65f58a32cb8 req-315d47ab-ecbf-4164-b75f-0a0c15b001d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081134 Oct 04 20:06:30.095832 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4335/8692] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:30.588575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:30.589610 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:30.596504 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:30.596988 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:30.597425 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:30.598110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:30.598566 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:30.598993 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:30.735388 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:30.743183 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-7f9b3e7d-21ef-44e4-83d1-0225b5d67ecf tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1684 microversion: 2.1 time: 0.158678 Oct 04 20:06:30.743811 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4358/8693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:30 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:31.625300 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b", "name": "network-vif-deleted", "tag": "cc50504b-3055-49a0-88db-57f9fe161d90"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:31.634902 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:31.635979 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:31.636605 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:31.647974 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] Creating event network-vif-deleted:cc50504b-3055-49a0-88db-57f9fe161d90 for instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b on n-h1-833090-21 Oct 04 20:06:31.653136 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-992a7bd5-5c36-4fc8-8ba8-7622ef327d82 req-fc99de37-7d71-40f7-8e0b-6c6f1f7737b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Oct 04 20:06:31.659299 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4336/8694] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:31.768578 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:31.769172 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:31.776626 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:31.777110 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:31.777546 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:31.778260 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:31.778712 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:31.779135 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:31.841549 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:31.849422 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ce3a34d2-06c2-432a-ae58-349ddd22361b tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 200 len: 1333 microversion: 2.1 time: 0.085514 Oct 04 20:06:31.850079 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4359/8695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:31 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:32.875233 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:32.875996 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:32.882445 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:32.882955 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:32.883413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:32.884152 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:32.884652 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:32.885097 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:32.902570 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] HTTP exception thrown: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Request method failure captured: Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b HTTP/1.1 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPJD-jEdX1agu_gCwtuFtd94xqgJx0YDhwSWM18k8VEtDfN9gUjTIhz7xSg-DDZccr_HM5EDyhMuMW0U0HaeKq87K1i9qbbPAUSpKezqEmUjAvCSMk_l0R-NQWv0BUkJkTktbmVKLQ_B8UCNzNmiEn8lzPRSFVBH1TM0LIJfSkrlY3EI Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 3422e5bfc6cc4bcf961fbb930a5cabb1 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}] Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 3422e5bfc6cc4bcf961fbb930a5cabb1 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestSnapshotPattern-325115882-project Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: df6fa735ea6847d8911a8492838d160e Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestSnapshotPattern-325115882-project Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': 'ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b'} Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:32.904265 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Returning 404 to user: Instance ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-e1f292a2-c3da-46fb-b2ff-dd8ba4dfd1cd tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b" status: 404 len: 111 microversion: 2.1 time: 0.036228 Oct 04 20:06:32.908542 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4337/8696] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:32 2022] GET /compute/v2.1/servers/ac2beaf0-7254-4b09-bf7a-e3d62dbc1c3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:06:35.078652 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:35.079171 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:35.086462 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:35.087121 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:35.087797 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:35.088671 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:35.089139 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:35.089575 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:35.116061 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Going to try to terminate instance {{(pid=123887) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:06:35.148147 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:35.161742 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:35.162346 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:35.162873 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:35.174905 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] Creating event network-changed:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:06:35.180408 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-6d05c8a5-a43f-4c24-8446-ef0242cf21d1 req-23d1df86-0309-4e57-a830-69934b09eaae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102376 Oct 04 20:06:35.180964 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4338/8697] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:35.368476 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-3af098d1-67a3-4521-9af8-66359d90efcb tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 204 len: 0 microversion: 2.1 time: 0.294298 Oct 04 20:06:35.369090 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4360/8698] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 4 20:06:35 2022] DELETE /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:06:35.378651 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:35.379597 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:35.386293 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:35.386807 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:35.387923 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:35.388867 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:35.389338 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:35.389826 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:35.530534 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.policy [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123886) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:35.538469 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-482ad1bb-eef7-446f-a54f-602d76c2a909 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1683 microversion: 2.1 time: 0.164234 Oct 04 20:06:35.539077 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4339/8699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:35 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:36.563571 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:36.564286 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:36.571397 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:36.571926 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:36.572370 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:36.573071 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:36.573532 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:36.573967 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:36.806752 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:36.815001 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-a05bb1a5-c13b-4e46-b666-dc304bae4f6e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1565 microversion: 2.1 time: 0.256414 Oct 04 20:06:36.815544 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4361/8700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:36 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1565 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:37.216815 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8", "name": "network-vif-deleted", "tag": "e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f"}]} {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:06:37.226413 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:37.226906 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:37.227382 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:37.238946 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.compute.server_external_events [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] Creating event network-vif-deleted:e06b3a9d-b5bd-4483-bb5b-025f1fc5f30f for instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 on n-h2-833090-21 Oct 04 20:06:37.243975 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [req-da3194f6-112a-4da3-9ea9-676130bf1fcf req-eb49f793-7d62-4503-beee-51f483e03a87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079864 Oct 04 20:06:37.244610 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4340/8701] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 4 20:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:06:37.838453 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:37.839067 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.compute.api [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123887) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:37.845105 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:37.849859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:37.849859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:37.849859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:37.849859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:37.849859 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:37.879363 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:37.879872 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:37.880308 n-d-833090-21 devstack@n-api.service[123887]: DEBUG oslo_concurrency.lockutils [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:37.880806 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.objects.instance [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lazy-loading 'fault' on Instance uuid 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 {{(pid=123887) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:06:37.921650 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.policy [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6fa735ea6847d8911a8492838d160e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3422e5bfc6cc4bcf961fbb930a5cabb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123887) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:06:37.929418 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-ff5c3499-5324-4120-ab6b-04939deb470e tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 200 len: 1338 microversion: 2.1 time: 0.095846 Oct 04 20:06:37.929993 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4362/8702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:37 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:06:38.958703 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '>' {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:38.959430 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.compute.api [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] [instance: 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8] Fetching instance by UUID {{(pid=123886) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:06:38.966410 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:38.966910 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:38.967364 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:38.968104 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Acquiring lock "bf969ffc-a161-4954-be17-eb629cb1623f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:06:38.968608 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:06:38.969057 n-d-833090-21 devstack@n-api.service[123886]: DEBUG oslo_concurrency.lockutils [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Lock "bf969ffc-a161-4954-be17-eb629cb1623f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:06:38.983058 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.wsgi [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] HTTP exception thrown: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Request method failure captured: Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: request: GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 HTTP/1.1 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Accept: application/json Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Accept-Encoding: identity Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Connection: close Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Content-Length: 0 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Content-Type: application/json Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Host: 10.222.0.40 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: Openstack-System-Scope: None Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: User-Agent: python-urllib3/1.26.12 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Auth-Token: gAAAAABjPJD-jEdX1agu_gCwtuFtd94xqgJx0YDhwSWM18k8VEtDfN9gUjTIhz7xSg-DDZccr_HM5EDyhMuMW0U0HaeKq87K1i9qbbPAUSpKezqEmUjAvCSMk_l0R-NQWv0BUkJkTktbmVKLQ_B8UCNzNmiEn8lzPRSFVBH1TM0LIJfSkrlY3EI Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Id: None Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Domain-Name: None Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Identity-Status: Confirmed Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Is-Admin-Project: True Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Id: default Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Domain-Name: Default Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Id: 3422e5bfc6cc4bcf961fbb930a5cabb1 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Project-Name: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Role: reader,member Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Roles: reader,member Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3422e5bfc6cc4bcf961fbb930a5cabb1"}]}] Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Id: 3422e5bfc6cc4bcf961fbb930a5cabb1 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-Tenant-Name: tempest-TestSnapshotPattern-325115882 Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-User: tempest-TestSnapshotPattern-325115882-project Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Id: default Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-User-Domain-Name: Default Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-User-Id: df6fa735ea6847d8911a8492838d160e Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: X-User-Name: tempest-TestSnapshotPattern-325115882-project Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: method: > Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: exception: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: action_args: {'id': '1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8'} Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: {{(pid=123886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:06:38.984738 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: ERROR nova.api.openstack.wsgi Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: DEBUG nova.api.openstack.wsgi [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Returning 404 to user: Instance 1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 could not be found. {{(pid=123886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: INFO nova.api.openstack.requestlog [None req-af256c38-8160-4db5-bcb4-a041a06e4999 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8" status: 404 len: 111 microversion: 2.1 time: 0.032802 Oct 04 20:06:38.988732 n-d-833090-21 devstack@n-api.service[123886]: [pid: 123886|app: 0|req: 4341/8703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 4 20:06:38 2022] GET /compute/v2.1/servers/1c7adbfb-8596-4b3f-b7a5-f7d5872a6fb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:06:39.229955 n-d-833090-21 devstack@n-api.service[123887]: DEBUG nova.api.openstack.wsgi [None req-104582a8-0dd8-43db-9d10-4891d8e10148 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] Calling method '.version_select at 0x7f900d86b700>' {{(pid=123887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:06:39.323080 n-d-833090-21 devstack@n-api.service[123887]: INFO nova.api.openstack.requestlog [None req-104582a8-0dd8-43db-9d10-4891d8e10148 tempest-TestSnapshotPattern-325115882 tempest-TestSnapshotPattern-325115882-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1269233147" status: 202 len: 0 microversion: 2.1 time: 0.097069 Oct 04 20:06:39.323762 n-d-833090-21 devstack@n-api.service[123887]: [pid: 123887|app: 0|req: 4363/8704] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 4 20:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1269233147 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)